Project Management Techniques for Test Estimation Optimization Thomas
Project Management Techniques for Test Estimation Optimization Thomas Janik, CSTE, CSQE DevOps Manager, Release Management American Family Insurance Project Management Techniques for Test
Estimation Optimization Session Agenda: Familiar/Common Test Estimating Techniques What is a Work Breakdown Structure (WBS)? What does DONE mean? Triple Constraint Estimation
Kaizen Events Test Estimation: Test Estimation: Function / Testing Point Analysis Method
Decide on an effort classification / weight Divide your application into function points Classify / weigh each function point Multiply the weight by the function point for the estimate Test Estimation: Function / Testing Point Analysis
Method Test Estimation: Function / Testing Point Analysis Method Advantages: Can be generated in early project stages
Can be generated from requirements specifications Simple math Disadvantages: No variables for unknowns Accurate only if continually updated
If no requirements exist, estimation must come from ideation Test Estimation: Use Case Point / Test Case Point Method Unadjusted actor weights = total number of actors (positive, negative, and exceptional)
Unadjusted use case weight = total number of use cases Use case point = actor weights + use case weight Determine EF (Environmental Factor or use .5) Adjusted use case point = use case point * [0.65+ (0.01 * EF] Estimate = adjusted use case point * CF (Conversion Factor) Or estimate duration/number of executions of each test case
Test Estimation: Use Case Point / Test Case Method Test Estimation: Use Case Point / Test Case Method
Advantages: Multiple weighting factors for better accuracy Experts not needed Very fast Disadvantages:
Requires a significant amount of system knowledge Requires requirements (or test case) completeness first Coefficients have to be adjusted Not so simple math Test Estimation: Development Percentage Method
Get development estimates Use a generic % of development for an initial test estimate Define complexity multiplier Multiply complexity multiplier by initial test estimate Test Estimation: Development Percentage Method
Advantages: Popular / widely used (circa 1996) Can be incorporated with function points for accuracy Simple math Disadvantages:
Not provable via scientific methods No different than ad-hoc estimation with a complexity factor Test Estimation: Experience Best Guess / Ad-hoc Methods Last time it took 2 months
I think it will be done in 2 weeks Just test until the release date (or end of sprint) Everyone knows all testing takes 27% of project time Dont estimate just tell them well be done when were done Test Estimation: Experience Best Guess / Ad-hoc
Methods Test Estimation: Experience Best Guess / Ad-hoc Methods Advantages: Super easy just guess (no math!)
Instant estimate People tend to think its accurate because of previous experience Disadvantages: Sets project up for missed deadlines In reality there is minimal accuracy sans ESP
How Can Project Management Techniques Help? Work Breakdown Structure Can be the basis for almost all modern test estimation methods Impossible to estimate anything as a whole
Must understand what DONE looks like (activity later) Break down functionality into smaller units Subdivide smaller units (wash, rinse, repeat) Continue to subdivide until all units are able to be estimated Its broken down enough when you can confidently estimate it
What Does DONE Mean? Draw a Pig, LLC Round 1: 1 minute to draw a pig
Draw a Pig, LLC Round 1: 1 minute to draw a pig Round 2: 1 minute to draw a pig using the work instructions and grid paper
Draw a Pig, LLC Round 1: 1 minute to draw a pig Round 2: 1 minute to draw a pig using the work instructions and grid paper Round 3: 30 seconds to draw a pig using the work instructions, grid
paper, and customer image. Knowing what DONE means will help your estimates Interview stakeholders to make sure you understand their definition of DONE and the risks they feel are important
Ask for all available documentation
Requirements Use Cases Scope Statements Wireframes / Comps
Development Timelines (sprint epics, stories, backlog, etc.) Anything you can get your hands on to help you know / understand what DONE means When you reach your definition of DONE actually be done!
How Can Project Management Techniques Help? The Triple Constraints Triangle Cost Scope Time
The Triple Constraints Triangle (Euler) Fast Good Cheap
The Triple Constraints Triangle (Euler) Fast Good Cheap The Triple Constraints Triangle
Resources Budget Quality Scope Risk Schedule
Using the Triple Constraints Triangle to know what DONE looks like What are the minimum results to ensure success? What deadlines and/or business events are important? Who is impacted if milestones are missed?
What does a quality product mean to you? Is there functionality that is more important than others? Does development have functionality prioritized? Using the Triple Constraints Triangle to optimize your estimates
Use 3 constraints to categorize your test cases, use cases, test scenarios, or units in your WBS Use the Euler Diagram to determine your two most valuable constraints Use overlaps in conjunction with any other test method to refine multipliers (environment factors, complexity factor,
etc.) Simple math The Triple Constraints Triangle A Kaizen Event
Rapid process improvement workshops Whatever you call them, a Kaizen event has a common aim and structure that looks to harness the ideas and creativity of your workforce in creating a step change improvement in a specific area of your business A Kaizen Event
Using a Kaizen event to optimize your estimates Document reality: Use a previous test estimate Identify waste:
Which estimates were way off? Plan countermeasures: Adjust estimation method Check reality: Are you still improving reality? Make changes: Estimate again
Measure results: Compare test estimate to actual Not a panacea . Using a Kaizen event to optimize your estimates
Continuous Improvement Thank you shout outs . https://uwmadison.app.box.com/v/pmfornonpm Scott Converse, UW Madison
Impression - mechanical fall/mechanical back pain; PLAN - 'For ASET and Physio review a.m. Overnight analgesia' Stable overnight - required ongoing analgesia however. Thoughts? Does the mechanism and apparent injury pattern make sense? What else could have happened?
The word culture, from the Latin colo, -ere, with its root meaning "to cultivate". Culture refers to the universal human capacity to classify, and communicate their experiences symbolically. What is culture? Standard 10.1 Culture - has been called "the way...
Morphogenesis in Plants Morphogenesis in Animals Cloning of Dolly Embryonic Stem Cells (These have pluripotential - they can become any type of cell.) LE 21-9 Pattern Formation for Plants Pattern Formation Pattern Formation Positional Information Maternal Effect and Zygote Polarity...
Feeding Infants in the CACFP. Lesson 7. Developmental Readiness for Solid Foods. Information in this lesson comes from Chapter 1: Giving Babies a Healthy Start With the CACFP and Chapter 6: Feeding Solid Foods in the Feeding Infants in the...
How to Make a Quadruple Line Graph Using Excel. It's easy…just follow the steps: Open excel . Fill in a data table..but use your Wisconsin Fast Plant Data! "GRAB" columns A through F and down to row 5. (it darkens...
WPCG (AIP) Work Clearance at Coles Express. Please note that the WPCG Work Clearance form applies to all physical tasks conducted by construction, maintenance and repair contractors. This includes work inside and outside of the sales building. It is the...
WALT: perform and create a solo with appropriate . expression. LESSON OUTCOMES- Perform a solo with appropriate expression and create a solo using ideas explored. WILF: is for you to - think of words to describe personality - match movements...
The synthesis will need to be 3-4 pages long and use 3-4 sources. It should be argumentative with a well-supported thesis. You will also need to use MLA documentation style both in text and on the works cited page.
Ready to download the document? Go ahead and hit continue!