Project Management Techniques for Test Estimation Optimization Thomas

Project Management Techniques for Test Estimation Optimization Thomas

Project Management Techniques for Test Estimation Optimization Thomas Janik, CSTE, CSQE DevOps Manager, Release Management American Family Insurance Project Management Techniques for Test

Estimation Optimization Session Agenda: Familiar/Common Test Estimating Techniques What is a Work Breakdown Structure (WBS)? What does DONE mean? Triple Constraint Estimation

Kaizen Events Test Estimation: Test Estimation: Function / Testing Point Analysis Method

Decide on an effort classification / weight Divide your application into function points Classify / weigh each function point Multiply the weight by the function point for the estimate Test Estimation: Function / Testing Point Analysis

Method Test Estimation: Function / Testing Point Analysis Method Advantages: Can be generated in early project stages

Can be generated from requirements specifications Simple math Disadvantages: No variables for unknowns Accurate only if continually updated

If no requirements exist, estimation must come from ideation Test Estimation: Use Case Point / Test Case Point Method Unadjusted actor weights = total number of actors (positive, negative, and exceptional)

Unadjusted use case weight = total number of use cases Use case point = actor weights + use case weight Determine EF (Environmental Factor or use .5) Adjusted use case point = use case point * [0.65+ (0.01 * EF] Estimate = adjusted use case point * CF (Conversion Factor) Or estimate duration/number of executions of each test case

Test Estimation: Use Case Point / Test Case Method Test Estimation: Use Case Point / Test Case Method

Advantages: Multiple weighting factors for better accuracy Experts not needed Very fast Disadvantages:

Requires a significant amount of system knowledge Requires requirements (or test case) completeness first Coefficients have to be adjusted Not so simple math Test Estimation: Development Percentage Method

Get development estimates Use a generic % of development for an initial test estimate Define complexity multiplier Multiply complexity multiplier by initial test estimate Test Estimation: Development Percentage Method

Advantages: Popular / widely used (circa 1996) Can be incorporated with function points for accuracy Simple math Disadvantages:

Not provable via scientific methods No different than ad-hoc estimation with a complexity factor Test Estimation: Experience Best Guess / Ad-hoc Methods Last time it took 2 months

I think it will be done in 2 weeks Just test until the release date (or end of sprint) Everyone knows all testing takes 27% of project time Dont estimate just tell them well be done when were done Test Estimation: Experience Best Guess / Ad-hoc

Methods Test Estimation: Experience Best Guess / Ad-hoc Methods Advantages: Super easy just guess (no math!)

Instant estimate People tend to think its accurate because of previous experience Disadvantages: Sets project up for missed deadlines In reality there is minimal accuracy sans ESP

How Can Project Management Techniques Help? Work Breakdown Structure Can be the basis for almost all modern test estimation methods Impossible to estimate anything as a whole

Must understand what DONE looks like (activity later) Break down functionality into smaller units Subdivide smaller units (wash, rinse, repeat) Continue to subdivide until all units are able to be estimated Its broken down enough when you can confidently estimate it

What Does DONE Mean? Draw a Pig, LLC Round 1: 1 minute to draw a pig

Draw a Pig, LLC Round 1: 1 minute to draw a pig Round 2: 1 minute to draw a pig using the work instructions and grid paper

Draw a Pig, LLC Round 1: 1 minute to draw a pig Round 2: 1 minute to draw a pig using the work instructions and grid paper Round 3: 30 seconds to draw a pig using the work instructions, grid

paper, and customer image. Knowing what DONE means will help your estimates Interview stakeholders to make sure you understand their definition of DONE and the risks they feel are important

Ask for all available documentation

Requirements Use Cases Scope Statements Wireframes / Comps

Development Timelines (sprint epics, stories, backlog, etc.) Anything you can get your hands on to help you know / understand what DONE means When you reach your definition of DONE actually be done!

How Can Project Management Techniques Help? The Triple Constraints Triangle Cost Scope Time

The Triple Constraints Triangle (Euler) Fast Good Cheap

The Triple Constraints Triangle (Euler) Fast Good Cheap The Triple Constraints Triangle

Resources Budget Quality Scope Risk Schedule

Using the Triple Constraints Triangle to know what DONE looks like What are the minimum results to ensure success? What deadlines and/or business events are important? Who is impacted if milestones are missed?

What does a quality product mean to you? Is there functionality that is more important than others? Does development have functionality prioritized? Using the Triple Constraints Triangle to optimize your estimates

Use 3 constraints to categorize your test cases, use cases, test scenarios, or units in your WBS Use the Euler Diagram to determine your two most valuable constraints Use overlaps in conjunction with any other test method to refine multipliers (environment factors, complexity factor,

etc.) Simple math The Triple Constraints Triangle A Kaizen Event

Kaizen Blitz Kaizen Burst Focused improvement workshops Kaizen workshops Continuous improvement workshops Accelerated improvement events

Rapid process improvement workshops Whatever you call them, a Kaizen event has a common aim and structure that looks to harness the ideas and creativity of your workforce in creating a step change improvement in a specific area of your business A Kaizen Event

Using a Kaizen event to optimize your estimates Document reality: Use a previous test estimate Identify waste:

Which estimates were way off? Plan countermeasures: Adjust estimation method Check reality: Are you still improving reality? Make changes: Estimate again

Measure results: Compare test estimate to actual Not a panacea . Using a Kaizen event to optimize your estimates

Continuous Improvement Thank you shout outs . https://uwmadison.app.box.com/v/pmfornonpm Scott Converse, UW Madison

http://www.softwaretestingclass.com/software-estimation-techniques/ http://www.methodsandtools.com/archive/archive.php http:// www.slideshare.net/MasudParvez8/software-outsourcing-and-new-mo del-of-test-estimation-for-agile-development-47062178 http://leanmanufacturingtools.org/625/planning-and-running-kaizen-e

vents / Questions? Project Management Techniques for Test Estimation Optimization Thomas Janik, CSTE, CSQE

DevOps Manager, Release Management American Family Insurance

Recently Viewed Presentations

  • Elderly in the ED - MEd from the SHED

    Elderly in the ED - MEd from the SHED

    Impression - mechanical fall/mechanical back pain; PLAN - 'For ASET and Physio review a.m. Overnight analgesia' Stable overnight - required ongoing analgesia however. Thoughts? Does the mechanism and apparent injury pattern make sense? What else could have happened?
  • What is culture? Standard 10.1 - The World of Teaching

    What is culture? Standard 10.1 - The World of Teaching

    The word culture, from the Latin colo, -ere, with its root meaning "to cultivate". Culture refers to the universal human capacity to classify, and communicate their experiences symbolically. What is culture? Standard 10.1 Culture - has been called "the way...
  • AP Biology - sshs.ecboe.org

    AP Biology - sshs.ecboe.org

    Morphogenesis in Plants Morphogenesis in Animals Cloning of Dolly Embryonic Stem Cells (These have pluripotential - they can become any type of cell.) LE 21-9 Pattern Formation for Plants Pattern Formation Pattern Formation Positional Information Maternal Effect and Zygote Polarity...
  • Feeding Infants in the CACFP - fns-prod.azureedge.net

    Feeding Infants in the CACFP - fns-prod.azureedge.net

    Feeding Infants in the CACFP. Lesson 7. Developmental Readiness for Solid Foods. Information in this lesson comes from Chapter 1: Giving Babies a Healthy Start With the CACFP and Chapter 6: Feeding Solid Foods in the Feeding Infants in the...
  • How to Make a Quadruple Line Graph Using Excel

    How to Make a Quadruple Line Graph Using Excel

    How to Make a Quadruple Line Graph Using Excel. It's easy…just follow the steps: Open excel . Fill in a data table..but use your Wisconsin Fast Plant Data! "GRAB" columns A through F and down to row 5. (it darkens...
  • Coles Express Permitting Induction for Contractors Part of

    Coles Express Permitting Induction for Contractors Part of

    WPCG (AIP) Work Clearance at Coles Express. Please note that the WPCG Work Clearance form applies to all physical tasks conducted by construction, maintenance and repair contractors. This includes work inside and outside of the sales building. It is the...
  • Year 4 dance Spring 1 Characters- Charlie and the Chocolate ...

    Year 4 dance Spring 1 Characters- Charlie and the Chocolate ...

    WALT: perform and create a solo with appropriate . expression. LESSON OUTCOMES- Perform a solo with appropriate expression and create a solo using ideas explored. WILF: is for you to - think of words to describe personality - match movements...
  • The Synthesis - Tamara Lynde's English Page

    The Synthesis - Tamara Lynde's English Page

    The synthesis will need to be 3-4 pages long and use 3-4 sources. It should be argumentative with a well-supported thesis. You will also need to use MLA documentation style both in text and on the works cited page.