A Method For Estimating Work
Method
For each task, record a P5 and a P95 estimate for how much time you’d expect to pass before the work is done if it were yours to complete.
Definitions
- Task
- P5 estimate - a soft lower bound. In the long run, a calibrated estimator completes 5% of estimated tasks before their P5 estimate for that task.
- P95 estimate - a soft upper bound. In the long run, a calibrated estimator completes 95% of estimated tasks before their P95 estimate for that task.
- Time
- Done - task specific, well defined, testable criteria indicating that a task is complete
Execution
Calibration
When a calibrated estimator has completed 20 estimated tasks
- exactly 1 task was completed before their P5 estimate for that task
- exactly 1 task was completed after their P95 estimate for that task
- the duration of the remaining 18 tasks fell between their corresponding P5 and P95 estimates
Of course, this is also true in percentage terms, regardless of the population of tasks considered.
Depending on the nature of the work, context, and the estimator’s experience this may be easy or hard to achieve.
An estimator should observe their task durations relative to their estimates and regularly review their overall performance.
Observing how our completed task durations differ from our estimates informs how we should adjust our judgements.
Miscalibrations
- Optimistic upper bounds. More than 5% of tasks are completed after our P95 estimates.
- Optimistic lower bounds. Fewer than 5% of tasks are completed before our P5 estimates.
- Pessimistic lower bounds. More than 5% of tasks are completed before our P5 estimates.
- Pessimistic upper bounds. Fewer than 5% of tasks are completed after our P95 estimates.
- Unjustified precision. Too many durations fall outside of our estimates on either side.
- Extreme case: P5 = P95
- Our estimates are never correct.
- Unjustified uncertainty. Too many durations fall inside our estimates.
- Extreme case: P5 = 0, P95 = infinity
- Our estimates are always correct.
Improving Estimates
- Break down complicated tasks
- Imagine a world where this task is done.
- Imagine the world when this task is started.
- Imagine doing the work required to complete this task.
- Write down the steps.
- Write down P5 and P95 estimates for each step.
- Review your task performance relative to your estimates regularly.
- When completing a task, reflect on surprises.
- What took more or less time than you expected?
Teamwork
- A second estimator opens the door to learning and collaboration. When estimates differ significantly
- Maybe there’s something one estimator isn’t considering
- Maybe there’s something one can learn from the other
- Breaking down work
- is often much faster than completing the task
- invites collaborative planning. Improving a plan is often faster, easier, cheaper, and feasible compared to improving a completed task.
- produces a reference plan that someone else may use for a similar task in the future.
- highlights processes that may be learned from or improved upon