What it means
A team labels 100 deals as having an 80% chance to close this quarter, and if only 40 close across several comparable quarters, the label is poorly calibrated. The team should inspect stage rules, dates and customer mix before changing every probability mechanically.
Define the forecast target first, since closed bookings, recognised revenue, invoiced sales and cash are not interchangeable, and a probability of closing by quarter-end differs from a probability of ever closing. Save the prediction as it was made, because if a manager revises a deal from 20% to 90% the day before signing, using the final version to judge earlier accuracy hides the original decision risk.
Salesforce's forecasting guidance discusses comparing forecasts with actual sales over time and examining why forecasts miss, though its example performance figures are vendor experience, not a benchmark every team must meet. CFA Institute's forecasting guidance discusses drivers, assumptions and scenario analysis, so calibration should revisit the inputs that fit a business model rather than impose an arbitrary target for every product.
Group similar predictions, so that for deals labelled 70-80% likely you compare observed wins after the stated horizon, remembering that a handful of deals is too noisy to draw a strong conclusion. An illustrative calibration gap for one probability group is observed win share minus average predicted probability: if deals averaged 80% predicted and 50% won by the stated date, the gap is negative 30 percentage points, which does not explain why.
Check value as well as count, because a model may predict wins accurately by count but miss revenue if the largest opportunity slips. Inspect timing errors, since a deal that closes next quarter is not a win for the current-quarter forecast, and track delayed wins separately from permanently lost deals.
Review stage definitions, because reps may use 'proposal sent' differently, and account for changes in the pipeline such as a new market, price, product or sales cycle, backtesting on recent, relevant cohorts and stating when there are too few observations. Track bias, as forecasts may consistently overshoot because close dates slide or discount approvals take longer than expected, and measure dispersion, since two forecasts with the same average error can differ if one has occasional very large misses.
Use human review carefully: a manager can override a model with new buyer evidence, but the reason and time should be recorded so an unsupported optimistic override is visible in the later review, and honest uncertainty should not be punished, since incentives that reward certainty or pipeline size invite gaming. Test changes prospectively, because improving a backtest alone is not proof the new approach works, and segment the test where there are enough deals, as large enterprise deals may close differently from smaller renewals.
Avoid hindsight bias by keeping both the forecast made at the time and the outcome, so no one can rewrite expectations after a deal slips; for an owner, calibration means a forecast label has a track record behind it.
In practice
Real-world examples.
Example
Deals labelled 80% are tested against actual quarter-end wins. The analyst groups deals by their probability at the start of the quarter rather than at the end. The result shows whether the label has earned its meaning.
Example
A large deal delayed into next quarter is separated from a permanent loss. The forecast review records it as a timing miss, not a failed prediction of eventual win. The sales leader sees how often delays rather than losses drive the gap.
Example
A manager override includes dated buyer evidence and is later backtested. The record shows that a deal was moved to 90% after a signed purchase order draft arrived. Overrides with evidence are compared with overrides without it.
Formula
Calculation
Calibration gap = observed win share - mean predicted probability, for one probability group.
Worked example: 50 deals are labelled around 80% likely to close by quarter-end, and 25 close by that date, so the observed win share is 25 / 50 = 50% and the gap is 50% - 80% = -30 percentage points. A second group of 50 deals averaging 40% predicted sees 22 close, so observed is 22 / 50 = 44% and the gap is +4 points. The first group is badly overconfident, while the second is close to calibrated.Case study
Seen in the real world.
In this entirely fictional example, Cedar Systems finds its 80%-likelihood deals close by quarter-end only half the time. It reviews dated forecasts and discovers a late-stage label was used before procurement approval. The team tightens the stage rule and tests later quarters.
The case does not claim every high-probability deal will close. After two quarters under the tighter rule, the fictional deals labelled 80% closed at a rate much nearer to the label, and the team kept the dated forecast log as a permanent record. The point of the exercise was a forecast whose labels mean what they say, not a higher forecast number.
Watch out
Common mistakes.
- Judging an earlier forecast from a revised probability entered after the fact.
- Counting next-quarter wins as current-quarter success.
- Changing probability scores without investigating stage and timing causes.
Questions
People also ask.
What does calibrated mean?
Predicted probabilities align with observed frequencies across comparable cases.
Can one deal be calibrated?
Calibration needs groups of outcomes; one deal can still surprise.
Does calibration guarantee exact revenue?
No. Deal sizes, timing and outside events still create uncertainty.
From the founder's library

Take it further with the book.
Build your financial confidence beyond this definition. Shihan's full-length guide, Accounting Fundamentals, takes the same plain-English approach and turns it into a complete, practical playbook for non-finance managers, business owners and students - with chapter-end quiz answers and presentation slides included.
25% off with code MMHQ25, applied at checkout. Priced in USD - checkout may show the equivalent in your local currency.
View the book and save 25%