Every day the system runs a closed learning loop against official results. Gated mode requires prospective evidence. Operator-enabled direct mode applies first, then measures subsequent settled slates under automatic rollback guardrails.
Reconcile every published forecast against the official MLB final: winner, score, win probability, and starting-pitcher line. This produces the verified result set below.
Attribute each miss to a concrete driver: a compressed win probability, an under-projected run total, or a starting-pitcher projection that diverged from the box score.
Translate the dominant drivers into a small, bounded change to a single registered parameter. Proposals are data, never commands.
Run the change in shadow on the same inputs, or in a chronological backtest for training parameters, until it clears the coverage and improvement gates across multiple slates.
Only a change that beats the current champion under those gates, with human approval, replaces production. A regression triggers automatic rollback.
The single prediction configuration currently serving every live pick. Today it is candidate-668e4305abca59bc.
A proposed change scored in the background on the same games. It never affects published output until approved.
A slate is only ~15 games, too few to separate skill from luck. A change must prove itself over roughly four days before it can replace the champion. This gate governs promotion only; the daily diagnosis below runs regardless.
Calibration quality of the win probabilities. Lower is better; 0.25 equals always publishing 50/50, so any value above 0.25 is worse than a coin flip.
Win/loss and the model spread (run line) are the same game two ways: Margin is model-projected margin vs actual (home minus away); Cover is whether the actual margin landed on the model's side.
| Game | Result | Pick vs winner | p(home) | Pred vs actual | Margin (model vs actual) | Cover | Run err | Primary diagnosis |
|---|---|---|---|---|---|---|---|---|
| LAD@MIL | ✓ hit | MIL → won MIL | 54.8% | 2-4 vs 1-2 | +2 vs +1 | ✓ covered | 3 |
Deterministic cross-layer findings. Critical means evidence or contract failure; high means material model/process risk. Each row pairs the action to take (Do this) with the wrong conclusion to avoid (Don't conclude).
| Severity | Domain | Finding | Action & guardrail |
|---|---|---|---|
| HIGH | calibration | Published confidence buckets were poorly aligned on this slate weighted absolute calibration error 0.4518 across 1 games | Do thisWatch the same confidence buckets over the full rolling window before changing any calibration weight. Don't concludeA single slate has far too few games to establish a stable calibration curve. |
| HIGH | model_validation | Validated run models explain very little holdout variance home/away/total R² = 0.0021/0.0309/0.0024 | Do thisTreat exact run scores as low-confidence estimates, and look for stronger features or a better target before tuning the score tails. Don't concludeA small positive R² only means the model beats guessing the average; it does not make the exact scores reliable. |
| INFO | coverage | Every settled game received structural QA 1/1 games structurally audited | Do thisKeep the per-game audit receipt in every report. Don't concludeFull audit coverage does not cancel the findings raised inside the audited games. |
| INFO | simulation | Simulation produced no winner-direction intervention on this slate flip candidates 0; published flips 0 | Do thisMeasure the simulation's contribution across rolling slates, separating score realization from winner flipping. Don't concludeZero winner flips is not a defect and does not mean the simulation did no score-reconciliation work. |
| Stage | Winner hits | Accuracy | Team-run MAE | Margin MAE |
|---|---|---|---|---|
| historical_ml | 1/1 | 100.0% | 2.984 | 0.352 |
| variance_applied | 1/1 | 100.0% | 3 | 0 |
| enhanced_prediction | 1/1 | 100.0% | 2 | 0 |
| kpi_layer | 1/1 | 100.0% | 2 | 0 |
| embedded_savant_run_environment | 1/1 | 100.0% | 1.5 | 1 |
| fundamental_edge_target_review | 1/1 | 100.0% | 1.5 | 1 |
| capped_target | 1/1 | 100.0% | 1.5 | 1 |
| simulation_result | 1/1 | 100.0% | 1.5 | 1 |
| published_final | 1/1 | 100.0% | 1.5 | 1 |
All values use the picked side. A higher published value is only a bypass if no named transformation explains it.
| Game | Raw model | Calibrated | Published | Recorded transformation |
|---|---|---|---|---|
| LAD@MIL | 57.1% | 54.8% | 54.8% | published probability matches the calibrated/governed value |
The system's honest read of its own state from measured evidence, and a prioritized plan split into what the nightly loop can fix by itself (auto) and what needs a human (operator: code, an isolated training backtest, or better data).
| # | Owner | Problem & evidence | Action |
|---|---|---|---|
| 1 | operator | simulation_inert_on_slate persisted 11 consecutive slates | confirm the simulation module is running, not silently no-oping Code to changeFiles: routers/team_router.pyWhere: _build_simulation_distribution (~L6153) + the draw loop early-exits (~L6107, ~L6115) and constants NUM_SIMULATIONS/MIN_DRAWS_BEFORE_CLOSE_EXIT (~L5719-5722) Root cause: The draw distribution is built from the SAME draws collected while searching for a play-by-play that realizes the model target, and the loop breaks as soon as it finds one (default draw_count ~2). away_win_rate over ~2 selected draws is not a probability, so the flip/agreement signal is vacuous (0 flip candidates for 11 slates). Change: Separate the two jobs: keep the target-realization search for the box score, but compute the win-probability distribution from an INDEPENDENT unsteered batch (e.g. 200-500 draws, or a closed-form Skellam/Poisson-difference on the expected runs + variance) that does NOT early-exit. Make the batch size a registered parameter so the loop can trade compute for signal. Feed that real win-rate into final_prediction_policy._distribution_agreement. Applies: coding_agent_or_operator |
| 1 | operator | run_model_near_zero_signal holdout R^2 total=0.002415 home=0.002143 away=0.030936 | the run models carry almost no signal; improve features/target and run an isolated training backtest. Nightly variance/confidence tuning cannot fix this. Real run-line/spread data as a feature would help most. Code to changeFiles: services/historical_game_features.py, services/historical_game_analyzer.pyWhere: the shared feature contract in historical_game_features.py + training in historical_game_analyzer.py Root cause: Holdout R^2 for run targets is near zero, so the features carry almost no run signal; no bounded nightly knob can raise this. Change: Add predictive features (market no-vig implied probability when a real source-labelled price exists, park/weather run environment, bullpen rest/fatigue, platoon-adjusted lineup quality) to the feature contract, then retrain and compare holdout R^2 via an isolated same-fingerprint backtest. Bump MODEL_SCHEMA_VERSION when feature semantics change. Applies: operator |
| 2 | auto (loop) | confidence_overconfident weighted calibration error 0.4518; high-conviction miss rate None | lower confidence caps and widen run variance levers: confidence.base_cap, confidence.moderate_cap, score.variance_multiplier, score.variance_floor |
The model's predicted run margin is its implied spread. This shows how far the actual margin fell from it, whether the actual landed on the model's side (cover), and whether the model's own conviction is predictive. When high-conviction picks lose more than they win, published confidence is anti-predictive and the promotable fix is lower confidence caps and wider run variance.
| Game | Conviction | Model margin | Actual margin | Margin err | Covered |
|---|---|---|---|---|---|
| LAD@MIL | lean | 2.0 | 1.0 | 1.0 | ✓ |
One blown start is noise. The same failure repeating across the slate is a model problem. These are the repeats.
| Sides analyzed | Broke on pitching | Broke on offense | Both | Variance | Mean starter ERA error | Mean lineup runs vs proj |
|---|---|---|---|---|---|---|
| 2 | 0 | 1 | 0 | 1 | -0.84 | -1.5 |
The blend mixes the trained win classifier with the margin-derived probability. It is only worth its weight if its decision survives the downstream reconciliation to the projected score.
On all 1 games with an applied blend, the blend's side and the published side agree.
Blend side survived on 1 of 1 games; the blend flagged a winner change on 0.
A bias on one slate is noise. The same sign across slates, large relative to how much it moves between them, is a model defect. Only the ones that pass both tests are turned into a named parameter change; the rest are held deliberately.
starter ERA error (actual minus projected)
Mean -0.34 over 10 slates (sign shared by 0.60 of them, z = -0.83).
starters beat their projection: the run model credits opposing offenses with more than they produced.
Hold: no change: this bias is not separable from slate-to-slate noise yet
6 of 10 slates share the sign, mean -0.34 +/- 0.41 standard error: not separable from noise
lineup runs actual minus projected
Mean -0.75 over 10 slates (sign shared by 0.70 of them, z = -2.13).
lineups scored below projection: the run environment is set too high.
Actionable: the total-runs projection is running hot; check the run environment before touching variance, and treat score.variance_floor only as the spread lever
Lever: score.variance_floor (default 2.75); watch total_run_mae, team_run_mae.
7 of 10 slates share the sign and the mean is 2.1 standard errors from zero
| Slate | Games | Winner acc | Mean starter ERA error | Mean lineup runs vs proj | Sides broke on pitching | Sides broke on offense |
|---|---|---|---|---|---|---|
| 20261010 | 1 | 1.000 | -1.93 | -2.00 | 1 | |
| 20261009 | — | — | — | |||
| 20261008 | 1 | 1.000 | 2.31 | 1.00 | ||
| 20261007 | 4 | 0.750 | 0.85 | -0.38 | 1 | 2 |
| 20261006 | 2 | 1.000 | -1.40 | -1.25 | 1 | |
| 20261005 | 2 | 0.000 | -1.11 | -0.75 | 2 | |
| 20261004 | 2 | 0.500 | -1.24 | -2.00 | 2 | |
| 20261003 | 4 | 1.000 | -0.95 | -2.25 | 4 | |
| 20261002 | — | — | — | |||
| 20261001 | 1 | 1.000 | 0.00 | 0.50 | ||
| 20260930 | 4 | 0.750 | 0.78 | 0.12 | 1 | |
| 20260929 | 4 | 1.000 | -0.76 | -0.50 | 3 |
Same evidence packet supplied to Luna. Lost games lead the list and open by default with a plain-language read (what went wrong, why, and whether it was a system fault or a game/team-specific event) followed by a full reconstruction: predicted vs actual, the score-construction path, probability layers, run environment, recent form, head-to-head, the largest player adjustments, and starters. Hits keep the lean view.
Evidence edges (home-away): season 0.003, recent -0.122, starter 0.072, composite 0.489
Deterministic observations
Quantified contributors
Starting pitchers: projected vs actual (ERA = earned runs over nine innings, so the miss is judged against the outs actually recorded: 4 ER in 6 outs is 18.00 ERA, 4 ER in 21 outs is 5.14. Raw ER cannot tell those apart.)
| Team | Starter | Projected | Actual | ERA error |
|---|---|---|---|---|
| LAD | Tarik Skubal | 5.68 ERA (4 ER / 19 outs) | 3.6 ERA (2 ER / 15 outs) | -2.08 |
| MIL | Jacob Misiorowski | 1.69 ERA (1 ER / 16 outs) | 2.08 ERA (1 ER / 13 outs) | 0.39 |
The winner was right. This is the player evidence behind it, so a correct call built on a wrong player picture is still visible.
| Side | Starter ERA (actual / proj) | ERA error | Bullpen ER | Lineup runs vs proj | HR | Starter experience | Verdict |
|---|---|---|---|---|---|---|---|
| away | 3.6 / 5.68 | -2.08 | 0 | -1 | 0 | neither side broke materially - the result is closer to variance | |
| home | 2.08 / 1.69 | 0.39 | 0 | -2 | 1 | offense: the lineup scored well below its projection |
Biggest movers vs projection:
Forecast-file integrity (checks on the saved forecast file, not why the pick missed)
PASS — 109 checks passed, 0 defects, 1 informational note(s) (expected design notes, not problems). The saved file is clean; it is not the reason this game missed.
| Lever | Would help | Would hurt / risk |
|---|---|---|
| score.variance_multiplier / score.variance_floor (widen run distributions) | ||
| player.pitcher.v4 form weights / player.pitcher_prior_games | ||
| recent.* / season.* run-mean weighting |
The complete forensic base that also feeds the standalone deep report and Luna, inlined so this page carries everything for the day under review. Nothing shown above is repeated.
Every hitter projection on the slate (18 lines) pooled per metric. Bias is the level error on the slate total. Spread is the projection standard deviation over the real one: near zero means every hitter got roughly the same number, so the total can be right while no hitter is separated. Flat MAE is the error from publishing the slate mean for everyone, which the projection has to beat to carry any per-player value.
| Metric | Lines | Projected | Actual | Bias | MAE | Flat MAE | Spread | Corr | Verdict |
|---|---|---|---|---|---|---|---|---|---|
| AB | 18 | 61 | 57 | +7% | 0.667 | 0.556 | 0.71 | -0.193 | no per-hitter value |
| H | 18 | 10 | 13 | -23.1% | 0.722 | 0.562 | 0.76 | -0.21 | no per-hitter value |
| BB | 18 | 8 | 10 | -20% | 0.667 | 0.556 | 0.83 | -0.27 | no per-hitter value |
| SO | 18 | 18 | 21 | -14.3% | 0.944 | 0.648 | 0.98 | -0.098 | no per-hitter value |
| RBI | 18 | 6 | 3 | +100% | 0.389 | 0.278 | 1.26 | 0 | no per-hitter value |
| R | 18 | 6 | 3 | +100% | 0.389 | 0.278 | 1.26 | 0 | no per-hitter value |
| HR | 18 | 1 | 1 | 0% | 0.111 | 0.105 | 1 | -0.059 | no per-hitter value |
| 2B | 18 | 2 | 1 | +100% | 0.167 | 0.105 | 1.37 | -0.086 | no per-hitter value |
What this slate says
AB: publishing the slate mean for every hitter would have scored a lower error (0.556 against 0.667), so the per-hitter projection added nothing on this slate.
H: slate total under-projected by 23% (10 against 13 real), which is a calibration problem in the rate or the at-bat volume.
H: publishing the slate mean for every hitter would have scored a lower error (0.562 against 0.722), so the per-hitter projection added nothing on this slate.
BB: slate total under-projected by 20% (8 against 10 real), which is a calibration problem in the rate or the at-bat volume.
BB: publishing the slate mean for every hitter would have scored a lower error (0.556 against 0.667), so the per-hitter projection added nothing on this slate.
SO: slate total under-projected by 14% (18 against 21 real), which is a calibration problem in the rate or the at-bat volume.
SO: publishing the slate mean for every hitter would have scored a lower error (0.648 against 0.944), so the per-hitter projection added nothing on this slate.
RBI: slate total over-projected by 100% (6 against 3 real), which is a calibration problem in the rate or the at-bat volume.
RBI: publishing the slate mean for every hitter would have scored a lower error (0.278 against 0.389), so the per-hitter projection added nothing on this slate.
R: slate total over-projected by 100% (6 against 3 real), which is a calibration problem in the rate or the at-bat volume.
R: publishing the slate mean for every hitter would have scored a lower error (0.278 against 0.389), so the per-hitter projection added nothing on this slate.
HR: publishing the slate mean for every hitter would have scored a lower error (0.105 against 0.111), so the per-hitter projection added nothing on this slate.
2B: slate total over-projected by 100% (2 against 1 real), which is a calibration problem in the rate or the at-bat volume.
2B: publishing the slate mean for every hitter would have scored a lower error (0.105 against 0.167), so the per-hitter projection added nothing on this slate.
Biggest per-hitter misses on the slate (actual / projected, ordered by run impact)
| Hitter | Team | Game | Run impact | Line (H BB SO RBI R) |
|---|---|---|---|---|
| Andy Pages | LAD | 20261011_LAD@MIL | -1.26 | H 1/1 BB 0/1 SO 1/2 RBI 1/1 R 0/1 |
| Brice Turang | MIL | 20261011_LAD@MIL | 1.26 | H 1/1 BB 1/0 SO 0/1 RBI 1/0 R 1/1 |
| Andrew Vaughn | MIL | 20261011_LAD@MIL | 1.11 | H 1/0 BB 1/0 SO 1/1 RBI 0/1 R 0/0 |
| Teoscar Hernández | LAD | 20261011_LAD@MIL | 0.94 | H 2/0 BB 0/0 SO 1/1 RBI 0/0 R 0/0 |
| Shohei Ohtani | LAD | 20261011_LAD@MIL | 0.8 | H 1/0 BB 1/0 SO 1/1 RBI 0/0 R 1/0 |
| Joey Ortiz | MIL | 20261011_LAD@MIL | -0.8 | H 0/1 BB 0/1 SO 2/1 RBI 0/1 R 0/0 |
| Enrique Hernández | LAD | 20261011_LAD@MIL | -0.78 | H 0/1 BB 0/0 SO 0/1 RBI 0/0 R 0/1 |
| William Contreras | MIL | 20261011_LAD@MIL | -0.78 | H 0/1 BB 1/1 SO 2/1 RBI 0/1 R 0/1 |
| Kyle Tucker | LAD | 20261011_LAD@MIL | 0.66 | H 0/0 BB 2/0 SO 2/1 RBI 0/0 R 0/0 |
| Mookie Betts | LAD | 20261011_LAD@MIL | 0.47 | H 1/0 BB 1/1 SO 0/0 RBI 0/0 R 0/0 |
| Jackson Chourio | MIL | 20261011_LAD@MIL | 0.47 | H 2/1 BB 0/0 SO 1/0 RBI 0/1 R 0/0 |
| Cooper Pratt | MIL | 20261011_LAD@MIL | -0.47 | H 0/1 BB 0/0 SO 2/0 RBI 0/0 R 0/1 |
| Max Muncy | LAD | 20261011_LAD@MIL | -0.33 | H 1/1 BB 0/1 SO 2/0 RBI 0/0 R 0/0 |
| Garrett Mitchell | MIL | 20261011_LAD@MIL | 0.33 | H 0/0 BB 1/0 SO 1/3 RBI 0/0 R 1/0 |
| Freddie Freeman | LAD | 20261011_LAD@MIL | 0.14 | H 1/0 BB 0/1 SO 1/2 RBI 0/0 R 0/0 |
Winner-direction change at each stage boundary. A negative Δ accuracy is an intermediate regression even when a later stage recovers the pick.
| Transition | Δ accuracy | Δ hits | Δ team-run MAE | Δ margin MAE | Games whose winner/tie changed |
|---|---|---|---|---|---|
| historical_ml → variance_applied | 0 | 0 | 0.0157 | -0.3521 | |
| variance_applied → enhanced_prediction | 0 | 0 | -1 | 0 | |
| enhanced_prediction → kpi_layer | 0 | 0 | 0 | 0 | |
| kpi_layer → embedded_savant_run_environment | 0 | 0 | -0.5 | 1 | |
| embedded_savant_run_environment → fundamental_edge_target_review | 0 | 0 | 0 | 0 | |
| fundamental_edge_target_review → capped_target | 0 | 0 | 0 | 0 | |
| capped_target → simulation_result | 0 | 0 | 0 | 0 | |
| simulation_result → published_final | 0 | 0 | 0 | 0 |
Narrow predicted margins next to wide actual margins is the signature the score-variance tail is too tight.
| Game | Pred margin | Actual margin | Pred − actual |
|---|---|---|---|
| LAD@MIL | 2 | 1 | 1 |
A finding that has repeated at or beyond the escalation streak is no longer single-slate noise. It carries its target registered lever and an action-oriented guardrail.
| Finding | Persistence | Target lever(s) | Direction | Guardrail |
|---|---|---|---|---|
| simulation_inert_on_slate | 11 consecutive · 11 in window | simulation.allow_score | confirm the simulation module is running, not silently no-oping | simulation_inert_on_slate has persisted 11 consecutive slates; this is no longer single-slate noise. Treat it as an actionable pattern and raise the code/diagnostic action named; do not force a parameter move. |
| Finding | Consecutive slates | Incidence | Present now | Fix type |
|---|---|---|---|---|
| pipeline_winner_instability | 0 | 1/11 | no | code/diagnostic |
| score_margin_compression | 0 | 2/11 | no | param |
| simulation_inert_on_slate | 11 | 11/11 | yes | code/diagnostic |
| single_slate_calibration_instability | 2 | 9/11 | yes | param |
| weak_run_model_signal | 2 | 9/11 | yes | code/diagnostic |
| Metric | Direction | Series (old → new) |
|---|---|---|
| winner_accuracy | improving | 1.0, –, 1.0, 0.5, 0.0, 1.0, 0.75, 1.0, –, 1.0, 1.0 |
| weighted_calibration_error | flat | 0.4832, –, 0.4705, 0.4806, 0.5291, 0.4642, 0.2272, 0.495, –, 0.4732, 0.4518 |
| margin_bias | improving | -3.0, –, -0.25, 0.0, -0.5, -0.5, -1.75, -3.0, –, -1.0, 1.0 |
| team_run_error_on_losses | improving | –, –, –, 2.0, 3.5, –, 2.0, –, –, –, – |
Which reports actually fed the diagnosis. A source shown as missing was not silently assumed.
| Source | Status | Evidence supplied | Path | Bytes |
|---|---|---|---|---|
| prediction review | loaded | official outcomes and scoring errors | /app/output/reports/prediction_review_20261011.json | 11400 |
| forensic deep audit | loaded | probability, provenance, starter and decision contracts | /app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20261011.json | 30976 |
| continuous learning | loaded | pipeline-stage quality, calibration, probability lineage, score distribution, and official starter comparisons | /app/output/learning/continuous_learning_daily_20261011.json | 181366 |
| detailed report | loaded | full game and simulation rendering | /app/output/reports/detailed_20261011.html | 31609 |
| ultra detailed player audit | loaded | player-level prediction trace | /app/output/reports/20261011_ultra_detailed_player_audit.html | 1635801 |
| structural audit | loaded | all invariant findings | /app/output/reports/audit_report_20261011.html | 120679 |
| integrity revision audit | loaded | structural audit of every post-start revision of the slate's games | /app/output/reports/audit_report_20261011_integrity_revision.html | 344105 |
Compared against packet 20261010. Last recorded change: v15.28.3 (2026-10-07) Audit the confidence blend against the adaptive cap actually in force.
| Metric | Prior | Current | Δ | Result |
|---|---|---|---|---|
| brier_score | 0.245 | 0.2449 | -0.000101 | improved |
| accuracy | 0.6195 | 0.6195 | +0 | flat |
| team_run_mae | 2.4292 | 2.4159 | -0.0133 | improved |
| total_run_mae | 3.6549 | 3.6637 | +0.0088 | regressed |
| calibration_error | 0.1325 | 0.1324 | -0.0001 | improved |
| starter_er_mae | 1.6435 | 1.6226 | -0.0209 | improved |
| starter_outs_mae | 4.2222 | 4.184 | -0.0382 | improved |
All seven source_manifest entries are marked loaded:
| Source | Status and stated purpose |
|---|---|
Prediction review, /app/output/reports/prediction_review_20261011.json (11,400 bytes) | Loaded; official outcomes and scoring errors |
Forensic deep audit, /app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20261011.json (30,976 bytes) | Loaded; probability, provenance, starter, and decision contracts |
Continuous learning, /app/output/learning/continuous_learning_daily_20261011.json (181,366 bytes) | Loaded; stage quality, calibration, probability lineage, score distribution, starter comparisons |
Detailed report, /app/output/reports/detailed_20261011.html (31,609 bytes) | Loaded; game and simulation rendering |
Ultra-detailed player audit, /app/output/reports/20261011_ultra_detailed_player_audit.html (1,635,801 bytes) | Loaded; player-level prediction trace |
Structural audit, /app/output/reports/audit_report_20261011.html (120,679 bytes) | Loaded; invariant findings |
Integrity revision audit, /app/output/reports/audit_report_20261011_integrity_revision.html (344,105 bytes) | Loaded; structural audit of three post-start game revisions |
Slate coverage: The diagnosis reports one expected game and one game reviewed; continuous-learning, forensic-deep-audit, starter-comparison, and structural-audit coverage are each 1/1. The reviewed game is LAD@MIL. No additional game is identified as missing by the supplied coverage matrix.
Gaps and internal contradictions:
probability_lineage.raw_model_pick_probability is 0.5713, while model_trace.confidence_path.raw_pick_probability is 0.550827; the lineage also gives 0.550827 as the governor input. The record does not explain why the field called “raw model” differs from the value used as governor input. The final published probability and governed value do match closely, and the lineage marks no unexplained material delta; this is a provenance ambiguity, not evidence that publication bypassed a recorded transformation.Winner accuracy: 1/1 (100%), MIL correctly predicted. This is a correct winner call, not a correct score forecast. The model’s holdout winner accuracy is 0.600414, and its walk-forward accuracy is 0.570149; one winning call does not validate those broader estimates.
Calibration quality: Published MIL win probability was 0.548241 (about 54.8%), with a home-minus-away probability edge of 0.0965 (about 9.65 percentage points). The pick was a hit, producing Brier score 0.204086. The single-slate calibration bucket had average confidence 0.5482 and observed hit rate 1.0, so confidence-minus-hit-rate was −0.4518; the monitor labels that bucket underconfident, and weighted absolute calibration error was 0.4518. This is a one-game bucket, not evidence for a stable calibration curve. A confidence edge of 0.12, if encountered elsewhere, is moderate—not a near coin flip; this game’s edge was smaller, about 0.10.
Score accuracy: The published score was LAD 2, MIL 4; the actual score was LAD 1, MIL 2. Winner was right, but both team-run forecasts were high: LAD by 1 and MIL by 2. The total was forecast at 6 versus 3 actual, a +3 total-run bias/error. Team-run absolute error is 3 as reported. Exact score quality should be treated cautiously: validated holdout run-model R² is only 0.002143 home, 0.030936 away, and 0.002415 total.
Starter accuracy: Both starter identities matched. Skubal was projected for 4 ER, 5.68 ERA, and 19 outs; actual was 2 ER, 3.60 ERA, and 15 outs. Misiorowski was projected for 1 ER, 1.69 ERA, and 16 outs; actual was 1 ER, 2.08 ERA, and 13 outs. The away starter substantially outperformed the projected ERA/ER line, while the home starter allowed the projected ER but had a higher actual ERA and fewer outs. This is mixed starter performance, not a uniform starter miss.
Artifact integrity: The per-game structural audit passed, with no critical/error/warning findings; forecast-file integrity is explicitly called clean. No artifact defect is identified as the cause of this game’s score error. The conflicting raw-probability fields remain a provenance ambiguity that should be reconciled, but the reported published probability matches the governed value and the lineage says no unexplained material delta.
Causal issue register, reconciled entry by entry:
single_slate_calibration_instability. Evidence: weighted absolute calibration error 0.4518 across one game, affecting LAD@MIL. Recommended action: watch the same confidence buckets over a rolling window before changing calibration weights. Guardrail: a single slate is far too small to establish a stable calibration curve. This high-severity label marks material calibration risk, not a critical evidence failure.weak_run_model_signal. Evidence: home/away/total R² 0.0021/0.0309/0.0024, affecting LAD@MIL. Recommended action: treat exact scores as low-confidence; seek stronger features or a better target before tuning score tails. Guardrail: small positive R² only means better than guessing the average; it does not make exact scores reliable.complete_slate_audit_coverage. Evidence: 1/1 games structurally audited. Action: keep the per-game audit receipt in every report. Guardrail: full coverage does not cancel findings inside audited games.simulation_inert_on_slate. Evidence: 0 flip candidates, 0 published flips, affecting LAD@MIL. Action: measure simulation contribution over rolling slates, separating score realization from winner flipping. Guardrail: zero winner flips alone is not a defect and does not show that score reconciliation did no work. The cross-slate escalation changes the persistence diagnosis; see sections 7–8.no_change). The matchup breakdown attributes the home-side shortfall to offense; the away side is characterized as not materially breaking and closer to variance. The strongest listed contributors include Andy Pages (LAD, −1.26 runs versus projection), Brice Turang (MIL, +1.26), Andrew Vaughn (MIL, +1.11), Teoscar Hernández (LAD, +0.94), and Shohei Ohtani (LAD, +0.80). The learning analysis labels the latter four as learnable hitter deviations based on their reported season contact-quality tiers and xwOBA; it does not establish that a one-game player adjustment would improve future forecasts. The slate-level player metrics report generally weak per-hitter projections against a flat slate mean; see section 5.There were no winner losses: misses 0, hits 1. There is consequently no losing pick for which to reconstruct the earliest stage that moved the predicted winner toward the wrong result. The score forecast did miss, and stage-level score metrics show where run and margin errors changed.
Score-stage quality, compared directly with the official final score:
| Stage | Team-run MAE | Change vs historical ML | Total-run MAE | Margin MAE | Change in winner accuracy |
|---|---|---|---|---|---|
historical_ml | 2.9843 | 0.0000 | 5.9685 | 0.3521 | Baseline; 1/1 |
variance_applied | 3.0000 | +0.0157 | 6.0000 | 0.0000 | 0 |
enhanced_prediction | 2.0000 | −0.9843 | 4.0000 | 0.0000 | 0 |
kpi_layer | 2.0000 | −0.9843 | 4.0000 | 0.0000 | 0 |
embedded_savant_run_environment | 1.5000 | −1.4843 | 3.0000 | 1.0000 | 0 |
fundamental_edge_target_review | 1.5000 | −1.4843 | 3.0000 | 1.0000 | 0 |
capped_target | 1.5000 | −1.4843 | 3.0000 | 1.0000 | 0 |
simulation_result | 1.5000 | −1.4843 | 3.0000 | 1.0000 | 0 |
published_final | 1.5000 | −1.4843 | 3.0000 | 1.0000 | 0 |
The transition log reports no changed-direction games and no winner-direction regressions. It does, however, show a score-metric tradeoff: historical ML → variance worsened team-run MAE by 0.0157 while margin MAE improved by 0.3521; variance → enhanced prediction improved team-run MAE by 1.0; KPI made no change; KPI → embedded run environment improved team-run MAE by 0.5 but worsened margin MAE by 1.0. Later improvements in team-run/total-run error do not erase the intermediate margin regression. The supplied per-stage table does not provide each stage’s exact predicted score, so those scores cannot be reconstructed from these MAEs alone.
Cause categories for this game:
Pipeline-stage audit across all stages and transitions: All nine recorded stages and all eight transitions are accounted for above. Winner accuracy remains 1/1 at every stage; changed-direction, improved-game, and regressed-game arrays are empty. The numerical MAE deltas still matter: variance_applied slightly worsened team-run MAE; enhanced_prediction improved it; the embedded environment stage improved team-run and total-run errors but regressed margin MAE. fundamental_edge_target_review, capped_target, simulation_result, and published_final then leave those metrics unchanged. A later score-error recovery therefore does not erase the intermediate margin regression.
There is one game, so “helps” and “hurts” can only name that game; the supplied lever_tension entries all explicitly report no helped games and no hurt games. That is absence of counterfactual evidence, not proof of neutrality.
| Lever tension entry | Games it helps / hurts | Net evidence on changing it |
|---|---|---|
score.variance_multiplier / score.variance_floor (widen run distributions); targets Brier and calibration error | Helps: none listed. Hurts: none listed. | No slate-specific help/hurt evidence. Do not infer that widening variance fixes the +3 total-run mean bias; variance is a spread lever. |
player.pitcher.v4 form weights / player.pitcher_prior_games; targets starter ER/outs MAE | Helps: none listed. Hurts: none listed. | No counterfactual evidence. Starter outcomes were mixed; no game-based case for changing these weights. |
recent.* / season.* run-mean weighting; targets team-run MAE, total-run MAE, accuracy | Helps: none listed. Hurts: none listed. | The game’s total was over-projected, but the single game does not show whether a recent/season reweighting would correct it. Cross-slate lineup evidence supports investigating the run environment, not a broad untested reweighting. |
Tempting one-game fixes not justified: Do not raise MIL’s hitter projections solely from Turang and Vaughn’s results, lower LAD projections solely from Pages’ result, or adjust pitcher weights from these two starts. Do not change calibration weights because the one-game bucket error is large; the monitor expressly recommends rolling-window observation. Do not widen score variance as a substitute for correcting a possibly hot run mean. These changes either lack counterfactual support or risk learning from one-game noise.
Audit finding inventory available in the supplied diagnosis:
Model versus artifact defects:
recency_discount_factor is null and recency_guardrail_applied false. Published-minus-calibrated is +0.000041, with transformation described as publication matching the calibrated/governed value and unexplained_material_delta=false. The trace independently calls 0.550827 the raw pick probability, in conflict with lineage’s 0.5713 raw-model value. Thus, the final published value is accounted for by the recorded downstream transformation, and this is not a demonstrated material publication bypass; the upstream raw-field semantics/contract still need reconciliation.Raw structural evidence:
diagnostic_only_without_independent_support, priority P2.historical_game_temporal_v11, trained 2026-09-27; holdout R² 0.002143 home / 0.030936 away / 0.002415 total; walk-forward accuracy 0.570149, Brier 0.242204; validation winner accuracy 0.600414, Brier 0.239378. The near-zero run-target signal is a model-development concern, not something a one-game score fix resolves.score.variance_floor only as a spread lever. Starter ERA error is negative on 6/10 slates, mean −0.345, z = −0.83, and is explicitly on hold as not separable from noise. The current slate’s mean lineup delta is −1.5 across two sides and mean starter ERA error −0.84.margin_bias improving (mean −1.0); mean_team_run_error_on_losses improving (mean 2.5); weighted_calibration_error flat (mean 0.4528); winner_accuracy improving (mean 0.8056). “Improving” is the recorded direction, not a claim that all metrics are already good.Every finding_streaks entry:
| Finding | Consecutive-slate count | Present now? | Context |
|---|---|---|---|
pipeline_winner_instability | 0 | No | Incidence 1 in an 11-slate window; no target lever. |
score_margin_compression | 0 | No | Incidence 2; target levers score.variance_multiplier, score.variance_floor. |
simulation_inert_on_slate | 11 | Yes | Incidence 11/11; targets simulation.allow_score; target metrics team-run and total-run MAE. |
single_slate_calibration_instability | 2 | Yes | Incidence 9; targets confidence.empirical_max_weight, confidence.base_cap, confidence.moderate_cap. |
weak_run_model_signal | 2 | Yes | Incidence 9; targets training XGBoost estimator count, depth, and learning rate; this finding is marked not parameter-actionable. |
Escalated finding—established failure, not single-slate noise: simulation_inert_on_slate is explicitly escalated at 11 consecutive slates. Treat it as an established simulation/process failure pattern. The self-assessment gives a concrete suspected mechanism: the same draws are used both to search for a target-realizing play-by-play and to form the win-probability distribution, with early exit after finding a realization (default draw count around 2). It says this can make the win-rate/agreement signal vacuous. That is a supplied diagnosis, not an independently verified code execution result. The specified action is to confirm the module runs rather than silently no-oping, then separate target-score realization from an independent, unsteered win-probability batch (or a closed-form distribution), and feed a meaningful win-rate to the final policy.
Recommendations are ranked by evidence strength, persistence, scope, expected metric, affected games, and regression risk. These are proposed changes or shadow tests only; no changes have been applied.
simulation.allow_score; target metrics team_run_mae, total_run_mae.param_actionable=false, and the self-assessment specifically calls for an operator/code fix. In shadow, instrument whether the simulation is actually invoked, its draw count, early-exit reason, and whether an independent unsteered distribution is produced. Implement the stated separation of score-target realization and win-probability estimation, with batch size registered; compare a bounded 200–500 independent draws against a closed-form alternative as an isolated diagnostic.recent.* / season.* run-mean weighting is the available lever-tension entry targeting team-run MAE, total-run MAE, and accuracy. A small 2% reduction in the run-mean contribution of the currently over-projecting component, evaluated in shadow only, is a bounded test—not a claim that the JSON identifies which component is at fault. Do not use score.variance_floor to lower the mean: the bias register explicitly calls that a spread lever and says to check the run environment first.confidence.empirical_max_weight, confidence.base_cap, confidence.moderate_cap.training.xgb.n_estimators, training.xgb.max_depth, training.xgb.learning_rate, but the finding is marked param_actionable=false.recent.* / season.* tension row lists none helped or hurt. LAD@MIL’s score error is one example, not proof that any of the training parameters will fix it.Known: the only reviewed game, LAD@MIL, was a correct MIL winner call but a wrong score forecast (2–4 predicted versus 1–2 actual). The published probability was about 54.8%, with a 0.0965 home-minus-away edge; the pick hit. The total was over-projected by 3. Starter evidence is mixed, the per-game structural audit passed, and no artifact defect is identified as the cause.
Persistent evidence is more actionable than the one-game result: the run model has near-zero holdout R², lineup runs have been below projection on 7/10 slates, and the simulation-inert finding has persisted 11 consecutive slates and is escalated. Calibration error is flat across the reported trend window, but this game’s calibration bucket contains only one outcome. The upstream raw-probability fields conflict, even though the final published value matches the governed value and no material publication bypass is recorded.
Uncertain: which run-mean component caused this particular overprojection; whether any specific hitter, pitcher, or calibration adjustment would improve future slates; and whether the diagnosed simulation mechanism is the live code path without operator verification.
Safest next action for the very next slate: instrument and shadow-audit the simulation’s independent probability-distribution path—confirm it runs, record draw count and early-exit behavior, and do not change live confidence or variance parameters on this one-game result.
Full supporting reports: deep report (standalone / printable) · ultra player audit · detailed report · structural audit · post-fix revision audit.
| Metric | Value | Reading |
|---|---|---|
| Earned-run MAE | 1 | average earned runs off per starter |
| Earned-run bias | 1 | positive = projected more ER than allowed |
| Outs MAE | 3.5 | workload error, in outs |
| Identity match rate | 100.0% | 2 starters compared |
| Game | Total pred vs actual | Starting pitchers (projected vs actual ER) | Primary driver |
|---|---|---|---|
| LAD@MIL | 6 vs 3 | LAD Tarik Skubal proj 4 ER / actual 2 ER; MIL Jacob Misiorowski proj 1 ER / actual 1 ER | Offence / bullpen |
Production is running candidate-668e4305abca59bc. This configuration was applied under operator-enabled direct mode and remains under the recorded rollback-monitor lifecycle.
Applied at 2026-10-07T09:21:41.221033+00:00. Active now: yes. The stored baseline and paired rollback predictions are retained for review.
| Parameter | Before | After |
|---|---|---|
confidence.empirical_max_weight | 0.5 | 0.45 |
| Parameter | Applied | Current live value | Verification |
|---|---|---|---|
confidence.empirical_max_weight | 0.45 | 0.45 | verified live |
paired_effect_observed · live predictions 7 · paired previous-config predictions 7 · published scores changed 0.
Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.
| Game | Result | Live values recorded | Paired control | P(home) delta | Live score ← previous config |
|---|---|---|---|---|---|
| 20261007_CLE@CHW | hit | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 5.0, 'home_runs': 4.0} ← {'away_runs': 5.0, 'home_runs': 4.0} |
| 20261007_LAD@ATL | hit | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 5.0, 'home_runs': 4.0} ← {'away_runs': 5.0, 'home_runs': 4.0} |
| 20261007_MIL@SD | hit | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 4.0, 'home_runs': 5.0} ← {'away_runs': 4.0, 'home_runs': 5.0} |
| 20261007_TB@NYY | miss | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 3.0, 'home_runs': 4.0} ← {'away_runs': 3.0, 'home_runs': 4.0} |
| 20261008_CLE@CHW | hit | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 5.0, 'home_runs': 4.0} ← {'away_runs': 5.0, 'home_runs': 4.0} |
| 20261010_CHW@CLE | hit | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 5.0, 'home_runs': 6.0} ← {'away_runs': 5.0, 'home_runs': 6.0} |
| 20261011_LAD@MIL | hit | {'confidence.empirical_max_weight': 0.45} | yes | 0.0 | {'away_runs': 3.0, 'home_runs': 4.0} ← {'away_runs': 3.0, 'home_runs': 4.0} |
This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.
| Metric | At apply | Latest window | Delta | Direction |
|---|---|---|---|---|
| Brier score | 0.245566 | 0.244879 | -0.000687 | improved |
| Winner accuracy | 0.5877 | 0.6195 | 0.0318 | improved |
| Team run MAE | 2.4474 | 2.4159 | -0.0315 | improved |
| Total run MAE | 3.6316 | 3.6637 | 0.0321 | regressed |
| Calibration error | 0.0992 | 0.1324 | 0.0332 | regressed |
| Starter ER MAE | 1.6795 | 1.6226 | -0.0569 | improved |
| Starter outs MAE | 4.2393 | 4.184 | -0.0553 | improved |
This is rebuilt from the append-only candidate and application records on every publication, so later runs cannot erase an earlier proposal or production change.
| Proposed UTC | Provider | Exact change | Decision | Measured outcome | Rationale |
|---|---|---|---|---|---|
| 2026-08-25T06:01:43 | gemini (legacy) | confidence.sparse_sample_max: 10 → 12 | reject | DID NOT WORK: rejected (zero measured effect). Measured over 16 settled games: brier_score flat (0.0); accuracy flat (0.0); calibration_error flat (0.0); team_run_mae flat (0.0); total_run_mae flat (0.0). | Why and evidenceIncreasing confidence.sparse_sample_max from 10 to 15 may improve calibration for sparsely sampled games, as indicated by the underconfidence in the 0.60-0.65 bucket and the overconfidence in the 0.80-1.00 bucket, while staying within the allowed bounds and daily delta. {
"evaluation_mode": "artifact_replay",
"coverage": {
"paired_games": 16,
"distinct_slates": 2
},
"failed_gates": [
"minimum_paired_games",
"minimum_distinct_slates"
],
"metric_effects": {
"brier_score": {
"champion": 0.297161,
"candidate": 0.297161,
"difference": 0.0,
"improvement": 0.0,
"candidate_better": null
},
"accuracy": {
"champion": 0.3125,
"candidate": 0.3125,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"team_run_mae": {
"champion": 2.5625,
"candidate": 2.5625,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"total_run_mae": {
"champion": 4.125,
"candidate": 4.125,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"calibration_error": {
"champion": 0.28026444,
"candidate": 0.28026444,
"difference": 0.0,
"improvement": null,
"candidate_better": null
}
}
} |
| 2026-08-27T06:02:02 | openai | confidence.moderate_cap: 0.6 → 0.58 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceReducing confidence.moderate_cap from 0.6 to 0.58 may improve overall calibration, as suggested by the errors in observed hit rates in moderate confidence buckets. {
"evaluation_mode": "enhanced_shadow",
"coverage": {
"paired_games": 22,
"distinct_slates": 2
},
"failed_gates": [
"minimum_paired_games",
"minimum_distinct_slates"
],
"metric_effects": {
"brier_score": {
"champion": 0.25333323,
"candidate": 0.25333323,
"difference": 0.0,
"improvement": 0.0,
"candidate_better": null
},
"accuracy": {
"champion": 0.54545455,
"candidate": 0.54545455,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"team_run_mae": {
"champion": 2.52272727,
"candidate": 2.52272727,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"total_run_mae": {
"champion": 3.40909091,
"candidate": 3.40909091,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"calibration_error": {
"champion": 0.10832609,
"candidate": 0.10832609,
"difference": 0.0,
"improvement": null,
"candidate_better": null
}
}
} |
| 2026-09-04T06:03:08 | openai | confidence.base_cap: 0.6 → 0.58 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceLowering the default confidence cap modestly should reduce overconfidence in the 0.55-0.70 buckets and improve the primary Brier score, while limiting exposure to the recent high-conviction miss pattern. {} |
| 2026-09-07T06:03:40 | openai | score.variance_multiplier: 1.65 → 1.75 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceIncreasing score variance modestly should reduce under-dispersed run margins and improve total-run error, while the shadow gate limits risk to winner calibration and run-model guardrails. {} |
| 2026-09-12T09:04:27 | openai | score.variance_multiplier: 1.75 → 1.85 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceA further small increase in score variance should reduce persistent margin compression and improve run-model error, building on the previously promoted variance increase while keeping the change within the registered daily bound. {} |
| 2026-09-15T09:04:57 | openai | score.variance_multiplier: 1.85 → 1.95 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceIncreasing score variance modestly should reduce persistent run-margin compression and lower total-run error, building on two prior variance increases that worked and the current deep-slate evidence that wider tails helped the high-confidence BAL@NYM miss. {} |
| 2026-09-18T09:05:32 | openai | score.variance_multiplier: 1.95 → 2.05 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceIncreasing score variance modestly from 1.95 to 2.05 may further reduce persistent margin compression and improve run-model error, supported by the regressing margin bias, the run-model loss incidence, and prior variance increases that worked. The shadow gate should detect any degradation in Brier score or calibration. {} |
| 2026-09-21T09:05:52 | openai | score.variance_multiplier: 2.05 → 2.15 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceIncreasing score variance modestly from 2.05 to 2.15 may further reduce under-dispersed run margins and improve team-run error, supported by the leading run-model loss incidence, current team and total run MAE regressions, deep-slate evidence that wider tails helped two loss cases versus one hurt case, and the prior sequence of successful variance increases. The shadow gate should detect degradation in Brier score, calibration, or run guardrails. {} |
| 2026-09-24T09:06:53 | openai | confidence.base_cap: 0.58 → 0.56 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceLowering the default confidence cap modestly should reduce persistent overconfidence in the 0.50-0.55 and 0.60-0.65 buckets and improve winner calibration and Brier score, while the shadow gate protects against worsening the underconfident 0.55-0.60 bucket. {} |
| 2026-09-27T09:06:54 | openai | score.variance_multiplier: 2.15 → 2.25 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceIncreasing score variance modestly from 2.15 to 2.25 should reduce persistent run-margin compression and improve total-run error. This extends a sequence of previously successful variance increases and targets the currently regressing run-model metrics, while the shadow gate protects against degradation in Brier score, calibration, and run-error guardrails. {} |
| 2026-10-07T09:21:29 | openai | confidence.empirical_max_weight: 0.5 → 0.45 | applied_to_production | APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed. | Why and evidenceReduce the maximum weight assigned to empirical confidence from 0.50 to 0.45 to increase shrinkage, as the escalated calibration-instability finding recommends. This bounded shadow test targets the regressing calibration error; the mixed calibration bucket results make the direction uncertain. {} |
Each night the verified evidence is sent to OpenAI (the Luna model). The provider may only propose one small, bounded change to a registered parameter, or abstain. It cannot promote, run commands, or write files.
This run: skipped open rollback monitor. Paused: a promoted change is still under rollback monitoring.
| Recommended action | Reason |
|---|---|
| inspect_evidence_and_propose_or_abstain | minimum evidence gates are satisfied |
Most recent recorded action: candidate promoted at 2026-10-07T09:21:41 UTC.
| When (UTC) | Provider | Event | Detail |
|---|---|---|---|
| 2026-10-07T09:21:41 | candidate promoted | ||
| 2026-10-07T09:21:29 | openai | candidate created | Reduce the maximum weight assigned to empirical confidence from 0.50 to 0.45 to increase shrinkage, as the escalated calibration-instability finding recommends. This bounded shadow test targets the re |
| 2026-09-27T09:07:01 | candidate promoted | ||
| 2026-09-27T09:06:54 | openai | candidate created | Increasing score variance modestly from 2.15 to 2.25 should reduce persistent run-margin compression and improve total-run error. This extends a sequence of previously successful variance increases an |
| 2026-09-24T09:07:04 | candidate promoted | ||
| 2026-09-24T09:06:53 | openai | candidate created | Lowering the default confidence cap modestly should reduce persistent overconfidence in the 0.50-0.55 and 0.60-0.65 buckets and improve winner calibration and Brier score, while the shadow gate protec |
| 2026-09-21T09:06:01 | candidate promoted | ||
| 2026-09-21T09:05:52 | openai | candidate created | Increasing score variance modestly from 2.05 to 2.15 may further reduce under-dispersed run margins and improve team-run error, supported by the leading run-model loss incidence, current team and tota |
| 2026-09-18T09:05:40 | candidate promoted | ||
| 2026-09-18T09:05:32 | openai | candidate created | Increasing score variance modestly from 1.95 to 2.05 may further reduce persistent margin compression and improve run-model error, supported by the regressing margin bias, the run-model loss incidence |
| 2026-09-15T09:05:08 | candidate promoted | ||
| 2026-09-15T09:04:57 | openai | candidate created | Increasing score variance modestly should reduce persistent run-margin compression and lower total-run error, building on two prior variance increases that worked and the current deep-slate evidence t |
Evidence: eligible True · settled games 113 · distinct slates 17
Below is the background experiment that tests small tuning changes before any of them can reach production.
A candidate needs this much matched history before it can be promoted or rejected.
| Requirement | Have | Need | Progress |
|---|---|---|---|
| Paired shadow games | 0 | 40 | |
| Distinct game days | 0 | 4 |
Measured on settled games with official finals. This is the champion actually in use.
| Metric | Value | Sample | Direction |
|---|---|---|---|
| Brier score | 0.2449 | 113 | lower is better |
| Winner accuracy | 62.0% | 113 | higher is better |
| Team run MAE | 2.4159 | 113 | lower is better |
| Total run MAE | 3.6637 | 113 | lower is better |
| Calibration error | 0.1324 | 113 | lower is better |
| Starter ER MAE | 1.6226 | 212 | lower is better |
| Starter outs MAE | 4.184 | 212 | lower is better |
No paired evaluation rows are available yet.
All gates satisfied.
| Stream | New | Already stored | Skipped |
|---|---|---|---|
| Game finals | 1 | 112 | 0 |
| Starter finals | 2 | 216 | 2 unsettled |
“New” is zero when every final for the day was already recorded on an earlier run.
{
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}{
"schema_version": "adaptive_status_report_v2",
"date": "20261011",
"generated_at_utc": "2026-10-12T09:21:33.063795+00:00",
"champion": {
"config_id": "candidate-668e4305abca59bc",
"config_hash": "sha256:02895b398be5e25b874cb24573f6272d7b4e2c440e5dad0b021995c628ed5ed3"
},
"active_candidate": null,
"ingestion": {
"appended": 1,
"repeated": 112,
"errors": [],
"skipped_unverifiable_pregame": 0,
"starter_actuals": {
"appended": 2,
"repeated": 216,
"skipped": 0,
"skipped_unsettled": 2,
"errors": []
}
},
"evaluation": {
"candidate": {
"status": "no_active_candidate"
},
"rollback_monitoring": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
"proposal": {
"status": "skipped_open_rollback_monitor"
},
"proposal_eligibility": {
"eligible": true,
"settled_games": 113,
"distinct_slates": 17,
"reasons": []
},
"recommended_actions": [
{
"action": "inspect_evidence_and_propose_or_abstain",
"reason": "minimum evidence gates are satisfied"
}
],
"proposal_history": [
{
"occurred_at_utc": "2026-09-15T09:04:57.841906+00:00",
"provider": "openai",
"event": "candidate_created",
"detail": "Increasing score variance modestly should reduce persistent run-margin compression and lower total-run error, building on two prior variance increases that worked and the current deep-slate evidence t"
},
{
"occurred_at_utc": "2026-09-15T09:05:08.617033+00:00",
"provider": "",
"event": "candidate_promoted",
"detail": ""
},
{
"occurred_at_utc": "2026-09-18T09:05:32.063728+00:00",
"provider": "openai",
"event": "candidate_created",
"detail": "Increasing score variance modestly from 1.95 to 2.05 may further reduce persistent margin compression and improve run-model error, supported by the regressing margin bias, the run-model loss incidence"
},
{
"occurred_at_utc": "2026-09-18T09:05:40.012512+00:00",
"provider": "",
"event": "candidate_promoted",
"detail": ""
},
{
"occurred_at_utc": "2026-09-21T09:05:52.468019+00:00",
"provider": "openai",
"event": "candidate_created",
"detail": "Increasing score variance modestly from 2.05 to 2.15 may further reduce under-dispersed run margins and improve team-run error, supported by the leading run-model loss incidence, current team and tota"
},
{
"occurred_at_utc": "2026-09-21T09:06:01.333346+00:00",
"provider": "",
"event": "candidate_promoted",
"detail": ""
},
{
"occurred_at_utc": "2026-09-24T09:06:53.755755+00:00",
"provider": "openai",
"event": "candidate_created",
"detail": "Lowering the default confidence cap modestly should reduce persistent overconfidence in the 0.50-0.55 and 0.60-0.65 buckets and improve winner calibration and Brier score, while the shadow gate protec"
},
{
"occurred_at_utc": "2026-09-24T09:07:04.378558+00:00",
"provider": "",
"event": "candidate_promoted",
"detail": ""
},
{
"occurred_at_utc": "2026-09-27T09:06:54.240008+00:00",
"provider": "openai",
"event": "candidate_created",
"detail": "Increasing score variance modestly from 2.15 to 2.25 should reduce persistent run-margin compression and improve total-run error. This extends a sequence of previously successful variance increases an"
},
{
"occurred_at_utc": "2026-09-27T09:07:01.435173+00:00",
"provider": "",
"event": "candidate_promoted",
"detail": ""
},
{
"occurred_at_utc": "2026-10-07T09:21:29.935210+00:00",
"provider": "openai",
"event": "candidate_created",
"detail": "Reduce the maximum weight assigned to empirical confidence from 0.50 to 0.45 to increase shrinkage, as the escalated calibration-instability finding recommends. This bounded shadow test targets the re"
},
{
"occurred_at_utc": "2026-10-07T09:21:41.221033+00:00",
"provider": "",
"event": "candidate_promoted",
"detail": ""
}
],
"evaluation_thresholds": {
"minimum_paired_games": 40,
"minimum_distinct_slates": 4
},
"slate_review": {
"schema_version": "adaptive_slate_review_v3",
"date": "20261011",
"games_reviewed": 1,
"hits": 1,
"misses": 0,
"winner_accuracy": 1.0,
"mean_brier_score": 0.2041,
"coin_flip_baseline_brier": 0.25,
"mean_run_error": 3.0,
"total_run_bias_pred_minus_actual": 3.0,
"total_run_mae": 3.0,
"near_coin_flip_games": 0,
"strong_conviction_games": 0,
"max_conviction": 0.0965,
"loss_reason_counts": {},
"metric_incidence": {
"losses": 0,
"by_dominant_metric": {},
"leading_metric": null,
"mean_total_run_error_on_losses": null,
"mean_team_run_error_on_losses": null,
"mean_winner_brier_on_losses": null,
"mean_starter_er_error_on_losses": null,
"headline": null
},
"starter_quality": {
"starters": 2,
"identity_match_rate": 1.0,
"er_mae": 1.0,
"er_bias_pred_minus_actual": 1.0,
"outs_mae": 3.5
},
"worst_run_misses": [
{
"game_id": "20261011_LAD@MIL",
"matchup": "LAD@MIL",
"predicted_total": 6.0,
"actual_total": 3.0,
"run_error": 3.0,
"starters": [
{
"team": "LAD",
"name": "Tarik Skubal",
"predicted_er": 4.0,
"actual_er": 2.0,
"er_miss": -2.0,
"predicted_outs": 19.0,
"actual_outs": 15.0
},
{
"team": "MIL",
"name": "Jacob Misiorowski",
"predicted_er": 1.0,
"actual_er": 1.0,
"er_miss": 0.0,
"predicted_outs": 16.0,
"actual_outs": 13.0
}
],
"primary_driver": "offence_or_bullpen"
}
],
"games": [
{
"game_id": "20261011_LAD@MIL",
"matchup": "LAD@MIL",
"pick": "MIL",
"winner": "MIL",
"outcome": "hit",
"home_win_probability": 0.5482,
"conviction": 0.0965,
"predicted_away_runs": 2.0,
"predicted_home_runs": 4.0,
"actual_away_runs": 1.0,
"actual_home_runs": 2.0,
"total_predicted": 6.0,
"total_actual": 3.0,
"run_error": 3.0,
"brier_score": 0.204086,
"loss_reason": null,
"metric_errors": {
"winner_brier": 0.204086,
"team_run_error": 3.0,
"total_run_error": 3.0,
"starter_er_error": 2.0
},
"dominant_metric": null
}
],
"findings": [
{
"area": "Overall",
"title": "No dominant failure pattern on this slate.",
"detail": "Losses were spread across causes with no single systematic driver."
}
],
"priority_actions": [],
"deep_diagnosis": "<rendered above; omitted from debug dump>",
"deep_report_path": "/app/output/reports/deep_slate_report_20261011.html",
"luna_analysis_status": "received",
"luna_analysis_quality": {
"complete": true,
"characters": 30302,
"minimum_characters": 6000,
"sections_present": [
1,
2,
3,
4,
5,
6,
7,
8,
9
],
"sections_required": [
1,
2,
3,
4,
5,
6,
7,
8,
9
],
"games_present": 1,
"games_required": 1,
"missing_games": [],
"causes_present": 4,
"causes_required": 4,
"missing_causes": [],
"sources_present": 7,
"sources_required": 7,
"missing_sources": [],
"coverage_score": 125
},
"luna_analysis": "<rendered above; omitted from debug dump>",
"change_impact": "<rendered above; omitted from debug dump>"
},
"metrics": {
"brier_score": {
"status": "measured",
"value": 0.244879,
"sample_size": 113,
"baseline_value": 0.24498,
"difference": -0.000101,
"direction": "improved",
"minimum_required_sample": 20,
"confidence_interval": null,
"evidence_ids": [
"metric.brier_score"
]
},
"accuracy": {
"status": "measured",
"value": 0.6195,
"sample_size": 113,
"baseline_value": 0.6195,
"difference": 0.0,
"direction": "stable",
"minimum_required_sample": 20,
"confidence_interval": null,
"evidence_ids": [
"summary.settled_results"
]
},
"team_run_mae": {
"status": "measured",
"value": 2.4159,
"sample_size": 113,
"baseline_value": 2.4292,
"difference": -0.0133,
"direction": "improved",
"minimum_required_sample": 20,
"confidence_interval": null,
"evidence_ids": [
"pipeline.stage.published_final"
]
},
"total_run_mae": {
"status": "measured",
"value": 3.6637,
"sample_size": 113,
"baseline_value": 3.6549,
"difference": 0.0088,
"direction": "regressed",
"minimum_required_sample": 20,
"confidence_interval": null,
"evidence_ids": [
"pipeline.stage.published_final"
]
},
"calibration_error": {
"status": "measured",
"value": 0.1324,
"sample_size": 113,
"baseline_value": 0.1325,
"difference": -0.0001,
"direction": "improved",
"minimum_required_sample": 20,
"confidence_interval": null,
"evidence_ids": [
"calibration.weighted_absolute_error"
]
},
"starter_er_mae": {
"status": "measured",
"value": 1.6226,
"sample_size": 212,
"baseline_value": 1.6435,
"difference": -0.0209,
"direction": "improved",
"minimum_required_sample": 40,
"confidence_interval": null,
"evidence_ids": [
"starter.baseline.er_mae"
]
},
"starter_outs_mae": {
"status": "measured",
"value": 4.184,
"sample_size": 212,
"baseline_value": 4.2222,
"difference": -0.0382,
"direction": "improved",
"minimum_required_sample": 40,
"confidence_interval": null,
"evidence_ids": [
"starter.baseline.outs_mae"
]
}
},
"previous_experiments": [
{
"experiment_id": "candidate-c7e288f75d707709",
"proposed_at_utc": "2026-08-25T06:01:43.820174+00:00",
"provider": "gemini",
"hypothesis": "Increasing confidence.sparse_sample_max from 10 to 15 may improve calibration for sparsely sampled games, as indicated by the underconfidence in the 0.60-0.65 bucket and the overconfidence in the 0.80-1.00 bucket, while staying within the allowed bounds and daily delta.",
"changes": [
{
"parameter": "confidence.sparse_sample_max",
"old_value": 10,
"new_value": 12,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.80-1.00"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "reject",
"reason": "zero measured effect",
"decided_at_utc": "2026-08-26T22:29:59.797443+00:00",
"measured_effect": {
"evaluation_mode": "artifact_replay",
"coverage": {
"paired_games": 16,
"distinct_slates": 2
},
"failed_gates": [
"minimum_paired_games",
"minimum_distinct_slates"
],
"metric_effects": {
"brier_score": {
"champion": 0.297161,
"candidate": 0.297161,
"difference": 0.0,
"improvement": 0.0,
"candidate_better": null
},
"accuracy": {
"champion": 0.3125,
"candidate": 0.3125,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"team_run_mae": {
"champion": 2.5625,
"candidate": 2.5625,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"total_run_mae": {
"champion": 4.125,
"candidate": 4.125,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"calibration_error": {
"champion": 0.28026444,
"candidate": 0.28026444,
"difference": 0.0,
"improvement": null,
"candidate_better": null
}
}
},
"outcome": "DID NOT WORK: rejected (zero measured effect). Measured over 16 settled games: brier_score flat (0.0); accuracy flat (0.0); calibration_error flat (0.0); team_run_mae flat (0.0); total_run_mae flat (0.0).",
"worked": false
},
{
"experiment_id": "candidate-31a39524087cf556",
"proposed_at_utc": "2026-08-27T06:02:02.124992+00:00",
"provider": "openai",
"hypothesis": "Reducing confidence.moderate_cap from 0.6 to 0.58 may improve overall calibration, as suggested by the errors in observed hit rates in moderate confidence buckets.",
"changes": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"new_value": 0.58,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.55-0.60",
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.65-0.70"
],
"risk_tier": "low",
"evaluation_mode": "enhanced_shadow"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-08-29T06:02:24.658142+00:00",
"measured_effect": {
"evaluation_mode": "enhanced_shadow",
"coverage": {
"paired_games": 22,
"distinct_slates": 2
},
"failed_gates": [
"minimum_paired_games",
"minimum_distinct_slates"
],
"metric_effects": {
"brier_score": {
"champion": 0.25333323,
"candidate": 0.25333323,
"difference": 0.0,
"improvement": 0.0,
"candidate_better": null
},
"accuracy": {
"champion": 0.54545455,
"candidate": 0.54545455,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"team_run_mae": {
"champion": 2.52272727,
"candidate": 2.52272727,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"total_run_mae": {
"champion": 3.40909091,
"candidate": 3.40909091,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"calibration_error": {
"champion": 0.10832609,
"candidate": 0.10832609,
"difference": 0.0,
"improvement": null,
"candidate_better": null
}
}
},
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260828",
"applied_at_utc": "2026-08-29T06:02:24.658142+00:00",
"candidate_id": "candidate-31a39524087cf556",
"changes": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"new_value": 0.58
}
],
"config_before": "default-v1",
"config_after": "candidate-31a39524087cf556",
"metric_baseline_at_apply": {
"brier_score": 0.241798,
"accuracy": 0.5833,
"team_run_mae": 2.4306,
"total_run_mae": 3.713,
"calibration_error": 0.1004,
"starter_er_mae": 1.7854,
"starter_outs_mae": 3.1073
},
"status": "applied_to_production",
"previous_config_id": "default-v1",
"new_config_id": "candidate-31a39524087cf556",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"applied_value": 0.58,
"current_live_value": 0.58,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.241798,
"latest_window": 0.244879,
"delta": 0.003081,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5833,
"latest_window": 0.6195,
"delta": 0.0362,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4306,
"latest_window": 2.4159,
"delta": -0.0147,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.713,
"latest_window": 3.6637,
"delta": -0.0493,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.1004,
"latest_window": 0.1324,
"delta": 0.032,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7854,
"latest_window": 1.6226,
"delta": -0.1628,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.1073,
"latest_window": 4.184,
"delta": 1.0767,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 66,
"paired_previous_config_predictions": 43,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260831_NYM@TB",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.6655,
"previous_home_win_probability": 0.6655,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_NYY@LAA",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411987,
"previous_home_win_probability": 0.411987,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_OAK@TEX",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546614,
"previous_home_win_probability": 0.546614,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_PHI@ARI",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.453386,
"previous_home_win_probability": 0.453386,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SD@CIN",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.326497,
"previous_home_win_probability": 0.326497,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SEA@BOS",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583303,
"previous_home_win_probability": 0.583303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SF@ATL",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546614,
"previous_home_win_probability": 0.546614,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260901_ATL@WAS",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_BAL@COL",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_CHW@HOU",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_DET@MIN",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_MIA@KC",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_MIL@CHC",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 8.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_NYM@TB",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_NYY@LAA",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_OAK@TEX",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_PHI@ARI",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SD@CIN",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SEA@BOS",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SF@PIT",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_STL@LAD",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_TOR@CLE",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_ATL@WAS",
"date": "20260902",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_BAL@COL",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_NYM@TB",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_OAK@TEX",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_PHI@ARI",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SD@CIN",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SEA@BOS",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SF@PIT",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-beeea24799c2c165",
"proposed_at_utc": "2026-09-04T06:03:08.215029+00:00",
"provider": "openai",
"hypothesis": "Lowering the default confidence cap modestly should reduce overconfidence in the 0.55-0.70 buckets and improve the primary Brier score, while limiting exposure to the recent high-conviction miss pattern.",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"new_value": 0.58,
"expected_metric": "brier_score",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.55-0.60",
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.65-0.70",
"metric.brier_score"
],
"risk_tier": "low",
"evaluation_mode": "enhanced_shadow"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-04T06:03:17.089072+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260903",
"applied_at_utc": "2026-09-04T06:03:17.089072+00:00",
"candidate_id": "candidate-beeea24799c2c165",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"new_value": 0.58
}
],
"config_before": "candidate-31a39524087cf556-registry-c5dd20fd32e9",
"config_after": "candidate-beeea24799c2c165",
"metric_baseline_at_apply": {
"brier_score": 0.252004,
"accuracy": 0.55,
"team_run_mae": 2.7667,
"total_run_mae": 3.85,
"calibration_error": 0.0989,
"starter_er_mae": 1.9192,
"starter_outs_mae": 3.0192
},
"status": "applied_to_production",
"previous_config_id": "candidate-31a39524087cf556-registry-c5dd20fd32e9",
"new_config_id": "candidate-beeea24799c2c165",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"applied_value": 0.58,
"current_live_value": 0.56,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.252004,
"latest_window": 0.244879,
"delta": -0.007125,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.55,
"latest_window": 0.6195,
"delta": 0.0695,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.7667,
"latest_window": 2.4159,
"delta": -0.3508,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.85,
"latest_window": 3.6637,
"delta": -0.1863,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0989,
"latest_window": 0.1324,
"delta": 0.0335,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.9192,
"latest_window": 1.6226,
"delta": -0.2966,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.0192,
"latest_window": 4.184,
"delta": 1.1648,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 46,
"paired_previous_config_predictions": 46,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260905_ARI@HOU",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.476266,
"previous_home_win_probability": 0.476266,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_ATL@PHI",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.455319,
"previous_home_win_probability": 0.455319,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_BOS@BAL",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.455286,
"previous_home_win_probability": 0.455286,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_CHC@MIA",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.26047,
"previous_home_win_probability": 0.26047,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_DET@CLE",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575318,
"previous_home_win_probability": 0.575318,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_LAA@PIT",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.635729,
"previous_home_win_probability": 0.635729,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_MIL@CIN",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.287611,
"previous_home_win_probability": 0.287611,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_MIN@CHW",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45369,
"previous_home_win_probability": 0.45369,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_NYY@SD",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.432863,
"previous_home_win_probability": 0.432863,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_OAK@SEA",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54631,
"previous_home_win_probability": 0.54631,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_SF@NYM",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.527739,
"previous_home_win_probability": 0.527739,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_STL@COL",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.478775,
"previous_home_win_probability": 0.478775,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_TB@TEX",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45369,
"previous_home_win_probability": 0.45369,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_TOR@KC",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.357403,
"previous_home_win_probability": 0.357403,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_WAS@LAD",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.586389,
"previous_home_win_probability": 0.586389,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_ARI@HOU",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.456108,
"previous_home_win_probability": 0.456108,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_ATL@PHI",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.559583,
"previous_home_win_probability": 0.559583,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_BOS@BAL",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.43182,
"previous_home_win_probability": 0.43182,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_CHC@MIA",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.328844,
"previous_home_win_probability": 0.328844,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_DET@CLE",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.528092,
"previous_home_win_probability": 0.528092,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_LAA@PIT",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.585076,
"previous_home_win_probability": 0.585076,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_MIL@CIN",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.374303,
"previous_home_win_probability": 0.374303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_MIN@CHW",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583263,
"previous_home_win_probability": 0.583263,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_NYY@SD",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.450638,
"previous_home_win_probability": 0.450638,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_OAK@SEA",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.561176,
"previous_home_win_probability": 0.561176,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_SF@NYM",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.51921,
"previous_home_win_probability": 0.51921,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_STL@COL",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.417854,
"previous_home_win_probability": 0.417854,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_TB@TEX",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.462085,
"previous_home_win_probability": 0.462085,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_TOR@KC",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.431542,
"previous_home_win_probability": 0.431542,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_WAS@LAD",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.577206,
"previous_home_win_probability": 0.577206,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-11bc4bc2dfc7264a",
"proposed_at_utc": "2026-09-07T06:03:40.049218+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly should reduce under-dispersed run margins and improve total-run error, while the shadow gate limits risk to winner calibration and run-model guardrails.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"new_value": 1.75,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-07T06:03:53.452273+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260906",
"applied_at_utc": "2026-09-07T06:03:53.452273+00:00",
"candidate_id": "candidate-11bc4bc2dfc7264a",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"new_value": 1.75
}
],
"config_before": "candidate-beeea24799c2c165",
"config_after": "candidate-11bc4bc2dfc7264a",
"metric_baseline_at_apply": {
"brier_score": 0.2509,
"accuracy": 0.5583,
"team_run_mae": 2.6083,
"total_run_mae": 3.65,
"calibration_error": 0.064,
"starter_er_mae": 1.9795,
"starter_outs_mae": 3.0123
},
"status": "applied_to_production",
"previous_config_id": "candidate-beeea24799c2c165",
"new_config_id": "candidate-11bc4bc2dfc7264a",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"applied_value": 1.75,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.2509,
"latest_window": 0.244879,
"delta": -0.006021,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5583,
"latest_window": 0.6195,
"delta": 0.0612,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.6083,
"latest_window": 2.4159,
"delta": -0.1924,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.65,
"latest_window": 3.6637,
"delta": 0.0137,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.064,
"latest_window": 0.1324,
"delta": 0.0684,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.9795,
"latest_window": 1.6226,
"delta": -0.3569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.0123,
"latest_window": 4.184,
"delta": 1.1717,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 26,
"paired_previous_config_predictions": 26,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260907_ARI@KC",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.579623,
"previous_home_win_probability": 0.581922,
"home_probability_delta": -0.002299,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_ATL@PHI",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.556519,
"previous_home_win_probability": 0.556626,
"home_probability_delta": -0.000107,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CHC@MIL",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.508021,
"previous_home_win_probability": 0.50826,
"home_probability_delta": -0.000239,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CIN@LAD",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575111,
"previous_home_win_probability": 0.577324,
"home_probability_delta": -0.002213,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CLE@BAL",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.510748,
"previous_home_win_probability": 0.510857,
"home_probability_delta": -0.000109,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_LAA@BOS",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.653937,
"previous_home_win_probability": 0.658266,
"home_probability_delta": -0.004329,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_MIN@DET",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.432458,
"previous_home_win_probability": 0.430463,
"home_probability_delta": 0.001995,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_NYM@MIA",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.524436,
"previous_home_win_probability": 0.524499,
"home_probability_delta": -6.3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_STL@SF",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.373236,
"previous_home_win_probability": 0.369592,
"home_probability_delta": 0.003644,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_TOR@OAK",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.300442,
"previous_home_win_probability": 0.295149,
"home_probability_delta": 0.005293,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_WAS@SD",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.541044,
"previous_home_win_probability": 0.541104,
"home_probability_delta": -6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_ARI@KC",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.366092,
"previous_home_win_probability": 0.364585,
"home_probability_delta": 0.001507,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CHC@MIL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.581938,
"previous_home_win_probability": 0.582044,
"home_probability_delta": -0.000106,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CIN@LAD",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.671836,
"previous_home_win_probability": 0.675324,
"home_probability_delta": -0.003488,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CLE@BAL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492884,
"previous_home_win_probability": 0.492672,
"home_probability_delta": 0.000212,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_COL@NYY",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.644809,
"previous_home_win_probability": 0.647495,
"home_probability_delta": -0.002686,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_HOU@PHI",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.436918,
"previous_home_win_probability": 0.435067,
"home_probability_delta": 0.001851,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_LAA@BOS",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.574016,
"previous_home_win_probability": 0.576192,
"home_probability_delta": -0.002176,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_MIN@DET",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.582467,
"previous_home_win_probability": 0.583089,
"home_probability_delta": -0.000622,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_NYM@MIA",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.453392,
"previous_home_win_probability": 0.453262,
"home_probability_delta": 0.00013,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_PIT@CHW",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.522678,
"previous_home_win_probability": 0.522785,
"home_probability_delta": -0.000107,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_STL@SF",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454963,
"previous_home_win_probability": 0.453634,
"home_probability_delta": 0.001329,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TB@ATL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.474696,
"previous_home_win_probability": 0.474417,
"home_probability_delta": 0.000279,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TEX@SEA",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.465664,
"previous_home_win_probability": 0.464641,
"home_probability_delta": 0.001023,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TOR@OAK",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.400365,
"previous_home_win_probability": 0.39841,
"home_probability_delta": 0.001955,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_WAS@SD",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.529136,
"previous_home_win_probability": 0.529245,
"home_probability_delta": -0.000109,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-ed18fee8af33cf7e",
"proposed_at_utc": "2026-09-12T09:04:27.150731+00:00",
"provider": "openai",
"hypothesis": "A further small increase in score variance should reduce persistent margin compression and improve run-model error, building on the previously promoted variance increase while keeping the change within the registered daily bound.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"new_value": 1.85,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-12T09:04:36.607786+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260911",
"applied_at_utc": "2026-09-12T09:04:36.607786+00:00",
"candidate_id": "candidate-ed18fee8af33cf7e",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"new_value": 1.85
}
],
"config_before": "candidate-11bc4bc2dfc7264a-registry-4c40ee6a3671",
"config_after": "candidate-ed18fee8af33cf7e",
"metric_baseline_at_apply": {
"brier_score": 0.242131,
"accuracy": 0.6,
"team_run_mae": 2.4417,
"total_run_mae": 3.7167,
"calibration_error": 0.0872,
"starter_er_mae": 1.8716,
"starter_outs_mae": 3.1284
},
"status": "applied_to_production",
"previous_config_id": "candidate-11bc4bc2dfc7264a-registry-4c40ee6a3671",
"new_config_id": "candidate-ed18fee8af33cf7e",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"applied_value": 1.85,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.242131,
"latest_window": 0.244879,
"delta": 0.002748,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6,
"latest_window": 0.6195,
"delta": 0.0195,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4417,
"latest_window": 2.4159,
"delta": -0.0258,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.7167,
"latest_window": 3.6637,
"delta": -0.053,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0872,
"latest_window": 0.1324,
"delta": 0.0452,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.8716,
"latest_window": 1.6226,
"delta": -0.249,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.1284,
"latest_window": 4.184,
"delta": 1.0556,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 40,
"paired_previous_config_predictions": 40,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260912_PHI@ATL",
"date": "20260912",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.493511,
"previous_home_win_probability": 0.493328,
"home_probability_delta": 0.000183,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_PIT@CHC",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.554666,
"previous_home_win_probability": 0.556195,
"home_probability_delta": -0.001529,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_SD@SF",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.496417,
"previous_home_win_probability": 0.496316,
"home_probability_delta": 0.000101,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_SEA@OAK",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.465434,
"previous_home_win_probability": 0.465334,
"home_probability_delta": 0.0001,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_TEX@ARI",
"date": "20260912",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.581582,
"previous_home_win_probability": 0.583173,
"home_probability_delta": -0.001591,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_BAL@TOR",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.534848,
"previous_home_win_probability": 0.534948,
"home_probability_delta": -0.0001,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CHW@STL",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.511703,
"previous_home_win_probability": 0.511749,
"home_probability_delta": -4.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CIN@MIL",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.735605,
"previous_home_win_probability": 0.741315,
"home_probability_delta": -0.00571,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CLE@MIN",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.563738,
"previous_home_win_probability": 0.563837,
"home_probability_delta": -9.9e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_COL@DET",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.646358,
"previous_home_win_probability": 0.649983,
"home_probability_delta": -0.003625,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_HOU@TB",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.527949,
"previous_home_win_probability": 0.528027,
"home_probability_delta": -7.8e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_KC@BOS",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.58576,
"previous_home_win_probability": 0.587159,
"home_probability_delta": -0.001399,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_LAA@WAS",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.604591,
"previous_home_win_probability": 0.606397,
"home_probability_delta": -0.001806,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_LAD@MIA",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.292502,
"previous_home_win_probability": 0.287288,
"home_probability_delta": 0.005214,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_NYM@NYY",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.588505,
"previous_home_win_probability": 0.589999,
"home_probability_delta": -0.001494,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_PHI@ATL",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.559569,
"previous_home_win_probability": 0.560163,
"home_probability_delta": -0.000594,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_PIT@CHC",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.526139,
"previous_home_win_probability": 0.526239,
"home_probability_delta": -0.0001,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_SD@SF",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454094,
"previous_home_win_probability": 0.453729,
"home_probability_delta": 0.000365,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_SEA@OAK",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411037,
"previous_home_win_probability": 0.409342,
"home_probability_delta": 0.001695,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_TEX@ARI",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492178,
"previous_home_win_probability": 0.491957,
"home_probability_delta": 0.000221,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_ATL@CHC",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.535036,
"previous_home_win_probability": 0.535203,
"home_probability_delta": -0.000167,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_BAL@NYM",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.627507,
"previous_home_win_probability": 0.63062,
"home_probability_delta": -0.003113,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_CHW@CLE",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507826,
"previous_home_win_probability": 0.508047,
"home_probability_delta": -0.000221,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_DET@TOR",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492174,
"previous_home_win_probability": 0.491953,
"home_probability_delta": 0.000221,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_LAD@CIN",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.27412,
"previous_home_win_probability": 0.268674,
"home_probability_delta": 0.005446,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_MIA@ARI",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.472665,
"previous_home_win_probability": 0.471904,
"home_probability_delta": 0.000761,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_NYY@MIN",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.355399,
"previous_home_win_probability": 0.351523,
"home_probability_delta": 0.003876,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SD@COL",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.336593,
"previous_home_win_probability": 0.333546,
"home_probability_delta": 0.003047,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SEA@LAA",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.538184,
"previous_home_win_probability": 0.538239,
"home_probability_delta": -5.5e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SF@STL",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507604,
"previous_home_win_probability": 0.507671,
"home_probability_delta": -6.7e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-57e651c7f36832cf",
"proposed_at_utc": "2026-09-15T09:04:57.841906+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly should reduce persistent run-margin compression and lower total-run error, building on two prior variance increases that worked and the current deep-slate evidence that wider tails helped the high-confidence BAL@NYM miss.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"new_value": 1.95,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-15T09:05:08.617033+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260914",
"applied_at_utc": "2026-09-15T09:05:08.617033+00:00",
"candidate_id": "candidate-57e651c7f36832cf",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"new_value": 1.95
}
],
"config_before": "candidate-ed18fee8af33cf7e",
"config_after": "candidate-57e651c7f36832cf",
"metric_baseline_at_apply": {
"brier_score": 0.24114,
"accuracy": 0.6333,
"team_run_mae": 2.5083,
"total_run_mae": 3.8167,
"calibration_error": 0.1244,
"starter_er_mae": 1.7778,
"starter_outs_mae": 3.2644
},
"status": "applied_to_production",
"previous_config_id": "candidate-ed18fee8af33cf7e",
"new_config_id": "candidate-57e651c7f36832cf",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"applied_value": 1.95,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.24114,
"latest_window": 0.244879,
"delta": 0.003739,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6333,
"latest_window": 0.6195,
"delta": -0.0138,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5083,
"latest_window": 2.4159,
"delta": -0.0924,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.8167,
"latest_window": 3.6637,
"delta": -0.153,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.1244,
"latest_window": 0.1324,
"delta": 0.008,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7778,
"latest_window": 1.6226,
"delta": -0.1552,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.2644,
"latest_window": 4.184,
"delta": 0.9196,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 39,
"paired_previous_config_predictions": 39,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260915_NYY@MIN",
"date": "20260915",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.347168,
"previous_home_win_probability": 0.345204,
"home_probability_delta": 0.001964,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_OAK@TB",
"date": "20260915",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.667434,
"previous_home_win_probability": 0.668988,
"home_probability_delta": -0.001554,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_PHI@WAS",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454124,
"previous_home_win_probability": 0.453895,
"home_probability_delta": 0.000229,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SD@COL",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.302515,
"previous_home_win_probability": 0.297761,
"home_probability_delta": 0.004754,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SEA@LAA",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.431377,
"previous_home_win_probability": 0.431105,
"home_probability_delta": 0.000272,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SF@STL",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.573518,
"previous_home_win_probability": 0.57406,
"home_probability_delta": -0.000542,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_ATL@CHC",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.56953,
"previous_home_win_probability": 0.569621,
"home_probability_delta": -9.1e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_BAL@NYM",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.567625,
"previous_home_win_probability": 0.568763,
"home_probability_delta": -0.001138,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_BOS@TEX",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.532791,
"previous_home_win_probability": 0.533043,
"home_probability_delta": -0.000252,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_CHW@CLE",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.578219,
"previous_home_win_probability": 0.579288,
"home_probability_delta": -0.001069,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_DET@TOR",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.347206,
"previous_home_win_probability": 0.343354,
"home_probability_delta": 0.003852,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_KC@HOU",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492371,
"previous_home_win_probability": 0.492168,
"home_probability_delta": 0.000203,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_LAD@CIN",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.322883,
"previous_home_win_probability": 0.318897,
"home_probability_delta": 0.003986,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_MIA@ARI",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.435826,
"previous_home_win_probability": 0.435283,
"home_probability_delta": 0.000543,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_MIL@PIT",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.34016,
"previous_home_win_probability": 0.336153,
"home_probability_delta": 0.004007,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_NYY@MIN",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.328454,
"previous_home_win_probability": 0.324223,
"home_probability_delta": 0.004231,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_OAK@TB",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.76686,
"previous_home_win_probability": 0.7726,
"home_probability_delta": -0.00574,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_PHI@WAS",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.474076,
"previous_home_win_probability": 0.47403,
"home_probability_delta": 4.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SD@COL",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.422542,
"previous_home_win_probability": 0.420568,
"home_probability_delta": 0.001974,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SEA@LAA",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492781,
"previous_home_win_probability": 0.492588,
"home_probability_delta": 0.000193,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SF@STL",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.48003,
"previous_home_win_probability": 0.479498,
"home_probability_delta": 0.000532,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_BOS@TEX",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.563326,
"previous_home_win_probability": 0.563889,
"home_probability_delta": -0.000563,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_DET@CHW",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.419311,
"previous_home_win_probability": 0.41719,
"home_probability_delta": 0.002121,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_KC@HOU",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540874,
"previous_home_win_probability": 0.540935,
"home_probability_delta": -6.1e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_LAD@CIN",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.289359,
"previous_home_win_probability": 0.284378,
"home_probability_delta": 0.004981,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_MIL@PIT",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.345684,
"previous_home_win_probability": 0.341797,
"home_probability_delta": 0.003887,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_MIN@LAA",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.477189,
"previous_home_win_probability": 0.477155,
"home_probability_delta": 3.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_OAK@TB",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.650236,
"previous_home_win_probability": 0.654022,
"home_probability_delta": -0.003786,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_PHI@NYM",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.561153,
"previous_home_win_probability": 0.56277,
"home_probability_delta": -0.001617,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_SD@COL",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.302781,
"previous_home_win_probability": 0.300726,
"home_probability_delta": 0.002055,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-f4c3ec3952acc919",
"proposed_at_utc": "2026-09-18T09:05:32.063728+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly from 1.95 to 2.05 may further reduce persistent margin compression and improve run-model error, supported by the regressing margin bias, the run-model loss incidence, and prior variance increases that worked. The shadow gate should detect any degradation in Brier score or calibration.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"new_value": 2.05,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-18T09:05:40.012512+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260917",
"applied_at_utc": "2026-09-18T09:05:40.012512+00:00",
"candidate_id": "candidate-f4c3ec3952acc919",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"new_value": 2.05
}
],
"config_before": "candidate-57e651c7f36832cf",
"config_after": "candidate-f4c3ec3952acc919",
"metric_baseline_at_apply": {
"brier_score": 0.242458,
"accuracy": 0.5917,
"team_run_mae": 2.5333,
"total_run_mae": 3.5333,
"calibration_error": 0.0728,
"starter_er_mae": 1.7326,
"starter_outs_mae": 3.2984
},
"status": "applied_to_production",
"previous_config_id": "candidate-57e651c7f36832cf",
"new_config_id": "candidate-f4c3ec3952acc919",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"applied_value": 2.05,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.242458,
"latest_window": 0.244879,
"delta": 0.002421,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5917,
"latest_window": 0.6195,
"delta": 0.0278,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5333,
"latest_window": 2.4159,
"delta": -0.1174,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.5333,
"latest_window": 3.6637,
"delta": 0.1304,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0728,
"latest_window": 0.1324,
"delta": 0.0596,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7326,
"latest_window": 1.6226,
"delta": -0.11,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.2984,
"latest_window": 4.184,
"delta": 0.8856,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 46,
"paired_previous_config_predictions": 46,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260919_BOS@TB",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540412,
"previous_home_win_probability": 0.540497,
"home_probability_delta": -8.5e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_CHC@CIN",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.316303,
"previous_home_win_probability": 0.31204,
"home_probability_delta": 0.004263,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_DET@CHW",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.406854,
"previous_home_win_probability": 0.404584,
"home_probability_delta": 0.00227,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_KC@PIT",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548212,
"previous_home_win_probability": 0.549427,
"home_probability_delta": -0.001215,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIA@SD",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.693765,
"previous_home_win_probability": 0.698213,
"home_probability_delta": -0.004448,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIL@BAL",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546191,
"previous_home_win_probability": 0.546276,
"home_probability_delta": -8.5e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIN@LAA",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575247,
"previous_home_win_probability": 0.575749,
"home_probability_delta": -0.000502,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_NYY@ARI",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.288751,
"previous_home_win_probability": 0.28402,
"home_probability_delta": 0.004731,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_OAK@CLE",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.658901,
"previous_home_win_probability": 0.662685,
"home_probability_delta": -0.003784,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_PHI@NYM",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540286,
"previous_home_win_probability": 0.540372,
"home_probability_delta": -8.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_SEA@COL",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.278696,
"previous_home_win_probability": 0.274208,
"home_probability_delta": 0.004488,
"live_predicted_score": {
"away_runs": 9.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 9.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_SF@LAD",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.565131,
"previous_home_win_probability": 0.565691,
"home_probability_delta": -0.00056,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_TOR@TEX",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.611002,
"previous_home_win_probability": 0.613734,
"home_probability_delta": -0.002732,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_WAS@STL",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.44034,
"previous_home_win_probability": 0.438842,
"home_probability_delta": 0.001498,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_ATL@HOU",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.378061,
"previous_home_win_probability": 0.375079,
"home_probability_delta": 0.002982,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_BOS@TB",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.571587,
"previous_home_win_probability": 0.572091,
"home_probability_delta": -0.000504,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_CHC@CIN",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.292579,
"previous_home_win_probability": 0.287903,
"home_probability_delta": 0.004676,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_DET@CHW",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.403591,
"previous_home_win_probability": 0.401256,
"home_probability_delta": 0.002335,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_KC@PIT",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.60076,
"previous_home_win_probability": 0.602022,
"home_probability_delta": -0.001262,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIA@SD",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.668942,
"previous_home_win_probability": 0.672912,
"home_probability_delta": -0.00397,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIL@BAL",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.37078,
"previous_home_win_probability": 0.36965,
"home_probability_delta": 0.00113,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIN@LAA",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.50745,
"previous_home_win_probability": 0.507638,
"home_probability_delta": -0.000188,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_NYY@ARI",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.447197,
"previous_home_win_probability": 0.4459,
"home_probability_delta": 0.001297,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_OAK@CLE",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.708446,
"previous_home_win_probability": 0.710487,
"home_probability_delta": -0.002041,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_PHI@NYM",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.523977,
"previous_home_win_probability": 0.524204,
"home_probability_delta": -0.000227,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_SEA@COL",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.39974,
"previous_home_win_probability": 0.397363,
"home_probability_delta": 0.002377,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_SF@LAD",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.613015,
"previous_home_win_probability": 0.614733,
"home_probability_delta": -0.001718,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_TOR@TEX",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.55937,
"previous_home_win_probability": 0.560861,
"home_probability_delta": -0.001491,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_WAS@STL",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.478382,
"previous_home_win_probability": 0.477836,
"home_probability_delta": 0.000546,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260921_WAS@DET",
"date": "20260921",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.576597,
"previous_home_win_probability": 0.578511,
"home_probability_delta": -0.001914,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-982561b127534866",
"proposed_at_utc": "2026-09-21T09:05:52.468019+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly from 2.05 to 2.15 may further reduce under-dispersed run margins and improve team-run error, supported by the leading run-model loss incidence, current team and total run MAE regressions, deep-slate evidence that wider tails helped two loss cases versus one hurt case, and the prior sequence of successful variance increases. The shadow gate should detect degradation in Brier score, calibration, or run guardrails.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"new_value": 2.15,
"expected_metric": "team_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.team_run_mae",
"metric.total_run_mae",
"errors.miss_reasons",
"pipeline.largest_team_run_regression",
"metric.brier_score"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-21T09:06:01.333346+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260920",
"applied_at_utc": "2026-09-21T09:06:01.333346+00:00",
"candidate_id": "candidate-982561b127534866",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"new_value": 2.15
}
],
"config_before": "candidate-f4c3ec3952acc919",
"config_after": "candidate-982561b127534866",
"metric_baseline_at_apply": {
"brier_score": 0.239314,
"accuracy": 0.6,
"team_run_mae": 2.5042,
"total_run_mae": 3.3583,
"calibration_error": 0.0885,
"starter_er_mae": 1.6855,
"starter_outs_mae": 3.4839
},
"status": "applied_to_production",
"previous_config_id": "candidate-f4c3ec3952acc919",
"new_config_id": "candidate-982561b127534866",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"applied_value": 2.15,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.239314,
"latest_window": 0.244879,
"delta": 0.005565,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6,
"latest_window": 0.6195,
"delta": 0.0195,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5042,
"latest_window": 2.4159,
"delta": -0.0883,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.3583,
"latest_window": 3.6637,
"delta": 0.3054,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0885,
"latest_window": 0.1324,
"delta": 0.0439,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6855,
"latest_window": 1.6226,
"delta": -0.0629,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.4839,
"latest_window": 4.184,
"delta": 0.7001,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 33,
"paired_previous_config_predictions": 33,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260922_CHW@KC",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492724,
"previous_home_win_probability": 0.492548,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_CIN@ATL",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.677436,
"previous_home_win_probability": 0.68125,
"home_probability_delta": -0.003814,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_CLE@BOS",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492724,
"previous_home_win_probability": 0.492548,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_HOU@SEA",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.640864,
"previous_home_win_probability": 0.642242,
"home_probability_delta": -0.001378,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_LAA@OAK",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.439751,
"previous_home_win_probability": 0.438311,
"home_probability_delta": 0.00144,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIA@CHC",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.650071,
"previous_home_win_probability": 0.652402,
"home_probability_delta": -0.002331,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIL@PHI",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.323223,
"previous_home_win_probability": 0.319274,
"home_probability_delta": 0.003949,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIN@SF",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.481856,
"previous_home_win_probability": 0.481794,
"home_probability_delta": 6.2e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_NYM@TEX",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.600919,
"previous_home_win_probability": 0.603295,
"home_probability_delta": -0.002376,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_SD@LAD",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.564073,
"previous_home_win_probability": 0.564152,
"home_probability_delta": -7.9e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_STL@PIT",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.553511,
"previous_home_win_probability": 0.553984,
"home_probability_delta": -0.000473,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_TB@NYY",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548329,
"previous_home_win_probability": 0.548407,
"home_probability_delta": -7.8e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_TB@NYY_2",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.52856,
"previous_home_win_probability": 0.528594,
"home_probability_delta": -3.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_WAS@DET",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583452,
"previous_home_win_probability": 0.584738,
"home_probability_delta": -0.001286,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_ARI@COL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.417476,
"previous_home_win_probability": 0.415569,
"home_probability_delta": 0.001907,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CHW@KC",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.387014,
"previous_home_win_probability": 0.385507,
"home_probability_delta": 0.001507,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CIN@ATL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.611439,
"previous_home_win_probability": 0.61287,
"home_probability_delta": -0.001431,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CLE@BOS",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_HOU@SEA",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.521174,
"previous_home_win_probability": 0.521227,
"home_probability_delta": -5.3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_LAA@OAK",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.421923,
"previous_home_win_probability": 0.420068,
"home_probability_delta": 0.001855,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIA@CHC",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.568568,
"previous_home_win_probability": 0.569269,
"home_probability_delta": -0.000701,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIL@PHI",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.358239,
"previous_home_win_probability": 0.354986,
"home_probability_delta": 0.003253,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIN@SF",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.484623,
"previous_home_win_probability": 0.484579,
"home_probability_delta": 4.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_NYM@TEX",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.404574,
"previous_home_win_probability": 0.403698,
"home_probability_delta": 0.000876,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_SD@LAD",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54136,
"previous_home_win_probability": 0.541567,
"home_probability_delta": -0.000207,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_STL@PIT",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.577526,
"previous_home_win_probability": 0.57864,
"home_probability_delta": -0.001114,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TB@NYY",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TOR@BAL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507287,
"previous_home_win_probability": 0.507463,
"home_probability_delta": -0.000176,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TOR@BAL_2",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.479819,
"previous_home_win_probability": 0.479757,
"home_probability_delta": 6.2e-05,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_WAS@DET",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-c1d5650d9262b3dc",
"proposed_at_utc": "2026-09-24T09:06:53.755755+00:00",
"provider": "openai",
"hypothesis": "Lowering the default confidence cap modestly should reduce persistent overconfidence in the 0.50-0.55 and 0.60-0.65 buckets and improve winner calibration and Brier score, while the shadow gate protects against worsening the underconfident 0.55-0.60 bucket.",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"new_value": 0.56,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.50-0.55",
"calibration.bucket.0.60-0.65",
"metric.calibration_error",
"metric.brier_score",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "enhanced_shadow"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-24T09:07:04.378558+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260923",
"applied_at_utc": "2026-09-24T09:07:04.378558+00:00",
"candidate_id": "candidate-c1d5650d9262b3dc",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"new_value": 0.56
}
],
"config_before": "candidate-982561b127534866",
"config_after": "candidate-c1d5650d9262b3dc",
"metric_baseline_at_apply": {
"brier_score": 0.244247,
"accuracy": 0.5546,
"team_run_mae": 2.5168,
"total_run_mae": 3.3697,
"calibration_error": 0.101,
"starter_er_mae": 1.756,
"starter_outs_mae": 3.572
},
"status": "applied_to_production",
"previous_config_id": "candidate-982561b127534866",
"new_config_id": "candidate-c1d5650d9262b3dc",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"applied_value": 0.56,
"current_live_value": 0.56,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.244247,
"latest_window": 0.244879,
"delta": 0.000632,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5546,
"latest_window": 0.6195,
"delta": 0.0649,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5168,
"latest_window": 2.4159,
"delta": -0.1009,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.3697,
"latest_window": 3.6637,
"delta": 0.294,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.101,
"latest_window": 0.1324,
"delta": 0.0314,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.756,
"latest_window": 1.6226,
"delta": -0.1334,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.572,
"latest_window": 4.184,
"delta": 0.612,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 42,
"paired_previous_config_predictions": 42,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260925_ARI@SD",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492715,
"previous_home_win_probability": 0.492715,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_ATL@MIA",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.452344,
"previous_home_win_probability": 0.452344,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_BAL@NYY",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.502563,
"previous_home_win_probability": 0.502563,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_BAL@NYY_2",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.531425,
"previous_home_win_probability": 0.531425,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CHC@BOS",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CHC@BOS_2",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.567062,
"previous_home_win_probability": 0.567062,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CIN@TOR",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.635849,
"previous_home_win_probability": 0.635849,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CLE@KC",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.404233,
"previous_home_win_probability": 0.404233,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_COL@CHW",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.723012,
"previous_home_win_probability": 0.723012,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_HOU@OAK",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.445431,
"previous_home_win_probability": 0.445431,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_LAA@SEA",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.475064,
"previous_home_win_probability": 0.475064,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_LAD@SF",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.422253,
"previous_home_win_probability": 0.422253,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_NYM@WAS",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.517636,
"previous_home_win_probability": 0.517636,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_PIT@DET",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.494293,
"previous_home_win_probability": 0.494293,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_STL@MIL",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.558508,
"previous_home_win_probability": 0.558508,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_TB@PHI",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540856,
"previous_home_win_probability": 0.540856,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_TEX@MIN",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54972,
"previous_home_win_probability": 0.54972,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_ARI@SD",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.452602,
"previous_home_win_probability": 0.452602,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_ATL@MIA",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.429694,
"previous_home_win_probability": 0.429694,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_CIN@TOR",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.619523,
"previous_home_win_probability": 0.619523,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_CLE@KC",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.412303,
"previous_home_win_probability": 0.412303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_COL@CHW",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.697769,
"previous_home_win_probability": 0.697769,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_HOU@OAK",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.468312,
"previous_home_win_probability": 0.468312,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_LAA@SEA",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.524943,
"previous_home_win_probability": 0.524943,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_LAD@SF",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.437089,
"previous_home_win_probability": 0.437089,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_NYM@WAS",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.508915,
"previous_home_win_probability": 0.508915,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_PIT@DET",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.484309,
"previous_home_win_probability": 0.484309,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_STL@MIL",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.549057,
"previous_home_win_probability": 0.549057,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_TB@PHI",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.392435,
"previous_home_win_probability": 0.392435,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_TEX@MIN",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.511743,
"previous_home_win_probability": 0.511743,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-8133e99fc8d4e4c7",
"proposed_at_utc": "2026-09-27T09:06:54.240008+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly from 2.15 to 2.25 should reduce persistent run-margin compression and improve total-run error. This extends a sequence of previously successful variance increases and targets the currently regressing run-model metrics, while the shadow gate protects against degradation in Brier score, calibration, and run-error guardrails.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"new_value": 2.25,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-27T09:07:01.435173+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260926",
"applied_at_utc": "2026-09-27T09:07:01.435173+00:00",
"candidate_id": "candidate-8133e99fc8d4e4c7",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"new_value": 2.25
}
],
"config_before": "candidate-c1d5650d9262b3dc",
"config_after": "candidate-8133e99fc8d4e4c7",
"metric_baseline_at_apply": {
"brier_score": 0.241266,
"accuracy": 0.5932,
"team_run_mae": 2.6314,
"total_run_mae": 3.8559,
"calibration_error": 0.0876,
"starter_er_mae": 1.7895,
"starter_outs_mae": 3.9123
},
"status": "applied_to_production",
"previous_config_id": "candidate-c1d5650d9262b3dc",
"new_config_id": "candidate-8133e99fc8d4e4c7",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"applied_value": 2.25,
"current_live_value": 2.25,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.241266,
"latest_window": 0.244879,
"delta": 0.003613,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5932,
"latest_window": 0.6195,
"delta": 0.0263,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.6314,
"latest_window": 2.4159,
"delta": -0.2155,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.8559,
"latest_window": 3.6637,
"delta": -0.1922,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0876,
"latest_window": 0.1324,
"delta": 0.0448,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7895,
"latest_window": 1.6226,
"delta": -0.1669,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.9123,
"latest_window": 4.184,
"delta": 0.2717,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 33,
"paired_previous_config_predictions": 31,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260927_CIN@TOR",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.520053,
"previous_home_win_probability": 0.520123,
"home_probability_delta": -7e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_CLE@KC",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.339536,
"previous_home_win_probability": 0.33608,
"home_probability_delta": 0.003456,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_COL@CHW",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.674495,
"previous_home_win_probability": 0.678204,
"home_probability_delta": -0.003709,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_HOU@OAK",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.354995,
"previous_home_win_probability": 0.352773,
"home_probability_delta": 0.002222,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_LAA@SEA",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.584837,
"previous_home_win_probability": 0.585876,
"home_probability_delta": -0.001039,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_LAD@SF",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.393554,
"previous_home_win_probability": 0.392458,
"home_probability_delta": 0.001096,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_NYM@WAS",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.46405,
"previous_home_win_probability": 0.463574,
"home_probability_delta": 0.000476,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_PIT@DET",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.494719,
"previous_home_win_probability": 0.494689,
"home_probability_delta": 3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_STL@MIL",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.631405,
"previous_home_win_probability": 0.632324,
"home_probability_delta": -0.000919,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_TB@PHI",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411012,
"previous_home_win_probability": 0.409007,
"home_probability_delta": 0.002005,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_TEX@MIN",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.483432,
"previous_home_win_probability": 0.483358,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_BOS@NYY",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.555379,
"previous_home_win_probability": 0.555452,
"home_probability_delta": -7.3e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_CHC@SD",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.510929,
"previous_home_win_probability": 0.511003,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_CHW@HOU",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.448712,
"previous_home_win_probability": 0.448639,
"home_probability_delta": 7.3e-05,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_PHI@ATL",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507466,
"previous_home_win_probability": 0.50754,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_BOS@NYY",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.562176,
"previous_home_win_probability": 0.562249,
"home_probability_delta": -7.3e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_CHC@SD",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.521101,
"previous_home_win_probability": 0.521159,
"home_probability_delta": -5.8e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_CHW@HOU",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_PHI@ATL",
"date": "20260930",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.51775,
"previous_home_win_probability": 0.517824,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261001_PHI@ATL",
"date": "20261001",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.523278,
"previous_home_win_probability": 0.52334,
"home_probability_delta": -6.2e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_ATL@LAD",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.564626,
"previous_home_win_probability": 0.565064,
"home_probability_delta": -0.000438,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_CHW@CLE",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.472943,
"previous_home_win_probability": 0.472869,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_NYY@TB",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.525419,
"previous_home_win_probability": 0.525493,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_SD@MIL",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.576129,
"previous_home_win_probability": 0.576989,
"home_probability_delta": -0.00086,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261004_ATL@LAD",
"date": "20261004",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.539404,
"previous_home_win_probability": 0.539465,
"home_probability_delta": -6.1e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261004_SD@MIL",
"date": "20261004",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.574449,
"previous_home_win_probability": 0.575537,
"home_probability_delta": -0.001088,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261005_CHW@CLE",
"date": "20261005",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.525605,
"previous_home_win_probability": 0.525679,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261005_NYY@TB",
"date": "20261005",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45339,
"previous_home_win_probability": 0.453316,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261006_LAD@ATL",
"date": "20261006",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20261006_MIL@SD",
"date": "20261006",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-668e4305abca59bc",
"proposed_at_utc": "2026-10-07T09:21:29.935210+00:00",
"provider": "openai",
"hypothesis": "Reduce the maximum weight assigned to empirical confidence from 0.50 to 0.45 to increase shrinkage, as the escalated calibration-instability finding recommends. This bounded shadow test targets the regressing calibration error; the mixed calibration bucket results make the direction uncertain.",
"changes": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"new_value": 0.45,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.weighted_absolute_error",
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.65-0.70"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-10-07T09:21:41.221033+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20261006",
"applied_at_utc": "2026-10-07T09:21:41.221033+00:00",
"candidate_id": "candidate-668e4305abca59bc",
"changes": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"new_value": 0.45
}
],
"config_before": "candidate-8133e99fc8d4e4c7",
"config_after": "candidate-668e4305abca59bc",
"metric_baseline_at_apply": {
"brier_score": 0.245566,
"accuracy": 0.5877,
"team_run_mae": 2.4474,
"total_run_mae": 3.6316,
"calibration_error": 0.0992,
"starter_er_mae": 1.6795,
"starter_outs_mae": 4.2393
},
"status": "applied_to_production",
"previous_config_id": "candidate-8133e99fc8d4e4c7",
"new_config_id": "candidate-668e4305abca59bc",
"currently_active": true,
"live_parameter_checks": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"applied_value": 0.45,
"current_live_value": 0.45,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.245566,
"latest_window": 0.244879,
"delta": -0.000687,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5877,
"latest_window": 0.6195,
"delta": 0.0318,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4474,
"latest_window": 2.4159,
"delta": -0.0315,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.6316,
"latest_window": 3.6637,
"delta": 0.0321,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0992,
"latest_window": 0.1324,
"delta": 0.0332,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6795,
"latest_window": 1.6226,
"delta": -0.0569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 4.2393,
"latest_window": 4.184,
"delta": -0.0553,
"direction": "improved",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 7,
"paired_previous_config_predictions": 7,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20261007_CLE@CHW",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.451379,
"previous_home_win_probability": 0.451379,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_LAD@ATL",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.491557,
"previous_home_win_probability": 0.491557,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_MIL@SD",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.505,
"previous_home_win_probability": 0.505,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_TB@NYY",
"date": "20261007",
"outcome": "miss",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.566481,
"previous_home_win_probability": 0.566481,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261008_CLE@CHW",
"date": "20261008",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261010_CHW@CLE",
"date": "20261010",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.537156,
"previous_home_win_probability": 0.537156,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261011_LAD@MIL",
"date": "20261011",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548241,
"previous_home_win_probability": 0.548241,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
}
],
"safety": {
"production_mutated": false,
"automatic_promotion": false,
"manual_approval_required": true,
"data_directory_mutated": false,
"llm_has_file_or_command_authority": false
},
"change_history": [
{
"experiment_id": "candidate-c7e288f75d707709",
"proposed_at_utc": "2026-08-25T06:01:43.820174+00:00",
"provider": "gemini",
"hypothesis": "Increasing confidence.sparse_sample_max from 10 to 15 may improve calibration for sparsely sampled games, as indicated by the underconfidence in the 0.60-0.65 bucket and the overconfidence in the 0.80-1.00 bucket, while staying within the allowed bounds and daily delta.",
"changes": [
{
"parameter": "confidence.sparse_sample_max",
"old_value": 10,
"new_value": 12,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.80-1.00"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "reject",
"reason": "zero measured effect",
"decided_at_utc": "2026-08-26T22:29:59.797443+00:00",
"measured_effect": {
"evaluation_mode": "artifact_replay",
"coverage": {
"paired_games": 16,
"distinct_slates": 2
},
"failed_gates": [
"minimum_paired_games",
"minimum_distinct_slates"
],
"metric_effects": {
"brier_score": {
"champion": 0.297161,
"candidate": 0.297161,
"difference": 0.0,
"improvement": 0.0,
"candidate_better": null
},
"accuracy": {
"champion": 0.3125,
"candidate": 0.3125,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"team_run_mae": {
"champion": 2.5625,
"candidate": 2.5625,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"total_run_mae": {
"champion": 4.125,
"candidate": 4.125,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"calibration_error": {
"champion": 0.28026444,
"candidate": 0.28026444,
"difference": 0.0,
"improvement": null,
"candidate_better": null
}
}
},
"outcome": "DID NOT WORK: rejected (zero measured effect). Measured over 16 settled games: brier_score flat (0.0); accuracy flat (0.0); calibration_error flat (0.0); team_run_mae flat (0.0); total_run_mae flat (0.0).",
"worked": false
},
{
"experiment_id": "candidate-31a39524087cf556",
"proposed_at_utc": "2026-08-27T06:02:02.124992+00:00",
"provider": "openai",
"hypothesis": "Reducing confidence.moderate_cap from 0.6 to 0.58 may improve overall calibration, as suggested by the errors in observed hit rates in moderate confidence buckets.",
"changes": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"new_value": 0.58,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.55-0.60",
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.65-0.70"
],
"risk_tier": "low",
"evaluation_mode": "enhanced_shadow"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-08-29T06:02:24.658142+00:00",
"measured_effect": {
"evaluation_mode": "enhanced_shadow",
"coverage": {
"paired_games": 22,
"distinct_slates": 2
},
"failed_gates": [
"minimum_paired_games",
"minimum_distinct_slates"
],
"metric_effects": {
"brier_score": {
"champion": 0.25333323,
"candidate": 0.25333323,
"difference": 0.0,
"improvement": 0.0,
"candidate_better": null
},
"accuracy": {
"champion": 0.54545455,
"candidate": 0.54545455,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"team_run_mae": {
"champion": 2.52272727,
"candidate": 2.52272727,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"total_run_mae": {
"champion": 3.40909091,
"candidate": 3.40909091,
"difference": 0.0,
"improvement": null,
"candidate_better": null
},
"calibration_error": {
"champion": 0.10832609,
"candidate": 0.10832609,
"difference": 0.0,
"improvement": null,
"candidate_better": null
}
}
},
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260828",
"applied_at_utc": "2026-08-29T06:02:24.658142+00:00",
"candidate_id": "candidate-31a39524087cf556",
"changes": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"new_value": 0.58
}
],
"config_before": "default-v1",
"config_after": "candidate-31a39524087cf556",
"metric_baseline_at_apply": {
"brier_score": 0.241798,
"accuracy": 0.5833,
"team_run_mae": 2.4306,
"total_run_mae": 3.713,
"calibration_error": 0.1004,
"starter_er_mae": 1.7854,
"starter_outs_mae": 3.1073
},
"status": "applied_to_production",
"previous_config_id": "default-v1",
"new_config_id": "candidate-31a39524087cf556",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"applied_value": 0.58,
"current_live_value": 0.58,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.241798,
"latest_window": 0.244879,
"delta": 0.003081,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5833,
"latest_window": 0.6195,
"delta": 0.0362,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4306,
"latest_window": 2.4159,
"delta": -0.0147,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.713,
"latest_window": 3.6637,
"delta": -0.0493,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.1004,
"latest_window": 0.1324,
"delta": 0.032,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7854,
"latest_window": 1.6226,
"delta": -0.1628,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.1073,
"latest_window": 4.184,
"delta": 1.0767,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 66,
"paired_previous_config_predictions": 43,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260831_NYM@TB",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.6655,
"previous_home_win_probability": 0.6655,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_NYY@LAA",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411987,
"previous_home_win_probability": 0.411987,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_OAK@TEX",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546614,
"previous_home_win_probability": 0.546614,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_PHI@ARI",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.453386,
"previous_home_win_probability": 0.453386,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SD@CIN",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.326497,
"previous_home_win_probability": 0.326497,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SEA@BOS",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583303,
"previous_home_win_probability": 0.583303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SF@ATL",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546614,
"previous_home_win_probability": 0.546614,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260901_ATL@WAS",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_BAL@COL",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_CHW@HOU",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_DET@MIN",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_MIA@KC",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_MIL@CHC",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 8.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_NYM@TB",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_NYY@LAA",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_OAK@TEX",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_PHI@ARI",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SD@CIN",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SEA@BOS",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SF@PIT",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_STL@LAD",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_TOR@CLE",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_ATL@WAS",
"date": "20260902",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_BAL@COL",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_NYM@TB",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_OAK@TEX",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_PHI@ARI",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SD@CIN",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SEA@BOS",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SF@PIT",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-beeea24799c2c165",
"proposed_at_utc": "2026-09-04T06:03:08.215029+00:00",
"provider": "openai",
"hypothesis": "Lowering the default confidence cap modestly should reduce overconfidence in the 0.55-0.70 buckets and improve the primary Brier score, while limiting exposure to the recent high-conviction miss pattern.",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"new_value": 0.58,
"expected_metric": "brier_score",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.55-0.60",
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.65-0.70",
"metric.brier_score"
],
"risk_tier": "low",
"evaluation_mode": "enhanced_shadow"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-04T06:03:17.089072+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260903",
"applied_at_utc": "2026-09-04T06:03:17.089072+00:00",
"candidate_id": "candidate-beeea24799c2c165",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"new_value": 0.58
}
],
"config_before": "candidate-31a39524087cf556-registry-c5dd20fd32e9",
"config_after": "candidate-beeea24799c2c165",
"metric_baseline_at_apply": {
"brier_score": 0.252004,
"accuracy": 0.55,
"team_run_mae": 2.7667,
"total_run_mae": 3.85,
"calibration_error": 0.0989,
"starter_er_mae": 1.9192,
"starter_outs_mae": 3.0192
},
"status": "applied_to_production",
"previous_config_id": "candidate-31a39524087cf556-registry-c5dd20fd32e9",
"new_config_id": "candidate-beeea24799c2c165",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"applied_value": 0.58,
"current_live_value": 0.56,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.252004,
"latest_window": 0.244879,
"delta": -0.007125,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.55,
"latest_window": 0.6195,
"delta": 0.0695,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.7667,
"latest_window": 2.4159,
"delta": -0.3508,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.85,
"latest_window": 3.6637,
"delta": -0.1863,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0989,
"latest_window": 0.1324,
"delta": 0.0335,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.9192,
"latest_window": 1.6226,
"delta": -0.2966,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.0192,
"latest_window": 4.184,
"delta": 1.1648,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 46,
"paired_previous_config_predictions": 46,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260905_ARI@HOU",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.476266,
"previous_home_win_probability": 0.476266,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_ATL@PHI",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.455319,
"previous_home_win_probability": 0.455319,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_BOS@BAL",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.455286,
"previous_home_win_probability": 0.455286,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_CHC@MIA",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.26047,
"previous_home_win_probability": 0.26047,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_DET@CLE",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575318,
"previous_home_win_probability": 0.575318,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_LAA@PIT",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.635729,
"previous_home_win_probability": 0.635729,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_MIL@CIN",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.287611,
"previous_home_win_probability": 0.287611,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_MIN@CHW",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45369,
"previous_home_win_probability": 0.45369,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_NYY@SD",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.432863,
"previous_home_win_probability": 0.432863,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_OAK@SEA",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54631,
"previous_home_win_probability": 0.54631,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_SF@NYM",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.527739,
"previous_home_win_probability": 0.527739,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_STL@COL",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.478775,
"previous_home_win_probability": 0.478775,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_TB@TEX",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45369,
"previous_home_win_probability": 0.45369,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_TOR@KC",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.357403,
"previous_home_win_probability": 0.357403,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_WAS@LAD",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.586389,
"previous_home_win_probability": 0.586389,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_ARI@HOU",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.456108,
"previous_home_win_probability": 0.456108,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_ATL@PHI",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.559583,
"previous_home_win_probability": 0.559583,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_BOS@BAL",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.43182,
"previous_home_win_probability": 0.43182,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_CHC@MIA",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.328844,
"previous_home_win_probability": 0.328844,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_DET@CLE",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.528092,
"previous_home_win_probability": 0.528092,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_LAA@PIT",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.585076,
"previous_home_win_probability": 0.585076,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_MIL@CIN",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.374303,
"previous_home_win_probability": 0.374303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_MIN@CHW",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583263,
"previous_home_win_probability": 0.583263,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_NYY@SD",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.450638,
"previous_home_win_probability": 0.450638,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_OAK@SEA",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.561176,
"previous_home_win_probability": 0.561176,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_SF@NYM",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.51921,
"previous_home_win_probability": 0.51921,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_STL@COL",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.417854,
"previous_home_win_probability": 0.417854,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_TB@TEX",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.462085,
"previous_home_win_probability": 0.462085,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_TOR@KC",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.431542,
"previous_home_win_probability": 0.431542,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_WAS@LAD",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.577206,
"previous_home_win_probability": 0.577206,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-11bc4bc2dfc7264a",
"proposed_at_utc": "2026-09-07T06:03:40.049218+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly should reduce under-dispersed run margins and improve total-run error, while the shadow gate limits risk to winner calibration and run-model guardrails.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"new_value": 1.75,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-07T06:03:53.452273+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260906",
"applied_at_utc": "2026-09-07T06:03:53.452273+00:00",
"candidate_id": "candidate-11bc4bc2dfc7264a",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"new_value": 1.75
}
],
"config_before": "candidate-beeea24799c2c165",
"config_after": "candidate-11bc4bc2dfc7264a",
"metric_baseline_at_apply": {
"brier_score": 0.2509,
"accuracy": 0.5583,
"team_run_mae": 2.6083,
"total_run_mae": 3.65,
"calibration_error": 0.064,
"starter_er_mae": 1.9795,
"starter_outs_mae": 3.0123
},
"status": "applied_to_production",
"previous_config_id": "candidate-beeea24799c2c165",
"new_config_id": "candidate-11bc4bc2dfc7264a",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"applied_value": 1.75,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.2509,
"latest_window": 0.244879,
"delta": -0.006021,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5583,
"latest_window": 0.6195,
"delta": 0.0612,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.6083,
"latest_window": 2.4159,
"delta": -0.1924,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.65,
"latest_window": 3.6637,
"delta": 0.0137,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.064,
"latest_window": 0.1324,
"delta": 0.0684,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.9795,
"latest_window": 1.6226,
"delta": -0.3569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.0123,
"latest_window": 4.184,
"delta": 1.1717,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 26,
"paired_previous_config_predictions": 26,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260907_ARI@KC",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.579623,
"previous_home_win_probability": 0.581922,
"home_probability_delta": -0.002299,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_ATL@PHI",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.556519,
"previous_home_win_probability": 0.556626,
"home_probability_delta": -0.000107,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CHC@MIL",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.508021,
"previous_home_win_probability": 0.50826,
"home_probability_delta": -0.000239,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CIN@LAD",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575111,
"previous_home_win_probability": 0.577324,
"home_probability_delta": -0.002213,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CLE@BAL",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.510748,
"previous_home_win_probability": 0.510857,
"home_probability_delta": -0.000109,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_LAA@BOS",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.653937,
"previous_home_win_probability": 0.658266,
"home_probability_delta": -0.004329,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_MIN@DET",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.432458,
"previous_home_win_probability": 0.430463,
"home_probability_delta": 0.001995,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_NYM@MIA",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.524436,
"previous_home_win_probability": 0.524499,
"home_probability_delta": -6.3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_STL@SF",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.373236,
"previous_home_win_probability": 0.369592,
"home_probability_delta": 0.003644,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_TOR@OAK",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.300442,
"previous_home_win_probability": 0.295149,
"home_probability_delta": 0.005293,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_WAS@SD",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.541044,
"previous_home_win_probability": 0.541104,
"home_probability_delta": -6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_ARI@KC",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.366092,
"previous_home_win_probability": 0.364585,
"home_probability_delta": 0.001507,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CHC@MIL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.581938,
"previous_home_win_probability": 0.582044,
"home_probability_delta": -0.000106,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CIN@LAD",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.671836,
"previous_home_win_probability": 0.675324,
"home_probability_delta": -0.003488,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CLE@BAL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492884,
"previous_home_win_probability": 0.492672,
"home_probability_delta": 0.000212,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_COL@NYY",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.644809,
"previous_home_win_probability": 0.647495,
"home_probability_delta": -0.002686,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_HOU@PHI",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.436918,
"previous_home_win_probability": 0.435067,
"home_probability_delta": 0.001851,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_LAA@BOS",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.574016,
"previous_home_win_probability": 0.576192,
"home_probability_delta": -0.002176,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_MIN@DET",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.582467,
"previous_home_win_probability": 0.583089,
"home_probability_delta": -0.000622,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_NYM@MIA",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.453392,
"previous_home_win_probability": 0.453262,
"home_probability_delta": 0.00013,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_PIT@CHW",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.522678,
"previous_home_win_probability": 0.522785,
"home_probability_delta": -0.000107,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_STL@SF",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454963,
"previous_home_win_probability": 0.453634,
"home_probability_delta": 0.001329,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TB@ATL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.474696,
"previous_home_win_probability": 0.474417,
"home_probability_delta": 0.000279,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TEX@SEA",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.465664,
"previous_home_win_probability": 0.464641,
"home_probability_delta": 0.001023,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TOR@OAK",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.400365,
"previous_home_win_probability": 0.39841,
"home_probability_delta": 0.001955,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_WAS@SD",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.529136,
"previous_home_win_probability": 0.529245,
"home_probability_delta": -0.000109,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-ed18fee8af33cf7e",
"proposed_at_utc": "2026-09-12T09:04:27.150731+00:00",
"provider": "openai",
"hypothesis": "A further small increase in score variance should reduce persistent margin compression and improve run-model error, building on the previously promoted variance increase while keeping the change within the registered daily bound.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"new_value": 1.85,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-12T09:04:36.607786+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260911",
"applied_at_utc": "2026-09-12T09:04:36.607786+00:00",
"candidate_id": "candidate-ed18fee8af33cf7e",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"new_value": 1.85
}
],
"config_before": "candidate-11bc4bc2dfc7264a-registry-4c40ee6a3671",
"config_after": "candidate-ed18fee8af33cf7e",
"metric_baseline_at_apply": {
"brier_score": 0.242131,
"accuracy": 0.6,
"team_run_mae": 2.4417,
"total_run_mae": 3.7167,
"calibration_error": 0.0872,
"starter_er_mae": 1.8716,
"starter_outs_mae": 3.1284
},
"status": "applied_to_production",
"previous_config_id": "candidate-11bc4bc2dfc7264a-registry-4c40ee6a3671",
"new_config_id": "candidate-ed18fee8af33cf7e",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"applied_value": 1.85,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.242131,
"latest_window": 0.244879,
"delta": 0.002748,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6,
"latest_window": 0.6195,
"delta": 0.0195,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4417,
"latest_window": 2.4159,
"delta": -0.0258,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.7167,
"latest_window": 3.6637,
"delta": -0.053,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0872,
"latest_window": 0.1324,
"delta": 0.0452,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.8716,
"latest_window": 1.6226,
"delta": -0.249,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.1284,
"latest_window": 4.184,
"delta": 1.0556,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 40,
"paired_previous_config_predictions": 40,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260912_PHI@ATL",
"date": "20260912",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.493511,
"previous_home_win_probability": 0.493328,
"home_probability_delta": 0.000183,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_PIT@CHC",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.554666,
"previous_home_win_probability": 0.556195,
"home_probability_delta": -0.001529,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_SD@SF",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.496417,
"previous_home_win_probability": 0.496316,
"home_probability_delta": 0.000101,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_SEA@OAK",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.465434,
"previous_home_win_probability": 0.465334,
"home_probability_delta": 0.0001,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_TEX@ARI",
"date": "20260912",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.581582,
"previous_home_win_probability": 0.583173,
"home_probability_delta": -0.001591,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_BAL@TOR",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.534848,
"previous_home_win_probability": 0.534948,
"home_probability_delta": -0.0001,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CHW@STL",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.511703,
"previous_home_win_probability": 0.511749,
"home_probability_delta": -4.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CIN@MIL",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.735605,
"previous_home_win_probability": 0.741315,
"home_probability_delta": -0.00571,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CLE@MIN",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.563738,
"previous_home_win_probability": 0.563837,
"home_probability_delta": -9.9e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_COL@DET",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.646358,
"previous_home_win_probability": 0.649983,
"home_probability_delta": -0.003625,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_HOU@TB",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.527949,
"previous_home_win_probability": 0.528027,
"home_probability_delta": -7.8e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_KC@BOS",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.58576,
"previous_home_win_probability": 0.587159,
"home_probability_delta": -0.001399,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_LAA@WAS",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.604591,
"previous_home_win_probability": 0.606397,
"home_probability_delta": -0.001806,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_LAD@MIA",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.292502,
"previous_home_win_probability": 0.287288,
"home_probability_delta": 0.005214,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_NYM@NYY",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.588505,
"previous_home_win_probability": 0.589999,
"home_probability_delta": -0.001494,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_PHI@ATL",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.559569,
"previous_home_win_probability": 0.560163,
"home_probability_delta": -0.000594,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_PIT@CHC",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.526139,
"previous_home_win_probability": 0.526239,
"home_probability_delta": -0.0001,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_SD@SF",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454094,
"previous_home_win_probability": 0.453729,
"home_probability_delta": 0.000365,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_SEA@OAK",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411037,
"previous_home_win_probability": 0.409342,
"home_probability_delta": 0.001695,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_TEX@ARI",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492178,
"previous_home_win_probability": 0.491957,
"home_probability_delta": 0.000221,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_ATL@CHC",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.535036,
"previous_home_win_probability": 0.535203,
"home_probability_delta": -0.000167,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_BAL@NYM",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.627507,
"previous_home_win_probability": 0.63062,
"home_probability_delta": -0.003113,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_CHW@CLE",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507826,
"previous_home_win_probability": 0.508047,
"home_probability_delta": -0.000221,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_DET@TOR",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492174,
"previous_home_win_probability": 0.491953,
"home_probability_delta": 0.000221,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_LAD@CIN",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.27412,
"previous_home_win_probability": 0.268674,
"home_probability_delta": 0.005446,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_MIA@ARI",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.472665,
"previous_home_win_probability": 0.471904,
"home_probability_delta": 0.000761,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_NYY@MIN",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.355399,
"previous_home_win_probability": 0.351523,
"home_probability_delta": 0.003876,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SD@COL",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.336593,
"previous_home_win_probability": 0.333546,
"home_probability_delta": 0.003047,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SEA@LAA",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.538184,
"previous_home_win_probability": 0.538239,
"home_probability_delta": -5.5e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SF@STL",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507604,
"previous_home_win_probability": 0.507671,
"home_probability_delta": -6.7e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-57e651c7f36832cf",
"proposed_at_utc": "2026-09-15T09:04:57.841906+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly should reduce persistent run-margin compression and lower total-run error, building on two prior variance increases that worked and the current deep-slate evidence that wider tails helped the high-confidence BAL@NYM miss.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"new_value": 1.95,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-15T09:05:08.617033+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260914",
"applied_at_utc": "2026-09-15T09:05:08.617033+00:00",
"candidate_id": "candidate-57e651c7f36832cf",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"new_value": 1.95
}
],
"config_before": "candidate-ed18fee8af33cf7e",
"config_after": "candidate-57e651c7f36832cf",
"metric_baseline_at_apply": {
"brier_score": 0.24114,
"accuracy": 0.6333,
"team_run_mae": 2.5083,
"total_run_mae": 3.8167,
"calibration_error": 0.1244,
"starter_er_mae": 1.7778,
"starter_outs_mae": 3.2644
},
"status": "applied_to_production",
"previous_config_id": "candidate-ed18fee8af33cf7e",
"new_config_id": "candidate-57e651c7f36832cf",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"applied_value": 1.95,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.24114,
"latest_window": 0.244879,
"delta": 0.003739,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6333,
"latest_window": 0.6195,
"delta": -0.0138,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5083,
"latest_window": 2.4159,
"delta": -0.0924,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.8167,
"latest_window": 3.6637,
"delta": -0.153,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.1244,
"latest_window": 0.1324,
"delta": 0.008,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7778,
"latest_window": 1.6226,
"delta": -0.1552,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.2644,
"latest_window": 4.184,
"delta": 0.9196,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 39,
"paired_previous_config_predictions": 39,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260915_NYY@MIN",
"date": "20260915",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.347168,
"previous_home_win_probability": 0.345204,
"home_probability_delta": 0.001964,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_OAK@TB",
"date": "20260915",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.667434,
"previous_home_win_probability": 0.668988,
"home_probability_delta": -0.001554,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_PHI@WAS",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454124,
"previous_home_win_probability": 0.453895,
"home_probability_delta": 0.000229,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SD@COL",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.302515,
"previous_home_win_probability": 0.297761,
"home_probability_delta": 0.004754,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SEA@LAA",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.431377,
"previous_home_win_probability": 0.431105,
"home_probability_delta": 0.000272,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SF@STL",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.573518,
"previous_home_win_probability": 0.57406,
"home_probability_delta": -0.000542,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_ATL@CHC",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.56953,
"previous_home_win_probability": 0.569621,
"home_probability_delta": -9.1e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_BAL@NYM",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.567625,
"previous_home_win_probability": 0.568763,
"home_probability_delta": -0.001138,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_BOS@TEX",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.532791,
"previous_home_win_probability": 0.533043,
"home_probability_delta": -0.000252,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_CHW@CLE",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.578219,
"previous_home_win_probability": 0.579288,
"home_probability_delta": -0.001069,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_DET@TOR",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.347206,
"previous_home_win_probability": 0.343354,
"home_probability_delta": 0.003852,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_KC@HOU",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492371,
"previous_home_win_probability": 0.492168,
"home_probability_delta": 0.000203,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_LAD@CIN",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.322883,
"previous_home_win_probability": 0.318897,
"home_probability_delta": 0.003986,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_MIA@ARI",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.435826,
"previous_home_win_probability": 0.435283,
"home_probability_delta": 0.000543,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_MIL@PIT",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.34016,
"previous_home_win_probability": 0.336153,
"home_probability_delta": 0.004007,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_NYY@MIN",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.328454,
"previous_home_win_probability": 0.324223,
"home_probability_delta": 0.004231,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_OAK@TB",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.76686,
"previous_home_win_probability": 0.7726,
"home_probability_delta": -0.00574,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_PHI@WAS",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.474076,
"previous_home_win_probability": 0.47403,
"home_probability_delta": 4.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SD@COL",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.422542,
"previous_home_win_probability": 0.420568,
"home_probability_delta": 0.001974,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SEA@LAA",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492781,
"previous_home_win_probability": 0.492588,
"home_probability_delta": 0.000193,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SF@STL",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.48003,
"previous_home_win_probability": 0.479498,
"home_probability_delta": 0.000532,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_BOS@TEX",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.563326,
"previous_home_win_probability": 0.563889,
"home_probability_delta": -0.000563,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_DET@CHW",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.419311,
"previous_home_win_probability": 0.41719,
"home_probability_delta": 0.002121,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_KC@HOU",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540874,
"previous_home_win_probability": 0.540935,
"home_probability_delta": -6.1e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_LAD@CIN",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.289359,
"previous_home_win_probability": 0.284378,
"home_probability_delta": 0.004981,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_MIL@PIT",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.345684,
"previous_home_win_probability": 0.341797,
"home_probability_delta": 0.003887,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_MIN@LAA",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.477189,
"previous_home_win_probability": 0.477155,
"home_probability_delta": 3.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_OAK@TB",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.650236,
"previous_home_win_probability": 0.654022,
"home_probability_delta": -0.003786,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_PHI@NYM",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.561153,
"previous_home_win_probability": 0.56277,
"home_probability_delta": -0.001617,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_SD@COL",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.302781,
"previous_home_win_probability": 0.300726,
"home_probability_delta": 0.002055,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-f4c3ec3952acc919",
"proposed_at_utc": "2026-09-18T09:05:32.063728+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly from 1.95 to 2.05 may further reduce persistent margin compression and improve run-model error, supported by the regressing margin bias, the run-model loss incidence, and prior variance increases that worked. The shadow gate should detect any degradation in Brier score or calibration.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"new_value": 2.05,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-18T09:05:40.012512+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260917",
"applied_at_utc": "2026-09-18T09:05:40.012512+00:00",
"candidate_id": "candidate-f4c3ec3952acc919",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"new_value": 2.05
}
],
"config_before": "candidate-57e651c7f36832cf",
"config_after": "candidate-f4c3ec3952acc919",
"metric_baseline_at_apply": {
"brier_score": 0.242458,
"accuracy": 0.5917,
"team_run_mae": 2.5333,
"total_run_mae": 3.5333,
"calibration_error": 0.0728,
"starter_er_mae": 1.7326,
"starter_outs_mae": 3.2984
},
"status": "applied_to_production",
"previous_config_id": "candidate-57e651c7f36832cf",
"new_config_id": "candidate-f4c3ec3952acc919",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"applied_value": 2.05,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.242458,
"latest_window": 0.244879,
"delta": 0.002421,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5917,
"latest_window": 0.6195,
"delta": 0.0278,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5333,
"latest_window": 2.4159,
"delta": -0.1174,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.5333,
"latest_window": 3.6637,
"delta": 0.1304,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0728,
"latest_window": 0.1324,
"delta": 0.0596,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7326,
"latest_window": 1.6226,
"delta": -0.11,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.2984,
"latest_window": 4.184,
"delta": 0.8856,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 46,
"paired_previous_config_predictions": 46,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260919_BOS@TB",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540412,
"previous_home_win_probability": 0.540497,
"home_probability_delta": -8.5e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_CHC@CIN",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.316303,
"previous_home_win_probability": 0.31204,
"home_probability_delta": 0.004263,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_DET@CHW",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.406854,
"previous_home_win_probability": 0.404584,
"home_probability_delta": 0.00227,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_KC@PIT",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548212,
"previous_home_win_probability": 0.549427,
"home_probability_delta": -0.001215,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIA@SD",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.693765,
"previous_home_win_probability": 0.698213,
"home_probability_delta": -0.004448,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIL@BAL",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546191,
"previous_home_win_probability": 0.546276,
"home_probability_delta": -8.5e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIN@LAA",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575247,
"previous_home_win_probability": 0.575749,
"home_probability_delta": -0.000502,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_NYY@ARI",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.288751,
"previous_home_win_probability": 0.28402,
"home_probability_delta": 0.004731,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_OAK@CLE",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.658901,
"previous_home_win_probability": 0.662685,
"home_probability_delta": -0.003784,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_PHI@NYM",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540286,
"previous_home_win_probability": 0.540372,
"home_probability_delta": -8.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_SEA@COL",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.278696,
"previous_home_win_probability": 0.274208,
"home_probability_delta": 0.004488,
"live_predicted_score": {
"away_runs": 9.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 9.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_SF@LAD",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.565131,
"previous_home_win_probability": 0.565691,
"home_probability_delta": -0.00056,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_TOR@TEX",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.611002,
"previous_home_win_probability": 0.613734,
"home_probability_delta": -0.002732,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_WAS@STL",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.44034,
"previous_home_win_probability": 0.438842,
"home_probability_delta": 0.001498,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_ATL@HOU",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.378061,
"previous_home_win_probability": 0.375079,
"home_probability_delta": 0.002982,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_BOS@TB",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.571587,
"previous_home_win_probability": 0.572091,
"home_probability_delta": -0.000504,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_CHC@CIN",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.292579,
"previous_home_win_probability": 0.287903,
"home_probability_delta": 0.004676,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_DET@CHW",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.403591,
"previous_home_win_probability": 0.401256,
"home_probability_delta": 0.002335,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_KC@PIT",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.60076,
"previous_home_win_probability": 0.602022,
"home_probability_delta": -0.001262,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIA@SD",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.668942,
"previous_home_win_probability": 0.672912,
"home_probability_delta": -0.00397,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIL@BAL",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.37078,
"previous_home_win_probability": 0.36965,
"home_probability_delta": 0.00113,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIN@LAA",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.50745,
"previous_home_win_probability": 0.507638,
"home_probability_delta": -0.000188,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_NYY@ARI",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.447197,
"previous_home_win_probability": 0.4459,
"home_probability_delta": 0.001297,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_OAK@CLE",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.708446,
"previous_home_win_probability": 0.710487,
"home_probability_delta": -0.002041,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_PHI@NYM",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.523977,
"previous_home_win_probability": 0.524204,
"home_probability_delta": -0.000227,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_SEA@COL",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.39974,
"previous_home_win_probability": 0.397363,
"home_probability_delta": 0.002377,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_SF@LAD",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.613015,
"previous_home_win_probability": 0.614733,
"home_probability_delta": -0.001718,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_TOR@TEX",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.55937,
"previous_home_win_probability": 0.560861,
"home_probability_delta": -0.001491,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_WAS@STL",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.478382,
"previous_home_win_probability": 0.477836,
"home_probability_delta": 0.000546,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260921_WAS@DET",
"date": "20260921",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.576597,
"previous_home_win_probability": 0.578511,
"home_probability_delta": -0.001914,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-982561b127534866",
"proposed_at_utc": "2026-09-21T09:05:52.468019+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly from 2.05 to 2.15 may further reduce under-dispersed run margins and improve team-run error, supported by the leading run-model loss incidence, current team and total run MAE regressions, deep-slate evidence that wider tails helped two loss cases versus one hurt case, and the prior sequence of successful variance increases. The shadow gate should detect degradation in Brier score, calibration, or run guardrails.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"new_value": 2.15,
"expected_metric": "team_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.team_run_mae",
"metric.total_run_mae",
"errors.miss_reasons",
"pipeline.largest_team_run_regression",
"metric.brier_score"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-21T09:06:01.333346+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260920",
"applied_at_utc": "2026-09-21T09:06:01.333346+00:00",
"candidate_id": "candidate-982561b127534866",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"new_value": 2.15
}
],
"config_before": "candidate-f4c3ec3952acc919",
"config_after": "candidate-982561b127534866",
"metric_baseline_at_apply": {
"brier_score": 0.239314,
"accuracy": 0.6,
"team_run_mae": 2.5042,
"total_run_mae": 3.3583,
"calibration_error": 0.0885,
"starter_er_mae": 1.6855,
"starter_outs_mae": 3.4839
},
"status": "applied_to_production",
"previous_config_id": "candidate-f4c3ec3952acc919",
"new_config_id": "candidate-982561b127534866",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"applied_value": 2.15,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.239314,
"latest_window": 0.244879,
"delta": 0.005565,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6,
"latest_window": 0.6195,
"delta": 0.0195,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5042,
"latest_window": 2.4159,
"delta": -0.0883,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.3583,
"latest_window": 3.6637,
"delta": 0.3054,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0885,
"latest_window": 0.1324,
"delta": 0.0439,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6855,
"latest_window": 1.6226,
"delta": -0.0629,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.4839,
"latest_window": 4.184,
"delta": 0.7001,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 33,
"paired_previous_config_predictions": 33,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260922_CHW@KC",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492724,
"previous_home_win_probability": 0.492548,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_CIN@ATL",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.677436,
"previous_home_win_probability": 0.68125,
"home_probability_delta": -0.003814,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_CLE@BOS",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492724,
"previous_home_win_probability": 0.492548,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_HOU@SEA",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.640864,
"previous_home_win_probability": 0.642242,
"home_probability_delta": -0.001378,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_LAA@OAK",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.439751,
"previous_home_win_probability": 0.438311,
"home_probability_delta": 0.00144,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIA@CHC",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.650071,
"previous_home_win_probability": 0.652402,
"home_probability_delta": -0.002331,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIL@PHI",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.323223,
"previous_home_win_probability": 0.319274,
"home_probability_delta": 0.003949,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIN@SF",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.481856,
"previous_home_win_probability": 0.481794,
"home_probability_delta": 6.2e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_NYM@TEX",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.600919,
"previous_home_win_probability": 0.603295,
"home_probability_delta": -0.002376,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_SD@LAD",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.564073,
"previous_home_win_probability": 0.564152,
"home_probability_delta": -7.9e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_STL@PIT",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.553511,
"previous_home_win_probability": 0.553984,
"home_probability_delta": -0.000473,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_TB@NYY",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548329,
"previous_home_win_probability": 0.548407,
"home_probability_delta": -7.8e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_TB@NYY_2",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.52856,
"previous_home_win_probability": 0.528594,
"home_probability_delta": -3.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_WAS@DET",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583452,
"previous_home_win_probability": 0.584738,
"home_probability_delta": -0.001286,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_ARI@COL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.417476,
"previous_home_win_probability": 0.415569,
"home_probability_delta": 0.001907,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CHW@KC",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.387014,
"previous_home_win_probability": 0.385507,
"home_probability_delta": 0.001507,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CIN@ATL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.611439,
"previous_home_win_probability": 0.61287,
"home_probability_delta": -0.001431,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CLE@BOS",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_HOU@SEA",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.521174,
"previous_home_win_probability": 0.521227,
"home_probability_delta": -5.3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_LAA@OAK",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.421923,
"previous_home_win_probability": 0.420068,
"home_probability_delta": 0.001855,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIA@CHC",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.568568,
"previous_home_win_probability": 0.569269,
"home_probability_delta": -0.000701,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIL@PHI",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.358239,
"previous_home_win_probability": 0.354986,
"home_probability_delta": 0.003253,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIN@SF",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.484623,
"previous_home_win_probability": 0.484579,
"home_probability_delta": 4.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_NYM@TEX",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.404574,
"previous_home_win_probability": 0.403698,
"home_probability_delta": 0.000876,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_SD@LAD",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54136,
"previous_home_win_probability": 0.541567,
"home_probability_delta": -0.000207,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_STL@PIT",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.577526,
"previous_home_win_probability": 0.57864,
"home_probability_delta": -0.001114,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TB@NYY",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TOR@BAL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507287,
"previous_home_win_probability": 0.507463,
"home_probability_delta": -0.000176,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TOR@BAL_2",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.479819,
"previous_home_win_probability": 0.479757,
"home_probability_delta": 6.2e-05,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_WAS@DET",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-c1d5650d9262b3dc",
"proposed_at_utc": "2026-09-24T09:06:53.755755+00:00",
"provider": "openai",
"hypothesis": "Lowering the default confidence cap modestly should reduce persistent overconfidence in the 0.50-0.55 and 0.60-0.65 buckets and improve winner calibration and Brier score, while the shadow gate protects against worsening the underconfident 0.55-0.60 bucket.",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"new_value": 0.56,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.bucket.0.50-0.55",
"calibration.bucket.0.60-0.65",
"metric.calibration_error",
"metric.brier_score",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "enhanced_shadow"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-24T09:07:04.378558+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260923",
"applied_at_utc": "2026-09-24T09:07:04.378558+00:00",
"candidate_id": "candidate-c1d5650d9262b3dc",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"new_value": 0.56
}
],
"config_before": "candidate-982561b127534866",
"config_after": "candidate-c1d5650d9262b3dc",
"metric_baseline_at_apply": {
"brier_score": 0.244247,
"accuracy": 0.5546,
"team_run_mae": 2.5168,
"total_run_mae": 3.3697,
"calibration_error": 0.101,
"starter_er_mae": 1.756,
"starter_outs_mae": 3.572
},
"status": "applied_to_production",
"previous_config_id": "candidate-982561b127534866",
"new_config_id": "candidate-c1d5650d9262b3dc",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"applied_value": 0.56,
"current_live_value": 0.56,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.244247,
"latest_window": 0.244879,
"delta": 0.000632,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5546,
"latest_window": 0.6195,
"delta": 0.0649,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5168,
"latest_window": 2.4159,
"delta": -0.1009,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.3697,
"latest_window": 3.6637,
"delta": 0.294,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.101,
"latest_window": 0.1324,
"delta": 0.0314,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.756,
"latest_window": 1.6226,
"delta": -0.1334,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.572,
"latest_window": 4.184,
"delta": 0.612,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 42,
"paired_previous_config_predictions": 42,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260925_ARI@SD",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492715,
"previous_home_win_probability": 0.492715,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_ATL@MIA",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.452344,
"previous_home_win_probability": 0.452344,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_BAL@NYY",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.502563,
"previous_home_win_probability": 0.502563,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_BAL@NYY_2",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.531425,
"previous_home_win_probability": 0.531425,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CHC@BOS",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CHC@BOS_2",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.567062,
"previous_home_win_probability": 0.567062,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CIN@TOR",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.635849,
"previous_home_win_probability": 0.635849,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CLE@KC",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.404233,
"previous_home_win_probability": 0.404233,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_COL@CHW",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.723012,
"previous_home_win_probability": 0.723012,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_HOU@OAK",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.445431,
"previous_home_win_probability": 0.445431,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_LAA@SEA",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.475064,
"previous_home_win_probability": 0.475064,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_LAD@SF",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.422253,
"previous_home_win_probability": 0.422253,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_NYM@WAS",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.517636,
"previous_home_win_probability": 0.517636,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_PIT@DET",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.494293,
"previous_home_win_probability": 0.494293,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_STL@MIL",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.558508,
"previous_home_win_probability": 0.558508,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_TB@PHI",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540856,
"previous_home_win_probability": 0.540856,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_TEX@MIN",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54972,
"previous_home_win_probability": 0.54972,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_ARI@SD",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.452602,
"previous_home_win_probability": 0.452602,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_ATL@MIA",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.429694,
"previous_home_win_probability": 0.429694,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_CIN@TOR",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.619523,
"previous_home_win_probability": 0.619523,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_CLE@KC",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.412303,
"previous_home_win_probability": 0.412303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_COL@CHW",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.697769,
"previous_home_win_probability": 0.697769,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_HOU@OAK",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.468312,
"previous_home_win_probability": 0.468312,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_LAA@SEA",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.524943,
"previous_home_win_probability": 0.524943,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_LAD@SF",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.437089,
"previous_home_win_probability": 0.437089,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_NYM@WAS",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.508915,
"previous_home_win_probability": 0.508915,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_PIT@DET",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.484309,
"previous_home_win_probability": 0.484309,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_STL@MIL",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.549057,
"previous_home_win_probability": 0.549057,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_TB@PHI",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.392435,
"previous_home_win_probability": 0.392435,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_TEX@MIN",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.511743,
"previous_home_win_probability": 0.511743,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-8133e99fc8d4e4c7",
"proposed_at_utc": "2026-09-27T09:06:54.240008+00:00",
"provider": "openai",
"hypothesis": "Increasing score variance modestly from 2.15 to 2.25 should reduce persistent run-margin compression and improve total-run error. This extends a sequence of previously successful variance increases and targets the currently regressing run-model metrics, while the shadow gate protects against degradation in Brier score, calibration, and run-error guardrails.",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"new_value": 2.25,
"expected_metric": "total_run_mae",
"expected_direction": "decrease",
"evidence_ids": [
"metric.total_run_mae",
"pipeline.largest_team_run_regression",
"errors.miss_reasons"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-09-27T09:07:01.435173+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20260926",
"applied_at_utc": "2026-09-27T09:07:01.435173+00:00",
"candidate_id": "candidate-8133e99fc8d4e4c7",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"new_value": 2.25
}
],
"config_before": "candidate-c1d5650d9262b3dc",
"config_after": "candidate-8133e99fc8d4e4c7",
"metric_baseline_at_apply": {
"brier_score": 0.241266,
"accuracy": 0.5932,
"team_run_mae": 2.6314,
"total_run_mae": 3.8559,
"calibration_error": 0.0876,
"starter_er_mae": 1.7895,
"starter_outs_mae": 3.9123
},
"status": "applied_to_production",
"previous_config_id": "candidate-c1d5650d9262b3dc",
"new_config_id": "candidate-8133e99fc8d4e4c7",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"applied_value": 2.25,
"current_live_value": 2.25,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.241266,
"latest_window": 0.244879,
"delta": 0.003613,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5932,
"latest_window": 0.6195,
"delta": 0.0263,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.6314,
"latest_window": 2.4159,
"delta": -0.2155,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.8559,
"latest_window": 3.6637,
"delta": -0.1922,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0876,
"latest_window": 0.1324,
"delta": 0.0448,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7895,
"latest_window": 1.6226,
"delta": -0.1669,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.9123,
"latest_window": 4.184,
"delta": 0.2717,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 33,
"paired_previous_config_predictions": 31,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260927_CIN@TOR",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.520053,
"previous_home_win_probability": 0.520123,
"home_probability_delta": -7e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_CLE@KC",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.339536,
"previous_home_win_probability": 0.33608,
"home_probability_delta": 0.003456,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_COL@CHW",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.674495,
"previous_home_win_probability": 0.678204,
"home_probability_delta": -0.003709,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_HOU@OAK",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.354995,
"previous_home_win_probability": 0.352773,
"home_probability_delta": 0.002222,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_LAA@SEA",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.584837,
"previous_home_win_probability": 0.585876,
"home_probability_delta": -0.001039,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_LAD@SF",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.393554,
"previous_home_win_probability": 0.392458,
"home_probability_delta": 0.001096,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_NYM@WAS",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.46405,
"previous_home_win_probability": 0.463574,
"home_probability_delta": 0.000476,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_PIT@DET",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.494719,
"previous_home_win_probability": 0.494689,
"home_probability_delta": 3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_STL@MIL",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.631405,
"previous_home_win_probability": 0.632324,
"home_probability_delta": -0.000919,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_TB@PHI",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411012,
"previous_home_win_probability": 0.409007,
"home_probability_delta": 0.002005,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_TEX@MIN",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.483432,
"previous_home_win_probability": 0.483358,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_BOS@NYY",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.555379,
"previous_home_win_probability": 0.555452,
"home_probability_delta": -7.3e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_CHC@SD",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.510929,
"previous_home_win_probability": 0.511003,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_CHW@HOU",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.448712,
"previous_home_win_probability": 0.448639,
"home_probability_delta": 7.3e-05,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_PHI@ATL",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507466,
"previous_home_win_probability": 0.50754,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_BOS@NYY",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.562176,
"previous_home_win_probability": 0.562249,
"home_probability_delta": -7.3e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_CHC@SD",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.521101,
"previous_home_win_probability": 0.521159,
"home_probability_delta": -5.8e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_CHW@HOU",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_PHI@ATL",
"date": "20260930",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.51775,
"previous_home_win_probability": 0.517824,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261001_PHI@ATL",
"date": "20261001",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.523278,
"previous_home_win_probability": 0.52334,
"home_probability_delta": -6.2e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_ATL@LAD",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.564626,
"previous_home_win_probability": 0.565064,
"home_probability_delta": -0.000438,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_CHW@CLE",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.472943,
"previous_home_win_probability": 0.472869,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_NYY@TB",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.525419,
"previous_home_win_probability": 0.525493,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_SD@MIL",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.576129,
"previous_home_win_probability": 0.576989,
"home_probability_delta": -0.00086,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261004_ATL@LAD",
"date": "20261004",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.539404,
"previous_home_win_probability": 0.539465,
"home_probability_delta": -6.1e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261004_SD@MIL",
"date": "20261004",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.574449,
"previous_home_win_probability": 0.575537,
"home_probability_delta": -0.001088,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261005_CHW@CLE",
"date": "20261005",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.525605,
"previous_home_win_probability": 0.525679,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261005_NYY@TB",
"date": "20261005",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45339,
"previous_home_win_probability": 0.453316,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261006_LAD@ATL",
"date": "20261006",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20261006_MIL@SD",
"date": "20261006",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
},
{
"experiment_id": "candidate-668e4305abca59bc",
"proposed_at_utc": "2026-10-07T09:21:29.935210+00:00",
"provider": "openai",
"hypothesis": "Reduce the maximum weight assigned to empirical confidence from 0.50 to 0.45 to increase shrinkage, as the escalated calibration-instability finding recommends. This bounded shadow test targets the regressing calibration error; the mixed calibration bucket results make the direction uncertain.",
"changes": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"new_value": 0.45,
"expected_metric": "calibration_error",
"expected_direction": "decrease",
"evidence_ids": [
"calibration.weighted_absolute_error",
"calibration.bucket.0.60-0.65",
"calibration.bucket.0.65-0.70"
],
"risk_tier": "low",
"evaluation_mode": "artifact_replay"
}
],
"decision": "applied_to_production",
"reason": "Operator-enabled direct apply; rollback monitoring remains authoritative.",
"decided_at_utc": "2026-10-07T09:21:41.221033+00:00",
"measured_effect": null,
"outcome": "APPLIED: the registered values were written to the live champion. Measurement status: paired_effect_observed.",
"worked": null,
"application": {
"date": "20261006",
"applied_at_utc": "2026-10-07T09:21:41.221033+00:00",
"candidate_id": "candidate-668e4305abca59bc",
"changes": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"new_value": 0.45
}
],
"config_before": "candidate-8133e99fc8d4e4c7",
"config_after": "candidate-668e4305abca59bc",
"metric_baseline_at_apply": {
"brier_score": 0.245566,
"accuracy": 0.5877,
"team_run_mae": 2.4474,
"total_run_mae": 3.6316,
"calibration_error": 0.0992,
"starter_er_mae": 1.6795,
"starter_outs_mae": 4.2393
},
"status": "applied_to_production",
"previous_config_id": "candidate-8133e99fc8d4e4c7",
"new_config_id": "candidate-668e4305abca59bc",
"currently_active": true,
"live_parameter_checks": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"applied_value": 0.45,
"current_live_value": 0.45,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.245566,
"latest_window": 0.244879,
"delta": -0.000687,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5877,
"latest_window": 0.6195,
"delta": 0.0318,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4474,
"latest_window": 2.4159,
"delta": -0.0315,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.6316,
"latest_window": 3.6637,
"delta": 0.0321,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0992,
"latest_window": 0.1324,
"delta": 0.0332,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6795,
"latest_window": 1.6226,
"delta": -0.0569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 4.2393,
"latest_window": 4.184,
"delta": -0.0553,
"direction": "improved",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 7,
"paired_previous_config_predictions": 7,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20261007_CLE@CHW",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.451379,
"previous_home_win_probability": 0.451379,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_LAD@ATL",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.491557,
"previous_home_win_probability": 0.491557,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_MIL@SD",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.505,
"previous_home_win_probability": 0.505,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_TB@NYY",
"date": "20261007",
"outcome": "miss",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.566481,
"previous_home_win_probability": 0.566481,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261008_CLE@CHW",
"date": "20261008",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261010_CHW@CLE",
"date": "20261010",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.537156,
"previous_home_win_probability": 0.537156,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261011_LAD@MIL",
"date": "20261011",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548241,
"previous_home_win_probability": 0.548241,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
}
],
"applied_change_history": [
{
"date": "20260828",
"applied_at_utc": "2026-08-29T06:02:24.658142+00:00",
"candidate_id": "candidate-31a39524087cf556",
"changes": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"new_value": 0.58
}
],
"config_before": "default-v1",
"config_after": "candidate-31a39524087cf556",
"metric_baseline_at_apply": {
"brier_score": 0.241798,
"accuracy": 0.5833,
"team_run_mae": 2.4306,
"total_run_mae": 3.713,
"calibration_error": 0.1004,
"starter_er_mae": 1.7854,
"starter_outs_mae": 3.1073
},
"status": "applied_to_production",
"previous_config_id": "default-v1",
"new_config_id": "candidate-31a39524087cf556",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.moderate_cap",
"old_value": 0.6,
"applied_value": 0.58,
"current_live_value": 0.58,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.241798,
"latest_window": 0.244879,
"delta": 0.003081,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5833,
"latest_window": 0.6195,
"delta": 0.0362,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4306,
"latest_window": 2.4159,
"delta": -0.0147,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.713,
"latest_window": 3.6637,
"delta": -0.0493,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.1004,
"latest_window": 0.1324,
"delta": 0.032,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7854,
"latest_window": 1.6226,
"delta": -0.1628,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.1073,
"latest_window": 4.184,
"delta": 1.0767,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 66,
"paired_previous_config_predictions": 43,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260831_NYM@TB",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.6655,
"previous_home_win_probability": 0.6655,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_NYY@LAA",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411987,
"previous_home_win_probability": 0.411987,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_OAK@TEX",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546614,
"previous_home_win_probability": 0.546614,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_PHI@ARI",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.453386,
"previous_home_win_probability": 0.453386,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SD@CIN",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.326497,
"previous_home_win_probability": 0.326497,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SEA@BOS",
"date": "20260831",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583303,
"previous_home_win_probability": 0.583303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260831_SF@ATL",
"date": "20260831",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546614,
"previous_home_win_probability": 0.546614,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260901_ATL@WAS",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_BAL@COL",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_CHW@HOU",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_DET@MIN",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_MIA@KC",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_MIL@CHC",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 8.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_NYM@TB",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_NYY@LAA",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_OAK@TEX",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_PHI@ARI",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SD@CIN",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SEA@BOS",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_SF@PIT",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_STL@LAD",
"date": "20260901",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260901_TOR@CLE",
"date": "20260901",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_ATL@WAS",
"date": "20260902",
"outcome": "hit",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_BAL@COL",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_NYM@TB",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_OAK@TEX",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_PHI@ARI",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SD@CIN",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SEA@BOS",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20260902_SF@PIT",
"date": "20260902",
"outcome": "miss",
"live_config_id": "candidate-31a39524087cf556",
"parameter_values_recorded_in_prediction": {
"confidence.moderate_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260903",
"applied_at_utc": "2026-09-04T06:03:17.089072+00:00",
"candidate_id": "candidate-beeea24799c2c165",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"new_value": 0.58
}
],
"config_before": "candidate-31a39524087cf556-registry-c5dd20fd32e9",
"config_after": "candidate-beeea24799c2c165",
"metric_baseline_at_apply": {
"brier_score": 0.252004,
"accuracy": 0.55,
"team_run_mae": 2.7667,
"total_run_mae": 3.85,
"calibration_error": 0.0989,
"starter_er_mae": 1.9192,
"starter_outs_mae": 3.0192
},
"status": "applied_to_production",
"previous_config_id": "candidate-31a39524087cf556-registry-c5dd20fd32e9",
"new_config_id": "candidate-beeea24799c2c165",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.base_cap",
"old_value": 0.6,
"applied_value": 0.58,
"current_live_value": 0.56,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.252004,
"latest_window": 0.244879,
"delta": -0.007125,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.55,
"latest_window": 0.6195,
"delta": 0.0695,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.7667,
"latest_window": 2.4159,
"delta": -0.3508,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.85,
"latest_window": 3.6637,
"delta": -0.1863,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0989,
"latest_window": 0.1324,
"delta": 0.0335,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.9192,
"latest_window": 1.6226,
"delta": -0.2966,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.0192,
"latest_window": 4.184,
"delta": 1.1648,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 46,
"paired_previous_config_predictions": 46,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260905_ARI@HOU",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.476266,
"previous_home_win_probability": 0.476266,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_ATL@PHI",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.455319,
"previous_home_win_probability": 0.455319,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_BOS@BAL",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.455286,
"previous_home_win_probability": 0.455286,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_CHC@MIA",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.26047,
"previous_home_win_probability": 0.26047,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_DET@CLE",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575318,
"previous_home_win_probability": 0.575318,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_LAA@PIT",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.635729,
"previous_home_win_probability": 0.635729,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_MIL@CIN",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.287611,
"previous_home_win_probability": 0.287611,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_MIN@CHW",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45369,
"previous_home_win_probability": 0.45369,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_NYY@SD",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.432863,
"previous_home_win_probability": 0.432863,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_OAK@SEA",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54631,
"previous_home_win_probability": 0.54631,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_SF@NYM",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.527739,
"previous_home_win_probability": 0.527739,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_STL@COL",
"date": "20260905",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.478775,
"previous_home_win_probability": 0.478775,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_TB@TEX",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45369,
"previous_home_win_probability": 0.45369,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_TOR@KC",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.357403,
"previous_home_win_probability": 0.357403,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260905_WAS@LAD",
"date": "20260905",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.586389,
"previous_home_win_probability": 0.586389,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_ARI@HOU",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.456108,
"previous_home_win_probability": 0.456108,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_ATL@PHI",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.559583,
"previous_home_win_probability": 0.559583,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_BOS@BAL",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.43182,
"previous_home_win_probability": 0.43182,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_CHC@MIA",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.328844,
"previous_home_win_probability": 0.328844,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_DET@CLE",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.528092,
"previous_home_win_probability": 0.528092,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_LAA@PIT",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.585076,
"previous_home_win_probability": 0.585076,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_MIL@CIN",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.374303,
"previous_home_win_probability": 0.374303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_MIN@CHW",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583263,
"previous_home_win_probability": 0.583263,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_NYY@SD",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.450638,
"previous_home_win_probability": 0.450638,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_OAK@SEA",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.561176,
"previous_home_win_probability": 0.561176,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_SF@NYM",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.51921,
"previous_home_win_probability": 0.51921,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_STL@COL",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.417854,
"previous_home_win_probability": 0.417854,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_TB@TEX",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.462085,
"previous_home_win_probability": 0.462085,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_TOR@KC",
"date": "20260906",
"outcome": "miss",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.431542,
"previous_home_win_probability": 0.431542,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260906_WAS@LAD",
"date": "20260906",
"outcome": "hit",
"live_config_id": "candidate-beeea24799c2c165",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.58
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.577206,
"previous_home_win_probability": 0.577206,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260906",
"applied_at_utc": "2026-09-07T06:03:53.452273+00:00",
"candidate_id": "candidate-11bc4bc2dfc7264a",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"new_value": 1.75
}
],
"config_before": "candidate-beeea24799c2c165",
"config_after": "candidate-11bc4bc2dfc7264a",
"metric_baseline_at_apply": {
"brier_score": 0.2509,
"accuracy": 0.5583,
"team_run_mae": 2.6083,
"total_run_mae": 3.65,
"calibration_error": 0.064,
"starter_er_mae": 1.9795,
"starter_outs_mae": 3.0123
},
"status": "applied_to_production",
"previous_config_id": "candidate-beeea24799c2c165",
"new_config_id": "candidate-11bc4bc2dfc7264a",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.65,
"applied_value": 1.75,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.2509,
"latest_window": 0.244879,
"delta": -0.006021,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5583,
"latest_window": 0.6195,
"delta": 0.0612,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.6083,
"latest_window": 2.4159,
"delta": -0.1924,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.65,
"latest_window": 3.6637,
"delta": 0.0137,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.064,
"latest_window": 0.1324,
"delta": 0.0684,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.9795,
"latest_window": 1.6226,
"delta": -0.3569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.0123,
"latest_window": 4.184,
"delta": 1.1717,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 26,
"paired_previous_config_predictions": 26,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260907_ARI@KC",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.579623,
"previous_home_win_probability": 0.581922,
"home_probability_delta": -0.002299,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_ATL@PHI",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.556519,
"previous_home_win_probability": 0.556626,
"home_probability_delta": -0.000107,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CHC@MIL",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.508021,
"previous_home_win_probability": 0.50826,
"home_probability_delta": -0.000239,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CIN@LAD",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575111,
"previous_home_win_probability": 0.577324,
"home_probability_delta": -0.002213,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_CLE@BAL",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.510748,
"previous_home_win_probability": 0.510857,
"home_probability_delta": -0.000109,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_LAA@BOS",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.653937,
"previous_home_win_probability": 0.658266,
"home_probability_delta": -0.004329,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_MIN@DET",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.432458,
"previous_home_win_probability": 0.430463,
"home_probability_delta": 0.001995,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_NYM@MIA",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.524436,
"previous_home_win_probability": 0.524499,
"home_probability_delta": -6.3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_STL@SF",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.373236,
"previous_home_win_probability": 0.369592,
"home_probability_delta": 0.003644,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_TOR@OAK",
"date": "20260907",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.300442,
"previous_home_win_probability": 0.295149,
"home_probability_delta": 0.005293,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260907_WAS@SD",
"date": "20260907",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.541044,
"previous_home_win_probability": 0.541104,
"home_probability_delta": -6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_ARI@KC",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.366092,
"previous_home_win_probability": 0.364585,
"home_probability_delta": 0.001507,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CHC@MIL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.581938,
"previous_home_win_probability": 0.582044,
"home_probability_delta": -0.000106,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CIN@LAD",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.671836,
"previous_home_win_probability": 0.675324,
"home_probability_delta": -0.003488,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_CLE@BAL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492884,
"previous_home_win_probability": 0.492672,
"home_probability_delta": 0.000212,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_COL@NYY",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.644809,
"previous_home_win_probability": 0.647495,
"home_probability_delta": -0.002686,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_HOU@PHI",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.436918,
"previous_home_win_probability": 0.435067,
"home_probability_delta": 0.001851,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_LAA@BOS",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.574016,
"previous_home_win_probability": 0.576192,
"home_probability_delta": -0.002176,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_MIN@DET",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.582467,
"previous_home_win_probability": 0.583089,
"home_probability_delta": -0.000622,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_NYM@MIA",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.453392,
"previous_home_win_probability": 0.453262,
"home_probability_delta": 0.00013,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_PIT@CHW",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.522678,
"previous_home_win_probability": 0.522785,
"home_probability_delta": -0.000107,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_STL@SF",
"date": "20260908",
"outcome": "miss",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454963,
"previous_home_win_probability": 0.453634,
"home_probability_delta": 0.001329,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TB@ATL",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.474696,
"previous_home_win_probability": 0.474417,
"home_probability_delta": 0.000279,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TEX@SEA",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.465664,
"previous_home_win_probability": 0.464641,
"home_probability_delta": 0.001023,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_TOR@OAK",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.400365,
"previous_home_win_probability": 0.39841,
"home_probability_delta": 0.001955,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260908_WAS@SD",
"date": "20260908",
"outcome": "hit",
"live_config_id": "candidate-11bc4bc2dfc7264a",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.75
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.529136,
"previous_home_win_probability": 0.529245,
"home_probability_delta": -0.000109,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260911",
"applied_at_utc": "2026-09-12T09:04:36.607786+00:00",
"candidate_id": "candidate-ed18fee8af33cf7e",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"new_value": 1.85
}
],
"config_before": "candidate-11bc4bc2dfc7264a-registry-4c40ee6a3671",
"config_after": "candidate-ed18fee8af33cf7e",
"metric_baseline_at_apply": {
"brier_score": 0.242131,
"accuracy": 0.6,
"team_run_mae": 2.4417,
"total_run_mae": 3.7167,
"calibration_error": 0.0872,
"starter_er_mae": 1.8716,
"starter_outs_mae": 3.1284
},
"status": "applied_to_production",
"previous_config_id": "candidate-11bc4bc2dfc7264a-registry-4c40ee6a3671",
"new_config_id": "candidate-ed18fee8af33cf7e",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.75,
"applied_value": 1.85,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.242131,
"latest_window": 0.244879,
"delta": 0.002748,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6,
"latest_window": 0.6195,
"delta": 0.0195,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4417,
"latest_window": 2.4159,
"delta": -0.0258,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.7167,
"latest_window": 3.6637,
"delta": -0.053,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0872,
"latest_window": 0.1324,
"delta": 0.0452,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.8716,
"latest_window": 1.6226,
"delta": -0.249,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.1284,
"latest_window": 4.184,
"delta": 1.0556,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 40,
"paired_previous_config_predictions": 40,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260912_PHI@ATL",
"date": "20260912",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.493511,
"previous_home_win_probability": 0.493328,
"home_probability_delta": 0.000183,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_PIT@CHC",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.554666,
"previous_home_win_probability": 0.556195,
"home_probability_delta": -0.001529,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_SD@SF",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.496417,
"previous_home_win_probability": 0.496316,
"home_probability_delta": 0.000101,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_SEA@OAK",
"date": "20260912",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.465434,
"previous_home_win_probability": 0.465334,
"home_probability_delta": 0.0001,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260912_TEX@ARI",
"date": "20260912",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.581582,
"previous_home_win_probability": 0.583173,
"home_probability_delta": -0.001591,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_BAL@TOR",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.534848,
"previous_home_win_probability": 0.534948,
"home_probability_delta": -0.0001,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CHW@STL",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.511703,
"previous_home_win_probability": 0.511749,
"home_probability_delta": -4.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CIN@MIL",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.735605,
"previous_home_win_probability": 0.741315,
"home_probability_delta": -0.00571,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_CLE@MIN",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.563738,
"previous_home_win_probability": 0.563837,
"home_probability_delta": -9.9e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_COL@DET",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.646358,
"previous_home_win_probability": 0.649983,
"home_probability_delta": -0.003625,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_HOU@TB",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.527949,
"previous_home_win_probability": 0.528027,
"home_probability_delta": -7.8e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_KC@BOS",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.58576,
"previous_home_win_probability": 0.587159,
"home_probability_delta": -0.001399,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_LAA@WAS",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.604591,
"previous_home_win_probability": 0.606397,
"home_probability_delta": -0.001806,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_LAD@MIA",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.292502,
"previous_home_win_probability": 0.287288,
"home_probability_delta": 0.005214,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_NYM@NYY",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.588505,
"previous_home_win_probability": 0.589999,
"home_probability_delta": -0.001494,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_PHI@ATL",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.559569,
"previous_home_win_probability": 0.560163,
"home_probability_delta": -0.000594,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_PIT@CHC",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.526139,
"previous_home_win_probability": 0.526239,
"home_probability_delta": -0.0001,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_SD@SF",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454094,
"previous_home_win_probability": 0.453729,
"home_probability_delta": 0.000365,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_SEA@OAK",
"date": "20260913",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411037,
"previous_home_win_probability": 0.409342,
"home_probability_delta": 0.001695,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260913_TEX@ARI",
"date": "20260913",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492178,
"previous_home_win_probability": 0.491957,
"home_probability_delta": 0.000221,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_ATL@CHC",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.535036,
"previous_home_win_probability": 0.535203,
"home_probability_delta": -0.000167,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_BAL@NYM",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.627507,
"previous_home_win_probability": 0.63062,
"home_probability_delta": -0.003113,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_CHW@CLE",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507826,
"previous_home_win_probability": 0.508047,
"home_probability_delta": -0.000221,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_DET@TOR",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492174,
"previous_home_win_probability": 0.491953,
"home_probability_delta": 0.000221,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_LAD@CIN",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.27412,
"previous_home_win_probability": 0.268674,
"home_probability_delta": 0.005446,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_MIA@ARI",
"date": "20260914",
"outcome": "miss",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.472665,
"previous_home_win_probability": 0.471904,
"home_probability_delta": 0.000761,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_NYY@MIN",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.355399,
"previous_home_win_probability": 0.351523,
"home_probability_delta": 0.003876,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SD@COL",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.336593,
"previous_home_win_probability": 0.333546,
"home_probability_delta": 0.003047,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SEA@LAA",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.538184,
"previous_home_win_probability": 0.538239,
"home_probability_delta": -5.5e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260914_SF@STL",
"date": "20260914",
"outcome": "hit",
"live_config_id": "candidate-ed18fee8af33cf7e",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.85
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507604,
"previous_home_win_probability": 0.507671,
"home_probability_delta": -6.7e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260914",
"applied_at_utc": "2026-09-15T09:05:08.617033+00:00",
"candidate_id": "candidate-57e651c7f36832cf",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"new_value": 1.95
}
],
"config_before": "candidate-ed18fee8af33cf7e",
"config_after": "candidate-57e651c7f36832cf",
"metric_baseline_at_apply": {
"brier_score": 0.24114,
"accuracy": 0.6333,
"team_run_mae": 2.5083,
"total_run_mae": 3.8167,
"calibration_error": 0.1244,
"starter_er_mae": 1.7778,
"starter_outs_mae": 3.2644
},
"status": "applied_to_production",
"previous_config_id": "candidate-ed18fee8af33cf7e",
"new_config_id": "candidate-57e651c7f36832cf",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.85,
"applied_value": 1.95,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.24114,
"latest_window": 0.244879,
"delta": 0.003739,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6333,
"latest_window": 0.6195,
"delta": -0.0138,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5083,
"latest_window": 2.4159,
"delta": -0.0924,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.8167,
"latest_window": 3.6637,
"delta": -0.153,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.1244,
"latest_window": 0.1324,
"delta": 0.008,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7778,
"latest_window": 1.6226,
"delta": -0.1552,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.2644,
"latest_window": 4.184,
"delta": 0.9196,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 39,
"paired_previous_config_predictions": 39,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260915_NYY@MIN",
"date": "20260915",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.347168,
"previous_home_win_probability": 0.345204,
"home_probability_delta": 0.001964,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_OAK@TB",
"date": "20260915",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.667434,
"previous_home_win_probability": 0.668988,
"home_probability_delta": -0.001554,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_PHI@WAS",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.454124,
"previous_home_win_probability": 0.453895,
"home_probability_delta": 0.000229,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SD@COL",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.302515,
"previous_home_win_probability": 0.297761,
"home_probability_delta": 0.004754,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SEA@LAA",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.431377,
"previous_home_win_probability": 0.431105,
"home_probability_delta": 0.000272,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260915_SF@STL",
"date": "20260915",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.573518,
"previous_home_win_probability": 0.57406,
"home_probability_delta": -0.000542,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_ATL@CHC",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.56953,
"previous_home_win_probability": 0.569621,
"home_probability_delta": -9.1e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_BAL@NYM",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.567625,
"previous_home_win_probability": 0.568763,
"home_probability_delta": -0.001138,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_BOS@TEX",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.532791,
"previous_home_win_probability": 0.533043,
"home_probability_delta": -0.000252,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_CHW@CLE",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.578219,
"previous_home_win_probability": 0.579288,
"home_probability_delta": -0.001069,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_DET@TOR",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.347206,
"previous_home_win_probability": 0.343354,
"home_probability_delta": 0.003852,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_KC@HOU",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492371,
"previous_home_win_probability": 0.492168,
"home_probability_delta": 0.000203,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_LAD@CIN",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.322883,
"previous_home_win_probability": 0.318897,
"home_probability_delta": 0.003986,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_MIA@ARI",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.435826,
"previous_home_win_probability": 0.435283,
"home_probability_delta": 0.000543,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_MIL@PIT",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.34016,
"previous_home_win_probability": 0.336153,
"home_probability_delta": 0.004007,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_NYY@MIN",
"date": "20260916",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.328454,
"previous_home_win_probability": 0.324223,
"home_probability_delta": 0.004231,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_OAK@TB",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.76686,
"previous_home_win_probability": 0.7726,
"home_probability_delta": -0.00574,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_PHI@WAS",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.474076,
"previous_home_win_probability": 0.47403,
"home_probability_delta": 4.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SD@COL",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.422542,
"previous_home_win_probability": 0.420568,
"home_probability_delta": 0.001974,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SEA@LAA",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492781,
"previous_home_win_probability": 0.492588,
"home_probability_delta": 0.000193,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260916_SF@STL",
"date": "20260916",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.48003,
"previous_home_win_probability": 0.479498,
"home_probability_delta": 0.000532,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_BOS@TEX",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.563326,
"previous_home_win_probability": 0.563889,
"home_probability_delta": -0.000563,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_DET@CHW",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.419311,
"previous_home_win_probability": 0.41719,
"home_probability_delta": 0.002121,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_KC@HOU",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540874,
"previous_home_win_probability": 0.540935,
"home_probability_delta": -6.1e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_LAD@CIN",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.289359,
"previous_home_win_probability": 0.284378,
"home_probability_delta": 0.004981,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_MIL@PIT",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.345684,
"previous_home_win_probability": 0.341797,
"home_probability_delta": 0.003887,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_MIN@LAA",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.477189,
"previous_home_win_probability": 0.477155,
"home_probability_delta": 3.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_OAK@TB",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.650236,
"previous_home_win_probability": 0.654022,
"home_probability_delta": -0.003786,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_PHI@NYM",
"date": "20260917",
"outcome": "miss",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.561153,
"previous_home_win_probability": 0.56277,
"home_probability_delta": -0.001617,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260917_SD@COL",
"date": "20260917",
"outcome": "hit",
"live_config_id": "candidate-57e651c7f36832cf",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 1.95
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.302781,
"previous_home_win_probability": 0.300726,
"home_probability_delta": 0.002055,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260917",
"applied_at_utc": "2026-09-18T09:05:40.012512+00:00",
"candidate_id": "candidate-f4c3ec3952acc919",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"new_value": 2.05
}
],
"config_before": "candidate-57e651c7f36832cf",
"config_after": "candidate-f4c3ec3952acc919",
"metric_baseline_at_apply": {
"brier_score": 0.242458,
"accuracy": 0.5917,
"team_run_mae": 2.5333,
"total_run_mae": 3.5333,
"calibration_error": 0.0728,
"starter_er_mae": 1.7326,
"starter_outs_mae": 3.2984
},
"status": "applied_to_production",
"previous_config_id": "candidate-57e651c7f36832cf",
"new_config_id": "candidate-f4c3ec3952acc919",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 1.95,
"applied_value": 2.05,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.242458,
"latest_window": 0.244879,
"delta": 0.002421,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5917,
"latest_window": 0.6195,
"delta": 0.0278,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5333,
"latest_window": 2.4159,
"delta": -0.1174,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.5333,
"latest_window": 3.6637,
"delta": 0.1304,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0728,
"latest_window": 0.1324,
"delta": 0.0596,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7326,
"latest_window": 1.6226,
"delta": -0.11,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.2984,
"latest_window": 4.184,
"delta": 0.8856,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 46,
"paired_previous_config_predictions": 46,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260919_BOS@TB",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540412,
"previous_home_win_probability": 0.540497,
"home_probability_delta": -8.5e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_CHC@CIN",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.316303,
"previous_home_win_probability": 0.31204,
"home_probability_delta": 0.004263,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_DET@CHW",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.406854,
"previous_home_win_probability": 0.404584,
"home_probability_delta": 0.00227,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_KC@PIT",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548212,
"previous_home_win_probability": 0.549427,
"home_probability_delta": -0.001215,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIA@SD",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.693765,
"previous_home_win_probability": 0.698213,
"home_probability_delta": -0.004448,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIL@BAL",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.546191,
"previous_home_win_probability": 0.546276,
"home_probability_delta": -8.5e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_MIN@LAA",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.575247,
"previous_home_win_probability": 0.575749,
"home_probability_delta": -0.000502,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_NYY@ARI",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.288751,
"previous_home_win_probability": 0.28402,
"home_probability_delta": 0.004731,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_OAK@CLE",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.658901,
"previous_home_win_probability": 0.662685,
"home_probability_delta": -0.003784,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_PHI@NYM",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540286,
"previous_home_win_probability": 0.540372,
"home_probability_delta": -8.6e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_SEA@COL",
"date": "20260919",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.278696,
"previous_home_win_probability": 0.274208,
"home_probability_delta": 0.004488,
"live_predicted_score": {
"away_runs": 9.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 9.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_SF@LAD",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.565131,
"previous_home_win_probability": 0.565691,
"home_probability_delta": -0.00056,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_TOR@TEX",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.611002,
"previous_home_win_probability": 0.613734,
"home_probability_delta": -0.002732,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260919_WAS@STL",
"date": "20260919",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.44034,
"previous_home_win_probability": 0.438842,
"home_probability_delta": 0.001498,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_ATL@HOU",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.378061,
"previous_home_win_probability": 0.375079,
"home_probability_delta": 0.002982,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_BOS@TB",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.571587,
"previous_home_win_probability": 0.572091,
"home_probability_delta": -0.000504,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_CHC@CIN",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.292579,
"previous_home_win_probability": 0.287903,
"home_probability_delta": 0.004676,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_DET@CHW",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.403591,
"previous_home_win_probability": 0.401256,
"home_probability_delta": 0.002335,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_KC@PIT",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.60076,
"previous_home_win_probability": 0.602022,
"home_probability_delta": -0.001262,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIA@SD",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.668942,
"previous_home_win_probability": 0.672912,
"home_probability_delta": -0.00397,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIL@BAL",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.37078,
"previous_home_win_probability": 0.36965,
"home_probability_delta": 0.00113,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_MIN@LAA",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.50745,
"previous_home_win_probability": 0.507638,
"home_probability_delta": -0.000188,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_NYY@ARI",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.447197,
"previous_home_win_probability": 0.4459,
"home_probability_delta": 0.001297,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_OAK@CLE",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.708446,
"previous_home_win_probability": 0.710487,
"home_probability_delta": -0.002041,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_PHI@NYM",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.523977,
"previous_home_win_probability": 0.524204,
"home_probability_delta": -0.000227,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_SEA@COL",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.39974,
"previous_home_win_probability": 0.397363,
"home_probability_delta": 0.002377,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_SF@LAD",
"date": "20260920",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.613015,
"previous_home_win_probability": 0.614733,
"home_probability_delta": -0.001718,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 7.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_TOR@TEX",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.55937,
"previous_home_win_probability": 0.560861,
"home_probability_delta": -0.001491,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260920_WAS@STL",
"date": "20260920",
"outcome": "miss",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.478382,
"previous_home_win_probability": 0.477836,
"home_probability_delta": 0.000546,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260921_WAS@DET",
"date": "20260921",
"outcome": "hit",
"live_config_id": "candidate-f4c3ec3952acc919",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.05
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.576597,
"previous_home_win_probability": 0.578511,
"home_probability_delta": -0.001914,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260920",
"applied_at_utc": "2026-09-21T09:06:01.333346+00:00",
"candidate_id": "candidate-982561b127534866",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"new_value": 2.15
}
],
"config_before": "candidate-f4c3ec3952acc919",
"config_after": "candidate-982561b127534866",
"metric_baseline_at_apply": {
"brier_score": 0.239314,
"accuracy": 0.6,
"team_run_mae": 2.5042,
"total_run_mae": 3.3583,
"calibration_error": 0.0885,
"starter_er_mae": 1.6855,
"starter_outs_mae": 3.4839
},
"status": "applied_to_production",
"previous_config_id": "candidate-f4c3ec3952acc919",
"new_config_id": "candidate-982561b127534866",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.05,
"applied_value": 2.15,
"current_live_value": 2.25,
"currently_matches_applied_value": false
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.239314,
"latest_window": 0.244879,
"delta": 0.005565,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.6,
"latest_window": 0.6195,
"delta": 0.0195,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5042,
"latest_window": 2.4159,
"delta": -0.0883,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.3583,
"latest_window": 3.6637,
"delta": 0.3054,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0885,
"latest_window": 0.1324,
"delta": 0.0439,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6855,
"latest_window": 1.6226,
"delta": -0.0629,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.4839,
"latest_window": 4.184,
"delta": 0.7001,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 33,
"paired_previous_config_predictions": 33,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260922_CHW@KC",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492724,
"previous_home_win_probability": 0.492548,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_CIN@ATL",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.677436,
"previous_home_win_probability": 0.68125,
"home_probability_delta": -0.003814,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_CLE@BOS",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492724,
"previous_home_win_probability": 0.492548,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_HOU@SEA",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.640864,
"previous_home_win_probability": 0.642242,
"home_probability_delta": -0.001378,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_LAA@OAK",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.439751,
"previous_home_win_probability": 0.438311,
"home_probability_delta": 0.00144,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIA@CHC",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.650071,
"previous_home_win_probability": 0.652402,
"home_probability_delta": -0.002331,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIL@PHI",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.323223,
"previous_home_win_probability": 0.319274,
"home_probability_delta": 0.003949,
"live_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 7.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_MIN@SF",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.481856,
"previous_home_win_probability": 0.481794,
"home_probability_delta": 6.2e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_NYM@TEX",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.600919,
"previous_home_win_probability": 0.603295,
"home_probability_delta": -0.002376,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_SD@LAD",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.564073,
"previous_home_win_probability": 0.564152,
"home_probability_delta": -7.9e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_STL@PIT",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.553511,
"previous_home_win_probability": 0.553984,
"home_probability_delta": -0.000473,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_TB@NYY",
"date": "20260922",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548329,
"previous_home_win_probability": 0.548407,
"home_probability_delta": -7.8e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_TB@NYY_2",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.52856,
"previous_home_win_probability": 0.528594,
"home_probability_delta": -3.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260922_WAS@DET",
"date": "20260922",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.583452,
"previous_home_win_probability": 0.584738,
"home_probability_delta": -0.001286,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_ARI@COL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.417476,
"previous_home_win_probability": 0.415569,
"home_probability_delta": 0.001907,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CHW@KC",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.387014,
"previous_home_win_probability": 0.385507,
"home_probability_delta": 0.001507,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CIN@ATL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.611439,
"previous_home_win_probability": 0.61287,
"home_probability_delta": -0.001431,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_CLE@BOS",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_HOU@SEA",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.521174,
"previous_home_win_probability": 0.521227,
"home_probability_delta": -5.3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_LAA@OAK",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.421923,
"previous_home_win_probability": 0.420068,
"home_probability_delta": 0.001855,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIA@CHC",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.568568,
"previous_home_win_probability": 0.569269,
"home_probability_delta": -0.000701,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIL@PHI",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.358239,
"previous_home_win_probability": 0.354986,
"home_probability_delta": 0.003253,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_MIN@SF",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.484623,
"previous_home_win_probability": 0.484579,
"home_probability_delta": 4.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_NYM@TEX",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.404574,
"previous_home_win_probability": 0.403698,
"home_probability_delta": 0.000876,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_SD@LAD",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54136,
"previous_home_win_probability": 0.541567,
"home_probability_delta": -0.000207,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_STL@PIT",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.577526,
"previous_home_win_probability": 0.57864,
"home_probability_delta": -0.001114,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TB@NYY",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TOR@BAL",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507287,
"previous_home_win_probability": 0.507463,
"home_probability_delta": -0.000176,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_TOR@BAL_2",
"date": "20260923",
"outcome": "miss",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.479819,
"previous_home_win_probability": 0.479757,
"home_probability_delta": 6.2e-05,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260923_WAS@DET",
"date": "20260923",
"outcome": "hit",
"live_config_id": "candidate-982561b127534866",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.15
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492721,
"previous_home_win_probability": 0.492545,
"home_probability_delta": 0.000176,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260923",
"applied_at_utc": "2026-09-24T09:07:04.378558+00:00",
"candidate_id": "candidate-c1d5650d9262b3dc",
"changes": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"new_value": 0.56
}
],
"config_before": "candidate-982561b127534866",
"config_after": "candidate-c1d5650d9262b3dc",
"metric_baseline_at_apply": {
"brier_score": 0.244247,
"accuracy": 0.5546,
"team_run_mae": 2.5168,
"total_run_mae": 3.3697,
"calibration_error": 0.101,
"starter_er_mae": 1.756,
"starter_outs_mae": 3.572
},
"status": "applied_to_production",
"previous_config_id": "candidate-982561b127534866",
"new_config_id": "candidate-c1d5650d9262b3dc",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "confidence.base_cap",
"old_value": 0.58,
"applied_value": 0.56,
"current_live_value": 0.56,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.244247,
"latest_window": 0.244879,
"delta": 0.000632,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5546,
"latest_window": 0.6195,
"delta": 0.0649,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.5168,
"latest_window": 2.4159,
"delta": -0.1009,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.3697,
"latest_window": 3.6637,
"delta": 0.294,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.101,
"latest_window": 0.1324,
"delta": 0.0314,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.756,
"latest_window": 1.6226,
"delta": -0.1334,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.572,
"latest_window": 4.184,
"delta": 0.612,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 42,
"paired_previous_config_predictions": 42,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260925_ARI@SD",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.492715,
"previous_home_win_probability": 0.492715,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_ATL@MIA",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.452344,
"previous_home_win_probability": 0.452344,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_BAL@NYY",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.502563,
"previous_home_win_probability": 0.502563,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_BAL@NYY_2",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.531425,
"previous_home_win_probability": 0.531425,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CHC@BOS",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CHC@BOS_2",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.567062,
"previous_home_win_probability": 0.567062,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CIN@TOR",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.635849,
"previous_home_win_probability": 0.635849,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_CLE@KC",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.404233,
"previous_home_win_probability": 0.404233,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_COL@CHW",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.723012,
"previous_home_win_probability": 0.723012,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_HOU@OAK",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.445431,
"previous_home_win_probability": 0.445431,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_LAA@SEA",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.475064,
"previous_home_win_probability": 0.475064,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_LAD@SF",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.422253,
"previous_home_win_probability": 0.422253,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_NYM@WAS",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.517636,
"previous_home_win_probability": 0.517636,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_PIT@DET",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.494293,
"previous_home_win_probability": 0.494293,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_STL@MIL",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.558508,
"previous_home_win_probability": 0.558508,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_TB@PHI",
"date": "20260925",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.540856,
"previous_home_win_probability": 0.540856,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260925_TEX@MIN",
"date": "20260925",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.54972,
"previous_home_win_probability": 0.54972,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_ARI@SD",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.452602,
"previous_home_win_probability": 0.452602,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_ATL@MIA",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.429694,
"previous_home_win_probability": 0.429694,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_CIN@TOR",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.619523,
"previous_home_win_probability": 0.619523,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_CLE@KC",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.412303,
"previous_home_win_probability": 0.412303,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_COL@CHW",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.697769,
"previous_home_win_probability": 0.697769,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_HOU@OAK",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.468312,
"previous_home_win_probability": 0.468312,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_LAA@SEA",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.524943,
"previous_home_win_probability": 0.524943,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_LAD@SF",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.437089,
"previous_home_win_probability": 0.437089,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_NYM@WAS",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.508915,
"previous_home_win_probability": 0.508915,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_PIT@DET",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.484309,
"previous_home_win_probability": 0.484309,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_STL@MIL",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.549057,
"previous_home_win_probability": 0.549057,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_TB@PHI",
"date": "20260926",
"outcome": "hit",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.392435,
"previous_home_win_probability": 0.392435,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 2.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 2.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260926_TEX@MIN",
"date": "20260926",
"outcome": "miss",
"live_config_id": "candidate-c1d5650d9262b3dc",
"parameter_values_recorded_in_prediction": {
"confidence.base_cap": 0.56
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.511743,
"previous_home_win_probability": 0.511743,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20260926",
"applied_at_utc": "2026-09-27T09:07:01.435173+00:00",
"candidate_id": "candidate-8133e99fc8d4e4c7",
"changes": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"new_value": 2.25
}
],
"config_before": "candidate-c1d5650d9262b3dc",
"config_after": "candidate-8133e99fc8d4e4c7",
"metric_baseline_at_apply": {
"brier_score": 0.241266,
"accuracy": 0.5932,
"team_run_mae": 2.6314,
"total_run_mae": 3.8559,
"calibration_error": 0.0876,
"starter_er_mae": 1.7895,
"starter_outs_mae": 3.9123
},
"status": "applied_to_production",
"previous_config_id": "candidate-c1d5650d9262b3dc",
"new_config_id": "candidate-8133e99fc8d4e4c7",
"currently_active": false,
"live_parameter_checks": [
{
"parameter": "score.variance_multiplier",
"old_value": 2.15,
"applied_value": 2.25,
"current_live_value": 2.25,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.241266,
"latest_window": 0.244879,
"delta": 0.003613,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5932,
"latest_window": 0.6195,
"delta": 0.0263,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.6314,
"latest_window": 2.4159,
"delta": -0.2155,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.8559,
"latest_window": 3.6637,
"delta": -0.1922,
"direction": "improved",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0876,
"latest_window": 0.1324,
"delta": 0.0448,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.7895,
"latest_window": 1.6226,
"delta": -0.1669,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 3.9123,
"latest_window": 4.184,
"delta": 0.2717,
"direction": "regressed",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 33,
"paired_previous_config_predictions": 31,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20260927_CIN@TOR",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.520053,
"previous_home_win_probability": 0.520123,
"home_probability_delta": -7e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_CLE@KC",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.339536,
"previous_home_win_probability": 0.33608,
"home_probability_delta": 0.003456,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_COL@CHW",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.674495,
"previous_home_win_probability": 0.678204,
"home_probability_delta": -0.003709,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 8.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_HOU@OAK",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.354995,
"previous_home_win_probability": 0.352773,
"home_probability_delta": 0.002222,
"live_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 8.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_LAA@SEA",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.584837,
"previous_home_win_probability": 0.585876,
"home_probability_delta": -0.001039,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_LAD@SF",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.393554,
"previous_home_win_probability": 0.392458,
"home_probability_delta": 0.001096,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_NYM@WAS",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.46405,
"previous_home_win_probability": 0.463574,
"home_probability_delta": 0.000476,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_PIT@DET",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.494719,
"previous_home_win_probability": 0.494689,
"home_probability_delta": 3e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_STL@MIL",
"date": "20260927",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.631405,
"previous_home_win_probability": 0.632324,
"home_probability_delta": -0.000919,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_TB@PHI",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.411012,
"previous_home_win_probability": 0.409007,
"home_probability_delta": 0.002005,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260927_TEX@MIN",
"date": "20260927",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.483432,
"previous_home_win_probability": 0.483358,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_BOS@NYY",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.555379,
"previous_home_win_probability": 0.555452,
"home_probability_delta": -7.3e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_CHC@SD",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.510929,
"previous_home_win_probability": 0.511003,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_CHW@HOU",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.448712,
"previous_home_win_probability": 0.448639,
"home_probability_delta": 7.3e-05,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260929_PHI@ATL",
"date": "20260929",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.507466,
"previous_home_win_probability": 0.50754,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 2.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_BOS@NYY",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.562176,
"previous_home_win_probability": 0.562249,
"home_probability_delta": -7.3e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_CHC@SD",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.521101,
"previous_home_win_probability": 0.521159,
"home_probability_delta": -5.8e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_CHW@HOU",
"date": "20260930",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 6.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20260930_PHI@ATL",
"date": "20260930",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.51775,
"previous_home_win_probability": 0.517824,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261001_PHI@ATL",
"date": "20261001",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.523278,
"previous_home_win_probability": 0.52334,
"home_probability_delta": -6.2e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_ATL@LAD",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.564626,
"previous_home_win_probability": 0.565064,
"home_probability_delta": -0.000438,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_CHW@CLE",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.472943,
"previous_home_win_probability": 0.472869,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_NYY@TB",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.525419,
"previous_home_win_probability": 0.525493,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261003_SD@MIL",
"date": "20261003",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.576129,
"previous_home_win_probability": 0.576989,
"home_probability_delta": -0.00086,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261004_ATL@LAD",
"date": "20261004",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.539404,
"previous_home_win_probability": 0.539465,
"home_probability_delta": -6.1e-05,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261004_SD@MIL",
"date": "20261004",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.574449,
"previous_home_win_probability": 0.575537,
"home_probability_delta": -0.001088,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261005_CHW@CLE",
"date": "20261005",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.525605,
"previous_home_win_probability": 0.525679,
"home_probability_delta": -7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261005_NYY@TB",
"date": "20261005",
"outcome": "miss",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.45339,
"previous_home_win_probability": 0.453316,
"home_probability_delta": 7.4e-05,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261006_LAD@ATL",
"date": "20261006",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 3.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
},
{
"game_id": "20261006_MIL@SD",
"date": "20261006",
"outcome": "hit",
"live_config_id": "candidate-8133e99fc8d4e4c7",
"parameter_values_recorded_in_prediction": {
"score.variance_multiplier": 2.25
},
"all_changed_values_verified": true,
"paired_previous_config": false,
"live_home_win_probability": null,
"previous_home_win_probability": null,
"home_probability_delta": null,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": null,
"score_changed_vs_previous_config": null
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
{
"date": "20261006",
"applied_at_utc": "2026-10-07T09:21:41.221033+00:00",
"candidate_id": "candidate-668e4305abca59bc",
"changes": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"new_value": 0.45
}
],
"config_before": "candidate-8133e99fc8d4e4c7",
"config_after": "candidate-668e4305abca59bc",
"metric_baseline_at_apply": {
"brier_score": 0.245566,
"accuracy": 0.5877,
"team_run_mae": 2.4474,
"total_run_mae": 3.6316,
"calibration_error": 0.0992,
"starter_er_mae": 1.6795,
"starter_outs_mae": 4.2393
},
"status": "applied_to_production",
"previous_config_id": "candidate-8133e99fc8d4e4c7",
"new_config_id": "candidate-668e4305abca59bc",
"currently_active": true,
"live_parameter_checks": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"applied_value": 0.45,
"current_live_value": 0.45,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.245566,
"latest_window": 0.244879,
"delta": -0.000687,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5877,
"latest_window": 0.6195,
"delta": 0.0318,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4474,
"latest_window": 2.4159,
"delta": -0.0315,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.6316,
"latest_window": 3.6637,
"delta": 0.0321,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0992,
"latest_window": 0.1324,
"delta": 0.0332,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6795,
"latest_window": 1.6226,
"delta": -0.0569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 4.2393,
"latest_window": 4.184,
"delta": -0.0553,
"direction": "improved",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 7,
"paired_previous_config_predictions": 7,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20261007_CLE@CHW",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.451379,
"previous_home_win_probability": 0.451379,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_LAD@ATL",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.491557,
"previous_home_win_probability": 0.491557,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_MIL@SD",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.505,
"previous_home_win_probability": 0.505,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_TB@NYY",
"date": "20261007",
"outcome": "miss",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.566481,
"previous_home_win_probability": 0.566481,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261008_CLE@CHW",
"date": "20261008",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261010_CHW@CLE",
"date": "20261010",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.537156,
"previous_home_win_probability": 0.537156,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261011_LAD@MIL",
"date": "20261011",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548241,
"previous_home_win_probability": 0.548241,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
}
],
"applied_change": {
"date": "20261006",
"applied_at_utc": "2026-10-07T09:21:41.221033+00:00",
"candidate_id": "candidate-668e4305abca59bc",
"changes": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"new_value": 0.45
}
],
"config_before": "candidate-8133e99fc8d4e4c7",
"config_after": "candidate-668e4305abca59bc",
"metric_baseline_at_apply": {
"brier_score": 0.245566,
"accuracy": 0.5877,
"team_run_mae": 2.4474,
"total_run_mae": 3.6316,
"calibration_error": 0.0992,
"starter_er_mae": 1.6795,
"starter_outs_mae": 4.2393
},
"status": "applied_to_production",
"previous_config_id": "candidate-8133e99fc8d4e4c7",
"new_config_id": "candidate-668e4305abca59bc",
"currently_active": true,
"live_parameter_checks": [
{
"parameter": "confidence.empirical_max_weight",
"old_value": 0.5,
"applied_value": 0.45,
"current_live_value": 0.45,
"currently_matches_applied_value": true
}
],
"metric_observation": {
"status": "observed_later_rolling_window",
"reason": "This is an observational before/latest rolling-window comparison. It is not causal because the windows can overlap and other inputs also changed.",
"metrics": [
{
"metric": "brier_score",
"baseline_at_apply": 0.245566,
"latest_window": 0.244879,
"delta": -0.000687,
"direction": "improved",
"sample_size": 113
},
{
"metric": "accuracy",
"baseline_at_apply": 0.5877,
"latest_window": 0.6195,
"delta": 0.0318,
"direction": "improved",
"sample_size": 113
},
{
"metric": "team_run_mae",
"baseline_at_apply": 2.4474,
"latest_window": 2.4159,
"delta": -0.0315,
"direction": "improved",
"sample_size": 113
},
{
"metric": "total_run_mae",
"baseline_at_apply": 3.6316,
"latest_window": 3.6637,
"delta": 0.0321,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "calibration_error",
"baseline_at_apply": 0.0992,
"latest_window": 0.1324,
"delta": 0.0332,
"direction": "regressed",
"sample_size": 113
},
{
"metric": "starter_er_mae",
"baseline_at_apply": 1.6795,
"latest_window": 1.6226,
"delta": -0.0569,
"direction": "improved",
"sample_size": 212
},
{
"metric": "starter_outs_mae",
"baseline_at_apply": 4.2393,
"latest_window": 4.184,
"delta": -0.0553,
"direction": "improved",
"sample_size": 212
}
]
},
"prediction_influence": {
"status": "paired_effect_observed",
"live_predictions_recorded": 7,
"paired_previous_config_predictions": 7,
"changed_score_predictions": 0,
"interpretation": "Paired rows compare the live promoted configuration with the preserved previous configuration on the same pregame inputs. Unpaired rows prove live parameter consumption but cannot isolate the prediction delta.",
"games": [
{
"game_id": "20261007_CLE@CHW",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.451379,
"previous_home_win_probability": 0.451379,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_LAD@ATL",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.491557,
"previous_home_win_probability": 0.491557,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_MIL@SD",
"date": "20261007",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.505,
"previous_home_win_probability": 0.505,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"previous_predicted_score": {
"away_runs": 4.0,
"home_runs": 5.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261007_TB@NYY",
"date": "20261007",
"outcome": "miss",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.566481,
"previous_home_win_probability": 0.566481,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261008_CLE@CHW",
"date": "20261008",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.495,
"previous_home_win_probability": 0.495,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261010_CHW@CLE",
"date": "20261010",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.537156,
"previous_home_win_probability": 0.537156,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"previous_predicted_score": {
"away_runs": 5.0,
"home_runs": 6.0
},
"score_changed_vs_previous_config": false
},
{
"game_id": "20261011_LAD@MIL",
"date": "20261011",
"outcome": "hit",
"live_config_id": "candidate-668e4305abca59bc",
"parameter_values_recorded_in_prediction": {
"confidence.empirical_max_weight": 0.45
},
"all_changed_values_verified": true,
"paired_previous_config": true,
"live_home_win_probability": 0.548241,
"previous_home_win_probability": 0.548241,
"home_probability_delta": 0.0,
"live_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"previous_predicted_score": {
"away_runs": 3.0,
"home_runs": 4.0
},
"score_changed_vs_previous_config": false
}
]
},
"measurement_status": "paired_effect_observed",
"rollback_monitor": {
"status": "monitoring",
"coverage": {
"paired_games": 7,
"distinct_slates": 4
},
"minimum_paired_games": 30,
"minimum_distinct_slates": 3
}
},
"change_trace_integrity": {
"status": "complete",
"errors": [],
"candidate_events_read": 12,
"applied_changes_read": 10,
"result_events_read": 1772
}
}