Luna deep analysis — slate 20261007
Coverage receipt: COMPLETE · 9/8 sections; 4/4 games; 6/6 causes; 7/7 sources
1. Evidence receipt and gaps
All 7 source_manifest entries are recorded as loaded. The supplied evidence identifies each by path, purpose, and byte count:
prediction review—/app/output/reports/prediction_review_20261007.json, 32,361 bytes; official outcomes and scoring errors.forensic deep audit—/app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20261007.json, 75,958 bytes; probability, provenance, starter, and decision contracts.continuous learning—/app/output/learning/continuous_learning_daily_20261007.json, 681,969 bytes; pipeline-stage quality, calibration, probability lineage, score distribution, and starter comparisons.detailed report—/app/output/reports/detailed_20261007.html, 108,248 bytes; game and simulation rendering.ultra detailed player audit—/app/output/reports/20261007_ultra_detailed_player_audit.html, 6,962,831 bytes; player-level prediction trace.structural audit—/app/output/reports/audit_report_20261007.html, 473,259 bytes; invariant findings.integrity revision audit—/app/output/reports/audit_report_20261007_integrity_revision.html, 1,646,215 bytes; audit of 14 post-start revision artifacts.
The manifest says the files were loaded; this analysis cannot independently verify their contents against the paths. All 4 games listed in the diagnosis are reviewed, matching games_reviewed: 4, expected_games: 4, and the coverage matrix’s 4/4 counts for structural audits, deep audits, continuous-learning games, canonical artifacts, and starter comparisons.
Gaps and internal inconsistencies to retain in the record:
TB@NYYhas no joined player-level actuals: the slate feed has 25 rows but none match that game ID. Its player-level causes therefore cannot be assessed from these data.- The
MIL@SDprobability lineage sayspredicted_side: homeand published pick probability0.505, while the game record predicts MIL (away), the diagnostic says home probability 0.495, and the displayed home-minus-away edge is −0.01. These point to an away pick. This is an internal probability-side/label inconsistency. - Several probability records contain distinct
raw_model_pick_probabilityandgovernor_input_probabilityvalues. The trace records the governor inputs and named transformations, but the meaning and exact ordering of all “raw” fields are not fully explicit. This is a lineage-clarity issue; it does not, by itself, establish an unrecorded calibrated-to-published bypass. probability_reversionsreports one blend flip at the blend stage, four sides surviving to publication, no overwrites, and an emptygameslist. The flip cannot be identified from that object.- The aggregate structural-audit result is 0 critical, 0 error, 0 warning, 4 info; each game says PASS with 0 critical/error/warning and one informational note. Those summaries do not supply the details of the four aggregate informational items.
2. Executive diagnosis
Winner accuracy
The slate went 3/4 (75%), with one miss, TB@NYY. This exceeds the supplied walk-forward accuracy of 0.570149 and historical winner accuracy of 0.600414, but four games do not establish improved performance. The cross-slate winner-accuracy trend is explicitly flat, with mean 0.7381 over the reported series.
A correct winner is not evidence that the score or confidence was good. Three games had the correct winner but substantial run errors.
Calibration quality
The four-game confidence bucket reports average confidence 0.5228, hit rate 0.75, and signed bucket calibration error −0.2272, labeled underconfident under the stated convention (published confidence minus observed hit rate). Its weighted absolute calibration error is 0.2272. That is a large single-slate mismatch, but the bucket contains only four games and the causal register explicitly says not to change calibration on this slate alone.
The reported published pick-side confidence values average approximately 0.528; the bucket’s 0.5228 matches the average of the displayed home probabilities (including probabilities below 0.5), not the average pick-side confidence. The signed-error definition is stated, but the confidence convention underlying that bucket is not fully clear. The conclusion is still poor slate-level alignment, not a reliable direction for a global curve.
Score accuracy
Published team-run MAE is 2.375 and total-run MAE is 3.75 across four games. Team-run absolute errors are 5, 5, 7, and 2. Predicted margins are compressed: 1, 2, 1, and 1 runs, versus actual margins of 6, 3, 2, and 1. The holdout run-model R² values are near zero: home 0.002143, away 0.030936, total 0.002415. Exact score outputs therefore have weak demonstrated signal.
Starter accuracy
All four games have starter comparisons in starter_lines, with identity matches true. The starter outcomes were mixed: CLE’s Daniel Espino allowed one earned run in two outs against a 3-ER projection, while TB’s Max Fried allowed four ER against a 2-ER projection. These comparisons do not show a uniform slate-wide starter miss, and the conspicuous Espino result is identified as an outlier/variance event. The diagnosis does not support tuning starter weights from this slate alone.
Artifact integrity
No supplied game structural audit has critical, error, or warning findings; all four are PASS, and the game diagnostic says the forecast file was clean. Coverage is complete for the four games. These facts argue against a saved-score artifact causing the TB miss. They do not resolve the internal MIL@SD probability-side contradiction or the missing TB player join. The latter are evidence/contract-quality issues to address in reporting and trace validation.
Causal issue register: reconciliation of every entry
- High —
pipeline_winner_instability:historical_ml → variance_appliedreduced winner accuracy by 0.2500 (one hit); affected game MIL@SD. Keep and expose the exact before/after game picks. Do not treat a later recovery as harmless. - High —
single_slate_calibration_instability: weighted absolute calibration error 0.2272 over four games; affects all four. Watch the same buckets over the rolling window before changing calibration. Do not infer a stable calibration curve from this slate. - High —
weak_run_model_signal: holdout home/away/total R² 0.0021/0.0309/0.0024; affects all four. Treat exact scores as low-confidence and investigate features/targets; do not infer that positive but tiny R² makes exact scores reliable. - Info —
complete_slate_audit_coverage: 4/4 structurally audited; all four. Keep the audit receipt. Coverage does not cancel in-game findings. - Info —
probability_publication_delta_explained: one material movement, with recorded score-coherence and/or recency transformations; TB@NYY is listed. Keep every probability layer visible. A published value above a calibrated value is not a bypass when the movement is recorded. - Info —
simulation_inert_on_slate: zero flip candidates and zero published flips; all four. Measure simulation contribution over rolling slates. Zero flips alone is not a defect and does not mean score reconciliation did no work.
No critical or error item appears in the causal register. The separate internal probability-label inconsistency is an evidence/contract issue discussed in section 6.
3. Every game
“Home-minus-away edge” below is the supplied signed system edge, not a probability distance from 50%. A 0.12 signed home-away edge is moderate, not a near coin flip. Runs and starter lines are the supplied projections and outcomes; no missing player results are inferred.
CLE@CHW
- Predicted / actual: CLE 5, CHW 4, predicted CLE; actual CLE 9, CHW 3, actual CLE. Correct winner, wrong score.
- Published confidence / edge / bucket: Published pick probability 0.535129 for away CLE; published home probability 0.465 in the game diagnostic; home-minus-away edge −0.0703, displayed system edge about 0.07; lean.
- Errors: Brier 0.216105; team-run absolute error 5 (CLE off by 4, CHW by 1); total-run bias −3 (9 projected versus 12 actual).
- Starter projected → actual: Daniel Espino, CLE: 3 ER, 12 outs, 6.75 ERA projected; 1 ER, 2 outs, 13.50 ERA actual. Sean Newcomb, CHW: 2 ER, 10 outs, 5.40 ERA projected; 0 ER, 6 outs, 0.00 ERA actual. Both identities match. Espino’s short outing makes the ERA rate an outlier; it does not mean CLE’s offense failed.
- Pregame edges: Season +0.1605, recent +0.030, pitcher −0.008, composite −0.1018 (home-minus-away). Season-quality adjustment was 0.0 because the quality edge was below threshold; pitcher run factors were 0.9914 for CLE runs off the home pitcher and 0.9834 for CHW runs off the away pitcher.
- Confidence/recency controls: Raw pick probability in the trace 0.555841; governor applied, governed probability 0.5486, calibration sample 464, empirical hit rate 0.5819; recency guardrail applied, no numeric discount factor supplied; starter-experience shrinkage not applied. Lineage separately lists raw model pick probability 0.5846.
- Score path and adjustments: Final forecast was 5–4 CLE; volatility action
no_change; Savant adjustment applied. The supplied stage table does not identify a CLE-specific winner flip. - Player evidence: Jo Adell 2-for-4, 3 RBI, run impact +1.42; Patrick Bailey 2-for-4, +0.80; Kyle Teel 1-for-4, 1 RBI, +0.78. These are among the deviations the audit labels supported by above-average contact quality. Other listed contributors include Murakami (−1.25) and Grichuk (−0.93); do not treat those individual results as repeatable parameters.
- Audit and causes: Structural audit PASS, no listed findings; forecast-file integrity reported clean. The game was a correct-winner/wrong-score result, principally a run/score miss. The starter feed identifies Espino’s poor rate line as variance; the official starter comparison also shows he recorded only two outs. Primary/secondary driver fields are null, so no formal driver label is assigned.
LAD@ATL
- Predicted / actual: LAD 6, ATL 4, predicted LAD; actual LAD 4, ATL 1, actual LAD. Correct winner, wrong score.
- Published confidence / edge / bucket: Published pick probability 0.507177 for away LAD; published home probability about 0.493; home-minus-away edge −0.0144, displayed edge about 0.01; toss_up.
- Errors: Brier 0.242875; team-run absolute error 5 (LAD by 2, ATL by 3); total-run bias +5 (10 projected versus 5 actual).
- Starter projected → actual: Tyler Glasnow, LAD: 2 ER, 16 outs, 3.38 ERA projected; 1 ER, 14 outs, 1.93 ERA actual. Tyler Mahle, ATL: 3 ER, 15 outs, 5.40 ERA projected; 1 ER, 19 outs, 1.42 ERA actual. Both starters performed better, by ERA, than projected.
- Pregame edges: Season −0.6096, recent −0.314, pitcher +0.1387, composite −0.4686 (home-minus-away). Season-quality adjustment moved the score toward LAD by −0.256; pitcher run factors were 0.9252 (LAD) and 1.0639 (ATL).
- Confidence/recency controls: Trace raw pick probability/governor input 0.535236; governed 0.5084, calibration sample 612, empirical hit rate 0.5474; recency guardrail applied, numeric factor absent; starter-experience shrinkage not applied. Lineage’s separate raw-model field is 0.5097.
- Score path and adjustments: Published score 6–4 LAD;
large_savant_run_environment_swingdiagnostic flag; Savant adjustment applied; volatility actionno_change. The final run total remained five too high. - Player evidence: No player-level breakdown supplied for this game.
- Audit and causes: Structural audit PASS; forecast-file integrity reported clean. The winner was right, but both starters beat their ERA projections and the total was over-projected by five. The supplied record does not assign a formal primary/secondary cause.
MIL@SD
- Predicted / actual: MIL 6, SD 5, predicted MIL; actual MIL 3, SD 1, actual MIL. Correct winner, wrong score.
- Published confidence / edge / bucket: Game diagnostic gives home probability 0.495, away pick probability 0.505, home-minus-away edge −0.01; toss_up. Probability lineage instead says predicted side home, published pick probability 0.505. This is the noted side-label contradiction.
- Errors: Brier 0.245025; team-run absolute error 7 (MIL by 3, SD by 4); total-run bias +7 (11 projected versus 4 actual).
- Starter projected → actual: Robert Gasser, MIL: 2 ER, 11 outs, 4.91 ERA projected; 1 ER, 12 outs, 2.25 ERA actual. Walker Buehler, SD: 3 ER, 11 outs, 7.36 ERA projected; 1 ER, 9 outs, 3.00 ERA actual. Both performed better by ERA than projected.
- Pregame edges: Season −0.723, recent +0.334, pitcher −0.0447, composite −0.2325 (home-minus-away). Season-quality margin adjustment −0.3037; run factors 1.0173 for MIL and 0.9726 for SD.
- Confidence/recency controls: Trace raw pick/governor input 0.524296; governed 0.505, sample 567, empirical hit rate 0.5485; no recency guardrail; starter-experience shrinkage not applied. Lineage separately lists raw-model probability 0.5.
- Score path and adjustments: Published score 6–5 MIL; Savant adjustment applied; volatility action
no_change. Pipeline stages show this is the one game with a winner-direction regression at variance application and later recovery; details appear in section 4. - Player evidence: No player-level breakdown supplied.
- Audit and causes: Structural audit PASS; forecast-file integrity reported clean. The three-run total over-projection is consistent with the starter comparisons and the supplied run factors, but there are no player actuals here to allocate the offense/bullpen portions. Formal primary/secondary cause fields are null.
TB@NYY
- Predicted / actual: TB 3, NYY 4, predicted NYY; actual TB 4, NYY 3, actual TB. Only winner miss.
- Published confidence / edge / bucket: Published home NYY probability 0.544016, home-minus-away edge +0.088 (displayed edge about 0.09); lean. This is a meaningful moderate home edge, not a near-coin-flip edge.
- Errors: Brier 0.295953; team-run absolute error 2 (each side off by 1); total-run bias 0 (7 projected, 7 actual). The total was right while the run allocation and winner were wrong.
- Starter projected → actual: Nick Martinez, TB: 2 ER, 13 outs, 4.15 ERA projected; 2 ER, 11 outs, 4.91 ERA actual. Max Fried, NYY: 2 ER, 16 outs, 3.38 ERA projected; 4 ER, 17 outs, 6.35 ERA actual. Both identities match; Fried’s ER were two above projection, while Martinez matched projected ER.
- Pregame edges: Season +0.1757, recent +0.182, pitcher −0.0142, composite +0.2909 (home-minus-away). The net pregame signals favored NYY despite the near-neutral pitcher edge. Season-quality adjustment was 0.0; run factors were 0.9797 (TB) and 0.9655 (NYY).
- Confidence/recency controls: Trace raw pick/governor input 0.521431; governed/calibrated 0.5665, sample 393, empirical hit rate 0.5674; recency guardrail applied, no numeric factor supplied; starter-experience shrinkage not applied. Lineage separately gives raw-model probability 0.6185. Score-coherence probability is 0.566481 and published probability 0.544016; the recorded transformation is score coherence followed by matchup-recency guardrail.
- Score path and adjustments: Published score 3–4 NYY;
large_savant_run_environment_swingflag; Savant adjustment applied; volatility actionno_change. Prediction put one run on the wrong side. - Player evidence: Not available because none of the 25 feed rows joined to this game ID. No player result should be inferred.
- Audit and causes: Structural audit PASS, forecast-file integrity reported clean. Recorded primary driver is mixed (“Several errors of similar size”), no secondary driver. Fried’s additional ER are a plausible starter contribution, but the data do not isolate offense, bullpen, or individual-player causes. The score total itself was not the problem; pregame side selection and run allocation were.
4. Miss reconstruction
TB@NYY: earliest wrong-direction evidence and attribution
The earliest explicitly supplied pregame evidence already favored the result that lost: season edge +0.1757, recent edge +0.182, and composite home edge +0.2909 all favored NYY; pitcher edge was only −0.0142 for the home side. The confidence trace then reports governed probability 0.5665 for the home pick, and the published home probability remains 0.544016. The system therefore did not merely miss on a nominal 0.50 selection: its published lean was for NYY at a 0.088 home-away edge.
The probability fields are not fully ordered transparently: the trace governor input is 0.521431, but the governed output is 0.5665; the separate lineage raw-model field is 0.6185. The named calibration/governor, score-coherence, and recency stages are recorded, so the supplied evidence does not justify calling the calibrated-to-published movement a bypass. It does justify checking the mapping and semantics of the multiple raw fields.
Attribution by category:
- Bad input: No specific faulty game input is established. Starter identities match. A player-actual join is missing, so player-level diagnostics are incomplete—not evidence that the model’s pregame inputs were wrong.
- Bad weighting: Season and recent evidence both pointed home, while the pitcher edge was nearly neutral and away-leaning. The miss is consistent with a side-weighting error, but one game does not establish which edge should have been weighted differently.
- Calibration: This was a lean with published home probability 0.544, not a high-conviction pick. It lost, but the four-game bucket was underconfident in aggregate because three of four picks hit. Calibration is a persistent cross-slate concern, not a proven TB-specific cause.
- Starter error: Fried allowed 4 ER versus 2 projected. Martinez allowed the projected 2 ER. This supports a home-starter contribution; it does not explain the entire loss by itself.
- Offense/bullpen miss: Player actuals are absent. The team-score split was off by one run on each side, but no offensive or bullpen attribution is available.
- Run-environment miss: Total runs were exactly right (7), so a total-level environment miss is not demonstrated for TB. The allocation across teams was wrong.
- Irreducible variance: Still plausible, especially for the starter/side outcome, but the supplied evidence cannot quantify it.
Pipeline-stage quality across all stages and transitions
All stages are measured against official final scores; positive deltas versus historical_ml are regressions.
| Stage | Winner hits | Winner accuracy | Team-run MAE | Total-run MAE | Margin MAE | Change in winner direction |
|---|---|---|---|---|---|---|
historical_ml | 3/4 | 0.75 | 1.8898 | 3.7594 | 2.6745 | Baseline |
variance_applied | 2/4 | 0.50 | 1.875 | 3.75 | 2.75 | MIL: MIL → TIE |
enhanced_prediction | 2/4 | 0.50 | 2.0 | 3.0 | 3.0 | MIL: TIE → SD |
kpi_layer | 2/4 | 0.50 | 2.0 | 3.0 | 3.0 | No change |
embedded_savant_run_environment | 2/4 | 0.50 | 2.125 | 3.25 | 2.75 | No change |
fundamental_edge_target_review | 3/4 | 0.75 | 2.375 | 3.75 | 2.25 | MIL: SD → MIL |
capped_target | 3/4 | 0.75 | 2.375 | 3.75 | 2.25 | No change |
simulation_result | 3/4 | 0.75 | 2.375 | 3.75 | 2.25 | No change |
published_final | 3/4 | 0.75 | 2.375 | 3.75 | 2.25 | No change |
The historical → variance transition regressed winner accuracy by one hit (−0.25) on MIL@SD; its team-run MAE improved only 0.0148. The next stage changed MIL from tie to SD without restoring the correct direction. The embedded-Savant-to-fundamental-review transition later flipped MIL from SD to MIL and restored the slate to 3/4. That recovery does not erase the intermediate regression. From fundamental review onward, the score and winner did not change through publication; simulation produced no winner intervention.
Team-run MAE ended 0.4852 worse than historical ML, despite margin MAE improving 0.4245. Total-run MAE finished essentially unchanged from the historical baseline (3.75 versus 3.7594). This is not a consistent score-quality improvement.
5. Cross-game counterfactuals
Every supplied lever_tension entry:
score.variance_multiplier / score.variance_floor(widen run distributions), targets Brier/calibration- Helps: none identified.
- Hurts: none identified.
- Evidence: 0 helped vs 0 hurt. There were no high-conviction games and no high-raw cluster. This slate does not demonstrate that widening distributions would improve particular games. A bounded shadow test is defensible only because of the persistent calibration pattern, not because this entry shows a per-game win.
player.pitcher.v4form weights /player.pitcher_prior_games, targets starter ER/outs MAE- Helps: none identified.
- Hurts: none identified.
- Evidence: 0 helped vs 0 hurt. CLE’s Espino outlier and TB’s Fried miss pull in different directions; neither establishes a systematic starter-weight change.
recent.* / season.*run-mean weighting- Helps: CLE@CHW (team runs off by 5), LAD@ATL (off by 5), MIL@SD (off by 7).
- Hurts: TB@NYY (team runs already close, off by 2; reweighting risks disturbing it).
- Evidence: 3 helped vs 1 hurt on run error. This supports testing the run-mean weighting against run-error metrics, but not a claimed winner-accuracy improvement or an unqualified live change; the data do not specify a direction or which sub-weight to alter.
Tempting one-game fixes to reject:
- Do not change pitcher weights solely to prevent a repeat of Espino’s two-out outing or Fried’s four ER. The observed starter results are mixed, and the cross-game pitcher tension shows no demonstrated benefit.
- Do not increase TB’s home-confidence adjustment because its total was correct; the home side lost and the player feed is missing.
- Do not use CLE’s Adell or Teel game as a one-game hitter-weight calibration. The audit says their deviations have supporting contact quality, but one slate and a 15-hitter sample do not establish a stable adjustment.
- Do not interpret the “3 helped/1 hurt” run-mean tension as evidence to change winner selection; its direct evidence is team-run error.
6. Data and contract defects
Audit findings and severity counts
- Per-game structural audits: all four games have status PASS, risk score 0, and no listed findings. Each reports 0 critical, 0 error, 0 warning, 108 good, and 1 info.
- Aggregate structural audit summary: 0 critical, 0 error, 0 info, 0 warning in its separate summary object, whereas the per-game summaries sum to four informational notes. This is a reporting-summary discrepancy, not proof of an invariant failure.
- Coverage matrix: all reported structural/deep/learning/starter/canonical counts are 4/4 and
all_games_structurally_audited: true. It is appropriate to say game-level structural coverage is complete, but not that every diagnostic is complete: TB player-level actuals do not join. - Source-integrity statements: all four game diagnostics say forecast-file integrity is clean; the integrity revision audit says 14 revision artifacts were audited, but no finding detail is supplied.
- Causal register findings: the three high and three info items are reproduced in section 2; none is a structural critical/error finding.
Specific contract and data issues
- MIL probability-side label inconsistency: lineage says home side/pick 0.505; game score, displayed edge, and diagnostic home probability imply away MIL is the pick at 0.505. Treat as an evidence/contract error requiring label validation. The contradictory label should not be silently used in calibration summaries.
- Probability-field semantics: lineage’s separate raw-model probability differs from the governor input/trace raw pick value for all four games. The named stages explain the calibrated/governed and calibrated-to-published changes at a high level, but the raw-field definitions and transition ordering should be explicit.
probability_reversionsincomplete event identification: one blend-stage flip is reported, butgamesis empty. No game can be named from this field, so it is not possible to check that flip against the per-game trace.- TB player join gap: no per-player actuals joined for TB@NYY. This is a forensic coverage gap for player causality, not a demonstrated score artifact defect.
- Calibration bucket convention: the reported average 0.5228 matches the mean of the displayed home probabilities, while the prediction outcomes are pick-side outcomes. Because the bucket’s confidence convention is not fully described and MIL is mislabeled, its summary should be interpreted cautiously.
Complete pick-side probability lineage
Values below preserve the supplied lineage. “Governor input” corresponds to the trace’s raw pick probability; the separate raw-model field is also shown so the distinction is visible.
| Game | Separate raw model | Governor input → output / calibrated | Score coherence → published | Recency / recorded transformation |
|---|---|---|---|---|
| CLE@CHW | 0.5846 | 0.555841 → 0.5486 / 0.5486 | 0.548621 → 0.535129 | Guardrail applied; named score coherence then matchup-recency |
| LAD@ATL | 0.5097 | 0.535236 → 0.5084 / 0.5084 | 0.508443 → 0.507177 | Guardrail applied; published value recorded as matching calibrated/governed value |
| MIL@SD | 0.5000 | 0.524296 → 0.505 / 0.505 | 0.505 → 0.505 | No guardrail; published equals calibrated. Side label conflicts with game record. |
| TB@NYY | 0.6185 | 0.521431 → 0.5665 / 0.5665 | 0.566481 → 0.544016 | Guardrail applied; named score coherence then matchup-recency |
All four lineage entries say unexplained_material_delta: false. Calibrated-to-published movements are recorded as score-coherence and/or recency transformations; the TB material movement is therefore not called a bypass. The audit register specifically says TB’s published value being above a calibrated one is not a governor bypass when the recorded transformations explain it. The raw-model/governor-input distinction and the absent numeric recency factors remain trace-clarity issues, not established unrecorded bypasses.
7. Cross-slate persistence
Cross-slate findings and escalation status
The report includes 10 prior slates and an 11-slate trend window. Finding streaks:
| Finding | Consecutive slates | Present now? | Persistence interpretation |
|---|---|---|---|
pipeline_winner_instability | 1 | Yes | Current-slate regression; not an established multi-slate streak. |
score_margin_compression | 0 | No | Incidence in window is 4, but it is not current and has no present streak. |
simulation_inert_on_slate | 11 | Yes | Escalated, established failure pattern; do not dismiss as single-slate noise. |
single_slate_calibration_instability | 5 | Yes | Escalated persistent calibration pattern. |
weak_run_model_signal | 5 | Yes | Escalated persistent near-zero run-signal pattern. |
For every escalated finding:
simulation_inert_on_slate— 11 consecutive, 11 incidences; targetssimulation.allow_score; metrics team-run MAE and total-run MAE. Direction: ensure the simulation module is actually producing an independent, informative distribution rather than a silent no-op. The self-assessment identifies the shared target-search draws and early exit as the root cause; fix/diagnose the simulation path, not a forced parameter change.single_slate_calibration_instability— 5 consecutive, 8 incidences; targetsconfidence.empirical_max_weight,confidence.base_cap,confidence.moderate_cap; metrics Brier and calibration error. Direction: increase empirical shrinkage via a bounded shadow experiment, then judge on rolling Brier/calibration.weak_run_model_signal— 5 consecutive, 9 incidences; liststraining.xgb.n_estimators,training.xgb.max_depth, andtraining.xgb.learning_rate, but is marked not parameter-actionable. The self-assessment says no nightly knob can supply missing run signal; investigate features/target with an isolated training backtest. Do not turn those listed training controls into an unsupported tuning change.
The self-assessment separately records run_model_near_zero_signal, with total/home/away R² 0.002415/0.002143/0.030936, as an operator action. This agrees with the escalated weak-run-signal finding rather than adding a reason for a nightly parameter adjustment.
Structural cross-slate evidence
- Margin distribution: actual margins were 1, 2, 3, 6; predicted margins were 1, 1, 1, 2. All four predicted margins were ≤2; one actual margin was ≥4. CLE@CHW had signed margin error −5 in that block; other listed errors were −1, −1, 0. This is evidence of slate-level compression, but
score_margin_compressionis not current and has a zero consecutive streak. - Calibration monitoring: four settled games; confidence bucket average 0.5228, observed hit rate 0.75, weighted absolute calibration error 0.2272. This is current-slate evidence within a five-slate escalation.
- High-raw cluster: threshold 0.65, but 0 games, 0 hits. There is no high-raw-cluster performance evidence on this slate.
- Simulation control: four observed games, 0 flip candidates, 0 published flips, priority P2,
diagnostic_only_without_independent_support. This aligns with the 11-slate escalation. - Pipeline transitions: the historical-to-variance MIL regression is current. Later recovery does not remove that intermediate-direction defect.
- Validation: 2,415 historical-temporal rows; winner accuracy 0.600414, walk-forward accuracy 0.570149, Brier 0.239378, walk-forward Brier 0.242204. These are broader baselines, not evidence that run scores are reliable.
Metric trends and top-confidence-pick streak
The trend directions are explicitly:
- Margin bias: regressing, mean −1.619.
- Mean team-run error on losses: improving, mean 2.86.
- Weighted calibration error: improving, mean 0.3854; despite the direction, its current value is 0.2272 and the finding has escalated.
- Winner accuracy: flat, mean 0.7381.
The top-confidence-pick loss streak is 1: the 20261005 top pick missed, 20261006 hit, and 20261007 missed. The current slate’s top-confidence pick is therefore a loss but does not extend a consecutive loss streak from 20261005 because a hit intervened. Two dates in the supplied sequence are blank/unknown and should not be treated as results.
8. Adjustments for today
These are bounded proposals for shadow evaluation, not live changes. Persistence is ranked ahead of single-slate evidence. No promotion is recommended from this diagnosis alone.
- Persistent calibration instability — shadow
confidence.empirical_max_weightupward by +0.02 absolute. - Reason/rank: five consecutive slates, 8 incidences; strongest parameter-actionable persistent pattern. The registered direction is increased empirical shrinkage.
- Expected metrics: lower rolling Brier and lower absolute calibration error; evaluate by confidence bucket and overall, not this four-game result alone.
- Games/tension: no named confidence lever tension lists game-level help/harm. TB@NYY is the current miss with a lean home probability of 0.544 and should be monitored for overconfidence regressions; three of four picks hit, so do not frame this as evidence to indiscriminately suppress all confidence.
- Risk/gate: small shadow-only test with rolling calibration and Brier rollback monitoring. Do not infer that the change will fix TB specifically.
- Persistent simulation inertness — code/diagnostic action, not a parameter move.
- Registered target:
simulation.allow_scoreis listed, but the finding is markedparam_actionable: false; the self-assessment gives a code-level root cause. - Action: inspect the simulation path so score-target realization and win-probability estimation use an independent, unsteered distribution that does not early-exit; record its contribution before/after. The supplied action describes an independent batch or closed-form run-difference distribution and a registered batch-size control.
- Expected metrics: first establish a non-vacuous distribution and measure team-run/total-run MAE contribution across rolling slates; do not promise a winner-accuracy gain from this slate.
- Games/tension: zero flip candidates across the four games; no per-game help or harm is identified in lever tension.
- Risk/rank: persistent 11-slate evidence warrants priority diagnostic/code work. Do not force
simulation.allow_scoreas a tuning change in place of fixing the no-op behavior.
- Persistent weak run signal — isolated feature/target backtest, not a nightly parameter change.
- Registered levers listed:
training.xgb.n_estimators,training.xgb.max_depth,training.xgb.learning_rate; finding is explicitly not parameter-actionable. The supplied action calls for a manual isolated training backtest. - Action: test the shared feature contract and target with the supplied candidate feature families—source-labelled no-vig market probabilities when available, park/weather, bullpen rest/fatigue, and platoon-adjusted lineup quality—then compare same-fingerprint holdout R²; bump the model schema version if semantics change.
- Expected metrics: improve holdout run-target R² and out-of-sample team-/total-run error without degrading winner or calibration measures.
- Games/tension: CLE, LAD, and MIL have the largest team-run errors and are listed as helped by run-mean reweighting; TB is the close-score harm case. The persistent code/feature diagnosis applies slate-wide; no single listed feature is proven by these four games.
- Risk/rank: high scope and operator effort, but the persistent near-zero R² is stronger evidence than any one-game score adjustment. No XGBoost knob-only shadow is recommended absent an isolated feature/target comparison.
- Strongest single-slate structural driver — shadow
score.variance_multiplierupward by 2% relative to its current value. - Reason/rank: every predicted margin was at most two runs while one actual margin was six; this is a concrete current-slate compression signal. It is weaker than the persistent findings, and the associated cross-slate streak is currently zero.
- Expected metrics: test whether score-distribution calibration/Brier improves; do not expect a direct improvement in run-mean MAE, since widening variance does not correct a biased mean.
- Games/tension: the variance lever’s tension record identifies no helped and no hurt games, so no game-specific benefit is claimed. Monitor the close TB@NYY score and the three correct-winner/wrong-score games for regressions.
- Risk/gate: shadow only; roll back if rolling Brier/calibration or score-distribution checks deteriorate. The supplied evidence does not support a live change or a larger adjustment.
No recent.* / season.* run-mean change is recommended today: its slate tension is 3 helped versus 1 hurt, but the entry does not specify the direction or sub-weight, and its clearest evidence concerns run errors rather than winners. No pitcher-weight change is recommended from this mixed slate.
9. Bottom line
Known: the slate finished 3/4, with three correct winners but materially inaccurate scores; TB@NYY was the only winner miss, despite a moderate 0.088 published home edge. The pipeline temporarily moved MIL in the wrong winner direction at variance application before later recovering. Run-model holdout signal is near zero, calibration instability and simulation inertness are persistent escalations, and the saved forecast artifacts passed the reported game-level structural checks.
Uncertain: the precise TB offensive/bullpen/player contribution, the causal source of the wrong team-run allocation, the interpretation of every raw probability field, and whether a variance change would improve outcomes. TB player actuals are missing; MIL probability-side lineage is internally inconsistent.
Safest next action for the very next slate: preserve the full probability and stage trace, add a contract check that rejects side/probability-label contradictions such as MIL@SD, and keep any calibration change in a bounded shadow experiment with rolling Brier/calibration monitoring. This addresses a concrete evidence-integrity risk without pretending that one slate identifies a winning model adjustment.