Luna deep analysis — slate 20261011

Coverage receipt: COMPLETE · 9/8 sections; 1/1 games; 4/4 causes; 7/7 sources

1. Evidence receipt and gaps

All seven source_manifest entries are marked loaded:

SourceStatus and stated purpose
Prediction review, /app/output/reports/prediction_review_20261011.json (11,400 bytes)Loaded; official outcomes and scoring errors
Forensic deep audit, /app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20261011.json (30,976 bytes)Loaded; probability, provenance, starter, and decision contracts
Continuous learning, /app/output/learning/continuous_learning_daily_20261011.json (181,366 bytes)Loaded; stage quality, calibration, probability lineage, score distribution, starter comparisons
Detailed report, /app/output/reports/detailed_20261011.html (31,609 bytes)Loaded; game and simulation rendering
Ultra-detailed player audit, /app/output/reports/20261011_ultra_detailed_player_audit.html (1,635,801 bytes)Loaded; player-level prediction trace
Structural audit, /app/output/reports/audit_report_20261011.html (120,679 bytes)Loaded; invariant findings
Integrity revision audit, /app/output/reports/audit_report_20261011_integrity_revision.html (344,105 bytes)Loaded; structural audit of three post-start game revisions

Slate coverage: The diagnosis reports one expected game and one game reviewed; continuous-learning, forensic-deep-audit, starter-comparison, and structural-audit coverage are each 1/1. The reviewed game is LAD@MIL. No additional game is identified as missing by the supplied coverage matrix.

Gaps and internal contradictions:

2. Executive diagnosis

Winner accuracy: 1/1 (100%), MIL correctly predicted. This is a correct winner call, not a correct score forecast. The model’s holdout winner accuracy is 0.600414, and its walk-forward accuracy is 0.570149; one winning call does not validate those broader estimates.

Calibration quality: Published MIL win probability was 0.548241 (about 54.8%), with a home-minus-away probability edge of 0.0965 (about 9.65 percentage points). The pick was a hit, producing Brier score 0.204086. The single-slate calibration bucket had average confidence 0.5482 and observed hit rate 1.0, so confidence-minus-hit-rate was −0.4518; the monitor labels that bucket underconfident, and weighted absolute calibration error was 0.4518. This is a one-game bucket, not evidence for a stable calibration curve. A confidence edge of 0.12, if encountered elsewhere, is moderate—not a near coin flip; this game’s edge was smaller, about 0.10.

Score accuracy: The published score was LAD 2, MIL 4; the actual score was LAD 1, MIL 2. Winner was right, but both team-run forecasts were high: LAD by 1 and MIL by 2. The total was forecast at 6 versus 3 actual, a +3 total-run bias/error. Team-run absolute error is 3 as reported. Exact score quality should be treated cautiously: validated holdout run-model R² is only 0.002143 home, 0.030936 away, and 0.002415 total.

Starter accuracy: Both starter identities matched. Skubal was projected for 4 ER, 5.68 ERA, and 19 outs; actual was 2 ER, 3.60 ERA, and 15 outs. Misiorowski was projected for 1 ER, 1.69 ERA, and 16 outs; actual was 1 ER, 2.08 ERA, and 13 outs. The away starter substantially outperformed the projected ERA/ER line, while the home starter allowed the projected ER but had a higher actual ERA and fewer outs. This is mixed starter performance, not a uniform starter miss.

Artifact integrity: The per-game structural audit passed, with no critical/error/warning findings; forecast-file integrity is explicitly called clean. No artifact defect is identified as the cause of this game’s score error. The conflicting raw-probability fields remain a provenance ambiguity that should be reconciled, but the reported published probability matches the governed value and the lineage says no unexplained material delta.

Causal issue register, reconciled entry by entry:

  1. High — single_slate_calibration_instability. Evidence: weighted absolute calibration error 0.4518 across one game, affecting LAD@MIL. Recommended action: watch the same confidence buckets over a rolling window before changing calibration weights. Guardrail: a single slate is far too small to establish a stable calibration curve. This high-severity label marks material calibration risk, not a critical evidence failure.
  2. High — weak_run_model_signal. Evidence: home/away/total R² 0.0021/0.0309/0.0024, affecting LAD@MIL. Recommended action: treat exact scores as low-confidence; seek stronger features or a better target before tuning score tails. Guardrail: small positive R² only means better than guessing the average; it does not make exact scores reliable.
  3. Info — complete_slate_audit_coverage. Evidence: 1/1 games structurally audited. Action: keep the per-game audit receipt in every report. Guardrail: full coverage does not cancel findings inside audited games.
  4. Info — simulation_inert_on_slate. Evidence: 0 flip candidates, 0 published flips, affecting LAD@MIL. Action: measure simulation contribution over rolling slates, separating score realization from winner flipping. Guardrail: zero winner flips alone is not a defect and does not show that score reconciliation did no work. The cross-slate escalation changes the persistence diagnosis; see sections 7–8.

3. Every game

LAD@MIL — correct winner, wrong score

4. Miss reconstruction

There were no winner losses: misses 0, hits 1. There is consequently no losing pick for which to reconstruct the earliest stage that moved the predicted winner toward the wrong result. The score forecast did miss, and stage-level score metrics show where run and margin errors changed.

Score-stage quality, compared directly with the official final score:

StageTeam-run MAEChange vs historical MLTotal-run MAEMargin MAEChange in winner accuracy
historical_ml2.98430.00005.96850.3521Baseline; 1/1
variance_applied3.0000+0.01576.00000.00000
enhanced_prediction2.0000−0.98434.00000.00000
kpi_layer2.0000−0.98434.00000.00000
embedded_savant_run_environment1.5000−1.48433.00001.00000
fundamental_edge_target_review1.5000−1.48433.00001.00000
capped_target1.5000−1.48433.00001.00000
simulation_result1.5000−1.48433.00001.00000
published_final1.5000−1.48433.00001.00000

The transition log reports no changed-direction games and no winner-direction regressions. It does, however, show a score-metric tradeoff: historical ML → variance worsened team-run MAE by 0.0157 while margin MAE improved by 0.3521; variance → enhanced prediction improved team-run MAE by 1.0; KPI made no change; KPI → embedded run environment improved team-run MAE by 0.5 but worsened margin MAE by 1.0. Later improvements in team-run/total-run error do not erase the intermediate margin regression. The supplied per-stage table does not provide each stage’s exact predicted score, so those scores cannot be reconstructed from these MAEs alone.

Cause categories for this game:

Pipeline-stage audit across all stages and transitions: All nine recorded stages and all eight transitions are accounted for above. Winner accuracy remains 1/1 at every stage; changed-direction, improved-game, and regressed-game arrays are empty. The numerical MAE deltas still matter: variance_applied slightly worsened team-run MAE; enhanced_prediction improved it; the embedded environment stage improved team-run and total-run errors but regressed margin MAE. fundamental_edge_target_review, capped_target, simulation_result, and published_final then leave those metrics unchanged. A later score-error recovery therefore does not erase the intermediate margin regression.

5. Cross-game counterfactuals

There is one game, so “helps” and “hurts” can only name that game; the supplied lever_tension entries all explicitly report no helped games and no hurt games. That is absence of counterfactual evidence, not proof of neutrality.

Lever tension entryGames it helps / hurtsNet evidence on changing it
score.variance_multiplier / score.variance_floor (widen run distributions); targets Brier and calibration errorHelps: none listed. Hurts: none listed.No slate-specific help/hurt evidence. Do not infer that widening variance fixes the +3 total-run mean bias; variance is a spread lever.
player.pitcher.v4 form weights / player.pitcher_prior_games; targets starter ER/outs MAEHelps: none listed. Hurts: none listed.No counterfactual evidence. Starter outcomes were mixed; no game-based case for changing these weights.
recent.* / season.* run-mean weighting; targets team-run MAE, total-run MAE, accuracyHelps: none listed. Hurts: none listed.The game’s total was over-projected, but the single game does not show whether a recent/season reweighting would correct it. Cross-slate lineup evidence supports investigating the run environment, not a broad untested reweighting.

Tempting one-game fixes not justified: Do not raise MIL’s hitter projections solely from Turang and Vaughn’s results, lower LAD projections solely from Pages’ result, or adjust pitcher weights from these two starts. Do not change calibration weights because the one-game bucket error is large; the monitor expressly recommends rolling-window observation. Do not widen score variance as a substitute for correcting a possibly hot run mean. These changes either lack counterfactual support or risk learning from one-game noise.

6. Data and contract defects

Audit finding inventory available in the supplied diagnosis:

Model versus artifact defects:

7. Cross-slate persistence

Raw structural evidence:

Every finding_streaks entry:

FindingConsecutive-slate countPresent now?Context
pipeline_winner_instability0NoIncidence 1 in an 11-slate window; no target lever.
score_margin_compression0NoIncidence 2; target levers score.variance_multiplier, score.variance_floor.
simulation_inert_on_slate11YesIncidence 11/11; targets simulation.allow_score; target metrics team-run and total-run MAE.
single_slate_calibration_instability2YesIncidence 9; targets confidence.empirical_max_weight, confidence.base_cap, confidence.moderate_cap.
weak_run_model_signal2YesIncidence 9; targets training XGBoost estimator count, depth, and learning rate; this finding is marked not parameter-actionable.

Escalated finding—established failure, not single-slate noise: simulation_inert_on_slate is explicitly escalated at 11 consecutive slates. Treat it as an established simulation/process failure pattern. The self-assessment gives a concrete suspected mechanism: the same draws are used both to search for a target-realizing play-by-play and to form the win-probability distribution, with early exit after finding a realization (default draw count around 2). It says this can make the win-rate/agreement signal vacuous. That is a supplied diagnosis, not an independently verified code execution result. The specified action is to confirm the module runs rather than silently no-oping, then separate target-score realization from an independent, unsteered win-probability batch (or a closed-form distribution), and feed a meaningful win-rate to the final policy.

8. Adjustments for today

Recommendations are ranked by evidence strength, persistence, scope, expected metric, affected games, and regression risk. These are proposed changes or shadow tests only; no changes have been applied.

  1. Persistent, escalated simulation failure — code/diagnostic action, not a forced parameter move.
  2. Registered target: simulation.allow_score; target metrics team_run_mae, total_run_mae.
  3. Bounded action: Do not change the parameter based on this record: the finding is marked param_actionable=false, and the self-assessment specifically calls for an operator/code fix. In shadow, instrument whether the simulation is actually invoked, its draw count, early-exit reason, and whether an independent unsteered distribution is produced. Implement the stated separation of score-target realization and win-probability estimation, with batch size registered; compare a bounded 200–500 independent draws against a closed-form alternative as an isolated diagnostic.
  4. Expected metric/direction: Establish that simulation contributes non-vacuous distribution information; then measure team-run and total-run MAE and winner-probability agreement across rolling slates. No numerical improvement is promised from this one slate.
  5. Lever-tension games: None recorded as helped or hurt. Current relevant game, LAD@MIL, had no winner flip; its eventual score error does not prove the simulation caused it.
  6. Risk: Moderate code/integration risk; shadow comparison and a rollback monitor are preferable to changing live behavior blindly.
  1. Persistent lineup/run-environment overprojection — bounded shadow test, not a variance fix.
  2. Evidence: The actionable cross-slate bias is negative on 7/10 slates, mean −0.751, z −2.13; current game’s total was over-projected by 3 and the two-side lineup delta averaged −1.5.
  3. Registered lever: recent.* / season.* run-mean weighting is the available lever-tension entry targeting team-run MAE, total-run MAE, and accuracy. A small 2% reduction in the run-mean contribution of the currently over-projecting component, evaluated in shadow only, is a bounded test—not a claim that the JSON identifies which component is at fault. Do not use score.variance_floor to lower the mean: the bias register explicitly calls that a spread lever and says to check the run environment first.
  4. Expected metric/direction: Team-run MAE and total-run MAE should decline if the run-mean overprojection is genuine; monitor winner accuracy as a guardrail.
  5. Lever-tension games: The entry lists no helped or hurt games. LAD@MIL is consistent with the overprojection symptom, but is not a counterfactual. Regression risk is uncertain because the register supplies no game-level tension sample.
  6. Gate: Require rolling, same-slate shadow comparison and rollback if winner accuracy worsens or run-error improvement fails to repeat.
  1. Single-slate calibration anomaly — hold calibration parameters today.
  2. Registered targets: confidence.empirical_max_weight, confidence.base_cap, confidence.moderate_cap.
  3. Evidence and metric: Current weighted absolute calibration error 0.4518 on one settled game; cross-slate weighted calibration trend is flat, mean 0.4528. The finding has a two-slate consecutive streak, but the current bucket still has only one observation.
  4. Recommendation: No live cap/weight change from this evidence. Record bucket-level sample counts and evaluate those exact registered parameters in a rolling shadow test; the current causal issue itself recommends waiting for the rolling bucket window.
  5. Expected metric/direction: Brier score and calibration error should improve if a change is supported by adequate rolling data; guard against degraded winner accuracy.
  6. Lever-tension games: None of the listed lever-tension entries concerns calibration caps, and none names helped/hurt games. LAD@MIL was a hit at 0.548, so it is not a calibration-loss example.
  1. Weak run-model signal — prioritize feature/target work over nightly tuning.
  2. Registered targets: training.xgb.n_estimators, training.xgb.max_depth, training.xgb.learning_rate, but the finding is marked param_actionable=false.
  3. Recommendation: No bounded hyperparameter move. Follow the supplied operator action: improve features/target (including properly source-labelled market data when available, park/weather run environment, bullpen rest/fatigue, and platoon-adjusted lineup quality), then run an isolated same-fingerprint training backtest and bump the model schema version if feature semantics change.
  4. Expected metric/direction: Improve holdout run-target R² and team-/total-run MAE in a controlled backtest. Current R² is near zero; a one-slate parameter change is not a sound remedy.
  5. Lever-tension games: The current recent.* / season.* tension row lists none helped or hurt. LAD@MIL’s score error is one example, not proof that any of the training parameters will fix it.
  6. Risk: Feature-contract and retraining changes have broader scope; require isolated validation before promotion.
  1. No starter-weight change.
  2. Starter ERA bias is explicitly on hold: 6/10 same sign, z −0.83, not separable from noise. The starter lever-tension entry lists no helped/hurt games. LAD@MIL’s starter outcomes were mixed. Preserve this as a diagnostic watch item rather than forcing a pitcher-weight adjustment.

9. Bottom line

Known: the only reviewed game, LAD@MIL, was a correct MIL winner call but a wrong score forecast (2–4 predicted versus 1–2 actual). The published probability was about 54.8%, with a 0.0965 home-minus-away edge; the pick hit. The total was over-projected by 3. Starter evidence is mixed, the per-game structural audit passed, and no artifact defect is identified as the cause.

Persistent evidence is more actionable than the one-game result: the run model has near-zero holdout R², lineup runs have been below projection on 7/10 slates, and the simulation-inert finding has persisted 11 consecutive slates and is escalated. Calibration error is flat across the reported trend window, but this game’s calibration bucket contains only one outcome. The upstream raw-probability fields conflict, even though the final published value matches the governed value and no material publication bypass is recorded.

Uncertain: which run-mean component caused this particular overprojection; whether any specific hitter, pitcher, or calibration adjustment would improve future slates; and whether the diagnosed simulation mechanism is the live code path without operator verification.

Safest next action for the very next slate: instrument and shadow-audit the simulation’s independent probability-distribution path—confirm it runs, record draw count and early-exit behavior, and do not change live confidence or variance parameters on this one-game result.