Luna deep analysis — slate 20261010

Coverage receipt: COMPLETE · 9/8 sections; 1/1 games; 4/4 causes; 7/7 sources

1. Evidence receipt and gaps

All seven source_manifest entries were marked loaded:

  1. prediction review — /app/output/reports/prediction_review_20261010.json, 11,425 bytes; official outcomes and scoring errors.
  2. forensic deep audit — /app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20261010.json, 30,956 bytes; probability, provenance, starter, and decision contracts.
  3. continuous learning — /app/output/learning/continuous_learning_daily_20261010.json, 185,336 bytes; pipeline-stage quality, calibration, probability lineage, score distribution, and official starter comparisons.
  4. detailed report — /app/output/reports/detailed_20261010.html, 33,426 bytes; full game and simulation rendering.
  5. ultra detailed player audit — /app/output/reports/20261010_ultra_detailed_player_audit.html, 1,811,791 bytes; player-level prediction trace.
  6. structural audit — /app/output/reports/audit_report_20261010.html, 128,231 bytes; invariant findings.
  7. integrity revision audit — /app/output/reports/audit_report_20261010_integrity_revision.html, 365,249 bytes; structural audit of three post-start revision artifacts.

Slate coverage: one game was expected, reviewed, structurally audited, included in continuous learning, and given a starter comparison: each corresponding coverage_matrix count is 1/1. The sole game, CHW@CLE, was a hit on the winner, not a loss. Full coverage does not remove the game-level run-score and model-quality concerns.

Gaps and internal inconsistencies:

2. Executive diagnosis

DimensionDiagnosis
Winner accuracy1/1 (100%), but this is one game. CLE was predicted and won. The cross-slate report gives a historical walk-forward winner accuracy of 0.570149; this slate alone does not establish improvement.
Calibration qualityThe only published pick had probability 0.526845 and hit, producing Brier 0.223876. On this one observation, confidence was below the observed hit rate (1.0), hence the bucket’s reported underconfidence, not overconfidence. The bucket has only one settled game; its absolute calibration error of 0.4732 is therefore not a stable calibration estimate. Cross-slate weighted calibration error is explicitly regressing, so it warrants monitoring and shadow testing, not a conclusion that this particular hit was overconfident.
Score accuracyPoor: predicted CHW 5, CLE 6 versus actual CHW 0, CLE 2. Team-run absolute error sums to 9; total runs were overprojected by 9 (11 predicted vs 2 actual). The winner being right does not make this a good score prediction.
Starter accuracyBoth starters were projected to allow more earned runs than they did; both also recorded more outs than projected. Burke’s projected-to-actual ER gap was 5 to 2; Williams’s was 1 to 0. This supports a starter/run-model miss on this game, but one game cannot establish a starter bias.
Artifact integrityThe structural audit passed, with 0 critical, 0 error, 0 warning, and 1 info finding; the game diagnostics report forecast-file integrity clean (0 defects, 1 informational note). No evidence says an artifact defect caused this game’s result. The probability-field mismatch and missing explanation of recency are separate traceability concerns, not recorded structural-audit failures.

Causal issue register reconciliation:

No causal issue in the register identifies a winner miss: there was none. The material observed failure is the run-score miss, with very weak historical run-model validation signal.

3. Every game

CHW@CLE — hit on winner, wrong score

4. Miss reconstruction

There are no game losses to reconstruct: misses: 0, loss_primary_drivers: {}, and CLE was the correct predicted winner. There is therefore no earliest stage at which evidence moved the pick toward a wrong result.

The score miss can still be traced, without misclassifying it as a winner miss:

Pipeline stage quality across all stages and transitions:

StageTeam-run MAETotal-run MAEMargin MAEWinner
historical_ml3.47116.94221.22241/1
variance_applied3.57.01.01/1
enhanced_prediction4.59.01.01/1
kpi_layer4.59.01.01/1
embedded_savant_run_environment4.59.01.01/1
fundamental_edge_target_review4.59.01.01/1
capped_target4.59.01.01/1
simulation_result4.59.01.01/1
published_final4.59.01.01/1

All eight transitions are reported: historical ML→variance applied, variance applied→enhanced, enhanced→KPI, KPI→embedded Savant, embedded Savant→fundamental review, fundamental review→capped target, capped target→simulation, and simulation→published final. No transition changed winner direction; all have winner-hit delta 0 and no direction-change games. The historical-ML→variance transition raised team-run MAE by 0.0289 while improving margin MAE by 0.2224. Variance→enhanced raised team-run MAE by 1.0 with no margin change. Every later transition had zero measured score-metric change. The eventual correct winner does not erase the intermediate team-run regression.

A home-away confidence edge of 0.12, if encountered, is moderate—not a near coin flip. This game’s edge was 0.0537, in the lean bucket.

5. Cross-game counterfactuals

There is only one game, so no genuine across-game counterfactual can be measured. For every lever_tension entry:

  1. score.variance_multiplier / score.variance_floor (widen run distributions) — helps: none listed; hurts: none listed; net evidence: 0 helped / 0 hurt. No game-specific evidence supports changing it from this entry. It targets Brier/calibration in the tension record, while score variance would not by itself correct a biased run mean.
  2. player.pitcher.v4 form weights / player.pitcher_prior_games — helps: CHW@CLE, noted as a hit with starter ER off by 3; hurts: none listed. This is a one-game directional lead, not adequate evidence for changing pitcher weights.
  3. recent.* / season.* run-mean weighting — helps: CHW@CLE, noted as a hit with team runs off by 9; hurts: none listed. A lower run mean might address the direction of this score error, but the lone game cannot identify which weighting caused it or establish net benefit.

Tempting one-game fixes to avoid: do not tune starter weights solely to Burke’s or Williams’s lower-than-projected ER; do not lower CLE’s run mean solely because the lineup underperformed; do not fit the player model to the listed individual deviations; do not widen score variance as if it necessarily fixes an overhigh mean; and do not lower confidence caps on the claim that this hit was overconfident. These moves are unsupported by the one-game result and can damage other slates or metrics.

6. Data and contract defects

Audit findings by severity:

Coverage reconciliation: expected, reviewed, structurally audited, continuously learned, starter-compared, and deep-audited counts are all 1/1; one canonical artifact set was loaded. Coverage is complete, but it does not make the run prediction accurate or erase within-game findings.

Prediction-model defects versus presentation/artifact issues:

Pick-side probability lineage, as supplied:

  1. Raw model: lineage says 0.5627; model trace instead calls 0.53629 the raw pick probability. The conflict is unresolved.
  2. Calibrated: 0.5372, calibration sample size 739, empirical hit rate 0.5683.
  3. Governor: input 0.53629, output 0.5372.
  4. Score coherence: 0.537156.
  5. Published: 0.526845; published-minus-calibrated −0.010355. The record attributes this to score coherence followed by a matchup-recency guardrail and says unexplained_material_delta: false.

The sequence includes recorded transformations and therefore does not establish an unrecorded material bypass. But the raw-probability mismatch, null recency factor/reason, and stated delta do prevent a fully reproducible arithmetic trace from the supplied evidence. The publication change is documented by name but not numerically attributable to each step. Record these as a traceability gap, not as a proven forecast-file defect.

7. Cross-slate persistence

Structural evidence:

Every finding_streaks entry:

FindingConsecutive slatesPresent now?Interpretation
pipeline_winner_instability0No2 incidences in the 11-slate window; no current consecutive streak.
score_margin_compression0No3 incidences in window; target levers are score.variance_multiplier and score.variance_floor, but not present now.
simulation_inert_on_slate11YesPresent on all 11 consecutive slates; escalated established failure.
single_slate_calibration_instability1Yes9 incidences in window; current, but only one consecutive slate.
weak_run_model_signal1Yes9 incidences in window; current, but only one consecutive slate.

Escalated finding: simulation_inert_on_slate has 11 consecutive slates and is explicitly escalated. Target lever listed: simulation.allow_score; target metrics: team-run MAE and total-run MAE. The finding says it is not parameter-actionable and directs a code/diagnostic action: confirm the simulation is running rather than silently no-oping. Its root-cause evidence in the self-assessment is that the same target-search draws are used to construct a win-probability distribution, with early exit after finding a target-realizing sequence; a default draw count around 2 makes the resulting win rate uninformative. The diagnosis proposes separating target-realization search from an independent, unsteered probability batch. Treat this as an established process failure, not single-slate noise.

Every metric_trends direction:

These trend labels are not a claim that each metric is well measured on every slate; the series includes nulls and small samples.

Top-confidence-pick record: loss streak 0. Listed results include hits on 2026-09-30, 2026-10-01, 2026-10-03, 2026-10-04, 2026-10-06, 2026-10-08, and 2026-10-10; misses on 2026-10-05 and 2026-10-07; and two unknown-result entries with blank dates. Thus the current top pick was a hit, with no active loss streak.

8. Adjustments for today

Ranked by persistence and scope:

  1. Escalated 11-slate simulation inertness — code/diagnostic action, not a forced parameter move.
  2. Registered target: simulation.allow_score; the finding explicitly marks the issue not parameter-actionable.
  3. Action: inspect and instrument the simulation control path; separate target-realization search from an independent, unsteered win-probability batch that does not early-exit, and expose/log the registered draw count. This is the specific code/diagnostic direction named in the self-assessment; it is not an instruction to promote a change.
  4. Expected metrics: obtain a non-vacuous simulation contribution measure and evaluate team-run MAE / total-run MAE and winner probability effects across slates. Direction of a metric change cannot be guaranteed before that independent comparison.
  5. Lever-tension games: none listed as helped or hurt for the simulation lever. No one-game counterfactual is available.
  6. Risk: low risk to prediction parameters if limited to diagnosis/shadow evaluation; implementation risk exists because simulation wiring is involved. This ranks first because the 11-slate persistence is explicit.
  1. Single-slate strongest driver: high run-score overprojection / weak run signal — operator feature-and-validation action, not nightly weight tuning.
  2. Registered targets in the finding: training.xgb.n_estimators, training.xgb.max_depth, and training.xgb.learning_rate, but the finding marks parameter actionability false. The diagnosis says nightly variance/confidence tuning cannot fix near-zero run signal.
  3. Action: follow the registered code/diagnostic recommendation: develop stronger run features (the self-assessment names source-labelled no-vig market probability when available, park/weather, bullpen rest/fatigue, and platoon-adjusted lineup quality), then retrain and compare an isolated same-fingerprint holdout backtest. Do not invent an unlisted exact parameter value or treat this slate’s 9-run error as sufficient tuning evidence.
  4. Expected metrics: seek improved holdout home-, away-, and total-run R² and lower team-run/total-run MAE; current R² values are 0.002143 / 0.030936 / 0.002415. Improvement is a test objective, not a guaranteed outcome.
  5. Lever-tension games: the one listed run-mean tension entry identifies CHW@CLE as a possible beneficiary; no hurt game is listed. This is not enough to establish that any particular feature or weighting would have fixed this game.
  6. Risk: broader model and data-contract scope; mitigate through isolated backtesting and schema-version control as recommended in the evidence.
  1. Calibration: monitor and run a bounded shadow comparison; do not blindly lower caps.
  2. The current one-game calibration observation is underconfident by the supplied definition, whereas the cross-slate weighted-error trend is regressing and the self-assessment recommends lower caps. Those signals do not identify the same direction of correction.
  3. The registered levers are confidence.empirical_max_weight, confidence.base_cap, and confidence.moderate_cap; the self-assessment additionally lists score.variance_multiplier and score.variance_floor. Given the one-hit bucket and lack of directionally consistent evidence, there is no defensible parameter direction or magnitude to prescribe today from this evidence. The causal register’s action—monitor the same buckets over a rolling window—remains appropriate. In particular, lowering caps on the assertion that this game was overconfident would contradict the observed one-game bucket.
  4. Lever-tension games: the variance entry lists no helps and no hurts; no cross-game calibration counterfactual exists. Any shadow comparison should log Brier and calibration error by confidence bucket and use the rollback monitor rather than treating this slate as proof.

No change to pitcher weights or season/recent run means is recommended today: their one-game tension evidence has no cross-game harms listed, but neither does it establish net benefit. This abstention reflects insufficient directionally reliable evidence for those moves, not a claim that the high run score was acceptable.

9. Bottom line

Known: CLE was correctly selected at published probability 0.526845, but the score prediction was badly high—11 predicted runs versus 2 actual, with team-run error 9. The structural audit passed, and no artifact defect is identified as the cause. The supplied probability trace nevertheless has a raw-probability field mismatch and incomplete recency metadata. Run-model holdout R² is near zero; the simulation-inertness finding has persisted for 11 consecutive slates and is escalated.

Uncertain: whether this game’s run miss reflects a repeatable mean bias, a starter-model issue, lineup variance, or some combination; whether the apparent calibration trend can be corrected by any particular confidence weight; and how much an independently sampled simulation would change published probabilities.

Safest next action for the very next slate: instrument and verify the simulation path in a non-promoted shadow/diagnostic run, separating its score-realization search from an independent win-probability sample. This directly addresses the strongest persistent, actionable process failure without making a one-game parameter adjustment.