Luna deep analysis — slate 20260912

Coverage receipt: COMPLETE · 9/8 sections; 15/15 games; 6/6 causes; 6/6 sources

1. Evidence receipt and gaps

Sources received

Six of seven manifest entries were loaded:

  1. Prediction review — /app/output/reports/prediction_review_20260912.json, 377,165 bytes; official outcomes and scoring errors.
  2. Forensic deep audit — /app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20260912.json, 240,873 bytes; probability, provenance, starter, and decision contracts.
  3. Continuous learning — /app/output/learning/continuous_learning_daily_20260912.json, 2,581,062 bytes; pipeline-stage quality, calibration, probability lineage, score distribution, and starter comparisons.
  4. Detailed report — /app/output/reports/detailed_20260912.html, 354,592 bytes; full game and simulation rendering.
  5. Ultra-detailed player audit — /app/output/reports/20260912_ultra_detailed_player_audit.html, 34,118,143 bytes; player-level prediction trace.
  6. Structural audit — /app/output/reports/audit_report_20260912.html, 1,868,598 bytes; invariant findings.

The following manifest item is missing:

  1. Integrity revision audit — /app/output/reports/audit_report_20260912_integrity_revision.html; intended purpose: post-Luna remediation proof for immutable revision artifacts.

This missing artifact is a receipt gap, but it is not itself evidence that the forecasts were altered. The game-level integrity audits report zero critical and error findings.

Coverage confirmation

All 15 expected games were reviewed:

BAL@TOR, CHW@STL, CIN@MIL, CLE@MIN, COL@DET, HOU@TB, KC@BOS, LAA@WAS, LAD@MIA, NYM@NYY, PHI@ATL, PIT@CHC, SD@SF, SEA@OAK, TEX@ARI.

Coverage is complete at the structural level:

Important gaps and contradictions


2. Executive diagnosis

Overall result

The slate was weak as a prediction product:

The headline is therefore: winner accuracy was barely above chance and below the validated baseline; calibration was poor and anti-predictive at high conviction; score accuracy was materially poor; starter projections were mixed; artifact integrity was mostly clean except for two unresolved probability-publication lineage failures and one missing revision-audit artifact.

A correct winner does not make the prediction good. Several correct calls had very large score errors, including:

Winner accuracy

The system selected the correct winner in 8 of 15 games. Four of seven losses were low-edge or toss-up decisions, but three were materially dangerous confidence failures:

The published confidence did not rank outcomes reliably. The four high-conviction games had only one winner hit: COL@DET was correct; LAD@MIA, CHW@STL, and TEX@ARI were misses.

Calibration quality

Calibration was poor:

The register correctly labels this as a high model/process risk, not a critical contract failure. One slate is too small to redesign calibration confidently, but the cross-slate evidence has escalated the run-model and simulation findings; calibration instability itself has persisted for two consecutive slates and five occurrences in the 11-slate window.

Score accuracy

Score prediction was the largest performance problem:

The validated run models explain very little holdout variance:

This is an established run-model weakness, not a one-game anomaly.

Starter accuracy

Starter performance was mixed and contributed directly to several misses:

The lever-tension evidence says pitcher reweighting would help six games and risk three, but the cross-slate register does not establish a persistent separable starter bias. The correct posture is bounded investigation, not an unrestricted pitcher-weight increase.

Artifact integrity

Artifact quality is mostly good:

However:

Causal issue register reconciliation

Critical: unexplained_probability_publication_delta

High: score_margin_compression

High: single_slate_calibration_instability

High: weak_run_model_signal

Info: complete_slate_audit_coverage

Info: simulation_inert_on_slate


3. Every game

Notation: p is the published probability of the selected side; edge is the published home-minus-away confidence edge. Starter format is projected ER/ERA/outs → actual ER/ERA/outs. “Controls” includes governor, recency, and experience handling. Player actuals were unavailable on the entire slate.

BAL@TOR — winner hit, score miss

CHW@STL — winner miss and wrong-score miss

CIN@MIL — winner hit, score miss

CLE@MIN — winner miss and wrong-score miss

COL@DET — winner hit, score miss

HOU@TB — winner hit, score miss

KC@BOS — winner hit, score miss

LAA@WAS — winner miss and wrong-score miss

LAD@MIA — winner miss, wrong-score miss, correct-winner/wrong-score not applicable

NYM@NYY — winner miss and severe score miss

PHI@ATL — winner miss and severe score miss

PIT@CHC — winner hit, modest score miss

SD@SF — winner hit, score miss

SEA@OAK — winner hit, extreme score miss

TEX@ARI — winner miss and wrong-score miss


4. Miss reconstruction

Earliest wrong-direction stage for every loss

GameEarliest evidence/stage moving toward wrong resultClassification
CHW@STLHistorical/variance/enhanced path retained STL; final probability remained materially committed to STLBad weighting / winner-direction judgment; offense miss secondary
CLE@MINEnhanced prediction moved to CLE 6–5; Savant reduced MIN further and preserved CLEBad weighting plus starter/run-environment miss
LAA@WASHistorical ML moved WAS to a tie, then variance/enhanced moved to LAAWinner-direction regression at variance/enhanced stage; starter miss and variance
LAD@MIAHistorical/fundamental edges supported LAD; 0-ER Glasnow projection produced a large LAD score and probability advantageStarter error, then wrong conviction
NYM@NYYSeason-quality adjustment maintained NYY; enhanced/Savant kept NYY 7–5Bad weighting and offense/bullpen/run miss
PHI@ATLVariance stage favored ATL, then enhanced prediction flipped to PHIIntermediate winner-direction regression; run-environment miss
TEX@ARIComposite/season/pitcher evidence supported ARI, but Rocker/Pfaadt projections reinforced ARIStarter projection error and wrong conviction

Loss-type distinctions

The 0.12 home-away confidence edge in TEX@ARI is moderate, not a near coin flip and not a strong call. It should not be treated as equivalent to the 0.20 strong LAD@MIA edge, nor as evidence that the outcome was almost random.

Pipeline-stage audit across all stages

StageWinner accuracyTeam-run MAETotal-run MAEInterpretation
historical_ml8/15, 53.33%2.88364.1122Baseline
variance_applied7/15, 46.67%2.83333.9333Run MAE improved slightly, but winner direction regressed
enhanced_prediction8/15, 53.33%3.03334.4667Team-run MAE regressed +0.1497 versus baseline
embedded_savant_run_environment8/153.00004.2667Partial recovery in run MAE, no winner recovery
fundamental_edge_target_review8/153.00004.2667No additional change
capped_target8/153.00004.2667No additional change
simulation_result8/153.00004.2667No additional change
published_final8/153.00004.2667Same as simulation result

Transition audit

The simulation did not intervene in winner direction on this slate. A later recovery in aggregate metrics does not erase LAA@WAS and PHI@ATL's intermediate winner regressions.


5. Cross-game counterfactuals

Lever tension: widen run distributions

Lever: score.variance_multiplier / score.variance_floor

Lever tension: pitcher form/prior weights

Lever: player.pitcher.v4 form weights / player.pitcher_prior_games

Lever tension: recent/season run-mean weighting

Lever: recent.* / season.* run-mean weighting

Tempting one-game fixes that should not be made


6. Data and contract defects

Audit finding inventory

Critical

  1. Unexplained probability publication delta
  2. Affects CHW@STL and COL@DET.
  3. Calibrated-to-published differences are material and not documented.
  4. Required action: block promotion until reconciled.

Errors

Warnings

Informational findings

Model defects versus presentation/artifact defects

Prediction-model defects

Presentation or artifact defects

These artifact issues should not be conflated with the model's poor predictive performance. The available evidence says the forecast files themselves were structurally clean, while the probability lineage contract was incomplete.

Complete probability lineage audit

The intended path is:

raw model → calibrated → governor → score coherence/recency → published.

Games with documented transformations

Bypasses or unexplained deltas

A material bypass-like gap is present only where the recorded transformation is absent:

These are not yet proven governor bypasses. They are unexplained transformations requiring code-level lineage tracing.

Coverage-matrix conclusion

The coverage matrix is complete, but the slate is not “clean”:


7. Cross-slate persistence

A single slate is noise; escalated findings are established patterns in this evidence.

Finding streaks

Escalated findings

Simulation inertness

Weak run-model signal

Metric trends

Every supplied trend is regressing:

The escalated simulation and run-model failures should not be dismissed as single-slate noise.


8. Adjustments for today

Recommendations are ranked by persistence, scope, expected metric benefit, and regression risk.

1. Repair and independently validate the simulation module

2. Run an isolated run-model feature/target backtest

3. Apply a small shadow reduction to confidence caps

4. Run a bounded pitcher-prior shadow experiment

5. Resolve probability lineage before promotion


9. Bottom line

Known

Uncertain

Single safest next action

Do not promote the current slate or tune broad model weights. First run a diagnostic code fix/shadow for the simulation distribution and independently reconcile the two missing probability transformations. This is the safest next action because it addresses the strongest persistent process failure and the critical contract gap without making an unsupported live parameter change.