Luna deep analysis — slate 20261006

Coverage receipt: COMPLETE · 9/8 sections; 2/2 games; 5/5 causes; 7/7 sources

1. Evidence receipt and gaps

All 7 source_manifest entries are marked loaded:

The diagnosis says 2 expected, 2 reviewed, and 2 structurally audited games; it also reports 2 continuous-learning games and starter comparisons for both. The coverage matrix is complete on those counts. The per-game audits both pass, and the revision audit is reported as loaded. No source-manifest entry is marked missing.

Important limitations and inconsistencies in the supplied evidence:

2. Executive diagnosis

Winner accuracy: Both games were called correctly: 2/2 (100%). That is a slate result, not proof of reliable forecasting. The validated historical winner accuracy is 0.600414, with walk-forward accuracy 0.570149.

Calibration quality: The two published picks both won, while their pick-side published probabilities were 0.505154 and 0.56643. The slate-level weighted absolute calibration error is reported as 0.4642. The bucket table labels both observations underconfident because its definition is average published confidence minus observed hit rate; with one hit in each bucket, those two observations cannot establish a stable calibration curve. The MIL publication discrepancy is a separate critical lineage defect. A “lower confidence caps” action in the self-assessment should not be read as an established direction from these two outcomes: the current bucket observations are labelled underconfident, and the persistent calibration finding calls for a shadow experiment, not an untested production change.

Score accuracy: Both predicted totals were too high: LAD@ATL predicted 7, actual 4; MIL@SD predicted 9, actual 7. The supplied team-run absolute-error figures are 3 and 2, respectively. Both games had positive total-run bias, +3 and +2. The validated run models have near-zero holdout explanatory power: home-run R² 0.002143, away-run R² 0.030936, and total-run R² 0.002415 across 2,415 rows. Scores are weak estimates even when the winner is right.

Starter accuracy: All four starter identities matched. The two starters in LAD@ATL had ER errors of 0 and 1; the MIL@SD starters had ER errors of 3 and 1. The slate-level matchup pattern summarizes four starter comparisons as mean ERA error −1.4, with starter projections overall too pessimistic on this slate. Individual starter lines vary substantially, so that aggregate is not a basis for changing a starter lever by itself.

Artifact integrity: Both per-game structural audits pass with zero critical, error, or warning findings; each has one informational item. The overall structural summary is 0 critical, 0 error, 0 warning, and 2 info. The per-game diagnostics call both saved forecast artifacts clean. However, those clean file audits do not resolve the MIL probability-lineage contract failure. Audit coverage is complete, but the slate is not contract-clean.

Causal issue register reconciliation:

3. Every game

LAD@ATL

MIL@SD

4. Miss reconstruction

There were no final winner losses: both published winners were correct. Therefore there is no final loss for which to identify a wrong-result prediction stage. This must not be substituted for a claim of good score or probability quality.

The measured intermediate winner-direction regression is in LAD@ATL: historical ML and variance-applied stages were 0.5 winner-accurate, and variance-applied had no winner-hit improvement. The transition from variance-applied to enhanced prediction changed LAD@ATL ATL → LAD, improving the winner result; later stages retained that direction. This is a real intermediate direction change, but the diagnosis does not provide numeric per-stage score lines or enough evidence to assign it to a specific bad input, weighting, or player adjustment. Later recovery does not erase it.

Across the two games:

Pipeline stages and transitions, all audited (each stage has 2 games):

StageWinner hitsMargin MAETeam-run MAETotal-run MAE
historical_ml1/21.49791.41832.8366
variance_applied1/21.50001.75003.5000
enhanced_prediction2/20.50001.25002.5000
kpi_layer2/20.50001.25002.5000
embedded_savant_run_environment2/20.50001.25002.5000
fundamental_edge_target_review2/20.50001.25002.5000
capped_target2/20.50001.25002.5000
simulation_result2/20.50001.25002.5000
published_final2/20.50001.25002.5000

Variance application regressed team-run MAE by +0.3317 and total-run MAE by +0.6634 relative to historical ML; margin MAE increased by 0.0021. The later enhanced-prediction transition improved team-run MAE by 0.5 and margin MAE by 1.0 and changed one winner direction. All subsequent score-stage transitions were measured as unchanged. This later recovery does not erase the variance-stage regression. The simulation stage had no measured score-stage improvement on this slate.

5. Cross-game counterfactuals

Each listed tension entry is accounted for:

  1. score.variance_multiplier / score.variance_floor (widen run distributions): Helps: none recorded. Hurts: none recorded. Net slate evidence: 0 helped, 0 hurt. This entry does not establish that widening improves either game or fix their overprojected run means. The separate stage-quality comparison shows variance-applied run-error regression, so any variance experiment should be a shadow test, not a direct production change.
  2. player.pitcher.v4 form weights / player.pitcher_prior_games: Helps: MIL@SD, where the starter ER was off by 3. Hurts: LAD@ATL, where Yamamoto’s ER projection was exact and the starter projection was described as accurate within one ER. Net evidence: one help, one risk; no cross-game case for a global form-weight change.
  3. recent.* / season.* run-mean weighting: Helps: none recorded. Hurts: MIL@SD, where team runs were already close (off by 2 total supplied team-run absolute error) and reweighting could disturb them. Net evidence: no slate support for changing these weights.

Tempting one-game fixes to avoid: Do not globally raise or lower pitcher form weighting because of May alone; it risks disrupting the more accurate LAD starter estimate. Do not shift recent/season run means to chase LAD@ATL’s three-run overprojection when the tension record marks MIL@SD as a risk and reports no helped game. Do not lower confidence solely because both hits received a high two-game calibration error: the observed buckets are labelled underconfident, and the sample is one observation per bucket. Do not assert a governor bypass or alter its setting to explain MIL; the documented problem is the missing probability transformation. Do not tune player projections to one-game hit/miss deviations unsupported by the player’s own contact quality.

6. Data and contract defects

Coverage reconciliation: The coverage matrix reports all expected games loaded and structurally audited: 2 expected, 2 canonical artifacts, 2 forensic audits, 2 continuous-learning games, 2 starter comparisons, and 2 completed structural audits. Both game audits pass. Complete coverage is not a clean bill of health: MIL has a critical lineage finding.

Findings by severity:

Prediction-model defects versus presentation/contract issues:

Complete pick-side probability lineage from supplied records:

7. Cross-slate persistence

The cross-slate record covers 11 slates, with 10 prior slates loaded. Persistent escalations are established failures or patterns under the supplied guardrails; they should not be dismissed as noise from this one slate.

Every finding_streaks entry:

FindingConsecutive slatesPresent now?Incidence in windowTarget(s)
pipeline_winner_instability0No3None registered; accuracy, Brier
score_margin_compression0No5score.variance_multiplier, score.variance_floor
simulation_inert_on_slate11Yes11simulation.allow_score
single_slate_calibration_instability4Yes8confidence.empirical_max_weight, confidence.base_cap, confidence.moderate_cap
weak_run_model_signal4Yes9training.xgb.n_estimators, training.xgb.max_depth, training.xgb.learning_rate

Escalated findings and required interpretation:

Raw structural blocks:

Cross-slate bias and trends:

8. Adjustments for today

Ranked by persistence and severity first, then scope, expected metrics, affected games, and regression risk. These are recommendations for controlled work; no configuration or code is changed here.

  1. Persistent probability calibration pattern — bounded shadow experiment. Exact parameter: confidence.empirical_max_weight. Direction and magnitude: increase by 0.02 absolute from the current registered value, within its valid range, in a shadow-only comparison; do not promote from this slate alone. Expected metric/direction: reduce rolling Brier score and calibration error if the escalation’s shrinkage diagnosis is causal. Games / tension: apply comparison to LAD@ATL and MIL@SD; neither game is explicitly marked as helped or hurt by this calibration lever in lever_tension. Both were hits, so the immediate regression risk is attenuating otherwise correct pick confidence; evaluate on the rolling window and retain the baseline. The shadow gate and rollback monitor, not this analysis, should determine whether the effect is causal.
  1. Persistent simulation inactivity — code/diagnostic action, not a forced parameter move. Registered target: simulation.allow_score is listed, but the escalation and self-assessment say this is not parameter-actionable and explicitly call for confirming the module is running rather than forcing a parameter move. Action: instrument and repair the simulation distribution path so the win-probability distribution comes from an independent, unsteered draw batch or a supported closed-form distribution, does not early-exit after finding a score realization, and reports its contribution to score and winner outputs. Register any batch-size control if introduced. Expected metrics/direction: make simulation contribution measurable and assess team-run MAE and total-run MAE; no improvement is assumed before measurement. Games / tension: both slate games had zero simulation winner flips and no measured simulation-stage score change. The variance lever tension has no helped or hurt games, so there is no game-level evidence to claim a beneficial simulation adjustment. This is an 11-slate established failure pattern, not single-slate noise.
  1. Persistent weak run-model signal — isolated feature/target backtest, not a nightly parameter tweak. Target levers listed: training.xgb.n_estimators, training.xgb.max_depth, and training.xgb.learning_rate; the escalation marks this finding non-actionable by parameter and calls for an isolated training investigation. Action: do not change those parameters as a stand-in for missing predictive signal. Test the shared feature contract and target in an isolated same-fingerprint backtest, with the specified candidate data such as properly source-labelled no-vig market probability, park/weather environment, bullpen rest/fatigue, and platoon-adjusted lineup quality; bump the model schema version if semantics change. Expected metric/direction: seek better holdout home/away/total run R² and team-run/total-run MAE; require measured improvement before use. Games / tension: the affected slate games are LAD@ATL and MIL@SD, both with total overprojection; the run-mean tension has no recorded helpful game and marks MIL@SD as a risk. Do not tune a feature from a single player or game.
  1. Strongest single-slate contract driver — repair MIL probability publication lineage before promotion. Parameter: none is registered for the unexplained probability delta; forcing a confidence or governor adjustment would conceal rather than resolve the contract defect. Action: reconcile and record every pick-side transformation between calibrated/governed, score-coherence, starter-experience/other controls, and published probability, including the trace-versus-lineage raw values; add a reconciliation check that blocks publication or promotion when a material delta is unexplained. Expected metric/direction: eliminate unexplained material lineage deltas and restore auditable published probability, rather than claiming an immediate accuracy gain. Game / tension: MIL@SD is the affected game. No listed lever-tension entry supports changing a model weight for this defect. This is the safest immediate intervention because it addresses a critical evidence/contract failure.

9. Bottom line

Known: both published winners were correct, both predicted scores were too high, all starter identities matched, and the structural audit coverage is complete. The run models have near-zero holdout signal, variance application worsened run MAE relative to the historical stage before later stages recovered, and a material MIL@SD probability publication delta is not documented. Simulation inactivity and weak run-model signal are persistent escalations; calibration instability has persisted for four slates and merits a bounded shadow test.

Uncertain: two games cannot establish calibration direction or a stable run-environment bias; the listed per-game player deviations do not isolate a generalizable lineup or starter adjustment; and the supplied probability records do not fully reconcile several raw and intermediate values. Clean artifact checks do not resolve those uncertainties.

Single safest next action for the very next slate: block promotion until the MIL-style published-probability lineage has a complete, auditable transformation record and a check that rejects unexplained material deltas.