Luna deep analysis — slate 20261001

Coverage receipt: COMPLETE · 9/8 sections; 1/1 games; 5/5 causes; 6/6 sources

1. Evidence receipt and gaps

Source manifest

All six listed source artifacts marked loaded were received and represented in the evidence:

  1. Prediction review — /app/output/reports/prediction_review_20261001.json, 101,990 bytes Purpose: official outcomes and scoring errors.
  2. Forensic deep audit — /app/output/reports/PREDICTION_SYSTEM_DEEP_AUDIT_20261001.json, 75,617 bytes Purpose: probability, provenance, starter, and decision contracts.
  3. Continuous learning — /app/output/learning/continuous_learning_daily_20261001.json, 454,850 bytes Purpose: pipeline-stage quality, calibration, probability lineage, score distribution, and starter comparisons.
  4. Detailed report — /app/output/reports/detailed_20261001.html, 98,628 bytes Purpose: full game and simulation rendering.
  5. Ultra-detailed player audit — /app/output/reports/20261001_ultra_detailed_player_audit.html, 8,732,780 bytes Purpose: player-level prediction trace.
  6. Structural audit — /app/output/reports/audit_report_20261001.html, 520,200 bytes Purpose: invariant findings.

One manifest entry is explicitly missing:

  1. Integrity revision audit — /app/output/reports/audit_report_20261001_integrity_revision.html Status: missing; byte count null Purpose: post-Luna remediation proof for immutable revision artifacts.

The missing integrity-revision audit is an evidence gap and an artifact-contract limitation. It is not, by itself, evidence that the prediction artifact was corrupted.

Games and coverage

The settled game reviewed in the detailed game section is:

The payload reports:

This is internally inconsistent. The game-level record and expected_games identify one settled game, but several coverage counters claim four games. The structural audit also reports 4/1 games structurally audited in the causal issue register. Therefore:

Other gaps and contradictions


2. Executive diagnosis

Overall diagnosis

This was a correct-winner, materially wrong-score prediction with clean structural QA for the represented game, but with important cross-slate process risks.

The system:

A correct winner is not equivalent to a good full prediction. The score forecast was compressed and missed the actual run distribution even though the side was correct.

Separate quality dimensions

Winner accuracy

The one-game winner result was correct and beat the cited baseline, but the sample is too small to establish improved winner skill. Cross-slate winner accuracy is labelled improving, with mean 0.6479 in the trend block, but that conclusion remains subject to the metadata inconsistencies noted above.

Calibration quality

Current-slate calibration is poor as an estimate, but not evidence of overconfidence:

The rolling trend labels weighted calibration error as regressing, with mean 0.2252. The persistent finding has occurred on three consecutive slates and seven times in the 11-slate window. The appropriate diagnosis is unstable or poorly aligned confidence, not “this single game was overconfident.”

Score accuracy

Score accuracy was the principal current-slate weakness:

The causal register’s score_margin_compression finding is high severity, with evidence that one of one predictions had margin ≤2 while the actual margin was ≥4. It correctly includes the guardrail that one blowout does not justify widening every score prediction. Cross-slate evidence, however, escalates this from a single-slate observation to a three-consecutive-slate pattern.

The run model is also weak at validation level:

This supports treating exact scores as low-confidence outputs, not merely adjusting one game’s variance.

Starter accuracy

The starter picture is mixed:

Starter projection error contributed to score uncertainty, especially Nola’s short outing and three earned runs, but the evidence does not justify identifying starter weighting as the main causal defect. The lever-tension record says changing pitcher form/prior weights would have hurt this game because the starter projection was judged sufficiently accurate overall, especially for Kerr’s zero ER result.

Artifact integrity

For the represented game:

Artifact integrity is therefore good for the supplied prediction artifact, subject to the missing integrity-revision audit and the inconsistent four-game coverage metadata. The missing audit is a contract/coverage gap, not evidence of a bad forecast.

Causal issue register reconciliation

score_margin_compression — high

single_slate_calibration_instability — high

weak_run_model_signal — high

complete_slate_audit_coverage — info

simulation_inert_on_slate — info, escalated cross-slate


3. Every game

PHI @ ATL

Prediction and result

FieldPredictionActual
PHI runs32
ATL runs46
WinnerATLATL
MarginATL by 1ATL by 4
Total78

This is explicitly a correct-winner/wrong-score game.

Probability, confidence, and conviction

Errors

Starter lines

PHI — Aaron Nola

ATL — Ray Kerr

Edge inputs

Confidence and recency controls

Score path

Pipeline stages, all compared with the actual final score:

StageWinnerTeam-run MAETotal-run MAEMargin MAE
historical_ml1.0001.67531.04623.3506
variance_applied1.0001.50001.00003.0000
enhanced_prediction1.0001.50001.00003.0000
embedded_savant_run_environment1.0001.50001.00003.0000
fundamental_edge_target_review1.0001.50001.00003.0000
capped_target1.0001.50001.00003.0000
simulation_result1.0001.50001.00003.0000
published_final1.0001.50001.00003.0000

Variance application improved the score metrics relative to historical ML, but the resulting margin remained too narrow. No later stage changed the final score.

Player-level adjustments and deviations

Material deviations included:

Three player deviations were large enough to move the game; only one was supported by the hitter’s own season contact-quality profile. The audit therefore classifies:

Slate-level player metrics also show:

These facts support weak player/run signal, but they do not establish that every individual hitter projection should be widened.

Audit findings

Causes


4. Miss reconstruction

There was no losing game: misses: 0. Therefore, no loss-specific winner reconstruction is applicable. The game was a score miss, not a winner miss.

Earliest wrong-direction score evidence

For the score objective, the earliest measurable issue is the underlying score model’s narrow margin:

The score evidence moved toward the wrong result at the base score-generation stage through insufficient margin dispersion. This is best classified as:

A 0.12 home-away confidence edge would be moderate, not a near coin flip. This game’s published edge was much smaller, 0.0336, and was appropriately bucketed as a toss-up.

Pipeline-stage quality across all stages

Every listed stage must be retained in the audit:

  1. historical_ml
  2. variance_applied
  3. enhanced_prediction
  4. embedded_savant_run_environment
  5. fundamental_edge_target_review
  6. capped_target
  7. simulation_result
  8. published_final

The transition record shows:

A later unchanged or successful final outcome does not erase the CHW@HOU intermediate direction change. Conversely, it should not be attributed to PHI@ATL without the missing game record.

The simulation’s lack of change is especially important because it has persisted for 11 slates and is diagnosed as potentially using target-seeking draws that terminate too early. Its apparent inertness is not proof that the simulation mathematically had no useful information; it is evidence that the current implementation may not be generating an independent probability distribution.


5. Cross-game counterfactuals

The lever_tension block contains three entries.

1. score.variance_multiplier / score.variance_floor

2. player.pitcher.v4 form weights / player.pitcher_prior_games

3. recent.* / season.* run-mean weighting

Tempting one-game fixes that should not be made

  1. Do not widen every score prediction because ATL won by four. The causal register explicitly prohibits that inference.
  2. Do not reweight pitcher form or prior games because Nola underperformed. The same game’s ATL starter projection was accurate in ER terms, and the lever tension records one hurt game.
  3. Do not lower all published confidence solely because this game’s score was wrong. The winner probability was modest and the realized winner was correct; the one-game calibration result is underconfident, not overconfident.
  4. Do not tune individual hitter projections to Albies or Harris alone. Only one of three material player deviations was supported by underlying contact quality; the other two are likely noise.
  5. Do not treat zero simulation flips on one slate as proof that simulation is useless. The persistent 11-slate diagnostic does justify code inspection, not a blind parameter adjustment.
  6. Do not tune the run model through nightly variance alone. Holdout R² near zero indicates a feature/target problem that requires isolated training work.

6. Data and contract defects

Critical, error, warning, and informational findings

The supplied structural audit reports:

The seven informational notes are counted but not individually enumerated in the payload. Therefore, the exact seven structural-audit information titles cannot be independently listed from the supplied evidence. The payload does provide several informational/diagnostic items:

  1. Every represented settled game received structural QA.
  2. Simulation produced no winner-direction intervention.
  3. Forecast-file integrity was clean.
  4. No source-labelled market cross-check was available.
  5. The starter feed had a missing settled pitching line for Aaron Nola.
  6. Ray Kerr had thin seasonal feed history and triggered confidence shrinkage.
  7. Player-level deviations were mostly variance rather than supported learnable signal.

Items 1–3 are causal/diagnostic notes; items 4–7 are evidence limitations or game-level informational findings. They should not be assumed to be the exact seven HTML audit labels.

Prediction-model defects versus artifact/presentation defects

Prediction-model/process defects

Artifact/presentation/contract defects

These are not all prediction defects. Missing labels, inconsistent counts, and absent audit artifacts are contract/presentation defects; near-zero R², compressed margins, and inert simulation are model/process defects.

Coverage reconciliation

The slate cannot be called fully clean because:

The correct conservative interpretation is:

Complete probability lineage

For PHI@ATL, the recorded pick-side lineage is:

  1. Raw model: 0.5453 in the lineage record; 0.53 in the confidence path.
  2. Calibration: 0.5278, based on sample size 815 and empirical hit rate 0.562.
  3. Governor: input 0.53, output 0.5278.
  4. Score coherence: 0.527795.
  5. Recency/starter controls: starter-experience shrinkage to 0.523278; recency guardrail applied.
  6. Published: 0.516818.

The lineage records:

There is no recorded material bypass. The raw-probability discrepancy (0.5453 versus 0.53) is a field-consistency defect, but not an unrecorded published bypass because the subsequent transformations are documented and the final delta is explained.


7. Cross-slate persistence

A single slate is noise; the following patterns have explicit multi-slate escalation and must be treated as established failures or actionable patterns.

Finding streaks

FindingConsecutive-slate countPresent now?Interpretation
high_raw_probability_cluster0NoNot currently present; one occurrence in the 11-slate window.
pipeline_winner_instability0NoNot currently present; five occurrences in the window but no current streak.
score_margin_compression3YesEstablished persistent compression pattern.
simulation_inert_on_slate11YesEstablished failure, not single-slate noise.
single_slate_calibration_instability3YesEstablished persistent calibration instability.
weak_run_model_signal3YesEstablished weak run-model signal.

Escalated findings

Score-margin compression

Simulation inertness

The self-assessment identifies the likely root cause: the same draws are used both for target realization and win-probability estimation, with early exit at a default draw count of approximately two. The recommended code target is _build_simulation_distribution and the draw-loop early exits in routers/team_router.py, with an independent 200–500 draw batch or a closed-form run-difference distribution.

Calibration instability

Weak run-model signal

Metric trends

The required directions are:

These directions must be read together: winner selection is improving, while score-margin and calibration quality are regressing.

Top-confidence-pick loss streak

Other cross-slate evidence

The two explicitly held cross-slate biases should remain held:

Thus, persistent escalated findings should be acted on; the two cross_slate_bias items remain no-change findings.


8. Adjustments for today

Recommendations are ranked by persistence, scope, expected metric impact, affected games, and regression risk.

1. Run a bounded shadow experiment for persistent margin compression

This is the strongest actionable change for the current slate because the score-margin problem is both directly observed and persistent.

2. Apply a bounded calibration-shrinkage shadow test

3. Do not make a nightly parameter move for simulation inertness; perform the registered code diagnostic

4. Investigate the weak run model through an isolated training backtest

5. Hold pitcher-form and recent/season run-mean weights


9. Bottom line

Known

Uncertain

Single safest next action

Run a control-versus-shadow experiment that modestly widens score.variance_multiplier and/or score.variance_floor, while keeping the current production path unchanged and monitoring margin tail coverage, team-run MAE, total-run MAE, and calibration.

This is the safest immediate improvement because it addresses the directly observed and cross-slate-persistent margin-compression problem without reacting to the one game by changing starter weights, hitter projections, or winner probabilities.