Luna deep analysis — slate 20260917

Coverage receipt: COMPLETE · 9/8 sections; 9/9 games; 4/4 causes; 5/6 sources

1. Evidence receipt and gaps

Sources received

All seven source_manifest entries were checked against the supplied evidence:

SourceStatusPurpose
prediction_review_20260917.json — 229,581 bytesLoadedOfficial outcomes and scoring errors
PREDICTION_SYSTEM_DEEP_AUDIT_20260917.json — 150,866 bytesLoadedProbability, provenance, starter, and decision contracts
continuous_learning_daily_20260917.json — 1,555,702 bytesLoadedPipeline stages, calibration, lineage, score distribution, starter comparisons
detailed_20260917.html — 214,325 bytesLoadedFull game and simulation rendering
20260917_ultra_detailed_player_audit.html — 20,306,685 bytesLoadedPlayer-level prediction trace
audit_report_20260917.html — 1,143,113 bytesLoadedStructural and invariant findings
audit_report_20260917_integrity_revision.htmlMissingPost-Luna remediation proof for immutable revision artifacts

The missing integrity-revision audit is an evidence gap. It does not invalidate the settled-game results, because the structural audits, prediction artifacts, and game-level audit receipts are present, but it prevents independent confirmation of post-remediation immutable-revision status.

Slate coverage

All nine expected games were reviewed:

Coverage was complete:

All nine game-level structural audits reported zero critical findings, zero errors, and zero warnings. They reported 70 informational findings in aggregate.

Internal contradictions and evidence limitations

  1. BOS@TEX probability-lineage wording is internally awkward. The row says published_minus_calibrated = -0.009473, the transformation says “no recorded transformation explains the publication delta,” but unexplained_material_delta is false. The delta is small and not material, so this is not a material bypass, but the wording should be normalized.
  1. The missing integrity-revision artifact remains unresolved. It is the only missing manifest entry.
  1. Published probability and confidence edge use different representations. For example, LAD@CIN has a governed/calibrated probability of 0.7106, but its published away-side probability is 0.56 and its displayed home-minus-away edge is -0.12. This is explainable by the named score-coherence and recency transformations, but reports should make the selected side and side-relative probability explicit.
  1. The pipeline-stage table contains a meaningful winner-direction regression that is not obvious from aggregate final accuracy. BOS@TEX moves historical ML TEX → TIE, then enhanced prediction moves TIE → TEX. The later recovery does not erase the intermediate regression.
  1. No market cross-check was available. There were zero source-labelled moneyline covers, so market agreement/disagreement cannot be evaluated.
  1. Player-level results are noisy. Only 13 of 53 material player deviations were supported by the hitter’s own season contact quality, a learnable share of 24.5%. The other deviations should not be treated as feature evidence.

2. Executive diagnosis

Overall result

This was not a good prediction slate merely because four winners were correct. Winner accuracy was below the stated walk-forward baseline and below coin-flip performance on this slate. Exact-score performance was substantially weaker than winner performance.

Separate diagnoses

Winner accuracy

Poor on this slate:

The five misses were BOS@TEX, DET@CHW, MIL@PIT, MIN@LAA, and PHI@NYM.

Calibration quality

Calibration was weak and overconfident:

The model did reduce high raw probabilities through score coherence and matchup-recency guardrails. That is good lineage behavior, but the residual published confidence still overstated reliability in the moderate and lean buckets.

Score accuracy

Score accuracy was materially weak:

The system systematically compressed the margin distribution, particularly in OAK@TB and SD@COL.

Starter accuracy

Starter performance was mixed and often decisive:

Venue-split evidence was specifically credible for several blown starters, especially Seth Lugo, Kyle Harrison, and Tanner Gordon. This supports a bounded shadow test of context.venue_adjustment_weight, but not an unvalidated production change.

Artifact integrity

Artifact integrity was strong for the settled game artifacts:

However, the missing integrity-revision audit prevents a fully closed artifact-revision receipt.

Causal issue register reconciliation

weak_run_model_signal — High

This is a material model-validation risk, not a contract failure. The appropriate action is an isolated feature/target backtest, not a nightly score tweak.

complete_slate_audit_coverage — Info

Correctly classified as informational.

probability_publication_delta_explained — Info

This is supported. BOS@TEX has a small wording inconsistency but no material unexplained delta.

simulation_inert_on_slate — Info for this slate, escalated persistent failure across slates

Cross-slate evidence changes the operational diagnosis: this has persisted for 11 consecutive slates and is now an established code/diagnostic failure pattern.


3. Every game

The game records use confidence_home_minus_away; negative values indicate an away-side edge. The published pick probability below is the probability of the selected side.

BOS@TEX — miss; correct-winner/wrong-score: no

DET@CHW — miss; correct-winner/wrong-score: no

KC@HOU — hit; correct-winner/wrong-score: yes

LAD@CIN — hit; correct-winner/wrong-score: yes

MIL@PIT — miss; correct-winner/wrong-score: no

MIN@LAA — miss; correct-winner/wrong-score: no

OAK@TB — hit; correct-winner/wrong-score: yes

PHI@NYM — miss; correct-winner/wrong-score: no

SD@COL — hit; correct-winner/wrong-score: yes

Game-level summary

Correct winners:

Correct winner but wrong score:

Misses:

There were no exact-score hits reported.


4. Miss reconstruction

Earliest wrong-direction stages

BOS@TEX

DET@CHW

MIL@PIT

MIN@LAA

PHI@NYM

Loss-cause classification

Across five losses:

A 0.12 confidence edge is moderate. It should not be described as a near coin flip, but neither should it be treated as high-confidence certainty. The appropriate response is calibration and distribution control, not removal of all directional signal.

Pipeline-stage quality across all stages

StageWinner accuracyTeam-run MAETotal-run MAEMargin MAE
historical_ml4/9 = 44.44%2.08632.17383.5824
variance_applied4/92.05562.11113.6667
enhanced_prediction4/91.88892.00003.5556
embedded_savant_run_environment4/91.94442.11113.4444
fundamental_edge_target_review4/91.94442.11113.4444
capped_target4/91.94442.11113.4444
simulation_result4/91.94442.11113.4444
published_final4/91.94442.11113.4444

Transitions:

  1. Historical ML → variance applied:
  2. Margin MAE regressed +0.0843
  3. Team-run MAE improved -0.0307
  4. Winner accuracy unchanged
  5. BOS moved TEX → TIE: an intermediate winner-direction regression
  1. Variance applied → enhanced prediction:
  2. Margin MAE improved -0.1111
  3. Team-run MAE improved -0.1667
  4. BOS moved TIE → TEX: later recovery
  5. This recovery does not erase the intermediate regression
  1. Enhanced → embedded Savant:
  2. Margin MAE improved -0.1112
  3. Team-run MAE worsened +0.0555
  4. Winner accuracy unchanged
  1. Embedded Savant → fundamental review:
  2. No change
  1. Fundamental review → capped:
  2. No change
  1. Capped → simulation:
  2. No change
  1. Simulation → published final:
  2. No change

The system’s later stages improved run-error metrics relative to historical ML, but none improved winner accuracy, and simulation made no measurable winner-direction intervention.


5. Cross-game counterfactuals

Lever tension: widen run distributions

Lever: score.variance_multiplier / score.variance_floor Targets: Brier score, calibration error

Helps

Hurts

Net evidence

Lever tension: pitcher form weights / prior games

Lever: player.pitcher.v4 form weights / player.pitcher_prior_games Targets: starter ER MAE, starter outs MAE

Helps

Hurts

Net evidence

Lever tension: recent/season run-mean weighting

Lever: recent.* / season.* run-mean weighting Targets: team-run MAE, total-run MAE, accuracy

Helps

Hurts

Net evidence

Tempting fixes that should not be made


6. Data and contract defects

Critical findings

No critical audit findings were reported in the nine game audits or the structural audit summary.

The missing integrity-revision artifact is a manifest gap, but it was not reported as a critical settled-game contract failure.

Error findings

No error audit findings were reported.

Warning findings

No warning audit findings were reported.

Informational findings

The aggregate structural audit reported 70 informational findings. The principal informational findings were:

Model defects versus artifact bugs

Prediction-model defects

  1. Weak run-model signal — high severity
  2. Total-run R² 0.005629
  3. Home-run R² 0.002745
  4. Away-run R² 0.02324
  5. Requires feature/target investigation and isolated retraining backtest.
  1. Simulation inertness — persistent code/diagnostic defect
  2. 11 consecutive slates
  3. Zero flip candidates and zero published flips on this slate
  4. The self-assessment identifies the likely cause: simulation uses the same target-realization draws, early exits after finding a play-by-play realization, and then treats roughly two selected draws as a probability distribution.
  5. This is a code/diagnostic problem, not a parameter-tuning problem.
  1. Margin compression
  2. Actual margins ≥4 in 4/9 games, predicted margins ≤2 in 6/9.
  3. Cross-slate margin-bias trend is regressing.
  1. Calibration overconfidence
  2. Weighted absolute calibration error 0.1016
  3. 50% high-conviction miss rate
  4. Moderate and lean buckets both overconfident.
  1. Player projection separation
  2. Hit and strikeout spread ratios only 0.402 and 0.423.
  3. RBI per-player model lost to a flat slate mean: MAE 0.642 versus 0.597.
  4. HR model also lost to the flat mean: 0.189 versus 0.171.

Presentation/artifact defects

  1. BOS@TEX lineage wording says no transformation explains a delta while marking it non-material and not unexplained. This should be clarified.
  2. The missing integrity-revision audit is a presentation/receipt gap unless independently shown to reflect an actual missing immutable-revision check.
  3. Probability layers should consistently identify:
  4. raw model probability
  5. calibrated probability
  6. governor input
  7. governor output
  8. score-coherence probability
  9. recency adjustment
  10. published selected-side probability

Coverage reconciliation

The coverage matrix is clean for the nine settled games:

The slate should not be called fully artifact-clean because the integrity-revision audit is missing, but it is structurally complete and learning-eligible.

Probability-lineage audit

Materially relevant rows:

These six material movements have recorded explanations; no material governor bypass is established.

BOS@TEX moved from calibrated 0.5633 to published 0.553827, a delta of only -0.009473. The row’s wording is inconsistent, but this is not a material unexplained delta.

MIN@LAA and PHI@NYM had small deltas and named recency/score-coherence handling.

No probability reversion or overwritten side was identified.


7. Cross-slate persistence

A single slate is not enough to establish most model patterns, but several findings have already escalated and must be treated as established failures.

Escalated findings

simulation_inert_on_slate

The self-assessment gives the concrete suspected defect: separate target-realization search from independent win-probability simulation; prevent early exit; use a registered batch size such as 200–500 draws or an independent closed-form distribution.

weak_run_model_signal

This is an established failure, not single-slate noise.

Non-escalated finding streaks

FindingConsecutive countPresent nowInterpretation
high_raw_probability_cluster0NoOccurred once in the 11-slate window; this slate had two high-raw games, but the registered streak is not current
pipeline_winner_instability0NoIncidence 2 in window, but no current streak
score_margin_compression0NoIncidence 1 in window under this finding label; current margin compression is visible but not escalated under this streak record
simulation_inert_on_slate11YesEstablished persistent failure
single_slate_calibration_instability0NoSeven occurrences in window but no consecutive current streak
weak_run_model_signal11YesEstablished persistent failure

Metric trends

Each direction is explicit:

“Improving” calibration and loss-run error do not mean they are good; they mean the recent series is moving in a favorable direction. Current calibration remains materially imperfect.

Top-confidence-pick loss streak

Other structural persistence


8. Adjustments for today

Recommendations are ranked by persistence, scope, expected metric impact, affected games, and regression risk.

1. Repair and independently measure simulation — highest evidence strength

2. Run an isolated run-model feature/target backtest — persistent high-severity issue

3. Bounded confidence-cap reduction for the strongest single-slate driver

4. Optional shadow test of run-mean weighting

Changes to abstain from today


9. Bottom line

Known

Uncertain

Single safest next action

Repair and instrument the simulation probability path before changing model parameters: separate independent win-probability draws from target-realization search, remove early exit, register the batch size, and run it in shadow with rollback monitoring. This directly addresses an 11-slate established failure, preserves the existing forecast path, and produces the most valuable evidence for the next slate without overfitting today’s nine games.