Soccer prediction system deep audit

Slate 20261026 · immutable forensic review of 1 match prediction artifact(s)

Executive conclusion

In 1 match(es) the headline score is not the distribution's modal scoreline (a breach of the published-mode contract) — see the MOST_LIKELY_IS_MODE findings.

At a glance

1matches audited
0critical
0errors
1warnings
0grid non-reproducible
1headline != modal
0winner disagreements
0lambda inconsistencies
0with real result
-winner hit-rate
-decisive hit-rate
0%predicted draws
-actual draws
0confident misses
-mean Brier
 

Matches

Sevilla vs Osasuna

20261026_OSA@SEV · LaLiga
WARNINGS risk 10 pred 2-1 (Sevilla)λ 1.80 / 1.18conf 0.74 warning 1 good 40
Problems (1)
SevCategoryRuleMessageValueExpected
warningmodel_behaviorMOST_LIKELY_IS_MODEHeadline score is not the modal scoreline (modal=1-1 (p=0.1084), shown=2-1 (p=0.0972)); the published exact score must be the grid mode, and the winning scenario belongs in the labelled most_likely_winning_score_home/away fields. Both lean Sevilla.2-11-1
Lambda evolution (audit trail)
StageHome λAway λ
Pre-competitive-floor1.8561.195
Pre-calibration1.7371.198
Final1.8041.179
competition_calibration_scale: 0.978competition_observed_total_goals: 2.984quality_gap_applied: Truemismatch_score_pressure_applied: Falsecompetitive_underdog_floor_applied: Falsestage_discount: 1.0
Scoreline distribution
Top scorelinesP
1-110.8%
2-19.7%
1-09.1%
2-08.2%
1-26.3%
Outcome — home 51.9% · draw 23.2% · away 24.8%
Markets — O2.5 57.3% · BTTS 57.9%
Passed checks (40)
SevCategoryRuleMessageValueExpected
goodintegritySCHEMA_KEYS_PRESENTAll required sections present.
goodstructureLINEUP_ELEVENSevilla: 11 starters.
goodstructureFORMATION_VALIDSevilla: formation 4-2-3-1 valid.
goodstructureLINEUP_ELEVENOsasuna: 11 starters.
goodstructureFORMATION_VALIDOsasuna: formation 4-3-3 valid.
goodprobabilityOUTCOME_SUMS_ONEoutcome sums to 1.0001.
goodprobabilityMARKETS_COMPLEMENTARYOver/Under and BTTS pairs each sum to 1.
goodprobabilitySCORELINE_PROBS_NONNEGAll scoreline probabilities within [0,1].
goodprobabilityGRID_SUMS_ONEscoreline grid sums to 0.9965.
goodmodel_behaviorGRID_REPRODUCIBLEGrid reproducible from lambdas (max cell diff 0.0007).
goodprobabilityMLS_PROBABILITY_MATCHESHeadline probability matches the grid.
goodmodel_behaviorOUTCOME_MATCHES_GRIDOutcome split matches the grid (max diff 0.0018).
goodmodel_behaviorMARKETS_MATCH_GRIDMarkets match the grid (max diff 0.0035).
goodintegrityWINNER_IS_VALID_TEAMpredicted_winner 'Sevilla' is a participating side.
goodmodel_behaviorWINNER_MATCHES_SCOREWinner agrees with headline score (Sevilla).
goodmodel_behaviorWINNER_PROBABILITY_DIRECTIONpredicted_winner 'Sevilla' follows the published modal scoreline 2-1.
goodmodel_behaviorLAMBDA_BOUNDSLambdas in range (home 1.804, away 1.179).
goodprovenanceLAMBDA_FACTORS_PRESENTlambda_factors audit trail present.
goodmodel_behaviorLAMBDA_CONSISTENCYLambda identical across prediction / antagonist / factors.
goodmodel_behaviorCALIBRATION_SCALE_BOUNDSCalibration scale 0.978 in range.
goodprovenanceCALIBRATION_RECORDEDCalibration recorded with pre/post lambdas.
goodprovenanceXGBOOST_REASONING_PRESENTMatch-level xgboost_reasoning present (XGBoost).
goodmodel_behaviorLAMBDA_REASONING_CONSISTENCYLambdas in xgboost_reasoning match final Poisson lambdas (1.804 / 1.179).
goodprovenanceFBREF_PRIORS_ACTIVEFBref team priors applied (blend weight 0.228, home E[lambda]=1.481, away E[lambda]=1.481).
goodprovenanceXGBOOST_PLAYER_REASONINGAll 22 starters carry full XGBoost / FBref reasoning.
goodintegrityTEAM_GOALS_SUMSevilla: player goals reconcile to team total (2).
goodintegrityTEAM_GOALS_SUMOsasuna: player goals reconcile to team total (1).
goodstructurePOSSESSION_SUMS_100Possession sums to 100.0%.
goodintegrityPLAYER_STAT_REALISMAll 22 projected player lines pass realism checks.
goodstructureEXACTLY_ONE_GOALKEEPERSevilla: exactly one goalkeeper (Odysseas Vlachodimos).
goodintegritySHOT_MATH_INTEGRITYAll 11 projected lines have consistent shot components.
goodintegrityTEAM_SHOTS_CAPSevilla: 15 projected shots inside the realistic envelope.
goodstructureEXACTLY_ONE_GOALKEEPEROsasuna: exactly one goalkeeper (Aitor Fernández).
goodintegritySHOT_MATH_INTEGRITYAll 11 projected lines have consistent shot components.
goodintegrityTEAM_SHOTS_CAPOsasuna: 10 projected shots inside the realistic envelope.
goodprovenanceSTANDING_AVAILABLELeague-standing context available for both sides.
goodprovenanceRANKING_PROVENANCE22/22 starters carry a ranking source.
goodprovenanceDATA_DEPTH22/22 starters have adequate recent history.
goodprovenancePREGAME_DIRECTION_AGREESPregame favorite agrees with the model winner (Sevilla).
goodprovenancePREGAME_TOTAL_CONSISTENTPregame total 2.98 ~ Poisson total 2.98.

Rule catalogue

RuleDescriptionTriggered
SCHEMA_KEYS_PRESENTAll required top-level sections exist in the artifact.ok
LINEUP_ELEVENEach side fields exactly 11 starters.ok
FORMATION_VALIDFormation string parses and its outfield lines sum to 10.ok
POSSESSION_SUMS_100Estimated possession of both teams sums to ~100%.ok
TEAM_GOALS_SUMPlayers' projected integer goals sum to the team's headline score.ok
TEAM_TOTALS_SCORE_MATCHteam_totals.projected_goals equals the headline score component.ok
TEAM_EG_LAMBDA_MATCHteam_totals.expected_goals matches the team's Poisson lambda.ok
PLAYER_STAT_REALISMProjected player lines are internally consistent (xG<=shots, accurate<=total passes, minutes/rating in range).ok
EXACTLY_ONE_GOALKEEPEREach starting XI fields exactly one goalkeeper.ok
SHOT_MATH_INTEGRITYShot components are physically consistent (on target <= total, on+off <= total; blocked shots cannot be negative).ok
PLAYER_MINUTES_LEAGUE_CAPNo player projects more minutes than the competition clock allows (90 + stoppage, or extra time in cups).ok
TEAM_SHOTS_CAPTeam projected shots stay inside the realistic historical envelope (~35).ok
OUTCOME_SUMS_ONEhome_win + draw + away_win sums to 1.ok
MARKETS_COMPLEMENTARYOver/Under and BTTS pairs each sum to 1.ok
GRID_SUMS_ONEThe scoreline probability grid sums to ~1.ok
SCORELINE_PROBS_NONNEGEvery scoreline probability is a valid [0,1] value.ok
GRID_REPRODUCIBLEThe reported scoreline grid is reproducible from the lambdas.ok
MOST_LIKELY_IS_MODEThe headline most-likely score is the distribution's modal scoreline.1 problems
MLS_PROBABILITY_MATCHESmost_likely_score_probability equals the grid value of that score.ok
OUTCOME_MATCHES_GRIDThe reported win/draw/loss split is derivable from the grid.ok
MARKETS_MATCH_GRIDThe reported Over/Under and BTTS are derivable from the grid.ok
WINNER_MATCHES_SCOREpredicted_winner agrees with the headline score direction.ok
WINNER_PROBABILITY_DIRECTIONpredicted_winner derives from the published modal scoreline; diverging from the 1X2 favorite is expected.ok
WINNER_IS_VALID_TEAMpredicted_winner names a participating team (or Draw).ok
MODAL_OUTCOME_IS_DRAWDraw is the single largest outcome bucket while a team is named.ok
LAMBDA_BOUNDSBoth lambdas fall inside the engine's [0.55, 5.00] envelope.ok
LAMBDA_CONSISTENCYThe lambda is identical across prediction / antagonist / lambda_factors.ok
LAMBDA_FACTORS_PRESENTThe lambda_factors decomposition (audit trail) is present.ok
CALIBRATION_SCALE_BOUNDScompetition_calibration_scale stays within [0.85, 1.35].ok
CALIBRATION_RECORDEDWhen calibration ran, the pre-calibration lambdas are recorded.ok
STANDING_AVAILABLELeague-standing context is available for a domestic fixture.ok
RANKING_PROVENANCEPlayer ranking/quality signals carry a recognised source.ok
DATA_DEPTHStarters have enough recent games to model rather than synthesise.ok
FBREF_PRIORS_ACTIVEFBref season-prior files exist so that branch is not silently inert.ok
XGBOOST_REASONING_PRESENTMatch-level xgboost_reasoning payload is present with full tracing pipeline.ok
XGBOOST_PLAYER_REASONINGStarters have xgboost_reasoning metadata tracking feature contributions and FBref priors.ok
LAMBDA_REASONING_CONSISTENCYLambdas reported in xgboost_reasoning match the final Poisson lambdas.ok
PREGAME_DIRECTION_AGREESThe pregame fair-line favorite agrees with the model winner.ok
PREGAME_TOTAL_CONSISTENTThe pregame expected total is close to the sum of the lambdas.ok
RESULT_WINNER_HITThe predicted winner matched the real result.ok
RESULT_EXACT_SCORE_HITThe headline score matched the real scoreline exactly.ok
RESULT_OU_HITThe Over/Under 2.5 lean matched reality.ok
RESULT_BTTS_HITThe BTTS lean matched reality.ok
RESULT_CONFIDENT_MISSA high-confidence prediction did not reach the real outcome.ok
OUTCOME_BRIERBrier score of the win/draw/loss probabilities vs the real result.ok

Generated 2026-10-26 13:38:43 UTC · Soccer prediction reporting