Skip to content

Weakener catalog (v0.17.0)

Generated from uofa catalog --format md at 2026-08-30T02:53:21Z. 57 patterns across 5 packs.

PatternSeverityDescription
COMPOUND-01CriticalCritical and High severity weakeners coexist — compounding risk escalation.
COMPOUND-03HighAssurance level is not Low, yet Critical weakeners exist — stated assurance level may be overstated.
W-AL-01HighValidation result has no uncertainty quantification — aleatory uncertainty is uncharacterized.
W-AL-02MediumUncertainty quantification is reported but no sensitivity analysis is documented — the drivers of uncertainty are uncharacterized.
W-AR-01CriticalCredibility factor has a required level but no acceptance criteria — basis for the requirement is unsupported.
W-AR-02CriticalCredibility factor achievedLevel is below requiredLevel, yet the decision outcome is Accepted with no documented offset rationale — contradictory result ignored.
W-AR-03HighRequirement requires a specific verification method but the supporting activity used a different activityType — evidence does not answer the question the requirement asked.
W-AR-04HighModelConfiguration was validated at a modelVersion that differs from the UofA currentModelVersion — validation evidence may not apply to the current model.
W-AR-05HighValidation result has no comparedAgainst link — comparator data source is absent.
W-CON-01HighDecision is Accepted but a credibility factor has neither requiredLevel nor achievedLevel — the acceptance rests on an unestablished factor.
W-CON-02MediumUofA references an identifier whose target does not resolve within the graph and has no documented external-fetch hint.
W-CON-03HighEvidence timestamp is later than the UofA signature timestamp — evidence was created after the UofA was signed, either a clock anomaly or an uncounted update.
W-CON-04MediumUofA conforms to ProfileComplete but declares no SensitivityAnalysis — a Complete profile is structurally expected to document sensitivity analysis alongside uncertainty quantification.
W-CON-05HighVerificationActivity is declared on the UofA but no Evidence is linked via prov:wasGeneratedBy — the activity is a procedural placeholder rather than real verification.
W-EP-01CriticalClaim has no prov:wasDerivedFrom link to evidence — provenance chain is broken.
W-EP-02HighValidation result has no prov:wasGeneratedBy — generation activity is missing.
W-EP-03HighInput dataset vintage predates the current model revision date — input data may be stale relative to the model it exercises.
W-EP-04HighCredibility factor is not assessed but model risk level exceeds 2 — unassessed factors at elevated risk weaken the credibility argument.
W-ON-01CriticalUofA has no Context of Use — intended use and risk context are undefined.
W-ON-02HighContext of Use has neither an applicability constraint nor an operating envelope — the COU is declared but its boundary of validity is undocumented.
W-PROV-01CriticalProvenance chain terminates at a node that has no upstream derivation/generation/use edge and is not marked uofa:isFoundationalEvidence=true — chain is incomplete.
W-SI-01MediumUofA has no digital signature — structural integrity cannot be verified.
W-SI-02HighUofA is missing bindsRequirement — incomplete profile binding.
PatternSeverityDescription
W-AIMS-AUDIT-STALEHighAudit results record declares cadence but lacks nextReviewDate — staleness relative to system change frequency cannot be verified.
W-AIMS-CROSSWALK-INVALIDMediumSoA asserts framework crosswalk but no AIMSControl carries the matching mappedToFramework — crosswalk invalid.
W-AIMS-DATA-DRIFT-UNDETECTEDHighData resource declared but no OngoingDataQualityMonitoring evidence present — data drift would go undetected.
W-AIMS-DATA-LINEAGE-BROKENHighData resource provenance stage has no hasNextStage successor — lineage discontinuity across processing stages.
W-AIMS-DEPLOYMENT-DRIFTHighDeployment configuration differs from validated configuration — deployment drift.
W-AIMS-IMPACT-SCOPEHighImpact assessment scope does not match assessed deployment scope — structural subset mismatch.
W-AIMS-IMPACT-STAKEHOLDERMediumImpact assessment record lacks affectedStakeholder enumeration — affected parties not documented.
W-AIMS-INCIDENT-UNCLOSEDHighNonconformity record present but no root cause analysis linked — incident not closed.
W-AIMS-MODEL-EVAL-SCOPEHighModel evaluation testSetCoverage does not match documented deploymentPopulation — test set scope mismatch.
W-AIMS-MODEL-EVAL-STALEHighModel evaluation report version does not match currently deployed model version — evaluation is stale.
W-AIMS-OBJECTIVE-UNMEASUREDMediumAIMS objective declared but no targetMeasure documented — objective is unmeasured.
W-AIMS-ROLE-UNASSIGNEDHighAIMS role assignment lacks both assignedPerson and assignedOrganizationalUnit — role is unassigned.
W-AL-02MediumClaim asserts framework mapping that no other bundle artifact references — claim-evidence alignment broken.
W-AR-02HighAccept-decision risk has acceptance rationale but no justification body — risk acceptance is not documented.
W-PROV-01HighData resource provenance record lacks sourceReference — upstream document or system identifier missing.
PatternSeverityDescription
COMPOUND-EV-01CriticalScore informs a high-risk decision while carrying neither an uncertainty estimate nor a null baseline - there is no basis for judging whether the reported difference is real.
COMPOUND-EV-02CriticalA generalized performance claim rests on a sample with no stated relationship to the population it generalizes over - the claim is broader than the evidence supporting it.
W-EV-CAP-06MediumNo capability-confound control stated - the reported separation may be attributable to general capability rather than to the construct the benchmark claims to measure.
W-EV-COR-09MediumNo independently furnished measurement corroborates this reported score - the furnished evidence available measures different properties, so the published number stands on a single referent.
W-EV-COU-05CriticalReported evaluation states no context-of-use relevance, and an assessment context was supplied - the score is being read against a decision the published record never claimed it informs.
W-EV-DET-03HighReported evaluation states no determinism floor - sampling settings and per-model run-to-run spread are uncharacterized, so the score is one draw reported as a measurement.
W-EV-DIV-07HighThe score reported in the published record disagrees with an independent measurement of the same benchmark by more than the measurement tolerance - the two do not agree, and which is correct is not established here.
W-EV-GEN-02HighReported benchmark score carries no account of how its items sample the target population - benchmark accuracy cannot be read as generalized accuracy.
W-EV-NULL-04HighReported score is not calibrated against a null, chance, or comprehension-free baseline - the floor the score must clear to mean anything is unstated.
W-EV-SUB-08HighThe evaluation subject is not configuration-controlled - its identity is claimed by the provider with no immutable version guarantee, so the score is evidence about an occasion rather than about a fixed artifact.
PatternSeverityDescription
W-NASA-01HighData pedigree factor is not assessed but model risk level exceeds 1 — input data provenance should be documented at elevated risk.
W-NASA-02HighTechnical review factor is assessed but has no linked ReviewActivity evidence.
W-NASA-03HighProcess management factor is assessed but has no linked ProcessAttestation evidence.
W-NASA-04MediumUse history is not assessed but model risk level exceeds 2 — prior deployment evidence would strengthen the credibility argument.
W-NASA-05HighResults uncertainty factor is assessed but UofA has no UQ data (hasUncertaintyQuantification is missing).
W-NASA-06HighResults robustness factor is assessed but has no linked SensitivityAnalysis evidence.
PatternSeverityDescription
W-SURR-01HighDeclared physics constraint has no linked constraint-check evidence — the surrogate claims to respect a governing law with no checkable residual/conservation artifact.
W-SURR-02CriticalSurrogate inherits credibility from a parent COU whose recorded decision is Not Accepted — inherited-credibility defeater.
W-SURR-03HighCOU evaluation point/region is not contained within the declared training envelope — the surrogate is exercised in extrapolation.