Scorecard · blank · audit scope
Assurance scorecard
Scored against the Ordoia Assurance Levels, v1.0. Eight dimensions are printed on every scorecard. Four are scored at this scope; four are printed as not assessed, with the maximum level the purchased depth could have obtained. A level established at inspected depth is a finding. A score is a statement about a named system, under a named rubric version, on a date, at a named depth — dropping any of the four makes it something else.
- System assessed
- Version identifier (commit or deploy reference)
- Engagement dates
- Engagement reference
- Coverage purchased
- Four dimensions — 1, 2, 5, 7
- Depth purchased
- Inspected
- Methodology version
- OAL v1.0, published 2026-09-19
- Engagement tenure
Truthfulness
Level —— · inspected · finding · OAL v1.0 · working paper WP—— · maximum obtainable at inspected depth: OAL 2
- Dimension
- 1 · Grounding and entailment
- Level
- to be entered on issue
- Depth
- Inspected
- Basis
- Finding
- Methodology version
- OAL v1.0
- Working paper
- to be entered on issue
- Maximum obtainable at inspected depth
- OAL 2
Level —— · inspected · finding · OAL v1.0 · working paper WP—— · maximum obtainable at inspected depth: OAL 3
- Dimension
- 2 · Tool-use integrity
- Level
- to be entered on issue
- Depth
- Inspected
- Basis
- Finding
- Methodology version
- OAL v1.0
- Working paper
- to be entered on issue
- Maximum obtainable at inspected depth
- OAL 3
Boundaries
No level. Maximum obtainable at inspected depth had it been in scope: OAL 2. Available as a baseline top-up at inspected depth, or at tested depth as part of a review.
- Dimension
- 3 · Authorisation and data boundary
- Level
- not assessed — outside audit scope
- Maximum obtainable at inspected depth had it been in scope
- OAL 2
No level. Maximum obtainable at inspected depth had it been in scope: OAL 2.
- Dimension
- 4 · Refusal and instruction-boundary robustness
- Level
- not assessed — outside audit scope
- Maximum obtainable at inspected depth had it been in scope
- OAL 2
Change control
Level —— · inspected · finding · OAL v1.0 · working paper WP—— · maximum obtainable at inspected depth: OAL 3
- Dimension
- 5 · Evaluation discipline
- Level
- to be entered on issue
- Depth
- Inspected
- Basis
- Finding
- Methodology version
- OAL v1.0
- Working paper
- to be entered on issue
- Maximum obtainable at inspected depth
- OAL 3
No level. Maximum obtainable at inspected depth had it been in scope: OAL 3.
- Dimension
- 6 · Model and upgrade control
- Level
- not assessed — outside audit scope
- Maximum obtainable at inspected depth had it been in scope
- OAL 3
Operations
Level —— · inspected · finding · OAL v1.0 · working paper WP—— · maximum obtainable at inspected depth: OAL 3
- Dimension
- 7 · Observability and failure detection
- Level
- to be entered on issue
- Depth
- Inspected
- Basis
- Finding
- Methodology version
- OAL v1.0
- Working paper
- to be entered on issue
- Maximum obtainable at inspected depth
- OAL 3
No level. Maximum obtainable at inspected depth had it been in scope: OAL 3.
- Dimension
- 8 · Execution bounds and cost attribution
- Level
- not assessed — outside audit scope
- Maximum obtainable at inspected depth had it been in scope
- OAL 3
Lowest level assessed: OAL —— on ——————————————— (enter every dimension tied at that level)
This field is the only place on the scorecard where the dimensions are compared, and it takes the lowest rather than the average. There is no overall score, no weighted average, no percentage and no traffic light. An OAL 0 on authorisation is not offset by an OAL 3 on cost control. A dimension printed as not assessed has no level and is never the lowest — it is a scope, not a result.
Lowest levels first
The two or three lowest scores, restated in one sentence each in the buyer's language.
- 1
- 2
- 3
Threshold position
Readiness thresholds are applied by the client to its own system. Reported as met or not met on the evidence obtained, which is a statement about this scorecard rather than a verdict about the system.
- Internal use — no dimension below OAL 2
- Client-facing
- Not evaluable at inspected depth
- Auditor- or regulator-facing
- Not evaluable at inspected depth
- Reason
- Both name OAL 3 at tested depth on dimensions inspection cannot reach.
Limitations
Reproduced in full on every scorecard, not summarised. This rubric scores the system, not the model. It does not establish that the system is secure, legally compliant, or correct on the substance of the domain, and it does not establish that a system at OAL 3 will not fail. It says nothing about periods outside the engagement, or about versions of the system other than the one named above. Each assessment is performed by a single assessor; there is no second reviewer on the work, and no accreditation stands behind it. What stands behind it is a published method, retained working papers, and a named person. Where the assessment covers fewer than eight dimensions, or is performed at inspected depth, this scorecard says so on its face and names the maximum level obtainable in that scope. Full text: ordoia.com/oal/v1.0#limits
Defect register
Ranked, with reproduction steps, as an appendix to this scorecard.
Assessors
Every assessment names the person who performed it and the methodology version it was performed under. Both are published. Add a row for each assessor on the engagement.
Working papers supporting every level above are retained for six years. A competent assessor given the same papers should reach the same level.
Ordoia · scorecard, audit scope · methodology OAL v1.0 · ordoia.com/scorecard