Claim LD06-SL-C23 (v1.0)
In their joint pre-deployment test of OpenAI’s o1, the US and UK AI Safety Institutes stated that their findings were preliminary and partial, that they tested an early version without the full mitigations after a limited period of access and after fixing tool-use problems with their own scaffolding, and that the results should not be read as showing whether the model was safe or appropriate for release.
Provenance and status
- Claim type
- Fact
- Publication status
- Eligible for publication, with a qualifier
- Verification state
- Checked against the primary source. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
- Does not license
- Conclusions about the released model
- Limitations
- One report on one model; later institute reports were not read
- Source (as cited)
- US AI Safety Institute & UK AI Safety Institute, “US AISI and UK AISI Joint Pre-Deployment Test: OpenAI o1,” December 2024
- Source type
- Government audit or evaluation (recorded as “Government evaluation report”)
- Institutional position
- Government AI safety institutes (US and UK)
- Maturity of the evidence
- Emerging evidence
- Recorded date
- 15 October 2026
- Currentness / correction
- This is the current version. No correction or concern is recorded on its sources.
Sources this version cites
Version
This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.
This pinned version is also the current version.
Raw record: every recorded field, with its coded values
All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.
- Claim type (coded)
- FACT (as printed: “FACT”)
- Publication status (coded)
- ELIGIBLE (QUALIFIED) (as printed: “ELIGIBLE WITH QUALIFIER”)
- Verification state (coded)
- CONTENT_VERIFIED_PRIMARY
- Source type (coded)
- GOVERNMENT_AUDIT_OR_EVALUATION
- Maturity (coded)
- EMERGING
| # | Canonical field | Canonical value (verbatim) | Normalized (Claim Value Vocabulary v1.0.2) |
|---|---|---|---|
| 1 | CLAIM ID | LD06-SL-C23 | — |
| 2 | PUBLIC-FACING CLAIM | In their joint pre-deployment test of OpenAI’s o1, the US and UK AI Safety Institutes stated that their findings were preliminary and partial, that they tested an early version without the full mitigations after a limited period of access and after fixing tool-use problems with their own scaffolding, and that the results should not be read as showing whether the model was safe or appropriate for release. | — |
| 3 | CLAIM TYPE | FACT | base_types: FACT |
| 4 | RESEARCH STRAND | C — Evaluation in governance, audits and red-teaming | — |
| 5 | MATURITY | EMERGING | states: EMERGING |
| 6 | SOURCE | US AI Safety Institute & UK AI Safety Institute, “US AISI and UK AISI Joint Pre-Deployment Test: OpenAI o1,” December 2024 | source_ids: SRC-SL-US-UK-AISI-O1-PREDEPLOYMENT-EVALUATION-2024-12 |
| 7 | SOURCE TYPE | Government evaluation report | classes: GOVERNMENT_AUDIT_OR_EVALUATION |
| 8 | INSTITUTIONAL POSITION | Government AI safety institutes (US and UK) | — |
| 9 | SCOPE | Cyber, biological and software-development capabilities of an early o1 version | — |
| 10 | DESIGN | Pre-deployment capability evaluation by two state institutes | — |
| 11 | SAMPLE / DATASET | Public and private benchmark tasks (for example 40 Cybench challenges and 47 UK AISI cyber challenges) | — |
| 12 | MODEL / TOOL / VERSION | An early version of OpenAI o1 | — |
| 13 | COMPARATOR | Reference models | — |
| 14 | MAIN RESULT | “A version of o1 that was better optimized for tool use might exhibit better performance”; the model comparison “cannot provide a reliable comparison of capabilities”; UK AISI could not assess the ceiling of o1’s cyber capabilities | — |
| 15 | INFERENTIAL TARGET | What a state pre-deployment evaluation can and cannot establish | — |
| 16 | DOES NOT LICENSE | Conclusions about the released model | — |
| 17 | VERIFICATION STATE | CONTENT VERIFIED | state: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN |
| 18 | LIMITATIONS | One report on one model; later institute reports were not read | — |
| 19 | CONTRADICTORY / SUPPORTING SOURCES | Compare the evaluator access and timing set out in LD06-SL-C24 | — |
| 20 | GEOGRAPHY / LANGUAGE | US / UK / English | — |
| 21 | DISTRIBUTIONAL LEDGER | Not analysed in this claim | — |
| 22 | R01 / FIELD-MAP LINKS | LD-06, D4b | — |
| 23 | WHAT WOULD CHANGE THIS CLAIM? | Later reports with longer access and full elicitation | — |
| 24 | PUBLICATION STATUS | ELIGIBLE WITH QUALIFIER | state: ELIGIBLE · qualifiers: QUALIFIED |
| 25 | RECORDED DATE | 2026-10-15 | — |
Field 22 references resolved against Field Map v0.2: LD-06 (LIVING_DEBATE); D4b (SUB_AREA)
The sources as recorded, with their record IDs and coded source types:
Pinned Sources (field 6, version-specific)
- “US AI Safety Institute & UK AI Safety Institute, “US AISI and UK AISI Joint Pre-Deployment Test: OpenAI o1,” December 2024” → US AI Safety Institute & UK AI Safety Institute (2024), “US AISI and UK…” (SRC-SL-US-UK-AISI-O1-PREDEPLOYMENT-EVALUATION-2024-12--v1.0) — US AI Safety Institute & UK AI Safety Institute, “US AISI and UK AISI Joint Pre-Deployment Test: OpenAI o1,” December 2024; class GOVERNMENT_AUDIT_OR_EVALUATION (explicit public provenance pin)
Cited by Living Debate versions
Cite this page
SocioLens project. (2026, October 15). In their joint pre-deployment test of OpenAI’s o1, the US and UK AI Safety Institutes stated that their findings were preliminary and partial, that they tested an early version without the full mitigations after a limited period of access and after fixing tool-use problems with their own scaffolding, and that the results should not be read as showing whether the model was safe or appropriate for release [Claim LD06-SL-C23, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld06-sl-c23/v1.0/
@misc{sociolens_ld06_sl_c23_v1_0,
author = {{SocioLens project}},
title = {In their joint pre-deployment test of OpenAI’s o1, the US and UK AI Safety Institutes stated that their findings were preliminary and partial, that they tested an early version without the full mitigations after a limited period of access and after fixing tool-use problems with their own scaffolding, and that the results should not be read as showing whether the model was safe or appropriate for release.},
year = {2026},
date = {2026-10-15},
howpublished = {\url{https://sociolens-web.pages.dev/claims/ld06-sl-c23/v1.0/}},
note = {Claim LD06-SL-C23, version v1.0}
}The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.
Research-of-record provenance
Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 36d054a66cb544f975a682bf6db8a44555567b391259ae8c2e0771637881b61b.
Repository-authored inputs (not Drive exports)
- SocioLens claim — LD06-SL-C23 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 23 — LD06-SL-C23” SHA-256
58aeabceb7b6f28b48b7f5c98f753886b40efadf4b0200c3565fbfd0ef31fdb0; fixturefixtures/authored/claims/LD06-SL-C23--v1.0.
Builder decisions (not Drive data)
- VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD06-SL-C23 v1.0); the first version of a new Claim of the LD-06 debate
- CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD06-SL-C23 v1.0" (Project Lead (Claude, AI), 2026-10-15); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts
- FIELD_6_SOURCE_REFERENCE = SRC-SL-US-UK-AISI-O1-PREDEPLOYMENT-EVALUATION-2024-12--v1.0 — basis: field 6 of ENTRY 23 — LD06-SL-C23 cites "US AI Safety Institute & UK AI Safety Institute, “US AISI and UK AISI Joint Pre-Deployment Test: OpenAI o1,” December 2024"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
- SOURCE_PROVENANCE_PIN = SRC-SL-US-UK-AISI-O1-PREDEPLOYMENT-EVALUATION-2024-12--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "US AI Safety Institute & UK AI Safety Institute, “US AISI and UK AISI Joint Pre-Deployment Test: OpenAI o1,” December 2024".