urn:uuid:f9f4963e-27c3-5c9c-9684-520ce26a7829 New versions of this debate, revisions of its claims, Radar updates and research opportunities. 2026-10-16T00:00:00Z SocioLens urn:uuid:4e856f02-3fb2-5ec5-b124-4dcc8467c485 2026-10-16T00:00:00Z

For general-purpose AI providers that also run platforms or search engines designated under the Digital Services Act, what does each legal route for outside scrutiny deliver in practice (external evaluation under the GPAI Code of Practice, which applies only to models with systemic risk, vetted-researcher data access under the Digital Services Act, and the AI Office's information requests and model evaluations), recorded for each route as what object is reached (model, platform data or documents), who can start it, how long it takes and how deep the access goes?

urn:uuid:3f3272d8-ee14-5fb2-82b2-fe8a79e49f1a 2026-10-15T00:00:00Z

Benchmark scores, leaderboard ranks, model judges, developers' own reports, red-teaming and audits are now used to decide what research is published, which models are bought, which are released and which comply with the law. Can they carry that weight?

urn:uuid:18ed36e2-8cb2-5459-bed4-4747c265f9de 2026-10-15T00:00:00Z

Across many language models, do scores on public benchmarks predict measured outcomes when the same models are used in real work, such as code that maintainers merge in live repositories, support tickets resolved or error rates in use, and are the benchmarks calibrated to those outcomes or only correct in rank?

urn:uuid:aac14651-7204-5c1c-883d-a31e94a87f1b 2026-10-15T00:00:00Z

When annual indices, industry reports and government or procurement documents cite benchmark and evaluation figures, what share come from the developers themselves, what share are independently measured, and how often is the figure, its unit or its scope changed between the primary source and the relay?

urn:uuid:3d4de4fc-0194-5eeb-b382-e01770eb1416 2026-10-15T00:00:00Z

When the same safety scenarios are presented with and without minimal cues that they are tests, how large is the gap in measured behaviour across open and closed frontier models, and does suppressing evaluation awareness in open-weight models on the same items reproduce the gap?

urn:uuid:842eabc6-a517-59a2-86c6-f8bbdfe99993 2026-10-15T00:00:00Z

Under the EU Code of Practice for general-purpose AI models with systemic risk, which signatories appoint independent external evaluators, how often are the exceptions used (a model judged similarly safe or safer, or no evaluator found after a public call), and what access and time do evaluators actually receive?

urn:uuid:fa107003-8e4e-534c-99b5-c8be70273fc9 2026-10-15T00:00:00Z

Under China's national standard GB/T 45654-2025, who builds the generated-content and refusal test banks that decide whether a generative AI service passes, how are the banks validated, and do providers' banks and third-party evaluators' banks give the same verdicts on the same models?

urn:uuid:e071e332-1598-553f-b0d0-93d5186e5ed9 2026-10-15T00:00:00Z

Among published studies in NLP, the social sciences and education research that evaluate closed language models through an API, what share used a model version that has since been retired or is due to retire, and how many of a sample can still be re-run to reproduce their main result?