Preview: not announced. Search engines asked not to index.

Bean, Kearns, Romanou, Hafner, Mayne, Batzner et al., “Measuring what Matters: Construct Validity in Large Language Model Benchmarks,” NeurIPS 2025 Datasets and Benchmarks Track, arXiv:2511.04703

Source SRC-SL-BEAN-ET-AL-NEURIPS-2025-ARXIV-2511-04703

Open the original (arXiv; link checked 2026-10-19)

Type of source
Peer-reviewed conference paper
Institutional position
Independent academic (University of Oxford-led)

Version

This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.

This pinned version is also the current version.

Versions: v1.0 · current

Claims that cite this source

Raw record: coded values of this source record
Source class (bibliographic)
PEER_REVIEWED_CONFERENCE_PAPER
Source-level roles
none
Visibility
PUBLIC_REFERENCE
Registry section
none
Registry “Linked claim” (logical Claim identity; never a pinned version)
LD06-SL-C05
Cited in field 6 of
LD06-SL-C05--v1.0
Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 7eb4eaf147ec510e4d1e83ca37436daf460bd9993fa92e7afe8e761b3971ff23.

Repository-authored inputs (not Drive exports)

  • SocioLens claim — LD06-SL-C05 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 05 — LD06-SL-C05” SHA-256 744226d6eedc602f1609e4ffa520590b0e343d5f5ad452e30d6300a82a7ba7c1; fixture fixtures/authored/claims/LD06-SL-C05--v1.0.

Builder decisions (not Drive data)

  • VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4). SocioLens Source-record version, not the external source's edition, revision or version of record.
  • CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-SL-BEAN-ET-AL-NEURIPS-2025-ARXIV-2511-04703--v1.0 current.
  • VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD06-SL-C05--v1.0 (explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Bean, Kearns, Romanou, Hafner, Mayne, Batzner et al., “Measuring what Matters: Construct Validity in Large Language Model Benchmarks,” NeurIPS 2025 Datasets and Benchmarks Track, arXiv:2511.04703".) (Amendment v1.2 §4, §6).