Hardy, Reuel, Jafari Meimandi, Soder, Griffith, Asmar, Koyejo, Bernstein & Kochenderfer, “More than Marketing? On the Information Value of AI Benchmarks for Practitioners,” arXiv:2412.05520, December 2024

Source SRC-SL-HARDY-ET-AL-MORE-THAN-MARKETING-ARXIV-2412-05520

Open the original (arXiv; link checked 2026-10-19)

Type of source: Preprint
Institutional position: Independent academic (Stanford, with one author at the policy think tank interface)

Version

This is the current version, v1.0. Earlier versions stay available, and their records never change.

Versions: v1.0 · current

Claims that cite this source

In interviews with 19 people who use or decided against using AI benchmarks… Claim LD06-SL-C13 (v1.0)

Raw record: coded values of this source record

Source class (bibliographic): PREPRINT
Source-level roles: none
Visibility: PUBLIC_REFERENCE
Registry section: none
Registry “Linked claim” (logical Claim identity; never a pinned version): LD06-SL-C13
Cited in field 6 of: LD06-SL-C13--v1.0

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 7f6a475a01c8dc1526219c855cada827d46305ad6f183f67532ecde2b3210b8f.

Repository-authored inputs (not Drive exports)

SocioLens claim — LD06-SL-C13 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 13 — LD06-SL-C13” SHA-256 7e6712e470f9064cc597511763903c97fdc20f4f4dfe4a79faf41cda8f7c6aa2; fixture fixtures/authored/claims/LD06-SL-C13--v1.0.

Builder decisions (not Drive data)

VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4). SocioLens Source-record version, not the external source's edition, revision or version of record.
CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-SL-HARDY-ET-AL-MORE-THAN-MARKETING-ARXIV-2412-05520--v1.0 current.
VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD06-SL-C13--v1.0 (explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Hardy, Reuel, Jafari Meimandi, Soder, Griffith, Asmar, Koyejo, Bernstein & Kochenderfer, “More than Marketing? On the Information Value of AI Benchmarks for Practitioners,” arXiv:2412.05520, December 2024".) (Amendment v1.2 §4, §6).