The 2025 Foundation Model Transparency Index found that the average transparency score of major AI developers fell from 58 in 2024 to 40 out of 100, and that no company adequately disclosed how far its training data overlap with the evaluations it is tested on; the authors note that changed indicators and companies may contribute to the decline.

SocioLens project,

Claim LD06-SL-C17 (v1.0)

Provenance and status

Claim type: Estimate
Publication status: Eligible for publication, with a qualifier
Verification state: Checked against the primary source; the source is a preprint. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
Does not license: A like-for-like trend (indicators, companies and reporting mechanisms changed)
Limitations: Indicator choice and weighting by the authors; six companies did not submit reports and were scored from public information
Source (as cited): Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025
Source type: Preprint (recorded as “Preprint”)
Institutional position: Independent academic (Stanford-led, with Berkeley, Princeton, MIT and others)
Maturity of the evidence: Rapidly maturing evidence
Recorded date: 15 October 2026
Currentness / correction: This is the current version. No correction or concern is recorded on its sources.

Sources this version cites

Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025 (Preprint)
Read the original

Version

This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.

This pinned version is also the current version.

Versions: v1.0 · current

Raw record: every recorded field, with its coded values

All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.

Claim type (coded): ESTIMATE (as printed: “ESTIMATE”)
Publication status (coded): ELIGIBLE (QUALIFIED) (as printed: “ELIGIBLE WITH QUALIFIER”)
Verification state (coded): CONTENT_VERIFIED_PRIMARY (PREPRINT)
Source type (coded): PREPRINT
Maturity (coded): RAPIDLY_MATURING

#	Canonical field	Canonical value (verbatim)	Normalized (Claim Value Vocabulary v1.0.2)
1	CLAIM ID	LD06-SL-C17	—
2	PUBLIC-FACING CLAIM	The 2025 Foundation Model Transparency Index found that the average transparency score of major AI developers fell from 58 in 2024 to 40 out of 100, and that no company adequately disclosed how far its training data overlap with the evaluations it is tested on; the authors note that changed indicators and companies may contribute to the decline.	—
3	CLAIM TYPE	ESTIMATE	base_types: ESTIMATE
4	RESEARCH STRAND	B — Leaderboards, judges and disclosure	—
5	MATURITY	RAPIDLY MATURING	states: RAPIDLY_MATURING
6	SOURCE	Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025	source_ids: SRC-SL-WAN-ET-AL-FMTI-2025-ARXIV-2512-10169
7	SOURCE TYPE	Preprint	classes: PREPRINT
8	INSTITUTIONAL POSITION	Independent academic (Stanford-led, with Berkeley, Princeton, MIT and others)	—
9	SCOPE	13 foundation-model developers, 2025	—
10	DESIGN	Indicator-based scoring from company reports and public information	—
11	SAMPLE / DATASET	13 companies	—
12	MODEL / TOOL / VERSION	Each company’s flagship foundation model	—
13	COMPARATOR	The 2024 index	—
14	MAIN RESULT	Average 58 in 2024 and 40 in 2025; IBM 95, xAI and Midjourney 14; seven of nine companies scored in both years fell; limited insight into evaluation methods and little detail for external reproduction; no company adequately discloses train–test overlap	—
15	INFERENTIAL TARGET	Developer disclosure about models, including how they were evaluated	—
16	DOES NOT LICENSE	A like-for-like trend (indicators, companies and reporting mechanisms changed)	—
17	VERIFICATION STATE	CONTENT VERIFIED PREPRINT	state: CONTENT_VERIFIED_PRIMARY · qualifiers: PREPRINT · verified_by: UNKNOWN
18	LIMITATIONS	Indicator choice and weighting by the authors; six companies did not submit reports and were scored from public information	—
19	CONTRADICTORY / SUPPORTING SOURCES	The 2024 rise to 58 depended on developers reporting on themselves	—
20	GEOGRAPHY / LANGUAGE	Global / English	—
21	DISTRIBUTIONAL LEDGER	Not analysed in this claim	—
22	R01 / FIELD-MAP LINKS	LD-06, D4b	—
23	WHAT WOULD CHANGE THIS CLAIM?	A like-for-like comparison on unchanged indicators	—
24	PUBLICATION STATUS	ELIGIBLE WITH QUALIFIER	state: ELIGIBLE · qualifiers: QUALIFIED
25	RECORDED DATE	2026-10-15	—

Field 22 references resolved against Field Map v0.2: LD-06 (LIVING_DEBATE); D4b (SUB_AREA)

The sources as recorded, with their record IDs and coded source types:

Pinned Sources (field 6, version-specific)

“Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025” → Wan et al. (2025), “The 2025 Foundation Model…” (SRC-SL-WAN-ET-AL-FMTI-2025-ARXIV-2512-10169--v1.0) — Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025; class PREPRINT (explicit public provenance pin)

Cited by Living Debate versions

The evaluation apparatus: Can benchmarks, leaderboards and audits carry the weight placed on them? (v0.1) LD-06

Cite this page

SocioLens project. (2026, October 15). The 2025 Foundation Model Transparency Index found that the average transparency score of major AI developers fell from 58 in 2024 to 40 out of 100, and that no company adequately disclosed how far its training data overlap with the evaluations it is tested on; the authors note that changed indicators and companies may contribute to the decline [Claim LD06-SL-C17, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld06-sl-c17/v1.0/

@misc{sociolens_ld06_sl_c17_v1_0,
  author = {{SocioLens project}},
  title = {The 2025 Foundation Model Transparency Index found that the average transparency score of major AI developers fell from 58 in 2024 to 40 out of 100, and that no company adequately disclosed how far its training data overlap with the evaluations it is tested on; the authors note that changed indicators and companies may contribute to the decline.},
  year = {2026},
  date = {2026-10-15},
  howpublished = {\url{https://sociolens-web.pages.dev/claims/ld06-sl-c17/v1.0/}},
  note = {Claim LD06-SL-C17, version v1.0}
}

The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 3c6098ac5be2b9decea1f7b0469cd80d43d710121c3140733cc71d2c559aa043.

Repository-authored inputs (not Drive exports)

SocioLens claim — LD06-SL-C17 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 17 — LD06-SL-C17” SHA-256 d675bfa1687feab1505924fc9acb36caea36ec8a571d547c7e9a7ec4df00aff2; fixture fixtures/authored/claims/LD06-SL-C17--v1.0.

Builder decisions (not Drive data)

VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD06-SL-C17 v1.0); the first version of a new Claim of the LD-06 debate
CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD06-SL-C17 v1.0" (Project Lead (Claude, AI), 2026-10-15); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts
FIELD_6_SOURCE_REFERENCE = SRC-SL-WAN-ET-AL-FMTI-2025-ARXIV-2512-10169--v1.0 — basis: field 6 of ENTRY 17 — LD06-SL-C17 cites "Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
SOURCE_PROVENANCE_PIN = SRC-SL-WAN-ET-AL-FMTI-2025-ARXIV-2512-10169--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Wan, Klyman, Kapoor, Maslej, Longpre, Xiong, Liang & Bommasani, “The 2025 Foundation Model Transparency Index,” arXiv:2512.10169, December 2025".