A comment on the preprint-productivity study shows that dating adoption to an author’s first flagged abstract can by itself create post-adoption gains: placebo flags gave mean effects of 0.37 and 0.30 against 0.36 in the replicated baseline; the original authors reply that the artefact is “real but bounded” and that the association persists in designs it cannot bias.

SocioLens project,

Claim LD09-SL-C06 (v1.0)

Provenance and status

Claim type: Estimate and Interpretation
Publication status: Eligible for publication, with qualifiers: preprint
Verification state: Checked against the primary source; the source is a preprint. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
Does not license: That the output gain is zero, or that it is as large as first reported
Limitations: Comment read in full; reply read in abstract only; neither is known to be peer-reviewed or published in the journal
Source (as cited): Renault, Bergeaud & Bosquet, “Comment on Scientific production in the era of large language models,” arXiv:2605.17979, May 2026; Kusumegi et al., “A robust association between LLM use and scientific productivity: Assessing stopping-time selection,” arXiv:2607.28968, July 2026
Source type: Preprint (recorded as “Preprint comment + preprint reply”)
Institutional position: Independent academic (the comment); the reply is by the authors of the original study
Maturity of the evidence: Contested evidence
Recorded date: 15 October 2026
Currentness / correction: This is the current version. No correction or concern is recorded on its sources.

Sources this version cites

Version

This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.

This pinned version is also the current version.

Versions: v1.0 · current

Raw record: every recorded field, with its coded values

All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.

Claim type (coded): ESTIMATE + INTERPRETATION (as printed: “ESTIMATE / INTERPRETATION”)
Publication status (coded): ELIGIBLE (PREPRINT) (as printed: “ELIGIBLE WITH PREPRINT QUALIFIER”)
Verification state (coded): CONTENT_VERIFIED_PRIMARY (PREPRINT)
Source type (coded): PREPRINT
Maturity (coded): CONTESTED

#	Canonical field	Canonical value (verbatim)	Normalized (Claim Value Vocabulary v1.0.2)
1	CLAIM ID	LD09-SL-C06	—
2	PUBLIC-FACING CLAIM	A comment on the preprint-productivity study shows that dating adoption to an author’s first flagged abstract can by itself create post-adoption gains: placebo flags gave mean effects of 0.37 and 0.30 against 0.36 in the replicated baseline; the original authors reply that the artefact is “real but bounded” and that the association persists in designs it cannot bias.	—
3	CLAIM TYPE	ESTIMATE / INTERPRETATION	base_types: ESTIMATE, INTERPRETATION
4	RESEARCH STRAND	A — Science and scholarship	—
5	MATURITY	CONTESTED	states: CONTESTED
6	SOURCE	Renault, Bergeaud & Bosquet, “Comment on Scientific production in the era of large language models,” arXiv:2605.17979, May 2026; Kusumegi et al., “A robust association between LLM use and scientific productivity: Assessing stopping-time selection,” arXiv:2607.28968, July 2026	source_ids: SRC-SL-RENAULT-BERGEAUD-BOSQUET-ARXIV-2605-17979, SRC-SL-KUSUMEGI-ET-AL-REPLY-ARXIV-2607-28968
7	SOURCE TYPE	Preprint comment + preprint reply	classes: PREPRINT
8	INSTITUTIONAL POSITION	Independent academic (the comment); the reply is by the authors of the original study	—
9	SCOPE	The arXiv part of the study in LD09-SL-C05; bioRxiv and SSRN are not replicated	—
10	DESIGN	Replication with placebo treatments (comment); recalibration and alternative designs (reply)	—
11	SAMPLE / DATASET	An author panel the comment rebuilds from raw arXiv metadata with the original study’s detector, because the replication package holds only the aggregated panel	—
12	MODEL / TOOL / VERSION	Neutral-keyword and random-flag placebos; pre-ChatGPT placebo	—
13	COMPARATOR	The replicated baseline estimate	—
14	MAIN RESULT	Mean post-treatment coefficients: baseline 0.36, neutral-keyword placebo 0.37, random-flag placebo 0.30, pre-ChatGPT placebo 0.11 (comment); positive association persists in split-year, conservative difference-in-differences, intensity and rank-based designs, and pre-ChatGPT placebos return nulls (reply)	—
15	INFERENTIAL TARGET	How much of the reported output gain is an artefact of how adoption is dated	—
16	DOES NOT LICENSE	That the output gain is zero, or that it is as large as first reported	—
17	VERIFICATION STATE	CONTENT VERIFIED PREPRINT	state: CONTENT_VERIFIED_PRIMARY · qualifiers: PREPRINT · verified_by: UNKNOWN
18	LIMITATIONS	Comment read in full; reply read in abstract only; neither is known to be peer-reviewed or published in the journal	—
19	CONTRADICTORY / SUPPORTING SOURCES	The original estimate: LD09-SL-C05	—
20	GEOGRAPHY / LANGUAGE	Global / English	—
21	DISTRIBUTIONAL LEDGER	Not recorded	—
22	R01 / FIELD-MAP LINKS	LD-09, D3	—
23	WHAT WOULD CHANGE THIS CLAIM?	An independent replication with author-level data, or a published resolution of the exchange	—
24	PUBLICATION STATUS	ELIGIBLE WITH PREPRINT QUALIFIER	state: ELIGIBLE · qualifiers: PREPRINT
25	RECORDED DATE	2026-10-15	—

Field 22 references resolved against Field Map v0.2: LD-09 (LIVING_DEBATE); D3 (DOMAIN)

The sources as recorded, with their record IDs and coded source types:

Pinned Sources (field 6, version-specific)

“Renault, Bergeaud & Bosquet, “Comment on Scientific production in the era of large language models,” arXiv:2605.17979, May 2026” → Renault et al. (2026), “Comment on Scientific production…” (SRC-SL-RENAULT-BERGEAUD-BOSQUET-ARXIV-2605-17979--v1.0) — Renault, Bergeaud & Bosquet, “Comment on Scientific production in the era of large language models,” arXiv:2605.17979, May 2026; class PREPRINT (explicit public provenance pin)
“Kusumegi et al., “A robust association between LLM use and scientific productivity: Assessing stopping-time selection,” arXiv:2607.28968, July 2026” → Kusumegi et al. (2026), “A robust association between LLM…” (SRC-SL-KUSUMEGI-ET-AL-REPLY-ARXIV-2607-28968--v1.0) — Kusumegi et al., “A robust association between LLM use and scientific productivity: Assessing stopping-time selection,” arXiv:2607.28968, July 2026; class PREPRINT (explicit public provenance pin)

Cited by Living Debate versions

Individual gain, collective narrowing? Does AI make science, creative work and shared knowledge more alike? (v0.1) LD-09

Cite this page

SocioLens project. (2026, October 15). A comment on the preprint-productivity study shows that dating adoption to an author’s first flagged abstract can by itself create post-adoption gains: placebo flags gave mean effects of 0.37 and 0.30 against 0.36 in the replicated baseline; the original authors reply that the artefact is “real but bounded” and that the association persists in designs it cannot bias [Claim LD09-SL-C06, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld09-sl-c06/v1.0/

@misc{sociolens_ld09_sl_c06_v1_0,
  author = {{SocioLens project}},
  title = {A comment on the preprint-productivity study shows that dating adoption to an author’s first flagged abstract can by itself create post-adoption gains: placebo flags gave mean effects of 0.37 and 0.30 against 0.36 in the replicated baseline; the original authors reply that the artefact is “real but bounded” and that the association persists in designs it cannot bias.},
  year = {2026},
  date = {2026-10-15},
  howpublished = {\url{https://sociolens-web.pages.dev/claims/ld09-sl-c06/v1.0/}},
  note = {Claim LD09-SL-C06, version v1.0}
}

The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 c2c40091b1b1616c5784a1594d57c9d614c1d861474e563eb0ede14532cfef40.

Repository-authored inputs (not Drive exports)

SocioLens claim — LD09-SL-C06 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-09 debate; a new Claim, first version, written from the project's LD-09 source notes, checked against full texts or official abstracts. Block “ENTRY 06 — LD09-SL-C06” SHA-256 7afa07e3665c573f0b14ef3ecf44683229f6ec209620cf66df255e4fe62f3db8; fixture fixtures/authored/claims/LD09-SL-C06--v1.0.

Builder decisions (not Drive data)

VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD09-SL-C06 v1.0); the first version of a new Claim of the LD-09 debate
CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD09-SL-C06 v1.0" (Project Lead (Claude, AI), 2026-10-15); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-09 debate; a new Claim, first version, written from the project's LD-09 source notes, checked against full texts or official abstracts
FIELD_6_SOURCE_REFERENCE = SRC-SL-RENAULT-BERGEAUD-BOSQUET-ARXIV-2605-17979--v1.0 — basis: field 6 of ENTRY 06 — LD09-SL-C06 cites "Renault, Bergeaud & Bosquet, “Comment on Scientific production in the era of large language models,” arXiv:2605.17979, May 2026"; the first field-6 segment of this ClaimVersion's repository-authored ledger block.
FIELD_6_SOURCE_REFERENCE = SRC-SL-KUSUMEGI-ET-AL-REPLY-ARXIV-2607-28968--v1.0 — basis: field 6 of ENTRY 06 — LD09-SL-C06 cites "Kusumegi et al., “A robust association between LLM use and scientific productivity: Assessing stopping-time selection,” arXiv:2607.28968, July 2026"; the second field-6 segment of this ClaimVersion's repository-authored ledger block.
SOURCE_PROVENANCE_PIN = SRC-SL-RENAULT-BERGEAUD-BOSQUET-ARXIV-2605-17979--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Renault, Bergeaud & Bosquet, “Comment on Scientific production in the era of large language models,” arXiv:2605.17979, May 2026".
SOURCE_PROVENANCE_PIN = SRC-SL-KUSUMEGI-ET-AL-REPLY-ARXIV-2607-28968--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Kusumegi et al., “A robust association between LLM use and scientific productivity: Assessing stopping-time selection,” arXiv:2607.28968, July 2026".