Allegheny supervisors screened out 21.0% of children marked as mandatory screen-ins; corrected analysis supports the conclusion that worker judgement reduced racial disparity relative to an AFST-only counterfactual.

SocioLens project,

Claim LD05-HQ-C04 (v1.0)

This is an older version. Read the current version, v1.1, or what changed in it.

Allegheny supervisors screened out 21.0% of children marked as mandatory screen-ins; corrected analysis supports the conclusion that worker judgement reduced racial disparity relative to an AFST-only counterfactual.

Provenance and status

Claim type: Fact
Publication status: Eligible for publication, with a qualifier
Verification state: Checked against the primary source. Who checked this claim is not recorded for it; claim checks so far were AI-led, and no person has checked claims against their sources.
Does not license: Overall human accuracy superiority; generalisation to child welfare elsewhere
Limitations: One county; exact 17.9→7.1 figure remains HOLD
What this line marks HOLD was revisited in a newer version of this claim, which gives the figure and says what it was checked against: version v1.1.
Source (as cited): Cheng et al., CHI 2022; Stapleton et al., corrected analysis arXiv:2204.13872
Source type: Peer-reviewed conference paper, Preprint (recorded as “Peer-reviewed conference paper + correction preprint”)
Institutional position: Independent academic
Maturity of the evidence: Rapidly maturing evidence
Recorded date: 25 September 2026
Currentness / correction: This is not the current version. Correction or concern on its sources: Cheng et al., “How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions,” CHI 2022: corrected by Stapleton et al., “Extended Analysis of ‘How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions’,” arXiv:2204.13872.

Sources this version cites

Cheng et al., “How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions,” CHI 2022 (Peer-reviewed conference paper)
Read the original Correction or concern: Cheng et al., “How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions,” CHI 2022: corrected by Stapleton et al., “Extended Analysis of ‘How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions’,” arXiv:2204.13872.
Stapleton et al., “Extended Analysis of ‘How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions’,” arXiv:2204.13872 (Preprint)
Read the original Correction or concern: Stapleton et al., “Extended Analysis of ‘How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions’,” arXiv:2204.13872: corrects Cheng et al., “How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions,” CHI 2022.

Version

This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.

NEWER VERSION EXISTS: read the current version, v1.1 (LD05-HQ-C04--v1.1). This version is explicitly superseded by LD05-HQ-C04--v1.1.

Versions: v1.0, v1.1 · current

Raw record: every recorded field, with its coded values

All 25 canonical Claim fields, verbatim, with the coded values derived from them. The plain-language labels above are read from these.

Claim type (coded): FACT (as printed: “FACT”)
Publication status (coded): ELIGIBLE (QUALIFIED) (as printed: “ELIGIBLE WITH QUALIFIER”)
Verification state (coded): CONTENT_VERIFIED_PRIMARY
Source type (coded): PEER_REVIEWED_CONFERENCE_PAPER, PREPRINT
Maturity (coded): RAPIDLY_MATURING
Source correction / concern relations (coded): SRC-LD05-CHENG-ET-AL-CHI-2022 CORRECTED_BY SRC-LD05-STAPLETON-ET-AL-2022

#	Canonical field	Canonical value (verbatim)	Normalized (Claim Value Vocabulary v1.0.2)
1	CLAIM ID	LD05-HQ-C04	—
2	PUBLIC-FACING CLAIM	Allegheny supervisors screened out 21.0% of children marked as mandatory screen-ins; corrected analysis supports the conclusion that worker judgement reduced racial disparity relative to an AFST-only counterfactual.	—
3	CLAIM TYPE	FACT	base_types: FACT
4	RESEARCH STRAND	B — Decision support vs automation	—
5	MATURITY	RAPIDLY MATURING	states: RAPIDLY_MATURING
6	SOURCE	Cheng et al., CHI 2022; Stapleton et al., corrected analysis arXiv:2204.13872	source_ids: SRC-LD05-CHENG-ET-AL-CHI-2022, SRC-LD05-STAPLETON-ET-AL-2022
7	SOURCE TYPE	Peer-reviewed conference paper + correction preprint	classes: PEER_REVIEWED_CONFERENCE_PAPER, PREPRINT
8	INSTITUTIONAL POSITION	Independent academic	—
9	SCOPE	Allegheny County child-welfare screening	—
10	DESIGN	Observational counterfactual analysis	—
11	SAMPLE / DATASET	County referral/screening data	—
12	MODEL / TOOL / VERSION	Allegheny Family Screening Tool	—
13	COMPARATOR	Worker+AFST vs AFST-only counterfactual	—
14	MAIN RESULT	21.0% mandatory-screen-in override; racial disparity lower under worker+AFST than AFST-only	—
15	INFERENTIAL TARGET	Meaningful override and disparity effect	—
16	DOES NOT LICENSE	Overall human accuracy superiority; generalisation to child welfare elsewhere	—
17	VERIFICATION STATE	CONTENT VERIFIED	state: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN
18	LIMITATIONS	One county; exact 17.9→7.1 figure remains HOLD	—
19	CONTRADICTORY / SUPPORTING SOURCES	Corrected analysis supersedes original accuracy comparison	—
20	GEOGRAPHY / LANGUAGE	US/English	—
21	DISTRIBUTIONAL LEDGER	Black/white screening disparity	—
22	R01 / FIELD-MAP LINKS	D5, D4a, L-A	—
23	WHAT WOULD CHANGE THIS CLAIM?	Reanalysis reversing corrected disparity result	—
24	PUBLICATION STATUS	ELIGIBLE WITH QUALIFIER	state: ELIGIBLE · qualifiers: QUALIFIED
25	RECORDED DATE	2026-09-25	—

Field 22 references resolved against Field Map v0.2: D5 (DOMAIN); D4a (SUB_AREA); L-A (LENS)

The sources as recorded, with their record IDs and coded source types:

Pinned Sources (field 6, version-specific)

“Cheng et al., CHI 2022” → Cheng et al. (2022), “How Child Welfare Workers Reduce…” (SRC-LD05-CHENG-ET-AL-CHI-2022--v1.0) — Cheng et al., “How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions,” CHI 2022; class PEER_REVIEWED_CONFERENCE_PAPER — status: CORRECTED_BY SRC-LD05-STAPLETON-ET-AL-2022 (explicit public provenance pin)
“Stapleton et al., corrected analysis arXiv:2204.13872” → Stapleton et al., “Extended Analysis of ‘How Child…” (SRC-LD05-STAPLETON-ET-AL-2022--v1.0) — Stapleton et al., “Extended Analysis of ‘How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions’,” arXiv:2204.13872; class PREPRINT — status: CORRECTS SRC-LD05-CHENG-ET-AL-CHI-2022 (explicit public provenance pin)

Cited by Living Debate versions

Discretion curtailed, relocated or encoded? (v0.1) LD-05

Cite this page

SocioLens project. (2026, September 25). Allegheny supervisors screened out 21.0% of children marked as mandatory screen-ins; corrected analysis supports the conclusion that worker judgement reduced racial disparity relative to an AFST-only counterfactual [Claim LD05-HQ-C04, version v1.0]. SocioLens. https://sociolens-web.pages.dev/claims/ld05-hq-c04/v1.0/

@misc{sociolens_ld05_hq_c04_v1_0,
  author = {{SocioLens project}},
  title = {Allegheny supervisors screened out 21.0\% of children marked as mandatory screen-ins; corrected analysis supports the conclusion that worker judgement reduced racial disparity relative to an AFST-only counterfactual.},
  year = {2026},
  date = {2026-09-25},
  howpublished = {\url{https://sociolens-web.pages.dev/claims/ld05-hq-c04/v1.0/}},
  note = {Claim LD05-HQ-C04, version v1.0}
}

The link points to this version, whose record never changes. For a finding, cite the original study as well: SocioLens summarizes research and does not replace it.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 29b7221f397b297c6d3882ffe2f7c03a7ff49bb5dbd9f1fc35b4840288915564.

Frozen Drive-derived inputs

R04 — LD-05 Canonical Claim Ledger v1.0 — LOCKED (v1.0) — Drive ID 1WkAv7jmWIrr1GBmYSv66jDc8m222Yd9z; revision: NOT_EXPOSED_BY_DRIVE_TEXT_EXPORT; Drive modified ; block “ENTRY 04 — LD05-HQ-C04” SHA-256 ecbbd8dc9eb9a4d558e3328baf563513d6625467254f91c72c02e69a47633edc; SocioLens — Programme Status & Authority Register v0.6 status “CURRENT.”; frozen fixture fixtures/frozen/r04-ld05-claim-ledger-v1.0.

Builder decisions (not Drive data)

VERSION = v1.0 — basis: Claim version taken from the canonical ledger artifact version (R04 — LD-05 Canonical Claim Ledger v1.0); Implementation Architecture Selection §5
CURRENT_POINTER = false — basis: not current: superseded by LD05-HQ-C04--v1.1 (manifest supersedes relation)
FIELD_6_SOURCE_REFERENCE = SRC-LD05-CHENG-ET-AL-CHI-2022--v1.0 — basis: field 6 of ENTRY 04 — LD05-HQ-C04 cites "Cheng et al., CHI 2022"; the frozen field-6 segment of this ClaimVersion's ledger block; Drive-derived identity authority (Issue #37 Source inventory): ledger C02/C04 fields 6–8; Batch 01 §3 "Primary source:" (DOI 10.1145/3491102.3501831); KEY EVIDENCE ("Peer-reviewed conference paper").
FIELD_6_SOURCE_REFERENCE = SRC-LD05-STAPLETON-ET-AL-2022--v1.0 — basis: field 6 of ENTRY 04 — LD05-HQ-C04 cites "Stapleton et al., corrected analysis arXiv:2204.13872"; the frozen field-6 segment of this ClaimVersion's ledger block; Drive-derived identity authority (Issue #37 Source inventory): ledger C02 "corrected analysis"/C04 fields 6–8; Batch 01 "Related extended correction"; KEY EVIDENCE ("Correction/preprint").
SOURCE_PROVENANCE_PIN = SRC-LD05-CHENG-ET-AL-CHI-2022--v1.0 — basis: Issue #5 proof rendering (Architecture Proof Protocol v0.1 AP-08 / Amendment v1.2 §6): explicit version-pinned public provenance of this ClaimVersion — the pinned field-6 Source record.
SOURCE_PROVENANCE_PIN = SRC-LD05-STAPLETON-ET-AL-2022--v1.0 — basis: Issue #5 proof rendering (Architecture Proof Protocol v0.1 AP-08 / Amendment v1.2 §6): explicit version-pinned public provenance of this ClaimVersion — the pinned field-6 Source record.