Dziri et al., “Faith and Fate: Limits of Transformers on Compositionality,” NeurIPS 2023

Source SRC-SL-DZIRI-ET-AL-FAITH-FATE-ARXIV-2305-18654

Open the original (arXiv; link checked 2026-10-19)

Type of source: Peer-reviewed conference paper
Institutional position: Independent academic and nonprofit research (Allen Institute for AI, University of Washington, University of Southern California, University of Chicago)

Version

This page shows version v1.0. Its record never changes, even when newer evidence arrives; the site may add a note to the page or withhold a figure not cleared for public use.

This pinned version is also the current version.

Versions: v1.0 · current

Claims that cite this source

Off-the-shelf ChatGPT and GPT-4 reached only 55% and 59% accuracy on 3-digit… Claim LD01-SL-C21 (v1.0)

Raw record: coded values of this source record

Source class (bibliographic): PEER_REVIEWED_CONFERENCE_PAPER
Source-level roles: none
Visibility: PUBLIC_REFERENCE
Registry section: none
Registry “Linked claim” (logical Claim identity; never a pinned version): LD01-SL-C21
Cited in field 6 of: LD01-SL-C21--v1.0

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 05ae542dc049d8cadec00b949c3b53566ee62f42e40684ab9cdb68983e95752a.

Repository-authored inputs (not Drive exports)

SocioLens claim — LD01-SL-C21 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-16; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-01 debate; a new Claim, first version, written from the project's LD-01 source notes, checked against full texts, official web pages or official abstracts. Block “ENTRY 21 — LD01-SL-C21” SHA-256 93d619f6555d8e3ff954f31982f70cb9e9d8bc090ba7c595ab2915083295234f; fixture fixtures/authored/claims/LD01-SL-C21--v1.0.

Builder decisions (not Drive data)

VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4). SocioLens Source-record version, not the external source's edition, revision or version of record.
CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-SL-DZIRI-ET-AL-FAITH-FATE-ARXIV-2305-18654--v1.0 current.
VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD01-SL-C21--v1.0 (explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Dziri et al., “Faith and Fate: Limits of Transformers on Compositionality,” NeurIPS 2023".) (Amendment v1.2 §4, §6).