Plan follow-through, GPT-5.4
The essay reports: the proportion of concrete next-moves GPT-5.4 wrote down for itself that it actually carried out within ten turns.
FindingSources & confidence: Limited evidence
Checked 2 October 2026 · AI-assisted review
Compared the reported GPT-5.4 plan follow-through of 63.2% within ten turns with the local essay and available analysis/code; no reproduction.
- Local essay: i-gave-an-ai-a-civilization
Local content/posts/i-gave-an-ai-a-civilization.mdx around line 240: GPT-5.4 plan follow-through of 63.2% within ten turns. The canonical URL identifies the essay; the checked artifact was the local file.
- civ6-mcp: cross-game analysis
Local file checked: qualitative analysis of early games; does not reproduce the seven published aggregate measurements.
What this check doesn’t establish
- The numeric result is a transcription of the author’s report, not independently verified experimental evidence.
- The number of eligible GPT-5.4 next-moves, game allocation, exclusions and scored matches are missing.
- No games or aggregate analysis were rerun.
Confidence applies to the scope above, not every claim made by the underlying source. How confidence works
63.2%
- Measured
- plan follow through
- Of
- GPT-5.4
- Sample
- not recorded
- Observed
- 2026-06-22
The essay reports 63.2% for GPT-5.4. The eligible unit is a recorded next-move, not a whole game. Neither the number of GPT games nor the action-level denominator was recovered. This is a reported descriptive figure, not evidence that GPT-5.4 outperforms another model under comparable conditions.
The publication date is retained in observed because no experiment date is documented here. Confidence concerns this reported result; the underlying experiment has not been independently verified.
In the essays
- I Gave an AI a Civilization to Run. It Built a Nuke.
Read the essay
Projects
- CivBench
Produced by
Ideas
- The knowing-doing gap
Subject
Record history
Catalogue source: knowledge/findings/plan-follow-through-gpt-5-4.md
Generated by claude-code/claude-opus-5 on 2026-07-25