I Gave an AI a Civilization to Run. It Built a Nuke.
An account of building a Civilization VI evaluation harness, with reported pilot results about agents’ observations, plans and actions.
EssaySources & confidence: Limited evidence
Checked 2 October 2026 · AI-assisted review
Checked local essay metadata, compared all seven reported values with their records, and cross-checked the Portugal narrative against available local development files.
- Local essay: i-gave-an-ai-a-civilization
Reported pilot figures and the author’s interpretations. Checked the repository MDX source, not the live page.
- civ6-mcp: Portugal game development log
Local file checked at this commit: France wins at turn 318; Portugal has 18 points; diplomatic scores are recorded at turns 280 and 310; nuclear strikes at turns 304–305 and 311.
- civ6-mcp: cross-game analysis
Local file checked: qualitative analysis of early games; does not reproduce the seven published aggregate measurements.
What this check doesn’t establish
- The seven aggregate results were not reproduced and their full metric-specific samples were not recovered.
- The Portugal development diary conflicts with the strongest no-monitoring interpretation in the essay.
- The review does not independently verify all run outcomes, model identities or comparisons.
Confidence applies to the scope above, not every claim made by the underlying source. How confidence works
This is a catalogue record describing a published essay, listing what the essay draws on and what has been checked. It is not the essay.
Read the essay →published 2026-06-22
The essay reports a 23-game pilot, three plan-follow-through percentages, an unchecked-loss count, two monitoring measures and a no-diary completion percentage. Those seven figures have separate Finding records; the overall pilot size is not necessarily each measurement’s denominator.
The local Portugal development diary supports a turn-318 diplomatic loss and two nuclear strikes, but also records France’s diplomatic score at turns 280 and 310. The essay’s claim that the diplomatic threat went unwatched is therefore too strong for the available account.
This review checks the catalogue’s relationship to the source and identifies a substantive conflict. It does not independently validate the experiments or convert the essay’s interpretations into established causal findings.
Sources
People
Projects
- civ6-mcp
Uses · Source
- CivBench
Uses · Source
- GovBench
Uses · Source
- Sid Meier's Civilization VI
Uses · Source
Ideas
- Stochastic parrots
Discusses
- The knowing-doing gap
Discusses
- The sensorium effect
Discusses
Findings
- Games reaching an ending without the external diary
Reports
- Losses where an imminent rival victory was never checked
Reports
- Plan follow-through, Claude Opus 4.6
Reports
- Plan follow-through, Gemini 3.1 Pro
Reports
- Plan follow-through, GPT-5.4
Reports
- Share of agent actions spent checking the whole board
Reports
- Victory-condition checks performed against the sixteen instructed
Reports
Cases
- The Portugal game
Examines
Images
- Gromit laying track ahead of the train
Illustrations · Uses
- Liftoff, A Grand Day Out
Illustrations · Uses
- Machiavelli, reputation versus reality
Illustrations · Uses
- Major Kong rides the bomb, Dr. Strangelove
Illustrations · Uses
- Not an exercise, Dr. Strangelove
Illustrations · Uses
- The nuking of Toulouse
Illustrations · Uses
- The Quarter Quell arena
Illustrations · Uses
- This Is Fine
Illustrations · Uses
- Wallace in the wrong trousers, landing on the train
Illustrations · Uses
- Where the agent spent its attention, Korea on Snowflake
Illustrations · Uses
Record history
Catalogue source: knowledge/essays/i-gave-an-ai-a-civilization.md
Generated by claude-code/claude-opus-5 on 2026-07-25