Plan follow-through, Gemini 3.1 Pro
The essay reports: the proportion of concrete next-moves Gemini 3.1 Pro wrote down for itself that it actually carried out within ten turns.
FindingSources & confidence: Limited evidence
Checked 2 October 2026 · AI-assisted review
Compared the reported Gemini 3.1 Pro plan follow-through of 65.8% within ten turns with the local essay and available analysis/code; no reproduction.
- Local essay: i-gave-an-ai-a-civilization
Local content/posts/i-gave-an-ai-a-civilization.mdx around line 241: Gemini 3.1 Pro plan follow-through of 65.8% within ten turns. The canonical URL identifies the essay; the checked artifact was the local file.
- civ6-mcp: cross-game analysis
Local file checked: qualitative analysis of early games; does not reproduce the seven published aggregate measurements.
What this check doesn’t establish
- The numeric result is a transcription of the author’s report, not independently verified experimental evidence.
- The number of eligible Gemini next-moves, game allocation, exclusions and scored matches are missing.
- No games or aggregate analysis were rerun.
Confidence applies to the scope above, not every claim made by the underlying source. How confidence works
65.8%
- Measured
- plan follow through
- Of
- Gemini 3.1 Pro
- Sample
- not recorded
- Observed
- 2026-06-22
The essay reports 65.8% for Gemini 3.1 Pro. The overall pilot’s 23 games are not the denominator of eligible planned moves. Without the scored actions, exclusions and per-model allocation, the figure cannot be reproduced or treated as a controlled model ranking.
The publication date is retained in observed because no experiment date is documented here. Confidence concerns this reported result; the underlying experiment has not been independently verified.
In the essays
- I Gave an AI a Civilization to Run. It Built a Nuke.
Read the essay
Projects
- CivBench
Produced by
Ideas
- The knowing-doing gap
Subject
Record history
Catalogue source: knowledge/findings/plan-follow-through-gemini-3-1-pro.md
Generated by claude-code/claude-opus-5 on 2026-07-25