Reading / 2026-06/2026-06-23t212958-how-ai-code-review-can-make-correct-code-worse
How AI Code Review Can Make Correct Code Worse
An experiment running an AI implementer→reviewer→fixer pipeline on SWE-bench Pro finds that weaker fixer agents "overreach" beyond review scope, breaking correct code — and that softer fixer instructions eliminate catastrophic regressions.
Jun 23, 2026 · tech · Weishi Zeng, Mark Ally, Imbue
Topics
- ai-assisted-coding
- agentic-workflows
- software-engineering
- benchmarks
- llm-engineering
Cited by
- Agentic workflows
Systems where AI agents execute multi-step tasks autonomously, raising interconnected questions about harness architecture, state management, reliability engineering, human oversight, and the organizational context those agents operate within.
- AI-assisted coding
Using LLMs as coding collaborators spans a spectrum from inline suggestion to fully autonomous multi-agent pipelines, with active debate about reliability, skill atrophy, security exposure, and what human oversight must remain.
- Benchmarks
Benchmarks measure model or system capability, but their results are only as meaningful as their design — a recurring problem across LLM, multi-agent, and vision tasks, where tests built for one context are routinely applied to contexts they cannot capture.
- LLM engineering
LLM engineering spans the full stack of building with large language models: training, inference optimization, agent architecture, harness design, and the operational tradeoffs that determine whether model capability translates into reliable software.
- Software engineering
Software engineering spans craft, process, and judgment — how code is structured, tested, reviewed, deployed, and maintained — and the sources collected here collectively interrogate each layer as AI tooling reshapes who does what and why.
Related
- Your agent loves MCP as much as you love GUIstopic
- Unslothtopic
- The Orchestrator Isn't Your Moattopic
- databricks-solutions/ai-dev-kittopic
- Scaling Managed Agents: Decoupling the Brain from the Handstopic
- Don't Prompt Your Agent for Reliability — Engineer Ittopic
- Agentic Coding is a Traptopic
- Vibe Training: Auto Train a Small Language Model for Your Use Casetopic