Reading / 2026-05/2026-05-14t190300-opus-47-low-vs-medium-vs-high-vs-xhigh-vs-max-the-reasoning
Opus 4.7 Low vs Medium vs High vs Xhigh vs Max: the Reasoning Curve on 29 Real Tasks
A hands-on benchmark of Claude Opus 4.7 across five reasoning-effort levels on 29 real GraphQL-go-tools tasks finds a non-monotonic curve: medium effort wins on pass rate, equivalence, code-review, and cost-efficiency, while high, xhigh, and max spend more without improving quality.
May 14, 2026 · tech · stet.sh, stet.sh
Topics
- benchmarks
- llm-engineering
- ai-assisted-coding
- llm-inference
- developer-tooling
Cited by
- AI-assisted coding
Using LLMs as coding collaborators spans a spectrum from inline suggestion to fully autonomous multi-agent pipelines, with active debate about reliability, skill atrophy, security exposure, and what human oversight must remain.
- Benchmarks
Benchmarks measure model or system capability, but their results are only as meaningful as their design — a recurring problem across LLM, multi-agent, and vision tasks, where tests built for one context are routinely applied to contexts they cannot capture.
- Developer tooling
Developer tooling spans the full surface area of software construction — version control, testing, shell ergonomics, AI coding assistants, and platform infrastructure — with a consistent theme: reducing friction without sacrificing correctness or security.
- LLM engineering
LLM engineering spans the full stack of building with large language models: training, inference optimization, agent architecture, harness design, and the operational tradeoffs that determine whether model capability translates into reliable software.
- LLM inference
LLM inference covers how language models generate tokens from a prompt — spanning hardware constraints, serving architecture, caching strategies, quantization, routing, and cost — and has become its own engineering discipline as scale and cost pressures intensify.
Related
- Your agent loves MCP as much as you love GUIstopic
- Unslothtopic
- The Orchestrator Isn't Your Moattopic
- databricks-solutions/ai-dev-kittopic
- Agentic Coding is a Traptopic
- Vibe Training: Auto Train a Small Language Model for Your Use Casetopic
- Vision Language Models (Better, Faster, Stronger)topic
- How to Build Scalable Web Apps with OpenAI's Privacy Filtertopic