https://jonnie.github.io/blog/Recent content in Blog on Jonathan FranklinHugoenMon, 05 Oct 2026 00:00:00 +0000https://jonnie.github.io/blog/agent-bench-qwen3-8-27b/Mon, 05 Oct 2026 00:00:00 +0000https://jonnie.github.io/blog/agent-bench-qwen3-8-27b/<p>Changing a coding agent does not necessarily mean changing its model. The same LLM can be wrapped in different system prompts, editing tools, context-management strategies and execution loops. Those choices matter: the useful output is not a confident explanation, but a patch that satisfies the task.</p> <p>I built <a href="https://github.com/jonnie/agent-bench">Agent Bench</a> to make that comparison easier. It runs the same coding tasks through different agent harnesses against <strong>one shared model endpoint</strong>, then grades the resulting code independently.</p>