5 AI Models, 1 Project Spec: Who Decomposes Best?

February 16, 2026

Task decomposition is the bottleneck of AI-driven development. Give an agent a vague plan and it writes vague code. Give it a precise, well-scoped subtask and it performs like a senior engineer.

The task: replicate the functionality of an existing HTTPS Security Checker service — take a working product, write a detailed spec describing what it does, and hand that spec to five different AI models to decompose into implementable subtasks.

We scored their decomposition plans across 17 criteria. The results reveal two fundamentally different philosophies for AI-assisted development.

The Experiment

We took an existing HTTPS Security Checker service and reverse-engineered a detailed product spec from it: TLS configuration analysis, certificate health, security headers, HSTS, DNS security, HTTP/3 support, mixed content detection, and HTTPS redirect validation. The spec included 8 check modules, a grading system, export capabilities, and deployment requirements.

Each model produced a full task decomposition plan — a DAG of subtasks with dependencies, file lists, and acceptance criteria.

The Models

ModelAgentPlan SizeSubtask CountTimeCost
GPT-5.3Copilot CLI~44 KB19~6 minPaid
Claude OpusClaude Code~110 KB15~13 minPaid
KimiKilocode~65 KB206 min 12 sec$0.46
GLM-5Kilocode~206 KB1626 min 14 secFree
MiniMax-25Kilocode~15 KB16~3 minFree

Opus clocked in at ~13 minutes but ran a swarm of subagents in parallel. GLM-5 and MiniMax-25 were free-tier models run through Kilocode. Kimi cost just $0.46 for a top-3 result. Codex via Copilot CLI finished in about 6 minutes — comparable to Kimi despite the paid tier.

Scoring Methodology

We evaluated each plan across 17 criteria grouped into 7 weighted categories:

CategoryWeightWhat We Measured
Decomposition quality20%Granularity, DAG correctness, one-concern-per-task adherence
File and criteria explicitness20%File path coverage, acceptance criteria quality
Implementation guidance20%Code examples, test strategy, practical implementability
Spec compliance15%Coverage of all 8 check modules
Security and robustness10%Error handling, SSRF defense, rate limiting
Frontend and export10%UI coverage, PDF/JSON/CSV export detail
DevOps and deployment5%Docker, cleanup cron, production config

Each criterion scored 1-10, then weighted into a final score.

Results

RankModelScorePhilosophy
1Codex / GPT-5.38.77Directive — zero code, maximum structure
2Claude Opus8.45Implementation-heavy — 33 code blocks
3Kimi8.43Balanced — structure meets detail
4GLM-58.30Code-rich — 206 KB of guidance
5MiniMax-255.13Skeletal — insufficient for handoff

Key Findings

Codex / GPT-5.3 (Score: 8.77)

Codex produced the most disciplined plan. Every one of its 19 tasks covers exactly one concern. File paths are fully specified (127+ files), and each task includes 3 runnable verification commands (typecheck, test, grep). The repository abstraction constraint is repeated verbatim in every single task.

The trade-off: zero TypeScript code blocks. The plan is purely directive — it tells the implementing agent what to build, not how. No Docker/deployment task, no CI/CD pipeline.

Claude Opus (Score: 8.45)

Opus took the opposite approach: 33 TypeScript code blocks with near-complete implementations. A developer could start coding immediately. It includes 80+ specific test cases, a comprehensive Docker task, and detailed grade calculator logic.

The trade-off: only 15 tasks. Five check modules are merged into just 2 tasks, violating the one-concern-per-subtask rule. At 7.3 KB per task, some subtasks may exceed optimal context windows for agent prompts.

Kimi (Score: 8.43)

Kimi hit the sweet spot between structure and detail with 20 well-scoped tasks. It follows the one-concern rule faithfully, provides interface signatures, and includes real-world test domains (badssl.com). Slightly less implementation detail than Opus or GLM, but more architecturally rigorous.

GLM-5 (Score: 8.30)

GLM produced the largest output at 206 KB — an engineer could start coding from the TypeBox schemas and patterns alone. But it merges HTTP/3 and Mixed Content into one task, stuffs too much into the API server task (10+ files), and marks PDF export as TODO.

MiniMax-25 (Score: 5.13)

At 0.9 KB per task, MiniMax's plans are skeletons. No code examples, no executable acceptance criteria, incomplete file lists. An implementer would essentially need to re-derive the spec.

Head-to-Head: Codex vs Opus

The top two plans represent fundamentally different design philosophies:

DimensionCodex / GPT-5.3Claude Opus
PhilosophyMaximally directive, zero codeMaximally detailed, near-complete code
Task count19 (one concern each)15 (some multi-concern)
Size44 KB (~2.3 KB/task)110 KB (~7.3 KB/task)
TypeScript code blocks033
Best forAI agents that generate code from specsDevelopers who want to copy-paste and adapt
Verification3 runnable commands per task11 testable criteria per task
One-concern rulePerfect adherence5 modules merged into 2 tasks
Docker/deployWeakComprehensive

What Every Plan Missed

No plan — from any model — covered these:

  • Caching layer (Redis-based result caching by domain)
  • OpenAPI / Swagger documentation
  • CI/CD pipeline as a dedicated task
  • Monitoring and observability (structured logging, metrics, tracing)
  • Database rollback strategy
  • Load testing
  • Certificate revocation (CRL) — only OCSP stapling was covered

Recommendations

For AI-agent-driven workflows (Codex, Claude Code, Cursor): Use Codex-style plans. Strict isolation, verbatim constraints, and verification commands are optimized for autonomous agents that generate their own code.

For human developers: Use Opus-style plans. The 33 code blocks and detailed specifications minimize ambiguity and allow direct implementation.

For a hybrid approach: Take Codex's 19-task DAG as the project structure, inject Opus's code blocks and test cases into each task, add Kimi's real-world test domains for acceptance criteria, and fill the gaps all plans missed (caching, CI/CD, OpenAPI).

The best decomposition depends on who — or what — is implementing it. Structure your plans for your executor.


Building AI-agent workflows? Get notified about VibeCoder Heretic updates.

Related posts