What we tested
We built a small React and TypeScript task list with its own Input component and gave Claude Code one feature request: add a due date that users pick from a calendar, that can't be in the past, and that is saved and shown in the list. This is close to the README's own date picker example, where the plain agent installs a library or hand-builds a calendar.
We ran the request once with the plugin loaded from the repository at commit 09c434a (version 5.3.2) and twice with nothing installed, all with the same model and settings. The agents could read and edit files and run the TypeScript checker. The plugin's start-of-session hook fired and loaded the rules at the full level.
What we found
- All three runs chose the simple approach. Each one used the browser's built-in date picker through the project's existing
Inputcomponent, set the earliest date to today in local time, and checked again on submit. None added a library. On this model the README's "library or hand-built calendar" baseline did not happen. - The plugin still wrote less. It added 16 lines and removed 5 in three files. The plain runs added 42 and 39. Most of the difference is a helper that shows the date as "Oct 28, 2026" instead of "2026-10-28", which both plain runs wrote and the plugin skipped. One plain run also put the helpers in a new file.
- It said what it left out. Its reply listed the plain date format, the missing tests and one real catch: the browser's own date limit usually stops the form before the custom error can show. One plain run solved that catch by turning off browser validation; the other did not mention it.
- All three passed the TypeScript check. We did not open them in a browser.
The plugin run took 14 turns, 54 seconds and $0.21 at API prices, as reported by Claude Code. The plain runs took 16 and 15 turns, 45 and 54 seconds, and $0.23 each. This is one small task in one project with one model, so read it as an example, not a benchmark.
Other benchmarks
- Ponytail README (version 5, Claude Code with Opus 5.5, 39 tasks, 5 runs each): 53% less code, 26% lower cost, 41% less time.
- Chase AI, June 2026 (version not stated, Claude Code, about 19 tasks): with Haiku 4.5, 56% less code, about 25% lower cost and about 31% less time; with Opus 4.8, 71% less code, about 53% lower cost and about 71% less time.
- JetBrains, July 2026 (version 4.8.4, Claude Code with Sonnet 5, 80 paired tasks): 15% less code on a typical task, 10.3% lower cost, 11% less time.
- Ordalin, this page (version 5.3.2, Claude Code with Opus 5.5, one task against two plain runs): 16 lines added against 39 and 42, about 8% lower cost, no time saved.
The README says its figure reaches 94% where an agent over-builds and is near zero where the code is already small. JetBrains found the same pattern: its cut reached 31% on large builds and was about zero on small ones. It found no difference in quality, though 80 pairs can only rule out large differences. JetBrains tested by loading the plugin's rule text the way its hook does, not through a normal plugin install.