Cline Test: Ox Alpha and Fable Both Fixed a Real Repository Bug, with About 3x Less Output

One-sentence takeaway

Cline says Ox Alpha and Fable both correctly fixed one real bug in its repository; Ox Alpha used about three times fewer output tokens and repeated less reasoning. This is an efficiency signal worth retesting, not a general capability ranking.

Test environment

• Task: One real bug in the Cline repository.

• Comparison models: Ox Alpha and Fable (the post does not provide versions, prices, or complete model IDs).

• Outcome: The post says both models fixed the bug correctly.

• Observation: Fable repeated “I found the root cause” seven times before editing; Ox Alpha stated it once and then wrote the fix.

Inputs/configuration

The post does not disclose the bug number, repository commit, prompt, context, tool permissions, temperature, effort, timeout, repetition count, or evaluation script. It refers to thinking tokens and total output tokens but provides no raw count table, so “about three times less” must be recorded as Cline’s self-reported figure.

Results data

Conclusion

If the question is how much output an agent needs to complete the same coding fix, this post is a useful starting point for a reproducible test: use the same repository and bug, and record tool calls, thinking/output tokens, post-fix tests, and reviewer rework. The current evidence supports only “Cline reported one correct comparison with less repeated output,” not that Ox Alpha generally beats Fable or GPT.

For Tabbit users, Ox Alpha is a fit for a controlled, low-cost trial: start with a redacted repository, fixed tasks, and a reversible branch before widening the task set.

Limitations

• One real bug is too small a sample and has no independent verification.

• Versions, context, effort, tool harness, and temperature for both models are undisclosed.

• The “about 3x” figure has no raw token accounting and excludes latency, retries, and human review from total cost.

• The “slightly ahead in early benchmarks” statement has no public scores or methodology and cannot be presented as leaderboard fact.

• Ox Alpha’s anonymous provider, temporary free status, and data terms require separate verification.

Reproduction steps

1. Fix the Cline repository commit, the same bug, model versions, and permissions; clear prior sessions.

2. Run Ox Alpha and Fable separately, saving prompts, tool calls, thinking/output tokens, elapsed time, and the complete diff.

3. Let the test suite confirm the fix, then have an independent reviewer assess side effects and rework.

4. Expand to at least 20 varied real tasks and report means, medians, failure types, and confidence intervals; do not extrapolate the single-bug “about 3x” figure.