On the author's 6,000-word novel with 90 seeded errors, Hydrogen caught 84 (93%) when the four categories were checked separately, and 68 (76%) when one prompt asked it to check all four at once. These results support the view that separate checks outperform a single all-in-one pass; they do not represent general copyediting accuracy.
Tasks this can inform: Checking grammar and spelling, repetition, redundancy, and consistency in a single English-language novel.
Tasks this should not be generalized to: Chinese editing, natural writing quality, open-ended polishing, or other genres and model-call environments.
Model version covered: Hydrogen; the specific model ID and revision were not provided.
Test environment or client: The results page says all models were tested through APIs; Hydrogen's specific provider routing, client, and call method were not provided.
Reasoning tier and parameters: Not provided. The test page only says that each model was given enough thinking time to review a full chapter in a few minutes; most used default or medium/high settings. Hydrogen's actual settings were not specified.
The author seeded 90 issues in an original short story of about 6,000 words: 45 grammar or spelling issues, 15 repetitions, 15 redundancies, and 15 continuity errors. Each category was checked separately with its own prompt, followed by one combined prompt asking for all four categories at once. The prompts were reportedly adapted from the icanwrite editor's checking prompts and then frozen; all models received the same instructions.
A model comment counted as a catch if it matched a seeded issue; scoring used text matching, with no other model acting as a judge. Comments quoting more than 300 characters did not count as catches. The test page does not say whether Hydrogen was run more than once, so the range of run-to-run variation cannot be assessed.
Separate checks caught 84/90 (93%): 41/45 grammar and spelling issues, 14/15 repetitions, 15/15 redundancies, and 14/15 consistency issues. The page lists 89 comments and 1 extra flag.
The combined prompt caught 68/90 (76%): 41/45 grammar and spelling issues, 8/15 repetitions, 9/15 redundancies, and 10/15 consistency issues—16 fewer catches than checking the four categories separately. The page lists 71 comments and 3 extra flags.
The six misses in the separate checks included four grammar issues, one cross-chapter repetition (“gleaming”), and one contradiction in a character's age. The combined prompt missed 22 issues, including repetition, redundancy, and consistency issues.
The results page reports 42 seconds and $0.26 for the separate checks, and 40 seconds and $0.11 for the combined prompt. On the same page, Argon's separate checks scored 84/90 in 26 seconds for $0.12; its combined prompt scored 80/90 in 48 seconds for $0.05. These are single-run results reported on that page and do not establish stable differences.
| Hydrogen review method | Grammar/spelling | Repetition | Redundancy | Consistency | Total | Extra flags | Time | Cost |
|---|---|---|---|---|---|---|---|---|
| Four separate checks | 41/45 | 14/15 | 15/15 | 14/15 | 84/90 | 1 | 42 seconds | $0.26 |
| One combined check across all four categories | 41/45 | 8/15 | 9/15 | 10/15 | 68/90 | 3 | 40 seconds | $0.11 |
Extra flags count comments that did not match a seeded issue; the page does not explain how each Hydrogen extra flag was judged. The test used one article, with fixed error categories and counts.
In this test, Hydrogen had a high catch rate on proofreading tasks with clearly separated categories, including all 15 redundancies. When asked to cover every category at once, misses increased mainly in repetition, redundancy, and consistency. In practice, the results suggest splitting checks into several focused steps, but the test did not compare post-edit readability, unwanted-change rates, or human editing preferences.
The sample was a single novel with seeded errors, and the full prompts, Hydrogen's specific model ID, reasoning parameters, and repeated-run data were not disclosed. The 93% figure is the hit rate on this sample, not overall accuracy on a large corpus; the results also do not establish the model's recall or precision on natural text. Extra flags may indicate possible false positives, but the page does not disclose their contents or human judgments.
The results page publishes the issue categories and counts, matching rules, Hydrogen's missed items, per-category scores, time, and cost; each model entry can be opened to view its comments. The page does not publish the full story, the complete prompts for the four categories, API request parameters, or call logs, so an independent item-by-item rerun and score verification are not possible. Comparisons with other models should be limited to that test page, the same novel, and its frozen prompts; the results should not be generalized into rankings across tasks.
Gemini 4 Hydrogen