The author says that during a large refactor, LongCat 2.5 Preview repeatedly failed to use tools, asked the same questions again, and changed unrelated code, leaving a result that would not compile. This is a personal report without code or execution logs.
Tasks this may inform: Consider potential tool-use, scope-of-change, and compilation issues during a large project refactor.
Tasks this should not be generalized to: Other tasks, other environments, or the overall performance of the official LongCat 2.5 release.
Model version covered: LongCat 2.5 Preview.
Test environment or client: The post appeared in r/opencodeCLI; the body does not specify the client, provider, or project language.
Reasoning level and parameters: Not specified.
The author had planned to complete a large refactor manually, but instead tried using the free LongCat 2.5 Preview to do it. The original post does not provide the refactoring requirements, project code, number of test runs, or a complete activity log.
The author reports that the task took a long time and tool use kept failing. The model asked a question that had already been answered five times in a row. The final output would not compile and also changed code unrelated to the task, affecting nearly every function in the project.
| Item | Report in the original post |
|---|---|
| Task | Large refactor |
| Repeated questions | Asked the same question five times in a row |
| Result | Would not compile; unrelated code was changed |
| Exact time taken, project size, and number of test runs | Not specified |
This account describes specific failure modes, but provides no prompt, code diff, logs, or configuration, so it cannot be independently verified. The effects of the model, client, or service on the result also cannot be determined. The author's 0/10 is a subjective rating and should not be treated as a comparable benchmark score.
In an isolated project copy, specify the refactoring scope and record the model identifier, client, tool calls, code diffs, and compilation results. The original post does not disclose the complete input or environment, so a strict reproduction is not possible.
LongCat 2.5
