Reddit: short repository tasks and autonomy boundaries

Historical snapshot notice

The body preserves research collected on September 8, 2026. The editorial summary and conditions above were reviewed on September 20. References to “current” values, rankings, and dynamic metrics in these notes describe the original snapshot, not live results. Reopen the source before making a decision.

One-sentence takeaway

The author used Gemini 3.8 Flash at the high tier in Antigravity for about an hour on deliberately underspecified short tasks in a serious code repository. They found it better than 3.7 Flash at planning and working from real code, and less prone to hallucinating automatically; however, they do not trust published benchmarks, consider it unsuitable for long-running, fully autonomous complex tasks, and still see it lagging behind Sol, Luna, and the GLM 5.3 series at understanding ambiguous intent and respecting boundaries.

Use cases

• Suitable tasks: Short tasks with code-repository context that require quickly locating an issue or completing a clearly bounded task, provided the user can check each step of the coding workflow promptly.

• Unsuitable tasks: Complex Agent tasks that run unattended for a long time and let the model determine the scope itself, especially work requiring continued reasoning and self-correction beyond the “happy path.”

• Applicable model version: The post explicitly discusses Gemini 3.8 Flash; the tier actually used was high. Do not extend the conclusions to other Gemini versions, reasoning tiers, or Gemini 3.8 Flash Cyber.

• Applicable client, Agent, or API: Google Antigravity; the post does not provide an API model ID, specific Agent configuration, or tool harness.

• Recommended reasoning tier and parameters: The original post discloses only high; it does not disclose temperature, context limit, tool permissions, retry policy, or other parameters. The API's best configuration cannot be inferred from this evidence.

Test environment, inputs, and observations

• The author says that over the past hour or so, they used Gemini 3.8 Flash high on a “serious repository,” deliberately using underspecified prompts (without spelling out the task requirements in detail).

• The author compared it with their memory of using Gemini 3.7 Flash: 3.7 Flash often jumped to a conclusion before actually doing anything, while 3.8 Flash improved at planning and at working from real data.

• This was a personal workflow observation. The repository name, commit, number of tasks, complete prompts, tool-call traces, success criteria, tokens, elapsed time, and number of repetitions were not disclosed.

• The author believes 3.8 Flash consumes about as much quota as 3.7 Flash, perhaps slightly more because it is more thorough and grounded. This is the author's summary of usage, not a measurement from billing or logs.

• The author believes 3.8 Flash hallucinates automatically less often than the previous generation, but still does not behave as well or stay as grounded as GLM 5.3 and GLM 5.3 Flash. At the same time, they subjectively felt a clear increase in its “intelligence,” roughly between Sol low and medium. All of these are the author's subjective comparisons and cannot be converted into scores.

Raw data

Conclusions

1. The most useful signal from this experience is not that “3.8 Flash is better across the board,” but a behavioral change on short tasks: the author observed that it was more willing to plan and better able to work around real information in the repository.

2. “Fewer hallucinations” and “more grounded” are subjective observations here, with no accompanying error samples, independent verification, or pass rate. They should be treated as directions worth retesting, not reliability metrics.

3. The author clearly states an autonomy boundary: the longer and more open-ended a task is, and the more it depends on the model deciding what to do next, the higher the risk. Breaking large tasks into short, verifiable tasks is more consistent with this evidence than simply leaving a long-running Agent to operate unchecked.

4. The comparison is affected by the author's usage habits: they mainly use Sol and Luna, and believe that under ambiguous prompts Luna or GLM 5.3 Flash understands intent better. Without a shared prompt, the same repository, and a standardized cost basis, this cannot establish a model ranking.

Scope and limitations

• The original post does not disclose the repository, commit, task list, prompts, tool permissions, context length, sampling parameters, model-service version, call logs, or final diff.

• “About an hour” is an experience duration, not a sample size. The post does not say how many tasks were completed or specify the success criteria for each task.

• “Similar quota use” and “possibly slightly higher” come from the author's observation and cannot replace API token statistics or billing data.

• The comparisons with Sol, Luna, GLM 5.3, and Gemini 3.7 were not A/B tests using the same time, harness, or task set. Do not interpret “between Sol low and medium” as a computable capability score.

• This article does not incorporate Kafka, microservices, frontend 3D, cost, or failure cases from the comments, to avoid presenting other users' individual cases or comment-section consensus as controlled evidence from the author's main post.

• The original post supports “personal subjective experience” and “retest hypotheses,” but not production-grade reliability, general-purpose coding ability, long-horizon Agent success rate, or a cost advantage.

Reproduction notes

1. Fix a real but recoverable code repository, and record the commit, dependencies, file scale, tool permissions, model version, and Antigravity configuration.

2. Design one set of clearly bounded short tasks and another set of deliberately underspecified tasks with explicit acceptance criteria; allow the model to handle only one task at a time.

3. Use Gemini 3.8 Flash high as the primary test, with Gemini 3.7 Flash, Sol, Luna, or GLM 5.3 Flash as controls. Use the same repository state, tool set, and acceptance scripts for every model.

4. Save the complete prompts, plans, tool calls, modification diffs, test output, failure recovery, and human takeover points; do not look only at the model's self-report or “completed” declaration.

5. Report short-task completion rate, unauthorized-change rate, hallucinations/unverified claims, tests passing despite missing functionality, human correction time, tokens, and cost per task separately; then test mid-task drift and recovery cost for long-running autonomous tasks separately.

6. Score “understanding ambiguous intent” and “respecting explicit boundaries” separately: the former should assess requirement clarification and goal hit rate, while the latter should assess whether the model changes only files and functionality within the authorized scope. The two cannot be substituted with one success rate.

Original evidence and data

• The original post title directly limits the discussion to a review of Gemini 3.8 Flash by an author who “doesn't trust this model with commit commands,” with the link https://www.reddit.com/r/google_antigravity/comments/1w5i29e/review_of_gemini_38_flash_from_a_person_who/.

• The author's disclosed environment was Google Antigravity, Gemini 3.8 Flash high, a serious code repository, deliberately ambiguous prompts, and a usage period of about an hour.

• The author's main observations were that, compared with 3.7 Flash, 3.8 Flash had better planning and grounding, fewer automatic hallucinations, and roughly similar quota use that might be slightly higher; the author still does not trust benchmark claims.

• The boundary given by the author was that short tasks showed a clear capability improvement, while long-running fully autonomous complex tasks were not recommended; complex reasoning beyond the happy path remained weaker than in other models they had used.

Source excerpts or observations (for compliant short quotation only)

The author summarized the recommendation as “don't trust this model with very long horizon fully autonomous tasks,” while also pointing out that “Shorter tasks get a really visible capability bump.” This is personal usage advice, not a promise from the model provider or a controlled-experiment finding.