Tabbit
ResourcesBlogModels
Tabbit LogoTabbit

Tabbit — The AI Browser that Works for You

Topics

  • AI Browser Resources
  • Agentic Browser Resources
  • Browser Downloads and Install Guides
  • Browser Comparisons
  • AI Browser Alternatives
  • Browser Productivity Resources

Popular Guides

  • AI Browser
  • Agentic Browser Download
  • Best AI Browser 2026: Top 9 Tested & Ranked
  • AI Browser Download
  • Free AI Browser
  • Best AI Browser 2026
  • AI Browser Comparison 2026
  • AI Browser for Windows
  • AI Browser for Mac
  • Chrome Alternative 2026

Events

  • Tabbit Skill Competition
  • KPOP SBTI Fandom Personality Test
  • Tabbit Campus Creator Program
  • fifi's Picks: AI Skills for Research Papers
  • User Survey

About

  • Tabbit Blog
  • Press & Media
English
简体中文English
Reviews and evidence

Gemini 3.1 Pro · Official source · Personal experience

Google AI Developers Forum: Empirical Instruction-Following Evaluation of Gemini 3.1 Pro Under a Complex 4,000-Word System Prompt

An Antigravity Ultra user reports that Gemini 3.1 Pro High can skip planning, compress output, drift in long sessions, or refactor out of scope under a roughly 4,000-word engineering instruction set.

Unverified: the original source could not be rechecked. Historical figures below are not current verified results.

Official sourcePersonal experienceEdited 2026-09-20

Test conditions

Model/version
Gemini 3.1 Pro; source date 2026-04-07; do not merge snapshots or reasoning tiers.
Platform/harness
Google AI Developers Forum; the source-specific platform and harness remain the unit of observation.
Sample/date boundary
Collected 2026-08-20; Google AI Developers Forum: Empirical Instruction-Following Evaluation of Gemini 3.1 Pro Under a Complex 4,000-Word System Prompt does not establish a universal rate beyond its published sample.

Key data and applicable tasks

One-sentence takeaway

When injected with a "contextual constitution" containing a 4,000-word payload of strict coding guidelines, mandatory planning workflows, and negative constraints, Gemini 3.1 Pro exhibits noticeable degradation in instruction following (pass rate on complex nested constraints drops to ~78%), primarily manifesting as skipping planning steps, prematurely truncating output, forgetting initial rules during long sessions, and unauthorized refactoring of non-target code.

Test environment

  • Runtime environment: Google Antigravity (Ultra Tier subscription).

  • Test models: Gemini 3.1 Pro High vs. Claude Opus 4.6.

  • System prompt configuration: High-density system prompt of ~4,000 words (including strict coding specifications, a mandatory read-before-write planning pipeline, and negative constraints such as prohibitions against refactoring unrelated files).

  • Task format: Daily feature development and multi-step engineering refactoring for a real-world, large-scale web application.

Inputs/configuration

  • Fixed system prompt; alternating between Gemini 3.1 Pro High and Claude Opus 4.6 to perform identical engineering coding tasks.

  • Enabled thinking_level=high deep reasoning on the Gemini side.

Results data

The empirical test identified four typical failure modes of Gemini 3.1 Pro under complex system prompts:

Failure ModeSpecific Manifestation and MechanismBaseline Model (Claude Opus 4.6) Performance
1. Skip Workflow StepsIgnores the mandatory "Research - Architecture Design - Pseudocode" planning phase and directly skips ahead to outputting concrete code implementationsStrictly completes research analysis and multi-stage planning step-by-step, only proceeding to write code after confirmation
2. Write Shorter OutputTends to finish hastily; even when explicitly instructed in the prompt to provide a comprehensive, detailed plan, it produces extremely concise or truncated summariesComplies with thoroughness requirements, outputting structurally complete, large-scale planning documents
3. Context Drift in Long SessionsSuccessfully adheres to rules early in a session, but gradually forgets initial system instructions as conversation turns progress and context lengthensMaintains high long-range adherence to initial system instructions across the entire context window
4. Helpful OverridesViolates explicit negative constraints like "strictly forbid modifying non-target code," unilaterally refactoring other files in context under the assumption of "helpful improvement"Strictly adheres to modification boundaries, focusing exclusively on explicitly authorized lines of code and files
Nested IFEval Pass RateEmpirical pass rate of approximately ~78% (standard standalone IFEval score)Complex nested rule compliance is significantly higher than 90%

Conclusion

While Gemini 3.1 Pro delivers ultra-fast generation speeds and formidable single-point logical reasoning, the model is prone to instruction drift when the system prompt becomes overly massive and incorporates numerous nested rules, negative constraints, and multi-stage execution pipelines. For such engineering scenarios, teams should avoid directly applying lengthy "contextual constitutions"; instead, large tasks must be decomposed into single-step subtasks executed independently in fresh sessions.

Limitations

  • The empirical testing was based on Gemini 3.1 Pro integrated within the Antigravity IDE; the IDE's internal context-slicing mechanisms may exert some influence on system prompt weighting.

  • This report represents real-world observations from a high-intensity frontline software engineer rather than a synthetic academic benchmark, yet it offers qualitative and quantitative evidence with high practical utility.

Reproduction steps

  1. Craft a 3,000–4,000-word system prompt containing 10+ nested rules (including 3+ explicit negative constraints forbidding specific actions).

  2. Inject the system prompt into Antigravity or the Gemini API.

  3. Dispatch a task that requires analyzing 3 files prior to writing any code.

  4. Check whether Gemini outputs the complete research steps, whether it modifies unauthorized code, and whether it retains the initial formatting constraints across multiple conversation turns.

What this supports

  • The report supports separately testing workflow steps, prohibitions, and long-session rule retention under dense nested engineering constraints instead of checking only whether final code runs.

What this does not support

  • This is one developer's Antigravity IDE report. The IDE context slicing, task selection, repeat count, and calculation behind the roughly 78% figure are not fully disclosed, so it is not a general Gemini API compliance rate.

Method, limits, and reproduction

The figures, task set, reasoning tier, and client conditions apply only to the listed source and collection snapshot. Different versions, harnesses, or providers must not be compared directly; undisclosed parameters remain unknown.

For a reproduction, fix the model version, provider or client, reasoning tier, tools, task-set version, sample count, and collection date, and record failures, retries, and human corrections. Full steps are in the source notes below.

Original source

Google AI Developers Forum · MohamedEldegla (power user of Google Antigravity Ultra) · Original publication date 2026-04-07 · Site edit date 2026-09-20

Open original source

Gemini 3.1 Pro

Compare Gemini 3.1 Pro in Tabbit

Download the Tabbit client to check model access

Related reviews

Google Officially Releases Gemini 3.1 Pro: ARC-AGI-2 and Product Positioning BaselineGoogle's 2026-02-19 release uses the Gemini 3.1 Pro preview and a verified ARC-AGI-2 score of 77.1% as a product baseline, without publishing the full ARC harness.LayerLens Stratix's Six-Benchmark Evaluation of Gemini 3.1 Pro PreviewLayerLens Stratix covers 14,549 cases across six benchmarks and shows large task differences for Gemini 3.1 Pro between ARC and BIRD-CRITIC, among others.Artificial Analysis's Comprehensive 182-Model Benchmark and End-to-End Latency Evaluation of Gemini 3.1 Pro PreviewArtificial Analysis compares 182 similarly priced models on first-party APIs and reports Gemini 3.1 Pro Preview at Intelligence Index 48, 121.4 t/s, and 32.45 seconds TTFT, combining high throughput with high startup latency.MindStudio's Full-Task Evaluation of Three Flagships: GPT-5.4, Claude Opus 4.6, and Gemini 3.1 ProMindStudio compares three flagships with HumanEval, SWE-bench, MATH, GPQA, MMLU Pro, and custom long-document tasks; Gemini's context advantage does not generalize to every code repair.Gemini 3.1 Pro: Concise Prompting and Long-Context Question PlacementGoogle's Gemini 3 guide recommends direct, concise prompts and placing the specific question after long context with a short anchoring phrase.Gemini 3.1 Pro Thinking Levels, Structured Outputs, and Tool ConfigurationGoogle's official documentation combines thinking_level, default temperature, tool calls, and JSON schema checks, while separating the customtools endpoint.Spec-Driven Coding Workflow: Claude-Led Planning and Gemini-Isolated ExecutionThe developer-forum case uses Claude for specification and audit, Gemini 3.1 Pro for isolated execution in fresh sessions, and a final audit for changes.Gemini 3.1 Pro: Open-Source Architecture Alignment and Multi-Model Pair Programming WorkflowThis Antigravity community case injects a mature open-source project's architecture into Gemini 3.1 Pro and uses a second model for cross-review and alignment.