Gemini 3.5 Flash · Official source · Vendor report
Google's follow-up release uses Gemini 3.5 Flash as the baseline for Gemini 3.6 Flash; differences on DeepSWE, MLE Bench, OSWorld-Verified, and GDPval-AA v2 are official-harness results.
Google's follow-up release uses Gemini 3.5 Flash as the baseline for 3.6 Flash: 3.6 outperforms 3.5 on DeepSWE, MLE Bench, OSWorld-Verified, and GDPval-AA v2, but these are official comparisons and cannot replace independent retesting of 3.5 on its own task set.
Suitable tasks: Understanding 3.5 Flash's baseline position in Google's subsequent versions, especially for version comparisons involving coding, computer use, knowledge work, and Agent cost efficiency.
Unsuitable tasks: Treating the difference between 3.6 and 3.5 as an absolute cross-model ranking, or overlooking thinking levels, tools, and the harness.
Applicable model version: Gemini 3.5 Flash (as the official baseline for 3.6 Flash).
Applicable client, Agent, or API: Google Gemini API and enterprise Agent scenarios; the article says 3.6's computer use can serve as a built-in client tool in the API, while 3.5's specific integration limitations require checking the model page separately.
Recommended reasoning levels and parameters: The original article does not disclose the complete thinking level, sampling parameters, or number of runs for each comparison; parameters that cannot be verified should not be added.
Comparison: Gemini 3.6 Flash vs Gemini 3.5 Flash.
Sources: Google's official release materials, citing the Artificial Analysis Index, Datacurve DeepSWE, MLE Bench, OSWorld-Verified, and GDPval-AA v2.
Environment details: The article does not disclose all test inputs, sample sizes, random seeds, tool harnesses, or confidence intervals.
The article describes 3.6 Flash as an iteration based on feedback from 3.5 Flash, emphasizing fewer output tokens, fewer reasoning steps, and fewer tool calls.
3.6 Flash is listed at $1.50 per million input tokens and $7.50 per million output tokens; these are 3.6 prices and should not be misremembered as 3.5's current prices.
The 3.5 Flash model page separately lists 1,048,576 input tokens, 65,536 output tokens, and support for thinking, function calling, code execution, Search grounding, and preview computer use.
| Metric | Gemini 3.6 Flash | Gemini 3.5 Flash | Article context |
|---|---|---|---|
| DeepSWE | 49% | 37% | 3.6 has higher precision and fewer unnecessary code edits and execution loops |
| MLE Bench | 63.9% | 49.7% | Machine learning research tasks |
| OSWorld-Verified | 83.0% | 78.4% | Computer use; the article describes 3.6 as a built-in client tool in the API |
| GDPval-AA v2 | 1,421 | 1,349 | Professional knowledge work |
| Artificial Analysis output tokens | 17% fewer than 3.5 | Baseline | The index source is the Artificial Analysis Index |
The official comparison supports the upgrade judgment that “3.6 is more efficient and delivers better quality than 3.5,” especially for coding, ML research, computer use, and knowledge work. However, it only tells us 3.5's relative baseline and is insufficient to determine whether 3.5 is suitable for a specific production task.
All figures come from Google's official release; third-party links are cited, but the page does not provide complete original experimental records.
The inputs, tools, reasoning levels, number of runs, and scoring implementations for the different benchmarks are not fully disclosed in the article.
The prices, model IDs, context, and tool availability of 3.5 and 3.6 may change over time or by plan; use the current model page for the target API as the reference.
3.6's advantages cannot be used to infer 3.5's absolute ranking against models from other vendors.
Fix the gemini-3.5-flash model version, thinking level, context, tools, and output limit.
Run DeepSWE, MLE Bench, and OSWorld-like tasks in the same code repository/computer environment, repeating them at least several times and recording success rate, tokens, tool calls, and total time.
Retest with the same harness used for 3.6 to avoid conflating a version upgrade with a test-framework upgrade.
Use the official difference as a reference range, and separately report your own confidence intervals, failure types, and costs.
Google describes 3.5 Flash as the direct feedback baseline for 3.6 Flash and says that 3.6 “takes fewer reasoning steps and tool calls.” This can guide version migration evaluations, but it is not an end-to-end acceptance test of 3.5 on its own.
The figures, task set, reasoning tier, and client conditions apply only to the listed source and collection snapshot. Different versions, harnesses, or providers must not be compared directly; undisclosed parameters remain unknown.
For a reproduction, fix the model version, provider or client, reasoning tier, tools, task-set version, sample count, and collection date, and record failures, retries, and human corrections. Full steps are in the source notes below.
Google Blog · Tulsee Doshi / Google · Original publication date 2026-07-21 · Site edit date 2026-09-20
Open original sourceGemini 3.5 Flash
Download the Tabbit client to check model access