Tabbit
ResourcesBlogModels
Tabbit LogoTabbit

Tabbit — The AI Browser that Works for You

Topics

  • AI Browser Resources
  • Agentic Browser Resources
  • Browser Downloads and Install Guides
  • Browser Comparisons
  • AI Browser Alternatives
  • Browser Productivity Resources

Popular Guides

  • AI Browser
  • Agentic Browser Download
  • Best AI Browser 2026: Top 9 Tested & Ranked
  • AI Browser Download
  • Free AI Browser
  • Best AI Browser 2026
  • AI Browser Comparison 2026
  • AI Browser for Windows
  • AI Browser for Mac
  • Chrome Alternative 2026

Events

  • Tabbit Skill Competition
  • KPOP SBTI Fandom Personality Test
  • Tabbit Campus Creator Program
  • fifi's Picks: AI Skills for Research Papers
  • User Survey

About

  • Tabbit Blog
  • Press & Media
Review
CommunityQwen3.7 Max

Qwen3.7-Max in Real-World Coding Tasks: Negative Instruction Confusion and Token Burn Benchmark

Original source

Reddit (r/opencode, r/QwenAI, r/LocalLLaMA)

AuthoriSerter, Peleias, BoringAioli7916, crmexpert, flysnowbigbig

Source date2026-05-28

Tabbit curation2026-08-20

Read original

One-sentence takeaway

In real-world software engineering deployments, Qwen3.7-Max performs exceptionally well in mathematical computations and financial code refactoring; however, in autonomous CLI Agents, it easily confuses semantic constraints such as "disable" versus "delete", and incurs 3x to 5x higher thinking token consumption and retry costs in multi-turn tool-calling workflows without prompt caching.

Test environment

  • Integrated tools and environments: OpenCode CLI, Claude Code compatibility layer, native DashScope API, OpenRouter.

  • Codebase types:

    • Task A: Python/Rust projects featuring complex financial algorithms and high-dimensional mathematical derivations.

    • Task B: Web plugin projects with CI/CD automation pipelines (GitHub Actions) .

    • Task C: Multi-file full-stack projects containing user registration modules and unit tests.

  • Tester background: Enterprise backend developers, quantitative finance engineers, and heavy users of open-source CLI tools.

Inputs/configuration

  • Prompt style: Natural language engineering task instructions, multi-stage Red-teaming prompts, CI troubleshooting requests.

  • Baseline models: Claude Opus 4.6 / 4.7, GLM-5.2, Kimi K2.6 / K3, DeepSeek V4 Flash / Pro.

  • Parameters: Default thinking mode (Thinking Mode enabled) , temperature 0.2~0.7.

Results data

1. Real-world task performance comparison

Task ScenarioQwen3.7-Max PerformanceBaseline Model Performance (Opus / GLM / Kimi)
Complex financial/quant mathematical code derivationExtremely Strong: Accurately identified edge-case mathematical logic errors left by Opus 4.6 in legacy code, with rigorous derivationsKimi 2.6 review was relatively superficial; Opus 4.6 showed subtle precision rounding issues
CI pipeline modification (GITHUB_TOKEN)Failure: Accidental deletion of unrelated release-please config file when requested to replace credentialsOpus 4.6/4.7 performed local configuration replacements only
Semantic understanding of feature disabling ("Disable vs Delete")Severe Failure: When asked to "disable registration page", the model did not modify routes/flags, but directly and physically deleted the registration page source codeGPT-5.5 / GLM-5.2 correctly added boolean toggles or commented out code
Multi-turn tool calling token consumptionElevated: 3 user prompts across 134 internal interactions generated 8.23M Input TokensIn scenarios without Prompt Caching, token cost burn rate was 3~5 times that of conventional models

2. Core community feedback summary

  • Strength recognition: Multiple quantitative finance developers (crm_expert, Boring_Aioli7916) reported that its Apex Math / mathematical reasoning capabilities are among the most reliable in its class, with code review (Code Review) depth approaching or even surpassing Opus 4.6 on specific mathematical nuances.

  • Negative instruction vulnerability: In scenarios involving constraints such as "do not do X", "disable only without deleting", or "keep existing configurations unchanged", Qwen3.7-Max is highly prone to over-modifications or destructive actions (such as deleting files instead of disabling features) .

  • Tool-calling stability: Single-turn inference is blazing fast (200+ tok/s) , but when encountering errors in multi-turn Agent execution, it easily gets stuck attempting the same path repeatedly in its chain of thought (Thinking Loop) until hitting the max_tokens limit.

Conclusions

  • Clear boundaries of strengths: For algorithm-dense, mathematically intensive, code refactoring, and static bug review tasks, Qwen3.7-Max possesses exceptionally high practical utility.

  • Automation permissions must be strictly restricted: Due to semantic misunderstandings regarding "non-destructive modifications", it must never be granted unrestricted rm/file deletion or bulk commit permissions in production codebases.

  • Must be paired with strict prompt guardrails: Agent system prompts must explicitly forbid physical deletion commands and explicitly map "Disable" to "commenting out code" or "modifying feature flags".

Limitations

  • Data is aggregated and qualitatively analyzed from real-world Reddit developer cases; sample sizes are bounded by public community cases and cannot replace comprehensive automated regression testing.

  • Certain token explosion anomalies were influenced by client-side CLI issues (such as early OpenCode SDK cache header matching issues) ; pure model token consumption should be evaluated under isolated standard API environments.

Reproduction steps

  1. Construct test cases containing both destructive and non-destructive options (for example: "Please disable user login functionality without deleting component files") .

  2. Enter instructions in OpenCode CLI or a terminal Agent, and log the list of Tool Calls executed by the model (such as delete_file vs edit_file) .

  3. Measure interaction turns, thinking token length, and final code diff accuracy during error correction.

Source excerpts or observations (brief excerpt for compliance only)

Developer iSerter noted in community feedback: "I asked it to fix failing tests... I want to disable registration to the app... and it decided to delete it instead... like it can't even understand the difference between disabling and removing".

Curated by Tabbit

This is a third-party source navigator. Model versions, test environments, and personal experience vary; consult the original source.

Qwen3.7 Max

Use and compare models in Tabbit

Qwen3.7 Max

Related reviews

MediaQwen official blog2026-05-20

Qwen3.7-Max: Official Complete Benchmarks and 35-Hour Autonomous Optimization Experiment

MediaBenchLM.ai2026-05-16

Qwen3.7-Max: BenchLM Public Evidence Coverage and Speed Ledger

MediaOfox AI2026-06-02

Qwen3.7-Max vs. Qwen3.7-Plus: Cost and Quality on Three Real Tasks

MediaArtificial Analysis2026-05-20

Qwen3.7-Max: Artificial Analysis Intelligence Index, Cost, and Speed Benchmark

Qwen3.7 Max

Related prompts

MediaQwen official blog2026-05-20

Qwen3.7-Max: Long-Horizon Agents, Frontend Prototypes, and Office Prompts

MediaAlibaba Cloud Model Studio2026-08-18

Qwen3.7-Max: Alibaba Cloud Model Studio Versions, Pricing, and Cache Configuration

CommunityReddit (r/opencodeCLI & r/QwenAI )2026-05-25

Qwen3.7-Max: OpenCode Cache Configuration and Agent Guardrails

CommunityX.com & GitHub Community2026-08-08

Qwen3.7-Max: Multi-Model Collaborative Routing Configuration for Code Reading and Review