Tabbit
ResourcesBlogModels
Tabbit LogoTabbit

Tabbit — The AI Browser that Works for You

Topics

  • AI Browser Resources
  • Agentic Browser Resources
  • Browser Downloads and Install Guides
  • Browser Comparisons
  • AI Browser Alternatives
  • Browser Productivity Resources

Popular Guides

  • AI Browser
  • Agentic Browser Download
  • Best AI Browser 2026: Top 9 Tested & Ranked
  • AI Browser Download
  • Free AI Browser
  • Best AI Browser 2026
  • AI Browser Comparison 2026
  • AI Browser for Windows
  • AI Browser for Mac
  • Chrome Alternative 2026

Events

  • Tabbit Skill Competition
  • KPOP SBTI Fandom Personality Test
  • Tabbit Campus Creator Program
  • fifi's Picks: AI Skills for Research Papers
  • User Survey

About

  • Tabbit Blog
  • Press & Media
English
简体中文English
Reviews and evidence

LongCat Flash Chat · Media / benchmark · Vendor report

LongCat-Flash-Chat Official Model Card: MoE Architecture, Benchmarks, and Tool Capabilities

The official card describes a 560B MoE with about 18.6B–31.3B dynamically active parameters, reports 89.71 on MMLU and 89.65 on IFEval, and documents LongCat tool tags.

Unverified: the original source could not be rechecked. Historical figures below are not current verified results.

Media / benchmarkVendor reportEdited 2026-09-20

Test conditions

Condition
Model/version: LongCat-Flash-Chat 560B MoE.
Condition
Harness/sample: card tables and stated settings; full prompts, repeats, and failures unknown.
Condition
Date: card reopened 2026-09-20.

Key data and applicable tasks

One-sentence takeaway

LongCat-Flash-Chat is a non-thinking MoE with 560B total parameters and about 27B active on average. The official table shows strong tool calling and instruction following and moderately strong coding performance, while long-context graph traversal and privacy and safety metrics still require separate validation.

Use cases

  • Good for: Non-thinking dialogue, tool calling, multi-step Agents, instruction execution, code generation/explanation, low-latency large-model inference, and 128K long-context tasks.

  • Not for: Deploying in sensitive production systems based only on the official table; long-context retrieval, privacy, safety, and cross-language scenarios in particular require local retesting.

  • Applicable model versions: The open-source meituan-longcat/LongCat-Flash-Chat; later API versions may differ from the open-source weights.

  • Applicable clients, Agents, or APIs: Hugging Face weights, SGLang/vLLM, and the local chat template; the historical LongCat API is also subject to the retirement timeline.

  • Recommended inference tier and parameters: The model card labels it non-thinking; no standardized temperature/top-p/sampling configuration is disclosed.

Test environment

  • Evaluator: Meituan LongCat Team.

  • Comparison models: DeepSeek V3.1, Qwen3 MoE-2507, Kimi-K2, GPT-4.1, Claude 4 Sonnet, and Gemini 2.5 Flash.

  • Model scale: LongCat-Flash has 560B total parameters and 27B active on average (a dynamic range of 18.6B–31.3B).

  • Inference-efficiency claim: The official claim is that inference exceeds 100 TPS on H800; the model card gives a 128K context, while an API update in 2025-12 also claims support for 256K, so the versions must be distinguished.

Input/configuration

  • Mode: non-thinking foundation model.

  • Tools: The official format uses <longcat_tool_call> XML tool calls, with the function name and arguments placed as JSON inside the tag.

  • Deployment: The repository provides basic SGLang/vLLM adapters and a deployment guide; complete hardware, quantization, batch, and sampling configurations are not disclosed.

  • Evaluation note: The comparison table notes that some external figures marked with * come from other public reports, and that several comparison models were evaluated in non-thinking mode.

Results data

The LongCat-Flash figures published in the model card (the parentheses indicate the metric definition):

CapabilityBenchmarkLongCat-Flash
GeneralMMLU89.71
GeneralMMLU-Pro82.68
GeneralArenaHard-V286.50
Instruction followingIFEval89.65
Instruction followingCOLLIE57.10
MathMATH50096.40
MathAIME24 avg@1070.42
MathAIME25 avg@1061.25
ReasoningGPQA-diamond73.23
ReasoningZebraLogic89.30
Long contextGraphWalks-128k precision51.05
CodingLiveCodeBench pass@148.02
CodingHumaneval+ pass@188.41
CodingMBPP+ pass@179.63
CodingSWE-Bench-Verified60.40
CodingTerminalBench39.51
Agent toolsτ²-Bench telecom avg@473.68
Agent toolsτ²-Bench airline avg@458.00
Agent toolsτ²-Bench retail avg@471.27
Agent toolsAceBench76.10
Agent toolsVitaBench avg@424.30
SafetyHarmful / Criminal / Misinformation / Privacy83.98 / 91.24 / 81.72 / 93.98

Conclusions

The official table supports the view that LongCat-Flash is competitive on tool use, instruction following, dialogue, and foundational coding tasks; τ²-Bench telecom 73.68, IFEval 89.65, and SWE-Bench Verified 60.4 are useful task signals. GraphWalks-128k at just 51.05 shows that “128K support” cannot substitute for long-context graph traversal performance; safety and privacy scores should also be considered alongside real policy testing.

Limitations

  • The figures come from the official model card; the full prompts, hardware, sampling configuration, and independent verification are not disclosed.

  • The model card and API Change Log use two context figures, 128K and 256K, for different versions; they must not be combined into one snapshot.

  • Some comparison models use non-thinking mode, and some figures marked with asterisks come from other reports; cross-column comparisons require caution.

  • The model card explicitly warns that downstream applications should assess accuracy, safety, and fairness themselves; official scores do not authorize deployment in sensitive scenarios.

Reproduction steps

  1. Fix the open-source commit, tokenizer, inference engine, quantization, context, temperature, and batch configuration.

  2. Use the official chat template to test tool-free, multi-turn, and tool-calling flows separately, saving the original messages and XML parsing logs.

  3. Retest in general, instruction, math, coding, Agent, long-context, and safety buckets, recording tokens, throughput, latency, and recovery from failures.

  4. Report the historical API and local weights separately, labeling the 128K/256K version and the model's retirement status.

Source excerpts or observations (for compliant short quotations only)

  • The model card defines LongCat-Flash as a non-thinking model and gives its dynamic activation range as 18.6B–31.3B.

  • The official Agent evaluation covers telecom, airline, and retail variants of τ²-Bench, showing that tool-task performance varies by scenario.

What this supports

  • Supports the card’s MMLU 89.71, IFEval 89.65, and documented tool-tag observations.

What this does not support

  • Does not support production success-rate, current API latency, or universal schema compatibility; local hardware and routing are outside the card.

Method, limits, and reproduction

The figures, task set, reasoning tier, and client conditions apply only to the listed source and collection snapshot. Different versions, harnesses, or providers must not be compared directly; undisclosed parameters remain unknown.

For a reproduction, fix the model version, provider or client, reasoning tier, tools, task-set version, sample count, and collection date, and record failures, retries, and human corrections. Full steps are in the source notes below.

Original source

Hugging Face (the official Meituan LongCat model card) · Meituan LongCat Team · Original publication date Unknown · Site edit date 2026-09-20

Open original source

LongCat Flash Chat

Compare LongCat Flash Chat in Tabbit

Download the Tabbit client to check model access

Related reviews

Reddit: Community Observations on LongCat-Flash-Chat 560B MoE Speed and Local DeploymentA LocalLLaMA discussion covers agent capability and deployment expectations, useful for selecting hypotheses to test; it is not a reproducible benchmark.LongCat Official Change Log: Flash-Chat API Launch, Upgrades, and Retirement/Migration BoundariesThe official Change Log records Flash-Chat API launches, upgrades, and retirement or migration points; it is useful for endpoint support checks, not answer quality.LongCat-Flash-Chat Official Chat Template and Tool-Calling PromptUse the official Round format and LongCat tool-call tags for one weather or order lookup, with explicit parameters, call order, and final-answer checks.LongCat API Official Compatibility Format and Authentication ConfigurationConfigure an OpenAI-compatible client with the LongCat endpoint, authentication, and timeout, then run a logged health check before the real request.