LongCat Flash Chat · Media / benchmark · Vendor report
The official card describes a 560B MoE with about 18.6B–31.3B dynamically active parameters, reports 89.71 on MMLU and 89.65 on IFEval, and documents LongCat tool tags.
Unverified: the original source could not be rechecked. Historical figures below are not current verified results.
LongCat-Flash-Chat is a non-thinking MoE with 560B total parameters and about 27B active on average. The official table shows strong tool calling and instruction following and moderately strong coding performance, while long-context graph traversal and privacy and safety metrics still require separate validation.
Good for: Non-thinking dialogue, tool calling, multi-step Agents, instruction execution, code generation/explanation, low-latency large-model inference, and 128K long-context tasks.
Not for: Deploying in sensitive production systems based only on the official table; long-context retrieval, privacy, safety, and cross-language scenarios in particular require local retesting.
Applicable model versions: The open-source meituan-longcat/LongCat-Flash-Chat; later API versions may differ from the open-source weights.
Applicable clients, Agents, or APIs: Hugging Face weights, SGLang/vLLM, and the local chat template; the historical LongCat API is also subject to the retirement timeline.
Recommended inference tier and parameters: The model card labels it non-thinking; no standardized temperature/top-p/sampling configuration is disclosed.
Evaluator: Meituan LongCat Team.
Comparison models: DeepSeek V3.1, Qwen3 MoE-2507, Kimi-K2, GPT-4.1, Claude 4 Sonnet, and Gemini 2.5 Flash.
Model scale: LongCat-Flash has 560B total parameters and 27B active on average (a dynamic range of 18.6B–31.3B).
Inference-efficiency claim: The official claim is that inference exceeds 100 TPS on H800; the model card gives a 128K context, while an API update in 2025-12 also claims support for 256K, so the versions must be distinguished.
Mode: non-thinking foundation model.
Tools: The official format uses <longcat_tool_call> XML tool calls, with the function name and arguments placed as JSON inside the tag.
Deployment: The repository provides basic SGLang/vLLM adapters and a deployment guide; complete hardware, quantization, batch, and sampling configurations are not disclosed.
Evaluation note: The comparison table notes that some external figures marked with * come from other public reports, and that several comparison models were evaluated in non-thinking mode.
The LongCat-Flash figures published in the model card (the parentheses indicate the metric definition):
| Capability | Benchmark | LongCat-Flash |
|---|---|---|
| General | MMLU | 89.71 |
| General | MMLU-Pro | 82.68 |
| General | ArenaHard-V2 | 86.50 |
| Instruction following | IFEval | 89.65 |
| Instruction following | COLLIE | 57.10 |
| Math | MATH500 | 96.40 |
| Math | AIME24 avg@10 | 70.42 |
| Math | AIME25 avg@10 | 61.25 |
| Reasoning | GPQA-diamond | 73.23 |
| Reasoning | ZebraLogic | 89.30 |
| Long context | GraphWalks-128k precision | 51.05 |
| Coding | LiveCodeBench pass@1 | 48.02 |
| Coding | Humaneval+ pass@1 | 88.41 |
| Coding | MBPP+ pass@1 | 79.63 |
| Coding | SWE-Bench-Verified | 60.40 |
| Coding | TerminalBench | 39.51 |
| Agent tools | τ²-Bench telecom avg@4 | 73.68 |
| Agent tools | τ²-Bench airline avg@4 | 58.00 |
| Agent tools | τ²-Bench retail avg@4 | 71.27 |
| Agent tools | AceBench | 76.10 |
| Agent tools | VitaBench avg@4 | 24.30 |
| Safety | Harmful / Criminal / Misinformation / Privacy | 83.98 / 91.24 / 81.72 / 93.98 |
The official table supports the view that LongCat-Flash is competitive on tool use, instruction following, dialogue, and foundational coding tasks; τ²-Bench telecom 73.68, IFEval 89.65, and SWE-Bench Verified 60.4 are useful task signals. GraphWalks-128k at just 51.05 shows that “128K support” cannot substitute for long-context graph traversal performance; safety and privacy scores should also be considered alongside real policy testing.
The figures come from the official model card; the full prompts, hardware, sampling configuration, and independent verification are not disclosed.
The model card and API Change Log use two context figures, 128K and 256K, for different versions; they must not be combined into one snapshot.
Some comparison models use non-thinking mode, and some figures marked with asterisks come from other reports; cross-column comparisons require caution.
The model card explicitly warns that downstream applications should assess accuracy, safety, and fairness themselves; official scores do not authorize deployment in sensitive scenarios.
Fix the open-source commit, tokenizer, inference engine, quantization, context, temperature, and batch configuration.
Use the official chat template to test tool-free, multi-turn, and tool-calling flows separately, saving the original messages and XML parsing logs.
Retest in general, instruction, math, coding, Agent, long-context, and safety buckets, recording tokens, throughput, latency, and recovery from failures.
Report the historical API and local weights separately, labeling the 128K/256K version and the model's retirement status.
The model card defines LongCat-Flash as a non-thinking model and gives its dynamic activation range as 18.6B–31.3B.
The official Agent evaluation covers telecom, airline, and retail variants of τ²-Bench, showing that tool-task performance varies by scenario.
The figures, task set, reasoning tier, and client conditions apply only to the listed source and collection snapshot. Different versions, harnesses, or providers must not be compared directly; undisclosed parameters remain unknown.
For a reproduction, fix the model version, provider or client, reasoning tier, tools, task-set version, sample count, and collection date, and record failures, retries, and human corrections. Full steps are in the source notes below.
Hugging Face (the official Meituan LongCat model card) · Meituan LongCat Team · Original publication date Unknown · Site edit date 2026-09-20
Open original sourceLongCat Flash Chat
Download the Tabbit client to check model access