LongCat-Flash-Chat is a non-thinking MoE with 560B total parameters and about 27B active on average. The official table shows strong tool calling and instruction following and moderately strong coding performance, while long-context graph traversal and privacy and safety metrics still require separate validation.
Good for: Non-thinking dialogue, tool calling, multi-step Agents, instruction execution, code generation/explanation, low-latency large-model inference, and 128K long-context tasks.
Not for: Deploying in sensitive production systems based only on the official table; long-context retrieval, privacy, safety, and cross-language scenarios in particular require local retesting.
Applicable model versions: The open-source meituan-longcat/LongCat-Flash-Chat; later API versions may differ from the open-source weights.
Applicable clients, Agents, or APIs: Hugging Face weights, SGLang/vLLM, and the local chat template; the historical LongCat API is also subject to the retirement timeline.
Recommended inference tier and parameters: The model card labels it non-thinking; no standardized temperature/top-p/sampling configuration is disclosed.
Evaluator: Meituan LongCat Team.
Comparison models: DeepSeek V3.1, Qwen3 MoE-2507, Kimi-K2, GPT-4.1, Claude 4 Sonnet, and Gemini 2.5 Flash.
Model scale: LongCat-Flash has 560B total parameters and 27B active on average (a dynamic range of 18.6B–31.3B).
Inference-efficiency claim: The official claim is that inference exceeds 100 TPS on H800; the model card gives a 128K context, while an API update in 2025-12 also claims support for 256K, so the versions must be distinguished.
Mode: non-thinking foundation model.
Tools: The official format uses <longcat_tool_call> XML tool calls, with the function name and arguments placed as JSON inside the tag.
Deployment: The repository provides basic SGLang/vLLM adapters and a deployment guide; complete hardware, quantization, batch, and sampling configurations are not disclosed.
Evaluation note: The comparison table notes that some external figures marked with * come from other public reports, and that several comparison models were evaluated in non-thinking mode.
The LongCat-Flash figures published in the model card (the parentheses indicate the metric definition):
| Capability | Benchmark | LongCat-Flash |
|---|---|---|
| General | MMLU | 89.71 |
| General | MMLU-Pro | 82.68 |
| General | ArenaHard-V2 | 86.50 |
| Instruction following | IFEval | 89.65 |
| Instruction following | COLLIE | 57.10 |
| Math | MATH500 | 96.40 |
| Math | AIME24 avg@10 | 70.42 |
| Math | AIME25 avg@10 | 61.25 |
| Reasoning | GPQA-diamond | 73.23 |
| Reasoning | ZebraLogic | 89.30 |
| Long context | GraphWalks-128k precision | 51.05 |
| Coding | LiveCodeBench pass@1 | 48.02 |
| Coding | Humaneval+ pass@1 | 88.41 |
| Coding | MBPP+ pass@1 | 79.63 |
| Coding | SWE-Bench-Verified | 60.40 |
| Coding | TerminalBench | 39.51 |
| Agent tools | τ²-Bench telecom avg@4 | 73.68 |
| Agent tools | τ²-Bench airline avg@4 | 58.00 |
| Agent tools | τ²-Bench retail avg@4 | 71.27 |
| Agent tools | AceBench | 76.10 |
| Agent tools | VitaBench avg@4 | 24.30 |
| Safety | Harmful / Criminal / Misinformation / Privacy | 83.98 / 91.24 / 81.72 / 93.98 |
The official table supports the view that LongCat-Flash is competitive on tool use, instruction following, dialogue, and foundational coding tasks; τ²-Bench telecom 73.68, IFEval 89.65, and SWE-Bench Verified 60.4 are useful task signals. GraphWalks-128k at just 51.05 shows that “128K support” cannot substitute for long-context graph traversal performance; safety and privacy scores should also be considered alongside real policy testing.
The figures come from the official model card; the full prompts, hardware, sampling configuration, and independent verification are not disclosed.
The model card and API Change Log use two context figures, 128K and 256K, for different versions; they must not be combined into one snapshot.
Some comparison models use non-thinking mode, and some figures marked with asterisks come from other reports; cross-column comparisons require caution.
The model card explicitly warns that downstream applications should assess accuracy, safety, and fairness themselves; official scores do not authorize deployment in sensitive scenarios.
Fix the open-source commit, tokenizer, inference engine, quantization, context, temperature, and batch configuration.
Use the official chat template to test tool-free, multi-turn, and tool-calling flows separately, saving the original messages and XML parsing logs.
Retest in general, instruction, math, coding, Agent, long-context, and safety buckets, recording tokens, throughput, latency, and recovery from failures.
Report the historical API and local weights separately, labeling the 128K/256K version and the model's retirement status.
The model card defines LongCat-Flash as a non-thinking model and gives its dynamic activation range as 18.6B–31.3B.
The official Agent evaluation covers telecom, airline, and retail variants of τ²-Bench, showing that tool-task performance varies by scenario.
LongCat Flash Chat