Tabbit
ResourcesBlogModels
Tabbit LogoTabbit

Tabbit — The AI Browser that Works for You

Topics

  • Best Browsers 2026: Rankings and Top Lists
  • AI Browser Guides and Resources
  • Browser Comparisons: Head-to-Head Guides
  • Browser Reviews and Explainers
  • Browser Alternatives
  • Browser Directory: Guides by Browser
  • Agentic Browser Resources
  • Browser Downloads and Install Guides
  • Browser Productivity Resources
  • SillyTavern Model Guides and Presets

Popular Guides

  • Best Browsers 2026: Top 10 Ranked & Compared
  • Best Free AI Browsers 2026: Plans & Prices Compared
  • Rabbit Browser: What It Is & Why Tabbit Is Better
  • Firefox vs Chrome 2026: Privacy, RAM & Speed Compared
  • Best Lightweight Browsers 2026: 7 Tested for RAM & Speed
  • AI Browser List 2026: 10 Browsers Compared
  • Neobrowser: Norton Neo, Download & Alternatives
  • Edge vs Chrome 2026: Speed, RAM & Battery Tested
  • Best Internet Browser for Android 2026
  • Best AI Browser 2026: Top 9 Tested & Ranked

Events

  • Tabbit Skill Competition
  • KPOP SBTI Fandom Personality Test
  • Tabbit Campus Creator Program
  • fifi's Picks: AI Skills for Research Papers
  • User Survey

About

  • Tabbit Blog
  • Press & Media
English
简体中文English
Review
OfficialHy4 Flash

Tencent Hunyuan Hy4 Flash: Official Benchmarks and WorkBuddy Blind Test

Original source

Tencent Hunyuan Research

AuthorNot stated

Source date2026-11-16

Tabbit curation2026-11-16

Read original

One-sentence takeaway

Tencent presents its internal WorkIndex benchmark, a WorkBuddy user blind test, and several product-team case studies separately. Its official data indicates that Hy4 Flash was less expensive and faster on these specific sets of everyday work tests. They are not independent replications and do not represent all tasks.

Use cases

  • Tasks these results can help assess: The office-work benchmarks, internal user blind test, and published agent and multimodal benchmarks disclosed by Tencent.

  • Tasks these results should not be generalized to: Tasks with undisclosed environments or toolchains, all user and business scenarios, long-horizon software engineering as a whole, or direct comparisons across different harnesses or pricing periods.

  • Model version covered: Hy4 Flash; comparison models are listed under their appendix names.

  • Test environment or client: WorkBuddy CLI was used for each internal WorkIndex test. The user blind test involved 85 internal WorkBuddy users. Environments for public benchmarks varied by project; see the methodology notes.

  • Reasoning level and parameters: The appendix says that each model was evaluated at its highest available reasoning setting. Specific API parameters, sampling parameters, and model revisions were not stated.

Evaluation method

Internal WorkIndex benchmark

Tencent describes WorkIndex as an internal evaluation set built around typical WorkBuddy tasks. It contains eight task types: creating presentations, editing presentations, co-editing presentations, co-editing Markdown, editing documents, fixing spreadsheets, audio/video processing, and visual understanding. The appendix maps these to PPTGenBench, PPTCoEditBench, PPTFixBench, MdCoEditBench, WordEditBench, ExcelFixBench, AudioVideoBench, and BuddyVQA Atlas.

The appendix table lists scores and per-task costs (in CNY) for seven models. The original chart does not explain the score scale; the table below transcribes the scores without interpreting them as percentages. Costs were calculated using each model's official API prices and the test usage.

Open Benchmarks and multimodal tasks

The main text lists seven Open Benchmarks: DeepSWE, ProgramBench, Terminal-Bench 4.0, APEX-Agents, AutomationBench, HLE, and OSWorld 2.1. The appendix lists two additional Multimodal items. These are separate sets from WorkIndex and should not be combined and described as one office-work benchmark.

WorkBuddy user blind test

The main text says Tencent invited 85 internal WorkBuddy users to conduct a blind test across 259 everyday work tasks in 27 categories. The results chart reports user satisfaction (on a four-point scale), median end-to-end time, and cost per task for four models. The page does not disclose task assignment, randomization or blinding details, API parameters for each model, the number of raters, score dispersion, or significance testing.

Key results

Blind-test results (as reported by Tencent)

ModelUser satisfaction (4-point scale)Median end-to-end timeCost per task
DeepSeek-V4.1-Flash-10173.0910.3 minutes¥1.20
Hy4 Flash2.796.7 minutes¥0.26
Claude Haiku 5.52.816.8 minutes¥4.73
GLM-5.3-Flash2.537.6 minutes¥0.81

The chart caption says the external models DeepSeek, Claude Haiku, and GLM all used the high setting. Hy4 Flash's satisfaction score was 0.02 points below Claude Haiku 5.5, while its time was 0.1 minute shorter. The chart shows its cost at about 1/18 of Claude's, 1/4.6 of DeepSeek's, and 1/3.1 of GLM's. The chart provides no error ranges, so it cannot establish whether the satisfaction difference is significant.

WorkIndex: internal benchmark score / cost per task

Each cell is formatted as “score / ¥ per task”; “—” means the original appendix provided no data.

BenchmarkHy4 FlashHy4Hy4 previewDeepSeek-V4.1-Flash-1017Qwen3.8-Flash-NextGLM-5.3-FlashGPT-6 Luna
PPTGenBench54.2 / 0.16961.5 / 3.96952.3 / 3.48464.4 / 1.67256.0 / 0.83053.6 / 1.46056.8 / 0.753
PPTCoEditBench74.0 / 0.10578.9 / 1.71471.5 / 1.71176.8 / 0.45962.9 / 0.21367.3 / 0.48943.5 / 0.303
PPTFixBench23.7 / 0.25345.6 / 15.40023.8 / 4.16045.3 / 1.67223.9 / 0.87528.6 / 2.5178.6 / 1.360
MdCoEditBench56.9 / 0.05757.7 / 0.89949.2 / 0.68129.2 / 0.19453.8 / 0.08032.3 / 0.13353.1 / 0.120
WordEditBench46.2 / 0.62957.2 / 10.30444.2 / 5.72553.5 / 2.23746.3 / 1.43047.6 / 2.84042.7 / 1.360
ExcelFixBench15.6 / 0.31027.8 / 6.12011.7 / 4.11020.0 / 1.51812.8 / 1.1559.9 / 2.8796.7 / 0.800
AudioVideoBench17.8 / 0.34427.4 / 7.29016.3 / 6.03022.2 / 5.33017.8 / 1.29011.9 / 3.37010.0 / 2.304
BuddyVQA Atlas (without tools)48.5 / 0.00755.5 / 0.180—43.7 / 0.05954.5 / 0.01250.1 / 0.01951.6 / 0.016

Open agent benchmarks and multimodal results

BenchmarkHy4 FlashHy4Hy4 previewDeepSeek-V4.1-Flash-1017Qwen3.8-Flash-NextGLM-5.3-FlashGPT-6 Luna
DeepSWE v1.164.6 / 0.29074.9 / 5.40964.3 / 8.95173.8 / 1.30465.1 / 3.25167.8 / 3.23067.1 / 1.535
ProgramBench (almost solved)16.0 / 0.56130.0 / 30.28117.5 / 107.06329.0 / 9.21422.0 / 18.43213.0 / 17.9596.0 / 1.024
Terminal-Bench 4.019.2 / 0.55844.4 / 12.01426.3 / 18.01540.0 / 3.88229.5 / 5.10035.4 / 5.59713.3 / 2.199
APEX-Agents v1.1 (pass@1)63.1 / 0.08775.2 / 3.10453.9 / 2.12372.9 / 1.46557.6 / 0.34951.5 / 0.48544.7 / 0.188
AutomationBench v1.0.652.2 / 0.03856.2 / 0.90836.3 / 0.42454.3 / 0.62049.3 / 0.07548.4 / 0.10438.1 / 0.137
HLE-Full (with tools)55.2 / 0.06059.1 / 2.300—57.1 / 0.65754.1 / 0.27552.2 / 0.61649.7 / 0.142
OSWorld 2.1 (Full, partial score)68.1 / 0.45178.9 / 5.992—68.4 / 2.07358.8 / 2.64464.0 / 3.80355.7 / 4.960
Multimodal: MMMU-Pro75.8 / 0.01078.6 / 0.197—76.7 / 0.07677.2 / 0.01577.0 / 0.01377.5 / 0.017
Multimodal: ZeroBench-main (with tools, pass@5)45.8 / 0.07755.4 / 1.389—16.5 / 0.09541.7 / 0.15935.3 / 1.86133.6 / 0.327

Raw data

Environments and task definitions listed in the appendix

  • Unified settings: Each model was evaluated at its highest available reasoning setting. All internal Buddy Index tests used WorkBuddy CLI.

  • DeepSWE v1.1: mini-SWE-agent; each task ran in a sandbox with 8 CPU cores and 16 GB of memory.

  • ProgramBench: The Almost Solved score was reported using mini-SWE-agent.

  • Terminal-Bench 4.0: Claude Code harness; up to 500 turns and 13 hours per trial; 16 CPUs and 32 GB RAM; each of the three GPU-dependent tasks used one H100.

  • APEX-Agents v1.1: Official reference agent harness (Loop), with up to 250 steps per run. The official dual-service main + world environment was limited to 8 CPUs and 24 GB RAM; the separate verifier container was limited to 2 CPUs and 8 GB RAM.

  • AutomationBench v1.0.6: 600 public tasks released by Zapier, evaluated using the official method.

  • PPTGenBench: Generate presentations from text; combine an overall aesthetic evaluation with penalties for critical errors; render presentations as PDFs using LibreOffice.

  • PPTCoEditBench: 100 real-world presentation-editing tasks. Checks whether requested changes were made without collateral damage such as overlapping shapes or dangling animations. Includes tasks that select content in the WorkBuddy editor. It is currently single-turn; multi-turn support is still in development.

  • PPTFixBench: 50 tasks. Each provides a presentation containing more than 25 formatting or content issues for the model to identify and fix.

  • MdCoEditBench: 65 Markdown co-editing tasks covering structural changes, local edits, continuation, intent understanding for selections, awareness of user edits, feedback generalization, editing conflicts, and version rollback; evaluated in the WorkBuddy editor.

  • WordEditBench: 100 real-world Word (.docx) editing tasks in four categories: error correction, cross-document formatting, targeted editing, and academic paper formatting. Scored by a rule-based checker on document XML, rewarding required edits and penalizing unrelated edits.

  • ExcelFixBench: 60 real-world spreadsheet repair tasks. Checks fixes to formulas, data, and formatting while preserving unrelated content; evaluated in a sandbox, with each task scored against a task rubric and averaged over three trials.

  • AudioVideoBench: Containerized end-to-end audio/video production tasks covering editing, compositing, restoration, aspect-ratio conversion, mixing, transcription, and content understanding.

  • BuddyVQA Atlas: Image question answering covering recognition, counting, comparison, OCR, spatial orientation, and localization, with an emphasis on small text, thin lines, and local targets that are easy to miss when answering directly from the full image.

  • ZeroBench-main: Network-isolated Jupyter environment using image output as the tool interface; up to 80 tool calls per round; each question was run independently 10 times to estimate pass@5.

  • Additional note on visual benchmarks: The original appendix states that, for benchmarks requiring visual capabilities, Hy4 Flash results were used to represent Hy4 preview when plotting.

Cost methodology

The appendix says costs were calculated using each model's official API pricing and a fixed exchange rate of 1 USD = 7.2 CNY. For models with discounts or time-of-day pricing, fixed prices were used (per million tokens, uncached input / cached input / output): DeepSeek-V4.1-Flash-1017 at ¥2 / ¥0.04 / ¥8 (peak-hour pricing), and GLM-5.3-Flash at ¥0.8 / ¥0.23 / ¥2.8 (standard API pricing). The Hy4 Flash launch page separately lists API prices of ¥0.02 for cached input, ¥0.5 for input, and ¥2 for output per million tokens; the corresponding Hy4 prices are ¥0.3, ¥6, and ¥18.

These costs are not an independent billing audit. The public materials do not provide complete input/output token counts for each model, task weights for each benchmark, or price snapshots for all models, so the results cannot be fully recalculated from the cost table alone.

How the page reports aggregate WorkIndex costs

The main text says the per-task WorkIndex cost was about 1/13 that of Hy4 preview, 1/20 that of Hy4, and 1/8 that of DeepSeek-V4.1-Flash-1017 (max setting, busy-hour pricing). The cost chart labels Hy4 Flash at about ¥0.2 per task, Hy4 preview at about ¥3.2 per task, and Hy4 at about ¥5.7 per task, and says the first was respectively 13.8× and 24.5× cheaper. The ratios in the body text do not fully match the chart's multipliers. The page gives neither aggregate weights nor unrounded values, so both original statements are retained without reconciling them or deriving a single ratio.

The main text also includes a product-side WorkBuddy evaluation of Hy4: average task time fell by 70%, average cost was about 1/15 that of Hy4, everyday task performance was broadly on par, and long-horizon Coding tasks declined slightly. The page does not explain task overlap with WorkIndex or the 259-task blind test, sample size, or calculation method; this should not be treated as the same experiment.

Conclusions and limitations

  • In Tencent's disclosed set of 259 internal everyday tasks, the blind test shows Hy4 Flash had the lowest median completion time and per-task cost. Its satisfaction score was 2.79/4, close to Claude Haiku 5.5 at 2.81/4. Variance and blinding details were not disclosed, so the statistical significance of the small satisfaction gap cannot be assessed.

  • The appendix's per-benchmark results are not uniformly favorable: Hy4 Flash scored below Hy4 or other models on several WorkIndex tasks and public benchmarks. The value-for-money claim therefore should not be restated as an overall capability lead.

  • WorkIndex is Tencent's internal set, the WorkBuddy blind test is a separate set of real-use tasks, and product-team case studies cover their own business scenarios. These three should not be conflated as one evaluation.

  • Public benchmarks in the tables use different harnesses, resource limits, and scoring methods, while costs also depend on the pricing assumptions. Cross-benchmark comparisons represent only this snapshot reported by Tencent and are not third-party replications under uniform conditions.

  • This article records the vendor's original disclosure; it has not been independently reproduced. The page does not publish the task sets, raw outputs, complete scoring rubrics, token usage by task, or reproduction scripts.

Reproduction notes

A reproduction could use the benchmark names, harnesses, resource limits, and highest reasoning settings listed on the original page. Exact reproduction is not possible from that page alone: the WorkIndex task set and complete scoring rules are not public; blind-test task distribution and randomization details are not public; specific API versions and request parameters for most models are not stated; and task-level token usage and complete price snapshots needed to calculate costs are not public. A reproduction should record these differences separately and should not directly replace the original chart with new results.

Curated by Tabbit

This is a third-party source navigator. Model versions, test environments, and personal experience vary; consult the original source.

Hy4 Flash

Use and compare models in Tabbit

Hy4 Flash

Related reviews

MediaPlotly2026-11-16

Tencent Hy4 Flash: Plotly Data Analytics Benchmark Results

Mediaifanr / APPSO2026-11-16

APPSO’s WorkBuddy Test: Hy4 Flash on a 3D Prototype and Office Tasks

CommunityReddit, r/LocalLLM2026-11-16

Reddit WorkBuddy Ad Metrics Comparison: All Three Models Got the Math Right, Hy4 Flash Had the Lowest Listed Prices

CommunityZhidongxi2026-11-16

Zhidongxi Tests Hy4 Flash: Front-End Prototypes, 3D Creation, and Cross-Tool Blender Tasks

Hy4 Flash

Related showcases & prompts

OfficialOpenRouter

Configuring the Tencent Hy4 Flash API on OpenRouter

OfficialTencent Cloud TokenHub2026-11-16

Tencent Cloud TokenHub: Hy4-Flash Reasoning and API Settings

OfficialOpenClaw documentation

Configure the Tencent Hy4-Flash Provider in OpenClaw

OfficialOpenCode Console

Using Hy4 flash Free in OpenCode Console