OpenAI claims that GPT-6.2 Astra outperforms its predecessor or competitors on several professional-work and science benchmarks, at a lower cost per task. However, the article does not publish full scores, sample sizes, or run configurations for most benchmarks, so the results cannot be independently reproduced or generalized to all tasks.
Tasks these results can inform: Understanding OpenAI's official benchmark and cost comparisons of Astra with GPT-6 Astra, GPT-6.2 Sol, and other models mentioned in the article.
Tasks these results should not be generalized to: Estimating actual costs for arbitrary business tasks, or comparing model performance across different tools, reasoning tiers, samples, and scoring methods.
Applicable model version: GPT-6.2 Astra; some comparisons involve GPT-6 Astra, GPT-6.2 Sol, GPT-6.1 Sol, Claude Fable 5.2, and others.
Test environment or client: Varies by benchmark; the article discloses only some environment details, as described below.
Reasoning tier and parameters: Only FrontierCode 2.0 explicitly states that both Astra and Sol were set to Max; most other benchmarks do not specify this.
The article summarizes several evaluations of long-horizon professional work, science, legal and knowledge work, coding, and 3D generation. For some results, it reports score differences, task costs, or relative costs. It also lists GPT-6.2 Astra's standard API token prices. Benchmark results and relative task costs are claims published by OpenAI, not independent measurements in this article.
Evaluation definitions and configurations disclosed in the article:
Agents’ Last Exam: Evaluates long-horizon professional workflows. The article says that Claude Fable 5.2's leaderboard results exclude nine tasks that used a fallback model. It does not provide a full score table, sample size, or run configurations for each model.
Terminal-Bench-Science 0.1: Evaluates the ability to do scientific work in a terminal. The article says Astra scored 9 percentage points higher than GPT-6 Astra, at less than one-third of its task cost. A footnote says Artificial Analysis's reported result for Fable 5.2 used the mini-swe-agent execution framework, while Anthropic reports a score of 74.6% for Claude Code at the Max tier. These results use different execution configurations and should not be treated as a direct comparison in the same environment.
FrontierCode 2.0: Evaluates whether changes to real codebases meet maintainers' merge standards. Both Astra and Sol were set to Max; the article compares their scores and relative task costs.
Harvey LAB-AA v1.1: A legal task evaluation that tests whether a model can extract facts from source files, follow detailed requirements, and deliver accurate results. The article says the primary metric only counts a result when the deliverable meets all scoring criteria and contains no material hallucinations.
GDPval v2: An internal OpenAI benchmark covering real, long-horizon knowledge-work tasks in fields such as finance, data science, biotechnology, and marketing.
AA-AnalystAgent: Evaluates analytical work using real spreadsheets and reports. As an example, the article asks the model to calculate medical transportation spending from a California Medicaid spending report; it does not disclose the full prompt, tool configuration, or total sample size for this item.
Artificial Analysis AA-3D: Reviewers, unaware of the models' identities, experience two works generated from the same prompt and vote between them. The article reports Elo scores but not the sample size, prompt set, or confidence intervals.
API pricing: Standard prices are reported per million tokens. These are list prices, not a recalculation of the actual costs of benchmark tasks.
Beyond these disclosures, the article does not provide the full prompts, hardware, toolchains, number of runs, statistical uncertainty, or itemized cost calculation methods for the evaluations.
| Evaluation or comparison | Results published by OpenAI | Limitations stated in the article |
|---|---|---|
| Agents’ Last Exam | Astra scored 5.2 points higher than GPT-6 Astra at less than one-third of its task cost; it scored 5.5 points higher than Claude Fable 5.2 at about 5% of its cost. | Fable 5.2's leaderboard result excludes nine tasks that used a fallback model; full scores and run configurations are not published. |
| Terminal-Bench-Science 0.1 | Astra scored 9 percentage points higher than GPT-6 Astra at less than one-third of its task cost. | Fable 5.2's public result used a different execution environment; see the evaluation method for details. |
| FrontierCode 2.0 | The score gap between Astra and Sol was less than 0.5 points; Sol cost about one-fifth as much as Astra. | Both were set to Max; absolute scores, sample size, and pricing details are not published. |
| LifeVal | Sol scored higher than GPT-6 Astra at about one-seventh of its cost. | Scores, sample size, and run parameters are not published. |
| Harvey LAB-AA v1.1 | Astra's pass rate was more than twice Fable 5.2's, at about one-sixth of its cost; the Astra configuration for lawyers scored higher. | Absolute pass rates, sample size, configuration, and cost calculation details are not published. |
| GDPval v2 | Astra scored 6.2 percentage points higher than GPT-6 Astra and used 22% fewer output tokens; Sol scored 5.3 percentage points higher than GPT-6.1 Sol. | Internal benchmark; full scores, sample size, and costs are not published. |
| AA-AnalystAgent | On one California Medicaid spending analysis task, 62.5% of questions were answered correctly on all five independent attempts. | This is the result for a specific task described in the article, not an accuracy rate for the full benchmark. |
| AA-3D | Astra: 1,318 Elo; Claude Fable 5.2: 1,271; Sol: 1,259. | Sample size, prompt set, and statistical intervals are not published. |
The article lists GPT-6.2 Astra's standard API prices per million tokens as $8 for input, $0.40 for cached input, and $40 for output. OpenAI says the input and output unit prices are 20% lower than GPT-6 Astra's, and the cached input unit price is 60% lower. These are token unit-price comparisons. The article separately says that per-task costs fell on several benchmarks, but does not publish the full calculation, so the two should not be conflated.
The launch article says Astra scored 5.2 points higher than GPT-6 Astra and 5.5 points higher than Claude Fable 5.2 on Agents’ Last Exam; the relative task costs were less than one-third and about 5%, respectively.
The launch article says Astra scored 9 percentage points higher than GPT-6 Astra on Terminal-Bench-Science 0.1, at less than one-third of the cost. A footnote describes two execution environments for Fable 5.2 but does not give Astra's run parameters.
The launch article says Astra and Sol were both set to Max on FrontierCode 2.0, with a score gap of less than 0.5 points; Sol cost about one-fifth as much as Astra.
The launch article says Sol scored higher than GPT-6 Astra on LifeVal at about one-seventh of the cost; on Harvey LAB-AA v1.1, Astra's pass rate was more than twice Fable 5.2's, at about one-sixth of the cost.
The launch article says Astra scored 6.2 percentage points higher than GPT-6 Astra on GDPval v2 and used 22% fewer output tokens; Sol scored 5.3 percentage points higher than GPT-6.1 Sol.
The launch article reports that 62.5% of questions in one AA-AnalystAgent task were answered correctly on all five independent attempts; AA-3D Elo scores were 1,318 for Astra, 1,271 for Fable 5.2, and 1,259 for Sol.
Standard API prices per million tokens: $8 for input, $0.40 for cached input, and $40 for output. The launch article says Astra's input and output token unit prices are 20% lower than GPT-6 Astra's, and cached input is 60% lower.
The only conclusion these data support is that, under the configurations and pricing basis described by OpenAI, Astra achieved higher results or lower costs on several evaluations listed in the launch article. The article does not provide full methods and raw results for most tests, or the token counts, tool fees, or distribution across repeated runs used to calculate task costs. Comparisons with other vendors may also involve differences in harnesses, reasoning tiers, or benchmark subsets. Treat these figures as vendor-published comparisons, not independent validation or a general performance guarantee.
Collection date: 2026-11-19. The user-specified English URL was opened in Tabbit; the page redirected to the same OpenAI launch article in Chinese and displayed the full text. The page lists OpenAI as the author and shows the year as “2026,” but no specific publication date metadata was found, so the publication date is recorded as “Not specified.” The collection date is not the publication date. No benchmarks or API requests were run for this article, so the model scores and task costs cannot be independently recalculated.
GPT-6.2 Astra