At the time of capture, the SimpleBench MCQ leaderboard ranked GPT-6.2 Astra 15th, with an AVG@5 score of 77.3%; GPT-6.2 Astra Pro was listed separately in 14th place at 79.2%. This is a snapshot of a dynamic leaderboard. The page provides neither per-question records for these results nor the complete model run configuration.
Tasks this can help assess: Spatial, temporal, social knowledge, and language-trap reasoning in multiple-choice questions.
Tasks this should not be generalized to: Programming, factual retrieval, long-form writing, tool use, or overall ability across general tasks.
Applicable model version: The leaderboard label is GPT-6.2 Astra; GPT-6.2 Astra Pro is a separate entry.
Test environment or client: SimpleBench MCQ leaderboard; the underlying model API, snapshot ID, and evaluation harness are not specified.
Reasoning level and parameters: The leaderboard does not list an Astra-specific level. Its general settings show temperature 0.7 and top-p 0.95, except for the o1 series.
SimpleBench is a six-option text benchmark covering spatial reasoning, temporal reasoning, social intelligence, and adversarial language questions. The website says it has more than 200 questions. The linked 2024 technical report records 204 human-written questions in the original dataset and says each model was run five times, with the average score and MAJ@5 reported. The current leaderboard column is labeled Score (AVG@5). The website also notes that it attempts to use engineered prompts to optimize benchmark scores.
The five runs, 204 questions, and prompt-method description in that report refer to the 2024 evaluation. The website does not say whether the current GPT-6.2 Astra entry uses exactly the same question set, prompts, and sampling process, nor does it disclose this run's model snapshot, individual scores, or submission date. AVG@5 is therefore recorded using the leaderboard's label; the current run's individual evaluation details cannot be inferred from it.
| Leaderboard entry | Rank | AVG@5 | Difference from GPT-6.2 Astra |
|---|---|---|---|
| GPT-6.2 Astra Pro | 14 | 79.2% | +1.9 percentage points |
| GPT-6.2 Astra | 15 | 77.3% | — |
| GPT-6 Astra Pro | 6 | 86.5% | Same Pro label; previous-generation entry is +9.2 percentage points |
| GPT-6 Astra | 7 | 83.6% | Previous-generation non-Pro entry is +6.3 percentage points |
| GPT-6.1 Sol | 8 | 82.9% | A different model entry; not treated as an Astra predecessor |
The leaderboard lists GPT-6.2 Astra and Astra Pro on separate rows; the Pro score should not be attributed to standard Astra. Compared with the leaderboard score for the previous-generation GPT-6 Astra, the current Astra entry is lower by 6.3 percentage points. This difference describes only the scores shown on the page and does not establish a decline in model capability, since the page provides no version snapshots or details about whether the runs were consistent.
Current leaderboard mode: MCQ; score column: Score (AVG@5).
GPT-6.2 Astra: 15th NEW, 77.3%, OpenAI.
GPT-6.2 Astra Pro: 14th NEW, 79.2%, OpenAI.
GPT-6 Astra: 7th, 83.6%; GPT-6 Astra Pro: 6th, 86.5%.
Page settings: temperature 0.7, top-p 0.95 (except for the o1 series); the page says it uses engineered prompts to optimize benchmark scores.
The page overview says the benchmark has more than 200 questions; the 2024 technical report says the original set had 204 six-option questions, divided approximately into 40% spatial, 10% temporal, 25% social intelligence, and 25% adversarial language questions.
Technical report method: five independent runs per model, reporting AVG and MAJ@5. Under the report's definition, an answer is counted as correct for MAJ@5 if the correct answer appears in at least three of the five runs. The report's definition of MAJ@5 is not the same as the AVG@5 displayed on the current leaderboard.
The 77.3% is a leaderboard score on a specific SimpleBench multiple-choice question set, not the model's overall accuracy or IQ. The leaderboard changes over time; this article records only the snapshot visible on 2026-11-19. The public page does not disclose question-level answers, the five individual run scores, model snapshot, actual prompts, failed samples, or confidence intervals for the GPT-6.2 entry. The older technical report can explain the benchmark's original design but cannot fill in these gaps.
On 2026-11-19, SimpleBench was opened through Tabbit at SimpleBench, and its MCQ leaderboard and expanded benchmark settings were reviewed. The linked SimpleBench technical report was also opened to check the original question set and methods. No model calls were made and no questions were rerun for this article.
GPT-6.2 Astra