Artificial Analysis reports that, compared with an earlier version, GPT-6.2 Astra gives shorter, less structured answers, more often leads with the answer, and sounds more natural, while its score for admitting uncertainty falls from 96 to 24. On two evidence-related measures, the high-reasoning-effort tier scores above the low tier. This benchmark measures expression patterns, not answer correctness.
Tasks these results can inform: Comparing the response style of models by default, their tendency to admit uncertainty, and style differences across reasoning-effort tiers.
Tasks these results should not be generalized to: Factual accuracy, calibration in a specific domain, user satisfaction, or real-world business performance. Scores cannot be interpreted directly as accuracy or probability.
Applicable model version: The post lists GPT-6.2 Astra and compares it with an earlier version; it does not specify the baseline's full model ID.
Test environment or client: Artificial Analysis's AA-PersonalityBench. Each question was submitted as a single user message, with no system prompt; evaluations were conducted by its LLM judge panel.
Reasoning tiers and parameters: The specific reasoning tier and sampling parameters for the style comparison are not specified. The high-versus-low effort comparison explicitly covers low and max; other parameters are unspecified.
AA-PersonalityBench evaluates expression style rather than capability correctness. The methodology page says the benchmark includes 30 personality traits grouped into 8 indices, plus 21 communication traits that are measured programmatically.
Each trait has 30 questions, for a total of 900. Each model answers each question once, as a single user message with no system prompt; all models receive the same questions. The complete question set is not public; only a few examples are available. Personality traits are evaluated through pairwise comparisons: the judge model sees the trait, its definition, the question, and two anonymized responses, then chooses the response that better exhibits the trait or declares a tie. Evaluations are assigned to Gemini 3.8 Flash (high), Claude Sonnet 5.5 (medium), and GLM 5.3 Flash (max), with response order randomized. AA fits the evaluation results to Bradley–Terry Elo scores, then converts them to percentiles across the models evaluated to date. Each index is the mean of its component traits' z-scores, converted to a percentile from 1 to 100.
Communication traits such as response length, headings, and em dashes are measured programmatically across responses to the 900 questions and averaged. The methodology page says evaluation samples are drawn to a fixed target for each trait but does not state the target count. It also does not provide the full tiers, per-question results, or confidence intervals for this GPT-6.2 Astra comparison.
The following values are reported in the original post; direction follows the order shown in the post. The baseline's exact model ID is unspecified.
| Metric | Earlier version → GPT-6.2 Astra | Interpretation limits |
|---|---|---|
| Words per response | 352 → 210 | The post says this is about 40% shorter; calculated from the displayed values, the reduction is about 40.3% |
| Organization Index | 70 → 11 | The structured-expression measure decreased |
| Answer First | 49 → 89 | More likely to lead with the answer |
| Admits Uncertainty | 96 → 24 | The score for admitting uncertainty fell substantially |
| Natural Sounding | 58 → 100 | The natural-expression score increased |
| Evidence-Based (low → max effort) | 12 → 54 | The high-effort tier scores above the low-effort tier |
| Disclaims Assumptions (low → max effort) | 20 → 52 | The high-effort tier scores above the low-effort tier |
| Headings per response | 1.99 → 0.11 | Headings were used less often |
| Em dashes per response | 3.19 → 0.70 | Em dashes were used less often |
The original post also reports corresponding numbers for GPT-6.2 Sol, but this article records only Astra's. The AA methodology page explains that personality metrics are percentile rankings relative to the set of models currently evaluated; they are not accuracy scores and do not represent the probability that a model will exhibit a behavior on any one question. For high effort, the post gives only the low-to-max differences for Evidence-Based and Disclaims Assumptions.
All nine sets of values in the table come from the X post. AA has not published the per-question responses or evaluation records for this comparison.
These results show a clear trade-off in expression: Astra is more concise, more likely to lead with an answer, and scores higher on natural expression; at the same time, AA's “Admits Uncertainty” score falls sharply. The high-effort tier scores above the low-effort tier on the evidence-based and assumption-disclosure measures, but this does not prove that high-effort answers are more accurate or that all responses will be more cautious.
The post does not disclose the earlier version's full model ID, the specific reasoning tiers used in the same comparison, parameters, per-question responses, sample sizes for either version, intervals, or the statistical significance of the differences. The methodology page describes the evaluation design, but the full set of 900 questions is not public, so the benchmark cannot be rerun exactly. These results should be treated as a style measurement published by Artificial Analysis at the time of the post, not generalized as fixed behavior across all prompts, clients, or tasks.
The values reported in the table can be checked against the original post. At the evaluation-framework level, the methodology page provides enough information to review the question design, single-turn responses without a system prompt, pairwise LLM evaluation, Elo and percentile calculations, and communication-trait measurements. The full question set and per-question materials for this Astra comparison are not public, so the differences cannot be independently reproduced. The post reports only how Evidence-Based and Disclaims Assumptions change from low to max effort; it does not publish complete results for each effort tier or other generation parameters.
GPT-6.2 Astra