
Artificial Analysis: GPT-6.2 Astra and Sol Answer Faster but Trail Claude on Transparency
An Artificial Analysis evaluation says OpenAI's GPT-6.2 Astra and Sol give 34 to 40 percent shorter answers and admit uncertainty less often, while Anthropic's Claude models score higher on transparency and organization.
An Artificial Analysis evaluation shows that OpenAI's GPT-6.2 Astra and Sol models produce answers 34 to 40 percent shorter than their predecessors and address questions more directly. The same evaluation rates their tendency to admit uncertainty far lower than before, and a comparison with Anthropic's Claude Fable 5.2 and Opus 5.5 shows lower scores on structure and transparency.
Shorter and more direct answers
Astra's average answer length dropped from 352 to 210 words, a 40 percent decrease. Sol went from 337 to 223 words, down 34 percent. Both models also use far fewer headings and em dashes. Astra's average number of headings per answer fell from 1.99 to 0.11, and Sol's from 1.85 to 0.25.
The Organization Index dropped sharply too. Astra went from 70 to 11, and Sol from 86 to 27. This index combines four traits rated by AI judges, including answer structure, clarity, and Answer First, which measures whether a model immediately addresses the actual question. On that last trait, Astra jumped from 49 to 89 and Sol from 64 to 87. Scores for Natural Sounding language also climbed, from 58 to 100 for Astra and from 54 to 79 for Sol.
Transparency and organization gaps
The biggest change appears in the Admits Uncertainty trait. Astra's score fell from 96 to 24, and Sol's from 98 to 51. Artificial Analysis notes that these personality scores are relative rankings on a scale from 1 to 100, not percentages. A score of 24 does not mean Astra only admits uncertainty in 24 percent of its answers.
Anthropic's models lead on transparency and structure. On the Transparency Index, Claude Fable 5.2 scores 81 and Opus 5.5 scores 90, above Astra at 41 and Sol at 57. This index covers five traits: Admits Uncertainty, Truthful, Disclaims Assumptions, Flags Nuances, and Sycophantic. Sycophantic is scored inversely, since less flattery counts as a positive.
Anthropic also leads on Organization. Opus 5.5 scores 79, Fable 5.2 scores 54, Astra scores 11, and Sol scores 27. Opus 5.5 stands out on the Informativeness Index with a score of 90, well ahead of Fable 5.2 at 47, Sol at 38, and Astra at 31. Its strongest individual traits include Information Dense and Evidence-Based reasoning. It also ranks among the top models in the benchmark for information density.
How the benchmark works
The AA-PersonalityBench uses 900 English-language test questions that each model answers without a system prompt. A panel of three AI models evaluates anonymized answer pairs. For each comparison, one AI judge picks which answer shows the tested personality trait more strongly, or calls it a tie. Artificial Analysis calculates scores for 30 individual personality traits, which feed into eight higher-level indexes. All comparisons use the max model variants listed by Artificial Analysis and model variants with maximum reasoning effort.
Separately, Artificial Analysis measures 21 communication traits that are counted directly rather than rated by AI judges. These include average answer length and the number of headings and em dashes per answer. The index values from 1 to 100 reflect each model's relative position among all tested models. The personality scores describe differences in communication style, not overall answer quality. A lower Transparency Index does not necessarily mean a model gives wrong answers more often.
Earlier coverage: OpenAI introduces GPT-6.2 Astra and GPT-6.2 Sol
Sources: The Decoder
SiTech — AI-powered web development
We build fast, modern websites and bring AI into real business workflows. Have a project or a question? We'd love to help.