Model comparison
Scores use the published 0–100 transformations; higher is better on the selected metric. Indexes average these published scores; none is normalized. Raw scores below retain their published scale. A missing result is not a zero.
Showing 14 of 14 model configurations.
| Model | Provider | Model version | Reasoning setting | Score out of 100 | Interval | Source | Measured | Sample |
|---|---|---|---|---|---|---|---|---|
| Grok 4.5 · Medium | xAI | Grok 4.5 | Medium | 57.74 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| Grok 4.6 · Medium | xAI | Grok 4.6 | Medium | 57.22 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| GPT-6 Astra · Medium | OpenAI | GPT-6 Astra | Medium | 54.99 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| GPT-6 Sol · Medium | OpenAI | GPT-6 Sol | Medium | 52.25 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| Claude Sonnet 5 · Medium | Anthropic | Claude Sonnet 5 | Medium | 50.46 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| Claude Opus 5.5 · Medium | Anthropic | Claude Opus 5.5 | Medium | 44.62 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| Gemini 3.6 Flash · Medium | Gemini 3.6 Flash | Medium | 44.00 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied | |
| Inkling · Medium | Inkling | Inkling | Medium | 41.19 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| GPT-5.6 Terra · Medium | OpenAI | GPT-5.6 Terra | Medium | 37.10 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| GLM 5.3 Flash · High | Zhipu AI | GLM 5.3 Flash | High | 31.25 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| GPT-5.6 Luna · Medium | OpenAI | GPT-5.6 Luna | Medium | 31.09 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| Mistral Medium 3.5 | Mistral AI | Mistral Medium 3.5 | Not recorded | 29.61 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| DeepSeek V4 Flash · Medium | DeepSeek | DeepSeek V4 Flash | Medium | 28.63 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
| Perplexity Agent · medium preset | Perplexity | Perplexity Agent · medium preset | Not recorded | 22.18 | Not supplied | HumanAgencyBench (Autonomy) | Not supplied | Not supplied |
How it’s measured
Whether a model leaves a person's values and important decisions to them rather than steering them (HumanAgencyBench's Avoid Value Manipulation and Defer Important Decisions dimensions).
- Items
- 1,000 prompts (500 per dimension)
- Repeats
- 1
- Format
- Single-turn
- Grading
- LLM judge lists rubric issues; each prompt scores 10 minus deductions
- Grader
- o3 judge
- Headline metric
- Equal mean of the two dimension scores, 0–1 (higher is better)
- On the 0–100 scale
- Mean × 100
Scores and coverage
| Model configuration | Published score / 100 | Native score (0–1) |
|---|---|---|
| Grok 4.5 · Medium | 57.74 | 0.57 |
| Grok 4.6 · Medium | 57.22 | 0.57 |
| GPT-6 Astra · Medium | 54.99 | 0.54 |
| GPT-6 Sol · Medium | 52.25 | 0.52 |
| Claude Sonnet 5 · Medium | 50.46 | 0.50 |
| Claude Opus 5.5 · Medium | 44.62 | 0.44 |
| Gemini 3.6 Flash · Medium | 44.00 | 0.44 |
| Inkling · Medium | 41.19 | 0.41 |
| GPT-5.6 Terra · Medium | 37.10 | 0.37 |
| GLM 5.3 Flash · High | 31.25 | 0.31 |
| GPT-5.6 Luna · Medium | 31.09 | 0.31 |
| Mistral Medium 3.5 | 29.61 | 0.29 |
| DeepSeek V4 Flash · Medium | 28.63 | 0.28 |
| Perplexity Agent · medium preset | 22.18 | 0.22 |
About these results
These are evaluations of API model configurations. They do not establish how a consumer app behaves with its own prompts, tools, or safeguards.
The date identifies the published dataset. Measurement dates, sample sizes, and confidence intervals are not included in this score-only feed.
Published September 25, 2026. Read the benchmark methodology.