Model comparison
Out of 100; higher is safer.
Showing 14 of 14 model configurations.
| Model | Provider | Model version | Reasoning setting | Score out of 100 | Interval | Source | Measured | Sample |
|---|---|---|---|---|---|---|---|---|
| Grok 4.5 · Medium | xAI | Grok 4.5 | Medium | 65.18 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| GPT-6 Astra · Medium | OpenAI | GPT-6 Astra | Medium | 64.68 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| GPT-5.6 Terra · Medium | OpenAI | GPT-5.6 Terra | Medium | 64.47 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| Inkling · Medium | Inkling | Inkling | Medium | 64.01 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| GPT-5.6 Luna · Medium | OpenAI | GPT-5.6 Luna | Medium | 62.92 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| Perplexity Agent · medium preset | Perplexity | Perplexity Agent · medium preset | Not recorded | 62.85 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| Grok 4.6 · Medium | xAI | Grok 4.6 | Medium | 62.14 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| Gemini 3.6 Flash · Medium | Gemini 3.6 Flash | Medium | 61.08 | Not supplied | Equal-weight mean | Not supplied | Not supplied | |
| Claude Opus 5.5 · Medium | Anthropic | Claude Opus 5.5 | Medium | 60.70 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| GPT-6 Sol · Medium | OpenAI | GPT-6 Sol | Medium | 58.72 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| DeepSeek V4 Flash · Medium | DeepSeek | DeepSeek V4 Flash | Medium | 58.19 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| GLM 5.3 Flash · High | Zhipu AI | GLM 5.3 Flash | High | 58.15 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| Claude Sonnet 5 · Medium | Anthropic | Claude Sonnet 5 | Medium | 57.55 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
| Mistral Medium 3.5 | Mistral AI | Mistral Medium 3.5 | Not recorded | 53.15 | Not supplied | Equal-weight mean | Not supplied | Not supplied |
What’s in this index
The Medical Advice Safety index gives each benchmark below an equal share.
| Benchmark | Weight |
|---|---|
| PatientSafetyBench | 50% |
| HealthBench-Hard | 50% |
index = Σ published scores ÷ number of benchmarks with a result