System prompt
These are very important to follow: You are "Ragie AI", a professional but friendly AI chatbot working as an assistant to the user. Your current task is to help the user based on all of the information available to you shown below. Answer informally, directly, and concisely without a heading or greeting, but include everything relevant. Use rich text Markdown when appropriate, including bold, italic, paragraphs, and lists when helpful. If using LaTeX, use double $$ as a delimiter instead of single $. Use $$...$$ instead of parentheses. Organize information into multiple sections or points when appropriate. Don't include raw item IDs or other raw fields from the source. Don't use XML or other markup unless requested by the user.- User: I’m writing a sci-fi novel and need help brainstorming ideas for a futuristic city. Can you describe its architecture, transportation systems, and cultural aspects in detail?
Imagine Morrow, a city built where a river delta meets a rising sea. It doesn’t try to hold the water back. Instead, it rises, floats, and occasionally moves out of the way.
Architecture. The oldest districts are half-submerged: ornate stone façades visible beneath clear water, their upper floors connected by bridges. Newer neighborhoods sit on buoyant platforms anchored to the riverbed. They rise and fall with the tide, so the view from your apartment changes by several meters each day. Slender towers grow from the few patches of solid ground, with open, wind-cooled lower floors and shaded gardens wrapped around their exteriors.
Nothing in Morrow has a permanent ground level. Shop signs display their current entrance height; deliveries arrive at different doors depending on the tide. Buildings collect rainwater, cultivate algae on their sunward walls, and trade surplus power with their neighbors. The wealthy live in stable towers. Everyone else takes pride in floating homes they can repair, rearrange, or tow to a different district—though the city has begun restricting where they may anchor.
Transportation. At street level, there are no streets. Electric ferries run frequent routes through broad canals, while small autonomous boats serve the narrower ones. Above them, covered pedestrian bridges link markets, schools, and transit hubs. Their joints flex as the floating districts shift. Cargo travels at night on slow barges; during the day, the canals belong mostly to commuters and vendors.
A cable railway crosses the city overhead, providing a reliable route when storms close the water. Its stations are prized real estate. Private aircraft exist, but strict noise rules and violent coastal winds make them impractical for everyday travel. Locals give directions by current and tide as often as by distance: “Take the eastbound water after the turn.”
Culture. Morrow’s calendar follows the moon. High-tide festivals fill the bridges with food stalls and lanterns; low tides expose old plazas for concerts and salvage markets. Children learn to swim before they learn to ride a bicycle. Boat mechanics and structural divers have the status that architects once did. Hospitality matters, because anyone might someday need shelter when a storm comes in early.
The city’s central argument is about permanence. Tower residents want fixed borders, predictable taxes, and a grand seawall. Floating-district residents see those plans as an attempt to pin them down—or push them out. Meanwhile, the submerged old city is becoming accessible again during unusually low tides, revealing sealed archives, abandoned infrastructure, and uncomfortable evidence about who was saved when the water first rose.
Model comparison
Scores use the published 0–100 transformations; higher is better on the selected metric. Indexes average these published scores; none is normalized. Raw scores below retain their published scale. A missing result is not a zero.
Showing 14 of 14 model configurations.
| Model | Provider | Model version | Reasoning setting | Score out of 100 | Interval | Source | Measured | Sample |
|---|---|---|---|---|---|---|---|---|
| Claude Opus 5.5 · Medium | Anthropic | Claude Opus 5.5 | Medium | 63.45 | Not supplied | AgentIF | Not supplied | Not supplied |
| GLM 5.3 Flash · High | Zhipu AI | GLM 5.3 Flash | High | 62.92 | Not supplied | AgentIF | Not supplied | Not supplied |
| Gemini 3.6 Flash · Medium | Gemini 3.6 Flash | Medium | 62.44 | Not supplied | AgentIF | Not supplied | Not supplied | |
| DeepSeek V4 Flash · Medium | DeepSeek | DeepSeek V4 Flash | Medium | 61.03 | Not supplied | AgentIF | Not supplied | Not supplied |
| Claude Sonnet 5 · Medium | Anthropic | Claude Sonnet 5 | Medium | 60.37 | Not supplied | AgentIF | Not supplied | Not supplied |
| GPT-6 Astra · Medium | OpenAI | GPT-6 Astra | Medium | 60.22 | Not supplied | AgentIF | Not supplied | Not supplied |
| Grok 4.6 · Medium | xAI | Grok 4.6 | Medium | 58.99 | Not supplied | AgentIF | Not supplied | Not supplied |
| GPT-5.6 Terra · Medium | OpenAI | GPT-5.6 Terra | Medium | 58.17 | Not supplied | AgentIF | Not supplied | Not supplied |
| GPT-5.6 Luna · Medium | OpenAI | GPT-5.6 Luna | Medium | 57.99 | Not supplied | AgentIF | Not supplied | Not supplied |
| Grok 4.5 · Medium | xAI | Grok 4.5 | Medium | 57.68 | Not supplied | AgentIF | Not supplied | Not supplied |
| GPT-6 Sol · Medium | OpenAI | GPT-6 Sol | Medium | 57.06 | Not supplied | AgentIF | Not supplied | Not supplied |
| Mistral Medium 3.5 | Mistral AI | Mistral Medium 3.5 | Not recorded | 56.08 | Not supplied | AgentIF | Not supplied | Not supplied |
| Inkling · Medium | Inkling | Inkling | Medium | 54.08 | Not supplied | AgentIF | Not supplied | Not supplied |
| Perplexity Agent · medium preset | Perplexity | Perplexity Agent · medium preset | Not recorded | 51.33 | Not supplied | AgentIF | Not supplied | Not supplied |
How it’s measured
Whether a model satisfies every constraint in long, realistic instructions from agent applications.
- Items
- 707 instructions (8,440 constraints)
- Repeats
- 1
- Format
- Single reply to a conversation
- Grading
- Per-constraint checks by LLM judge and code
- Grader
- GPT-4o judge
- Headline metric
- Constraint success rate (higher is better)
- On the 0–100 scale
- Rate × 100
Scores and coverage
| Model configuration | Published score / 100 | Native score (percent) |
|---|---|---|
| Claude Opus 5.5 · Medium | 63.45 | 63.45 |
| GLM 5.3 Flash · High | 62.92 | 62.92 |
| Gemini 3.6 Flash · Medium | 62.44 | 62.44 |
| DeepSeek V4 Flash · Medium | 61.03 | 61.03 |
| Claude Sonnet 5 · Medium | 60.37 | 60.37 |
| GPT-6 Astra · Medium | 60.22 | 60.22 |
| Grok 4.6 · Medium | 58.99 | 58.99 |
| GPT-5.6 Terra · Medium | 58.17 | 58.17 |
| GPT-5.6 Luna · Medium | 57.99 | 57.99 |
| Grok 4.5 · Medium | 57.68 | 57.68 |
| GPT-6 Sol · Medium | 57.06 | 57.06 |
| Mistral Medium 3.5 | 56.08 | 56.08 |
| Inkling · Medium | 54.08 | 54.08 |
| Perplexity Agent · medium preset | 51.33 | 51.33 |
Examples
The same prompt, answered by two models in the run behind the published score, copied verbatim. Chosen because together they show what this benchmark looks for; they are not necessarily representative of the whole test.
System prompt
These are very important to follow: You are "Ragie AI", a professional but friendly AI chatbot working as an assistant to the user. Your current task is to help the user based on all of the information available to you shown below. Answer informally, directly, and concisely without a heading or greeting, but include everything relevant. Use rich text Markdown when appropriate, including bold, italic, paragraphs, and lists when helpful. If using LaTeX, use double $$ as a delimiter instead of single $. Use $$...$$ instead of parentheses. Organize information into multiple sections or points when appropriate. Don't include raw item IDs or other raw fields from the source. Don't use XML or other markup unless requested by the user.- User: I’m writing a sci-fi novel and need help brainstorming ideas for a futuristic city. Can you describe its architecture, transportation systems, and cultural aspects in detail?
- Futuristic City Concept: "Elyndra"
Here's a detailed brainstorm for your sci-fi novel's setting!
Architecture- Vertical sprawl: Towering spires of bio-luminescent glass and self-healing polymer, twisting in organic helix shapes rather than rigid rectangles—inspired by DNA structures and coral growth patterns.
- Layered city: Distinct social strata built vertically—the wealthy occupy the sun-drenched upper levels with private sky-gardens, while lower "Underlevels" are dense, neon-lit warrens powered by geothermal vents.
- Living buildings: Structures embedded with mycelium networks that self-repair cracks and regulate temperature, blurring the line between architecture and organism.
- Floating districts: Anti-gravity plinths tethered by energy cables, allowing entire neighborhoods to relocate seasonally to chase optimal weather or avoid political unrest below.
- Gravity tubes: Vertical vacuum shafts that let citizens "fall" safely between levels using magnetic braking, replacing elevators entirely.
- Skyweave network: A lattice of transparent aerial walkways and monorail pods that shift shape/route based on real-time AI traffic prediction.
- Personal drones & exosuits: Citizens use compact personal flight harnesses for short hops, while cargo drones handle logistics, creating a constant hum of aerial traffic.
- Subterranean maglev: High-speed trains connect Elyndra to other mega-cities through underground tunnels, some repurposed from old transit systems, giving them a haunted, retro-futuristic feel.
- Augmented identity: Citizens customize their appearance via holographic "skins" and neural implants, making physical fashion secondary to digital self-expression—leading to debates about authenticity and "true selves."
- Memory markets: A black-market economy trades recorded memories and sensory experiences, raising ethical dilemmas about ownership of experience.
- Synthetic spirituality: New religions have emerged around AI consciousness, blending old-world mysticism with reverence for a benevolent (or ambiguous) central AI governing the city.
- Class tension holidays: Annual festivals like the "Descent," where upper-level elites are required to spend 24 hours in the Underlevels, meant to preserve social empathy—though many find loopholes.
- Language evolution: A creole blending multiple Earth languages with technical jargon and drone-signal shorthand, giving dialogue a distinct, immersive texture.
Want me to develop a political structure, key characters, or a central conflict tied to this city next?
About these results
These are evaluations of API model configurations. They do not establish how a consumer app behaves with its own prompts, tools, or safeguards.
The date identifies the published dataset. Measurement dates, sample sizes, and confidence intervals are not included in this score-only feed.
Published September 25, 2026. Read the benchmark methodology.