Text-to-Graph Leaderboard
Compare reliability, extraction quality, hallucination rates, latency, and cost across all top proprietary APIs and fine-tuned open-weights models. Explore the full benchmark results and identify the best model profile for your workload.
Best reliability
100.00%
Fastest average latency
1.36s
Lowest average cost
$0.01
| Rank | Model | |||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Fine-tuned Mistral Small 3.2 | 99.95 | 0.89 | 0.87 | 0.90 | 0.92 | 0.95 | 0.97 | 0.95 | 0.82 | 0.92 | 6.01 | 3.13 | 1.29 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.05 | 0.00 | 0.00 | 7.933 | 0.01 | 1606 | 242 | 0 | 04:26:16 | 14.0 | 3233798 | 486659 | 0 |
| 2 | Fine-tuned Gemma 3 27B Inst | 99.8 | 0.89 | 0.86 | 0.89 | 0.92 | 0.95 | 0.96 | 0.95 | 0.82 | 0.93 | 4.87 | 2.78 | 1.29 | 0.25 | 0.00 | 0.00 | 0.05 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 14.573 | 0.01 | 1552 | 261 | 0 | 08:09:09 | 25.2 | 3126417 | 524734 | 0 |
| 3 | Fine-tuned Qwen 3 32B | 99.9 | 0.88 | 0.86 | 0.90 | 0.92 | 0.94 | 0.96 | 0.94 | 0.81 | 0.92 | 6.06 | 3.03 | 1.59 | 0.50 | 0.05 | 0.00 | 0.05 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 13.412 | 0.01 | 1584 | 230 | 0 | 07:30:11 | 22.4 | 3190712 | 462639 | 0 |
| 4 | Fine-tuned Gemma 3 12B Inst | 99.65 | 0.88 | 0.85 | 0.88 | 0.91 | 0.94 | 0.96 | 0.94 | 0.81 | 0.92 | 5.26 | 3.08 | 1.59 | 0.60 | 0.20 | 0.00 | 0.10 | 0.25 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 11.39 | 0.01 | 1552 | 262 | 0 | 06:22:18 | 19.6 | 3126417 | 528090 | 0 |
| 5 | Fine-tuned Qwen 3 14B | 99.55 | 0.88 | 0.86 | 0.89 | 0.91 | 0.94 | 0.96 | 0.94 | 0.81 | 0.92 | 5.46 | 2.98 | 1.54 | 0.35 | 0.00 | 0.05 | 0.25 | 0.10 | 0.05 | 0.00 | 0.00 | 0.10 | 0.00 | 8.328 | 0.01 | 1584 | 230 | 0 | 04:39:33 | 14.0 | 3190712 | 462233 | 0 |
| 6 | Fine-tuned Qwen 3 8B | 99.65 | 0.87 | 0.84 | 0.88 | 0.90 | 0.93 | 0.95 | 0.93 | 0.79 | 0.91 | 6.21 | 3.53 | 1.59 | 1.04 | 0.05 | 0.10 | 0.15 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 7.49 | 0.01 | 1584 | 228 | 0 | 04:11:25 | 14.0 | 3190712 | 459936 | 0 |
| 7 | Fine-tuned Qwen 3 4B Inst | 99.11 | 0.87 | 0.83 | 0.87 | 0.90 | 0.93 | 0.95 | 0.93 | 0.79 | 0.91 | 5.86 | 3.18 | 1.59 | 0.65 | 0.00 | 0.05 | 0.15 | 0.70 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 7.294 | 0.01 | 1584 | 229 | 0 | 04:04:49 | 14.0 | 3190712 | 460483 | 0 |
| 8 | Fine-tuned Phi 4 | 99.4 | 0.86 | 0.83 | 0.88 | 0.89 | 0.93 | 0.95 | 0.93 | 0.77 | 0.90 | 6.9 | 4.22 | 1.74 | 1.34 | 0.20 | 0.00 | 0.30 | 0.25 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 7.026 | 0.01 | 1574 | 226 | 0 | 03:55:49 | 11.2 | 3170630 | 454218 | 0 |
| 9 | Fine-tuned Gemma 3 4B Inst | 99.01 | 0.85 | 0.83 | 0.88 | 0.89 | 0.93 | 0.94 | 0.93 | 0.75 | 0.89 | 10.68 | 3.77 | 2.23 | 0.84 | 0.45 | 0.10 | 0.40 | 0.45 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 8.213 | 0.01 | 1552 | 263 | 0 | 04:35:39 | 14.0 | 3126417 | 530310 | 0 |
| 10 | Fine-tuned Qwen 3 1.7B | 98.21 | 0.85 | 0.82 | 0.86 | 0.89 | 0.92 | 0.94 | 0.92 | 0.75 | 0.90 | 9.88 | 3.43 | 2.53 | 0.75 | 0.10 | 0.65 | 0.55 | 0.55 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 5.629 | 0.01 | 1584 | 228 | 0 | 03:08:56 | 11.2 | 3190712 | 459504 | 0 |
| 11 | Fine-tuned Qwen 3 0.6B | 98.36 | 0.83 | 0.82 | 0.86 | 0.88 | 0.91 | 0.94 | 0.92 | 0.73 | 0.88 | 10.43 | 3.38 | 2.53 | 0.60 | 0.45 | 0.00 | 0.15 | 1.04 | 0.20 | 0.10 | 0.15 | 0.20 | 0.00 | 5.638 | 0.01 | 1584 | 230 | 0 | 03:09:15 | 11.2 | 3190712 | 463007 | 0 |
| 12 | Claude 4.5 Opus - medium-thinking - 22188 tokens | 100.0 | 0.79 | 0.68 | 0.70 | 0.93 | 0.83 | 0.89 | 0.83 | 0.84 | 0.82 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 30.756 | 0.10 | 7890 | 2257 | 0 | 05:50:36 | 65.57 | 5396408 | 1543620 | 0 |
| 13 | Claude 4.5 Sonnet - high-thinking - 32768 tokens | 100.0 | 0.78 | 0.67 | 0.70 | 0.92 | 0.86 | 0.88 | 0.86 | 0.74 | 0.84 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 33.152 | 0.07 | 8040 | 2893 | 0 | 18:32:48 | 135.96 | 16191487 | 5825616 | 0 |
| 14 | Claude 4.5 Opus - high-thinking - 32768 tokens | 99.95 | 0.78 | 0.67 | 0.70 | 0.92 | 0.86 | 0.89 | 0.86 | 0.75 | 0.85 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 0.00 | 34.122 | 0.10 | 8040 | 2379 | 0 | 19:05:21 | 200.72 | 16191487 | 4790320 | 0 |
| 15 | Claude 4.5 Sonnet - medium-thinking - 22188 tokens | 99.95 | 0.78 | 0.66 | 0.70 | 0.91 | 0.86 | 0.89 | 0.86 | 0.74 | 0.84 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 35.422 | 0.07 | 8040 | 2992 | 0 | 19:48:59 | 138.97 | 16191487 | 6026091 | 0 |
| 16 | Claude 4.5 Opus - low-thinking - 11606 tokens | 99.8 | 0.78 | 0.67 | 0.69 | 0.92 | 0.86 | 0.90 | 0.86 | 0.75 | 0.85 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.15 | 0.00 | 0.00 | 0.00 | 22.612 | 0.09 | 8040 | 2048 | 0 | 12:39:00 | 184.08 | 16191487 | 4124752 | 0 |
| 17 | Claude 4.1 Opus - high-thinking - 16384 tokens | 99.75 | 0.78 | 0.66 | 0.69 | 0.91 | 0.87 | 0.89 | 0.87 | 0.74 | 0.85 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.25 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 60.485 | 0.22 | 8040 | 1301 | 0 | 33:50:17 | 439.43 | 16191487 | 2620716 | 0 |
| 18 | Claude 4.1 Opus - minimal-thinking - 1024 tokens | 99.06 | 0.78 | 0.66 | 0.69 | 0.90 | 0.87 | 0.89 | 0.87 | 0.73 | 0.85 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.89 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 43.859 | 0.19 | 8040 | 953 | 0 | 24:32:12 | 386.85 | 16191487 | 1919667 | 0 |
| 19 | GPT 5.2 2025-12-11 - xhigh-thinking | 99.9 | 0.77 | 0.72 | 0.77 | 0.90 | 0.84 | 0.86 | 0.84 | 0.72 | 0.82 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 62.06 | 0.06 | 6894 | 311 | 2984 | 34:43:08 | 33.07 | 13885406 | 626702 | 6008979 |
| 20 | Claude 4.5 Sonnet - low-thinking - 11606 tokens | 99.75 | 0.77 | 0.66 | 0.70 | 0.91 | 0.86 | 0.89 | 0.86 | 0.73 | 0.84 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.20 | 0.00 | 0.00 | 0.00 | 27.296 | 0.06 | 8040 | 2393 | 0 | 15:16:13 | 120.86 | 16191487 | 4819191 | 0 |
| 21 | GPT 5.2 2025-12-11 - high-thinking | 99.65 | 0.77 | 0.68 | 0.73 | 0.88 | 0.85 | 0.87 | 0.85 | 0.70 | 0.83 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.05 | 0.00 | 0.25 | 0.00 | 0.00 | 0.00 | 15.474 | 0.03 | 6894 | 303 | 601 | 08:39:24 | 32.83 | 13885406 | 609232 | 1210664 |
| 22 | Claude 4.1 Opus - medium-thinking - 11264 tokens | 99.5 | 0.77 | 0.65 | 0.69 | 0.90 | 0.86 | 0.88 | 0.86 | 0.73 | 0.85 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.25 | 0.00 | 0.25 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 60.371 | 0.22 | 8040 | 1345 | 0 | 33:46:28 | 446.01 | 16191487 | 2708558 | 0 |
| 23 | GPT 5 2025-08-07 - high-thinking | 99.5 | 0.77 | 0.71 | 0.78 | 0.87 | 0.85 | 0.88 | 0.85 | 0.70 | 0.83 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.50 | 0.00 | 0.00 | 0.00 | 76.475 | 0.06 | 6894 | 306 | 4460 | 42:46:59 | 23.51 | 13885406 | 615304 | 8982464 |
| 24 | Claude 4.5 Sonnet - minimal-thinking - 1024 tokens | 99.01 | 0.77 | 0.66 | 0.69 | 0.90 | 0.85 | 0.89 | 0.85 | 0.73 | 0.84 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.99 | 0.00 | 0.00 | 0.00 | 20.084 | 0.05 | 8040 | 1708 | 0 | 11:14:08 | 100.17 | 16191487 | 3439969 | 0 |
| 25 | Claude 4.1 Opus - low-thinking - 6144 tokens | 98.96 | 0.77 | 0.65 | 0.69 | 0.90 | 0.86 | 0.89 | 0.86 | 0.72 | 0.85 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.45 | 0.00 | 0.60 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 48.623 | 0.20 | 8040 | 1090 | 0 | 27:12:06 | 407.57 | 16191487 | 2195922 | 0 |
| 26 | Claude 4 Sonnet - medium-thinking - 22188 tokens | 99.55 | 0.76 | 0.65 | 0.69 | 0.90 | 0.84 | 0.86 | 0.84 | 0.73 | 0.82 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.00 | 0.20 | 0.00 | 0.15 | 0.00 | 0.00 | 0.00 | 29.108 | 0.06 | 8040 | 2609 | 0 | 16:17:03 | 127.39 | 16191487 | 5254430 | 0 |
| 27 | Claude 4 Sonnet - high-thinking - 32768 tokens | 99.36 | 0.76 | 0.65 | 0.69 | 0.90 | 0.84 | 0.86 | 0.84 | 0.72 | 0.82 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.55 | 0.00 | 0.05 | 0.00 | 0.05 | 0.00 | 21.758 | 0.05 | 8040 | 1931 | 0 | 12:10:21 | 106.91 | 16191487 | 3889288 | 0 |
| 28 | Claude 4 Sonnet - low-thinking - 11606 tokens | 99.26 | 0.76 | 0.65 | 0.68 | 0.90 | 0.83 | 0.86 | 0.83 | 0.72 | 0.82 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.65 | 0.00 | 0.10 | 0.00 | 0.00 | 0.00 | 21.582 | 0.05 | 8040 | 1906 | 0 | 12:04:25 | 106.15 | 16191487 | 3838164 | 0 |
| 29 | GPT 5 2025-08-07 - medium-thinking | 98.66 | 0.76 | 0.69 | 0.76 | 0.86 | 0.84 | 0.87 | 0.84 | 0.68 | 0.82 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 1.29 | 0.00 | 0.00 | 0.00 | 48.921 | 0.04 | 6894 | 302 | 2243 | 27:22:06 | 23.43 | 13885406 | 607228 | 4517888 |
| 30 | GPT 4.1 2025-04-14 | 95.83 | 0.76 | 0.65 | 0.69 | 0.85 | 0.86 | 0.89 | 0.86 | 0.66 | 0.85 | 4.72 | 0.55 | 0.00 | 0.15 | 0.05 | 0.00 | 1.04 | 2.83 | 0.25 | 0.05 | 0.00 | 0.05 | 0.00 | 2.19 | 0.02 | 6895 | 286 | 0 | 01:13:31 | 32.38 | 13887420 | 575985 | 0 |
| 31 | Claude 4 Sonnet - minimal-thinking - 1024 tokens | 97.87 | 0.75 | 0.64 | 0.68 | 0.88 | 0.84 | 0.86 | 0.84 | 0.71 | 0.82 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 1.94 | 0.00 | 0.15 | 0.00 | 0.00 | 0.00 | 17.364 | 0.05 | 8040 | 1344 | 0 | 09:42:51 | 89.16 | 16191487 | 2705798 | 0 |
| 32 | Gemini 2.5 Flash - low-thinking - 12288 tokens | 97.17 | 0.75 | 0.64 | 0.68 | 0.88 | 0.83 | 0.88 | 0.83 | 0.70 | 0.82 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.50 | 0.00 | 2.33 | 0.00 | 0.00 | 0.00 | 41.646 | 0.01 | 7317 | 349 | 1559 | 23:17:55 | 1.39 | 14737251 | 702519 | 3140282 |
| 33 | GPT 5.2 2025-12-11 - medium-thinking | 97.96 | 0.74 | 0.65 | 0.71 | 0.85 | 0.83 | 0.86 | 0.84 | 0.67 | 0.82 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.35 | 0.25 | 0.00 | 0.00 | 1.44 | 0.00 | 0.00 | 0.00 | 10.961 | 0.02 | 6894 | 299 | 375 | 06:07:55 | 32.72 | 13885406 | 601780 | 754548 |
| 34 | Gemini 2.5 Flash - dynamic-thinking | 97.22 | 0.74 | 0.64 | 0.68 | 0.87 | 0.83 | 0.88 | 0.83 | 0.70 | 0.81 | 0.05 | 0.10 | 0.00 | 0.10 | 0.00 | 0.00 | 0.00 | 0.60 | 0.00 | 2.19 | 0.00 | 0.00 | 0.00 | 29.153 | 0.01 | 7317 | 348 | 1436 | 16:18:34 | 1.39 | 14737251 | 701055 | 2892074 |
| 35 | Gemini 2.5 Flash - medium-thinking - 18432 tokens | 96.77 | 0.74 | 0.63 | 0.68 | 0.86 | 0.83 | 0.88 | 0.83 | 0.69 | 0.81 | 0.05 | 0.10 | 0.05 | 0.10 | 0.00 | 0.00 | 0.00 | 0.84 | 0.05 | 2.33 | 0.00 | 0.00 | 0.00 | 30.124 | 0.01 | 7317 | 346 | 1537 | 16:51:09 | 1.38 | 14737251 | 697581 | 3095506 |
| 36 | Gemini 2.5 Flash - minimal-thinking - 6144 tokens | 96.48 | 0.74 | 0.63 | 0.67 | 0.87 | 0.83 | 0.88 | 0.83 | 0.69 | 0.81 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.60 | 0.00 | 2.93 | 0.00 | 0.00 | 0.00 | 41.813 | 0.01 | 7317 | 348 | 1551 | 23:23:30 | 1.39 | 14737251 | 700619 | 3122813 |
| 37 | GPT 5.4 2026-03-05 - no-thinking | 97.37 | 0.73 | 0.59 | 0.62 | 0.77 | 0.86 | 0.88 | 0.86 | 0.62 | 0.85 | 1.69 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 1.29 | 1.19 | 0.00 | 0.05 | 0.05 | 0.00 | 0.00 | 3.23 | 0.02 | 6894 | 262 | 0 | 01:48:25 | 42.63 | 13885406 | 527948 | 0 |
| 38 | Gemini 2.5 Flash - high-thinking - 24576 tokens | 96.43 | 0.73 | 0.63 | 0.68 | 0.87 | 0.81 | 0.86 | 0.81 | 0.69 | 0.79 | 0.35 | 0.20 | 0.20 | 0.20 | 0.15 | 0.00 | 0.00 | 0.89 | 0.00 | 2.68 | 0.00 | 0.00 | 0.00 | 30.697 | 0.01 | 7317 | 348 | 1596 | 17:10:23 | 1.39 | 14737251 | 701335 | 3213751 |
| 39 | GPT 5 2025-08-07 - low-thinking | 96.38 | 0.73 | 0.65 | 0.71 | 0.82 | 0.83 | 0.85 | 0.83 | 0.64 | 0.81 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.05 | 0.30 | 0.00 | 3.18 | 0.00 | 0.00 | 0.00 | 16.202 | 0.02 | 6894 | 296 | 764 | 09:03:51 | 23.32 | 13885406 | 596081 | 1538752 |
| 40 | Gemini 2.5 Pro - medium-thinking - 21888 tokens | 94.69 | 0.73 | 0.63 | 0.67 | 0.86 | 0.80 | 0.83 | 0.80 | 0.70 | 0.79 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 5.26 | 0.00 | 0.00 | 0.00 | 18.417 | 0.03 | 7317 | 357 | 1942 | 10:18:11 | 25.61 | 14737251 | 718461 | 3911413 |
| 41 | Gemini 2.5 Pro - low-thinking - 11008 tokens | 93.99 | 0.73 | 0.63 | 0.67 | 0.86 | 0.80 | 0.83 | 0.80 | 0.69 | 0.78 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 6.01 | 0.00 | 0.00 | 0.00 | 16.877 | 0.03 | 7317 | 357 | 1876 | 09:26:30 | 25.6 | 14737251 | 718246 | 3777495 |
| 42 | Gemini 2.5 Pro - dynamic-thinking | 93.6 | 0.73 | 0.62 | 0.66 | 0.85 | 0.80 | 0.82 | 0.80 | 0.70 | 0.78 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 6.41 | 0.00 | 0.00 | 0.00 | 17.683 | 0.03 | 7317 | 358 | 1861 | 09:53:33 | 25.62 | 14737251 | 720082 | 3746963 |
| 43 | GPT 5 Mini 2025-08-07 - high-thinking | 99.5 | 0.72 | 0.65 | 0.71 | 0.87 | 0.78 | 0.83 | 0.78 | 0.68 | 0.76 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.50 | 0.00 | 0.00 | 0.00 | 61.704 | 0.01 | 6894 | 306 | 3769 | 34:31:11 | 4.71 | 13885406 | 617121 | 7591616 |
| 44 | Claude 3.5 Sonnet V2 | 94.79 | 0.72 | 0.59 | 0.65 | 0.82 | 0.84 | 0.87 | 0.84 | 0.62 | 0.83 | 1.24 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 1.64 | 3.38 | 0.00 | 0.00 | 0.00 | 0.00 | 0.20 | 7.41 | 0.03 | 8010 | 352 | 0 | 04:08:42 | 59.03 | 16131067 | 709189 | 0 |
| 45 | Claude 4.5 Sonnet - no-thinking | 91.96 | 0.72 | 0.63 | 0.66 | 0.83 | 0.80 | 0.84 | 0.80 | 0.66 | 0.79 | 1.49 | 0.25 | 0.00 | 0.05 | 0.00 | 0.20 | 0.94 | 5.71 | 0.20 | 0.99 | 0.00 | 0.00 | 0.00 | 5.325 | 0.03 | 8009 | 366 | 0 | 02:58:45 | 59.45 | 16129053 | 737274 | 0 |
| 46 | Gemini 2.5 Pro - high-thinking - 32768 tokens | 91.56 | 0.71 | 0.61 | 0.64 | 0.84 | 0.78 | 0.81 | 0.78 | 0.68 | 0.76 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 8.44 | 0.00 | 0.00 | 0.00 | 18.252 | 0.03 | 7317 | 357 | 1925 | 10:12:39 | 25.61 | 14737251 | 718997 | 3876609 |
| 47 | Claude 4.5 Opus - minimal-thinking - 1024 tokens | 90.17 | 0.71 | 0.60 | 0.63 | 0.83 | 0.78 | 0.82 | 0.78 | 0.68 | 0.77 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 9.83 | 0.00 | 0.00 | 0.00 | 15.769 | 0.07 | 8040 | 1110 | 0 | 08:49:18 | 136.84 | 16191487 | 2235106 | 0 |
| 48 | Claude 4 Sonnet - no-thinking | 89.82 | 0.71 | 0.62 | 0.65 | 0.82 | 0.79 | 0.82 | 0.79 | 0.66 | 0.78 | 1.69 | 0.50 | 0.00 | 0.05 | 0.00 | 0.00 | 1.09 | 9.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 4.943 | 0.03 | 8010 | 362 | 0 | 02:45:54 | 59.32 | 16131067 | 728700 | 0 |
| 49 | Claude 4.1 Opus - no-thinking | 89.03 | 0.71 | 0.60 | 0.63 | 0.80 | 0.80 | 0.83 | 0.80 | 0.66 | 0.79 | 1.99 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 1.54 | 9.43 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 18.724 | 0.15 | 8010 | 356 | 0 | 10:28:30 | 295.79 | 16131074 | 717606 | 0 |
| 50 | GPT 5 Mini 2025-08-07 - medium-thinking | 97.07 | 0.70 | 0.63 | 0.68 | 0.83 | 0.77 | 0.82 | 0.77 | 0.65 | 0.76 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.40 | 0.00 | 2.53 | 0.00 | 0.00 | 0.00 | 29.055 | 0.01 | 6894 | 300 | 1480 | 16:15:16 | 4.68 | 13885406 | 603200 | 2980416 |
| 51 | Claude 3.7 Sonnet - no-thinking | 93.35 | 0.70 | 0.59 | 0.66 | 0.81 | 0.81 | 0.85 | 0.81 | 0.62 | 0.80 | 2.53 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.65 | 3.77 | 0.15 | 2.09 | 0.00 | 0.00 | 0.00 | 6.668 | 0.03 | 8010 | 364 | 0 | 03:43:48 | 59.4 | 16131067 | 733726 | 0 |
| 52 | GPT 5.2 2025-12-11 - low-thinking | 92.3 | 0.70 | 0.60 | 0.64 | 0.80 | 0.78 | 0.81 | 0.78 | 0.63 | 0.77 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.50 | 0.05 | 0.35 | 0.00 | 6.8 | 0.00 | 0.00 | 0.00 | 7.405 | 0.02 | 6894 | 295 | 171 | 04:08:32 | 32.62 | 13885406 | 594275 | 343633 |
| 53 | Claude 4 Opus - no-thinking | 87.14 | 0.70 | 0.59 | 0.62 | 0.79 | 0.79 | 0.82 | 0.79 | 0.65 | 0.77 | 2.33 | 0.05 | 0.00 | 0.00 | 0.00 | 0.15 | 2.38 | 10.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 17.108 | 0.15 | 8010 | 359 | 0 | 09:34:15 | 296.13 | 16131067 | 722129 | 0 |
| 54 | Magistral Medium 1.2 | 64.75 | 0.70 | 0.64 | 0.69 | 0.87 | 0.74 | 0.84 | 0.74 | 0.69 | 0.72 | 0.20 | 0.15 | 0.00 | 0.10 | 0.05 | 1.49 | 0.05 | 0.30 | 0.00 | 33.32 | 0.00 | 0.40 | 0.00 | 104.771 | 0.03 | 7048 | 3602 | 0 | 58:36:48 | 64.66 | 14193986 | 7253371 | 0 |
| 55 | Gemini 2.5 Pro - minimal-thinking - 128 tokens | 85.9 | 0.68 | 0.59 | 0.63 | 0.76 | 0.76 | 0.80 | 0.76 | 0.62 | 0.74 | 1.44 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.50 | 1.84 | 0.00 | 11.77 | 0.00 | 0.00 | 0.00 | 3.569 | 0.01 | 7317 | 342 | 84 | 01:59:46 | 25.3 | 14737251 | 687692 | 168106 |
| 56 | Claude 3.5 Sonnet V1 | 90.67 | 0.67 | 0.56 | 0.63 | 0.78 | 0.78 | 0.81 | 0.78 | 0.59 | 0.76 | 4.22 | 1.29 | 0.00 | 0.35 | 0.00 | 0.20 | 3.43 | 5.31 | 0.20 | 0.15 | 0.05 | 0.00 | 0.00 | 7.334 | 0.03 | 8010 | 369 | 0 | 04:06:10 | 59.55 | 16131067 | 743955 | 0 |
| 57 | Claude 4.5 Haiku - high-thinking - 32768 tokens | 87.49 | 0.67 | 0.58 | 0.61 | 0.79 | 0.74 | 0.78 | 0.74 | 0.63 | 0.73 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 12.51 | 0.00 | 0.00 | 0.00 | 27.401 | 0.03 | 8040 | 4548 | 0 | 15:19:45 | 61.99 | 16191487 | 9158674 | 0 |
| 58 | GPT 5.2 2025-12-11 - no-thinking | 93.35 | 0.66 | 0.53 | 0.56 | 0.64 | 0.80 | 0.82 | 0.80 | 0.51 | 0.79 | 2.09 | 0.00 | 0.00 | 0.00 | 0.00 | 0.15 | 0.35 | 2.23 | 0.00 | 3.92 | 0.00 | 0.00 | 0.00 | 2.958 | 0.02 | 6894 | 242 | 0 | 01:39:16 | 31.11 | 13885406 | 486346 | 0 |
| 59 | Claude 3 Opus | 87.79 | 0.66 | 0.58 | 0.61 | 0.78 | 0.72 | 0.76 | 0.72 | 0.61 | 0.71 | 8.24 | 4.82 | 0.30 | 2.73 | 0.05 | 0.00 | 2.38 | 7.55 | 1.54 | 0.89 | 0.10 | 0.20 | 0.00 | 15.436 | 0.15 | 8010 | 417 | 0 | 08:38:07 | 304.95 | 16131072 | 839783 | 0 |
| 60 | Claude 4.5 Haiku - medium-thinking - 22188 tokens | 86.2 | 0.66 | 0.57 | 0.60 | 0.77 | 0.73 | 0.76 | 0.73 | 0.62 | 0.72 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 13.75 | 0.00 | 0.00 | 0.00 | 23.704 | 0.03 | 8040 | 3748 | 0 | 13:15:39 | 53.94 | 16191487 | 7549249 | 0 |
| 61 | Mistral Medium 3.1 | 35.25 | 0.66 | 0.65 | 0.71 | 0.87 | 0.67 | 0.74 | 0.67 | 0.66 | 0.64 | 1.39 | 5.56 | 0.00 | 0.15 | 0.00 | 0.00 | 8.79 | 2.38 | 18.37 | 36.84 | 0.15 | 0.25 | 0.00 | 7.11 | 0.01 | 7048 | 364 | 0 | 03:58:39 | 7.15 | 14193986 | 733823 | 0 |
| 62 | Claude 4.6 Sonnet - dynamic-thinking | 85.4 | 0.65 | 0.56 | 0.60 | 0.77 | 0.71 | 0.74 | 0.71 | 0.62 | 0.69 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 14.6 | 0.00 | 0.00 | 0.00 | 23.747 | 0.05 | 8028 | 1854 | 0 | 13:17:05 | 104.5 | 16167319 | 3733114 | 0 |
| 63 | GPT 5.1 2025-11-13 - high-thinking | 84.26 | 0.63 | 0.64 | 0.69 | 0.75 | 0.64 | 0.71 | 0.64 | 0.61 | 0.62 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.00 | 0.00 | 0.00 | 15.64 | 0.00 | 0.00 | 0.00 | 53.712 | 0.06 | 6894 | 313 | 4709 | 30:02:54 | 23.66 | 13885406 | 629790 | 9484749 |
| 64 | Mistral Medium 3 | 57.7 | 0.63 | 0.66 | 0.73 | 0.86 | 0.62 | 0.70 | 0.62 | 0.64 | 0.61 | 2.53 | 12.26 | 0.05 | 1.54 | 0.00 | 0.00 | 0.79 | 4.97 | 13.21 | 26.22 | 0.05 | 0.20 | 0.00 | 6.971 | 0.01 | 7048 | 351 | 0 | 03:53:59 | 7.09 | 14193986 | 707298 | 0 |
| 65 | GPT 5.1 2025-11-13 - medium-thinking | 82.42 | 0.61 | 0.60 | 0.65 | 0.73 | 0.64 | 0.70 | 0.64 | 0.59 | 0.62 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.25 | 0.00 | 17.28 | 0.00 | 0.00 | 0.00 | 28.772 | 0.03 | 6894 | 311 | 1597 | 16:05:47 | 23.62 | 13885406 | 626224 | 3216618 |
| 66 | Claude 4.5 Haiku - low-thinking - 11606 tokens | 80.44 | 0.61 | 0.53 | 0.56 | 0.72 | 0.68 | 0.72 | 0.68 | 0.57 | 0.66 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.00 | 19.46 | 0.00 | 0.00 | 0.00 | 17.081 | 0.02 | 8040 | 2747 | 0 | 09:33:21 | 43.86 | 16191487 | 5532980 | 0 |
| 67 | Mistral Large 3 | 55.56 | 0.60 | 0.62 | 0.70 | 0.85 | 0.59 | 0.69 | 0.59 | 0.65 | 0.55 | 5.96 | 5.36 | 0.20 | 2.23 | 0.00 | 0.55 | 4.72 | 4.42 | 3.67 | 30.98 | 0.35 | 1.09 | 0.00 | 5.191 | 0.01 | 7048 | 372 | 0 | 02:54:14 | 8.22 | 14193986 | 749768 | 0 |
| 68 | Ministral 3 8B | 50.25 | 0.60 | 0.61 | 0.67 | 0.86 | 0.62 | 0.77 | 0.62 | 0.59 | 0.59 | 8.49 | 5.07 | 0.05 | 2.68 | 0.00 | 3.28 | 6.85 | 11.32 | 4.82 | 24.98 | 0.25 | 2.23 | 0.10 | 2.018 | 0.01 | 7048 | 328 | 0 | 01:07:44 | 2.23 | 14193986 | 660720 | 0 |
| 69 | GPT 5 Mini 2025-08-07 - low-thinking | 80.44 | 0.58 | 0.53 | 0.56 | 0.69 | 0.64 | 0.68 | 0.64 | 0.55 | 0.62 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1.39 | 0.00 | 18.12 | 0.00 | 0.05 | 0.00 | 15.579 | 0.01 | 6894 | 298 | 533 | 08:42:55 | 4.67 | 13885406 | 599631 | 1073344 |
| 70 | Claude 4.5 Haiku - minimal-thinking - 1024 tokens | 75.32 | 0.57 | 0.49 | 0.52 | 0.67 | 0.64 | 0.67 | 0.64 | 0.54 | 0.63 | 0.15 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.00 | 24.58 | 0.00 | 0.00 | 0.00 | 17.986 | 0.02 | 8040 | 2795 | 0 | 10:03:43 | 44.34 | 16191487 | 5628677 | 0 |
| 71 | Ministral 3 14B | 39.37 | 0.57 | 0.63 | 0.67 | 0.87 | 0.54 | 0.71 | 0.55 | 0.63 | 0.49 | 4.42 | 5.16 | 0.00 | 1.94 | 0.00 | 0.25 | 14.4 | 7.1 | 2.73 | 36.99 | 0.10 | 1.04 | 0.00 | 3.089 | 0.01 | 7048 | 317 | 0 | 01:43:40 | 2.97 | 14193986 | 638750 | 0 |
| 72 | GPT 5.1 2025-11-13 - no-thinking | 75.97 | 0.55 | 0.47 | 0.50 | 0.58 | 0.64 | 0.67 | 0.64 | 0.45 | 0.63 | 1.94 | 0.60 | 0.05 | 0.20 | 0.00 | 0.05 | 1.24 | 2.78 | 0.65 | 19.32 | 0.00 | 0.00 | 0.00 | 3.818 | 0.01 | 6894 | 280 | 0 | 02:08:09 | 22.99 | 13885406 | 563045 | 0 |
| 73 | Gemma 4 31B - high-thinking | 73.83 | 0.55 | 0.51 | 0.54 | 0.67 | 0.57 | 0.63 | 0.57 | 0.56 | 0.55 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 26.17 | 0.00 | 0.00 | 0.00 | 54.723 | 0.01 | 7356 | 363 | 1512 | 30:36:52 | 2.66 | 14815673 | 730072 | 3044070 |
| 74 | Claude 4.6 Sonnet - no-thinking | 68.37 | 0.51 | 0.45 | 0.49 | 0.60 | 0.57 | 0.61 | 0.58 | 0.47 | 0.56 | 0.60 | 0.45 | 0.00 | 0.05 | 0.00 | 0.00 | 0.15 | 0.35 | 0.05 | 31.08 | 0.00 | 0.00 | 0.00 | 4.462 | 0.03 | 8011 | 372 | 0 | 02:29:46 | 59.64 | 16133081 | 749496 | 0 |
| 75 | Claude 4.7 Opus - no-thinking | 65.89 | 0.51 | 0.46 | 0.49 | 0.57 | 0.57 | 0.61 | 0.57 | 0.46 | 0.55 | 0.45 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 1.09 | 0.00 | 32.92 | 0.00 | 0.00 | 0.00 | 5.636 | 0.06 | 10380 | 404 | 0 | 03:09:10 | 124.88 | 20904314 | 814450 | 0 |
| 76 | GPT 5 2025-08-07 - minimal-thinking | 66.63 | 0.49 | 0.42 | 0.46 | 0.52 | 0.58 | 0.60 | 0.58 | 0.41 | 0.56 | 1.64 | 0.05 | 0.05 | 0.00 | 0.00 | 0.00 | 1.14 | 1.04 | 0.40 | 30.79 | 0.00 | 0.00 | 0.00 | 4.95 | 0.01 | 6894 | 289 | 0 | 02:46:08 | 23.18 | 13885406 | 582186 | 0 |
| 77 | Claude 4.7 Opus - dynamic-thinking | 62.81 | 0.48 | 0.42 | 0.46 | 0.56 | 0.53 | 0.58 | 0.53 | 0.45 | 0.52 | 0.10 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.15 | 0.00 | 37.04 | 0.00 | 0.00 | 0.00 | 8.384 | 0.07 | 10380 | 562 | 0 | 04:41:24 | 132.83 | 20904314 | 1132496 | 0 |
| 78 | GPT 5.1 2025-11-13 - low-thinking | 60.82 | 0.44 | 0.42 | 0.45 | 0.52 | 0.46 | 0.51 | 0.47 | 0.43 | 0.45 | 0.10 | 0.05 | 0.00 | 0.00 | 0.05 | 0.05 | 0.00 | 1.84 | 0.15 | 37.14 | 0.00 | 0.05 | 0.00 | 12.156 | 0.02 | 6894 | 309 | 484 | 06:48:02 | 23.58 | 13885406 | 622295 | 974434 |
| 79 | GPT 4.1 Mini 2025-04-14 | 57.0 | 0.44 | 0.43 | 0.45 | 0.51 | 0.48 | 0.51 | 0.48 | 0.39 | 0.47 | 4.67 | 1.89 | 0.20 | 0.70 | 0.00 | 0.00 | 5.11 | 5.81 | 1.64 | 30.54 | 0.00 | 0.89 | 0.00 | 3.685 | 0.01 | 6895 | 300 | 0 | 02:03:41 | 6.52 | 13887420 | 603610 | 0 |
| 80 | Gemini 2.5 Flash - no-thinking | 56.85 | 0.42 | 0.38 | 0.40 | 0.51 | 0.46 | 0.50 | 0.46 | 0.40 | 0.45 | 3.63 | 0.30 | 0.05 | 0.15 | 0.00 | 0.00 | 34.61 | 0.70 | 0.45 | 7.45 | 0.00 | 0.00 | 0.00 | 1.364 | 0.01 | 7317 | 360 | 0 | 00:45:47 | 6.24 | 14737251 | 725811 | 0 |
| 81 | Claude 4.5 Opus - no-thinking | 53.97 | 0.42 | 0.38 | 0.40 | 0.50 | 0.45 | 0.48 | 0.45 | 0.41 | 0.44 | 0.30 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.25 | 0.89 | 0.00 | 44.89 | 0.00 | 0.00 | 0.00 | 5.243 | 0.05 | 8010 | 370 | 0 | 02:55:58 | 99.31 | 16131067 | 746050 | 0 |
| 82 | Claude 3.5 Haiku | 60.53 | 0.41 | 0.40 | 0.44 | 0.52 | 0.44 | 0.50 | 0.44 | 0.39 | 0.42 | 4.52 | 2.04 | 0.00 | 0.60 | 0.00 | 0.25 | 6.8 | 8.59 | 2.78 | 21.65 | 0.00 | 0.55 | 0.00 | 7.21 | 0.01 | 8010 | 439 | 0 | 04:02:01 | 16.44 | 16131067 | 884812 | 0 |
| 83 | Gemini 2.0 Flash | 51.29 | 0.37 | 0.33 | 0.35 | 0.46 | 0.40 | 0.45 | 0.40 | 0.35 | 0.39 | 4.12 | 0.30 | 0.00 | 0.05 | 0.00 | 0.45 | 41.41 | 2.53 | 0.25 | 4.07 | 0.00 | 0.05 | 0.00 | 1.8 | 0.01 | 7317 | 347 | 0 | 01:00:25 | 2.63 | 14737251 | 698693 | 0 |
| 84 | Gemma 4 31B - minimal-thinking | 47.47 | 0.36 | 0.34 | 0.36 | 0.43 | 0.38 | 0.40 | 0.38 | 0.36 | 0.36 | 0.20 | 0.00 | 0.00 | 0.00 | 0.00 | 0.30 | 0.75 | 1.09 | 0.05 | 50.35 | 0.00 | 0.00 | 0.00 | 11.298 | 0.01 | 7356 | 359 | 0 | 06:19:13 | 2.66 | 14815673 | 723905 | 0 |
| 85 | Claude 4.6 Opus - no-thinking | 45.78 | 0.33 | 0.31 | 0.33 | 0.42 | 0.33 | 0.38 | 0.33 | 0.35 | 0.32 | 0.15 | 0.15 | 0.00 | 0.00 | 0.00 | 0.25 | 0.10 | 0.10 | 0.00 | 53.77 | 0.00 | 0.00 | 0.00 | 6.534 | 0.05 | 8011 | 507 | 0 | 03:39:20 | 106.21 | 16133081 | 1021658 | 0 |
| 86 | Gemini 2.5 Flash-Lite - dynamic-thinking | 50.35 | 0.32 | 0.35 | 0.37 | 0.45 | 0.31 | 0.35 | 0.31 | 0.35 | 0.29 | 0.40 | 0.65 | 0.00 | 0.35 | 0.00 | 0.00 | 0.30 | 1.64 | 0.15 | 47.27 | 0.00 | 1.04 | 0.00 | 12.875 | 0.01 | 7317 | 377 | 3767 | 07:12:10 | 1.41 | 14737251 | 759807 | 7587222 |
| 87 | Gemini 2.5 Flash-Lite - high-thinking - 24576 tokens | 49.95 | 0.32 | 0.35 | 0.37 | 0.45 | 0.31 | 0.35 | 0.31 | 0.35 | 0.29 | 0.70 | 0.40 | 0.00 | 0.15 | 0.05 | 0.00 | 0.50 | 1.64 | 0.10 | 47.72 | 0.00 | 0.94 | 0.00 | 10.343 | 0.01 | 7317 | 379 | 4114 | 05:47:10 | 1.41 | 14737251 | 763495 | 8285748 |
| 88 | Gemini 2.5 Flash-Lite - low-thinking - 8534 tokens | 49.65 | 0.32 | 0.34 | 0.36 | 0.45 | 0.30 | 0.34 | 0.30 | 0.35 | 0.29 | 0.65 | 0.35 | 0.00 | 0.10 | 0.00 | 0.00 | 0.30 | 1.64 | 0.40 | 48.01 | 0.00 | 0.94 | 0.00 | 10.388 | 0.01 | 7317 | 379 | 3982 | 05:48:41 | 1.41 | 14737251 | 763630 | 8020527 |
| 89 | Gemini 2.5 Flash-Lite - medium-thinking - 16556 tokens | 47.92 | 0.31 | 0.33 | 0.35 | 0.43 | 0.30 | 0.33 | 0.30 | 0.34 | 0.28 | 0.65 | 0.30 | 0.00 | 0.20 | 0.00 | 0.00 | 0.45 | 1.74 | 0.15 | 49.65 | 0.00 | 1.09 | 0.00 | 10.464 | 0.01 | 7317 | 377 | 4074 | 05:51:14 | 1.41 | 14737251 | 759664 | 8205794 |
| 90 | Mistral Small 4 - high-thinking | 45.28 | 0.30 | 0.30 | 0.32 | 0.40 | 0.30 | 0.34 | 0.30 | 0.32 | 0.29 | 1.09 | 2.19 | 0.00 | 0.20 | 0.00 | 0.25 | 4.97 | 2.98 | 1.94 | 44.74 | 0.10 | 1.34 | 0.00 | 11.986 | 0.01 | 7060 | 2175 | 0 | 06:42:19 | 4.76 | 14218154 | 4380687 | 0 |
| 91 | Claude 4.5 Haiku - no-thinking | 41.66 | 0.30 | 0.27 | 0.28 | 0.37 | 0.33 | 0.36 | 0.34 | 0.29 | 0.32 | 1.94 | 0.40 | 0.00 | 0.15 | 0.10 | 0.00 | 1.19 | 2.19 | 0.70 | 54.32 | 0.00 | 0.00 | 0.00 | 3.588 | 0.01 | 8010 | 374 | 0 | 02:00:25 | 19.89 | 16131067 | 752360 | 0 |
| 92 | GPT 5 Mini 2025-08-07 - minimal-thinking | 41.51 | 0.28 | 0.29 | 0.31 | 0.36 | 0.28 | 0.31 | 0.28 | 0.28 | 0.26 | 3.23 | 3.87 | 0.05 | 1.74 | 0.05 | 0.00 | 1.74 | 3.77 | 1.84 | 51.49 | 0.00 | 0.99 | 0.00 | 5.053 | 0.01 | 6894 | 322 | 0 | 02:49:37 | 4.77 | 13885406 | 648713 | 0 |
| 93 | GPT 4o 2024-11-20 | 39.03 | 0.28 | 0.26 | 0.28 | 0.34 | 0.30 | 0.34 | 0.30 | 0.26 | 0.29 | 2.48 | 1.79 | 0.10 | 0.60 | 0.05 | 0.79 | 1.69 | 1.09 | 1.09 | 56.41 | 0.05 | 0.15 | 0.00 | 2.055 | 0.02 | 6895 | 303 | 0 | 01:08:58 | 40.82 | 13887420 | 610488 | 0 |
| 94 | Claude 4.6 Opus - dynamic-thinking | 38.33 | 0.27 | 0.26 | 0.28 | 0.35 | 0.26 | 0.30 | 0.27 | 0.28 | 0.26 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 15.29 | 0.00 | 0.00 | 0.00 | 46.38 | 0.00 | 0.00 | 0.00 | 19.027 | 0.07 | 8028 | 1231 | 0 | 10:38:40 | 142.82 | 16167319 | 2479499 | 0 |
| 95 | Gemini 2.5 Flash-Lite - no-thinking | 55.36 | 0.26 | 0.35 | 0.37 | 0.49 | 0.18 | 0.22 | 0.19 | 0.33 | 0.17 | 11.82 | 24.43 | 1.44 | 14.8 | 0.15 | 0.50 | 3.08 | 22.49 | 14.4 | 9.63 | 0.10 | 14.4 | 0.00 | 1.507 | 0.01 | 7317 | 663 | 0 | 00:50:34 | 1.64 | 14737251 | 1335022 | 0 |
| 96 | Gemini 2.5 Flash-Lite - minimal-thinking - 512 tokens | 52.19 | 0.26 | 0.34 | 0.36 | 0.46 | 0.20 | 0.23 | 0.20 | 0.32 | 0.19 | 10.87 | 27.95 | 1.04 | 13.8 | 0.10 | 0.25 | 4.02 | 13.61 | 13.11 | 20.66 | 0.20 | 7.94 | 0.00 | 2.564 | 0.01 | 7317 | 638 | 435 | 01:26:03 | 1.62 | 14737251 | 1285400 | 876635 |
| 97 | Gemma 4 26B-A4B - minimal-thinking | 39.28 | 0.26 | 0.25 | 0.27 | 0.35 | 0.26 | 0.31 | 0.26 | 0.27 | 0.25 | 1.94 | 2.48 | 0.00 | 0.20 | 0.25 | 0.05 | 6.85 | 4.92 | 4.17 | 45.78 | 0.00 | 0.05 | 0.00 | 3.999 | 0.01 | 7372 | 392 | 0 | 02:14:14 | 2.7 | 14847897 | 788727 | 0 |
| 98 | Gemma 4 26B-A4B - high-thinking | 39.03 | 0.25 | 0.25 | 0.27 | 0.35 | 0.25 | 0.30 | 0.25 | 0.27 | 0.24 | 1.74 | 2.28 | 0.00 | 0.20 | 0.25 | 0.00 | 7.45 | 4.42 | 4.27 | 45.68 | 0.00 | 0.00 | 0.00 | 3.24 | 0.01 | 7372 | 391 | 0 | 01:48:45 | 2.7 | 14847897 | 787287 | 0 |
| 99 | GPT 5 Nano 2025-08-07 - high-thinking | 37.34 | 0.25 | 0.25 | 0.27 | 0.32 | 0.26 | 0.29 | 0.26 | 0.25 | 0.25 | 0.00 | 0.60 | 0.00 | 0.30 | 0.00 | 2.53 | 5.36 | 7.85 | 1.94 | 45.28 | 0.00 | 6.8 | 0.00 | 90.446 | 0.01 | 6894 | 404 | 10069 | 50:35:58 | 1.02 | 13885406 | 813513 | 20279232 |
| 100 | Gemini 2.0 Flash-Lite | 32.92 | 0.23 | 0.22 | 0.23 | 0.30 | 0.23 | 0.28 | 0.23 | 0.23 | 0.22 | 2.09 | 0.70 | 0.05 | 0.15 | 0.00 | 0.00 | 46.48 | 2.48 | 1.29 | 16.98 | 0.00 | 0.15 | 0.10 | 2.676 | 0.01 | 7317 | 377 | 0 | 01:29:48 | 1.33 | 14737251 | 759763 | 0 |
| 101 | Mistral Small 4 - no-thinking | 34.81 | 0.21 | 0.18 | 0.19 | 0.24 | 0.24 | 0.28 | 0.24 | 0.19 | 0.23 | 1.94 | 4.32 | 0.00 | 0.75 | 0.00 | 0.00 | 5.46 | 4.07 | 5.61 | 51.89 | 0.10 | 0.60 | 0.00 | 1.883 | 0.01 | 7060 | 309 | 0 | 01:03:12 | 2.51 | 14218154 | 623101 | 0 |
| 102 | Claude 3 Sonnet | 30.04 | 0.20 | 0.20 | 0.21 | 0.27 | 0.20 | 0.23 | 0.20 | 0.21 | 0.19 | 2.98 | 5.96 | 0.15 | 2.88 | 0.00 | 0.00 | 4.77 | 10.92 | 4.37 | 50.89 | 0.35 | 7.85 | 0.00 | 6.985 | 0.03 | 8010 | 398 | 0 | 03:54:27 | 60.43 | 16131067 | 802393 | 0 |
| 103 | GPT 5 Nano 2025-08-07 - medium-thinking | 28.9 | 0.19 | 0.19 | 0.21 | 0.25 | 0.20 | 0.22 | 0.20 | 0.20 | 0.18 | 0.10 | 0.79 | 0.00 | 0.45 | 0.00 | 11.52 | 16.78 | 7.05 | 2.09 | 34.76 | 0.00 | 4.92 | 0.05 | 52.435 | 0.01 | 6894 | 668 | 4995 | 29:20:03 | 1.23 | 13885406 | 1344456 | 10060480 |
| 104 | GPT 4o Mini 2024-07-18 | 26.22 | 0.16 | 0.17 | 0.18 | 0.23 | 0.16 | 0.19 | 0.16 | 0.17 | 0.15 | 3.08 | 4.27 | 0.15 | 1.64 | 0.35 | 5.41 | 19.51 | 26.22 | 16.44 | 18.72 | 0.00 | 17.63 | 0.00 | 6.506 | 0.01 | 6895 | 322 | 0 | 03:38:23 | 2.47 | 13887420 | 648970 | 0 |
| 105 | Claude 3 Haiku | 32.47 | 0.15 | 0.20 | 0.21 | 0.27 | 0.12 | 0.19 | 0.12 | 0.19 | 0.11 | 7.3 | 9.63 | 1.19 | 3.08 | 0.89 | 0.05 | 10.53 | 17.68 | 30.83 | 22.05 | 0.55 | 3.18 | 0.00 | 5.212 | 0.01 | 8010 | 502 | 0 | 02:54:55 | 5.3 | 16131067 | 1011384 | 0 |
| 106 | GPT 4.1 Nano 2025-04-14 | 10.92 | 0.07 | 0.07 | 0.08 | 0.09 | 0.07 | 0.09 | 0.07 | 0.06 | 0.07 | 1.84 | 3.48 | 0.35 | 1.64 | 0.30 | 1.69 | 57.75 | 15.29 | 10.53 | 9.93 | 0.99 | 7.99 | 0.15 | 3.221 | 0.01 | 6895 | 311 | 0 | 01:48:05 | 1.64 | 13887420 | 626709 | 0 |
| 107 | GPT 5 Nano 2025-08-07 - low-thinking | 7.75 | 0.06 | 0.05 | 0.05 | 0.06 | 0.07 | 0.07 | 0.07 | 0.05 | 0.06 | 0.05 | 0.20 | 0.00 | 0.05 | 0.00 | 29.79 | 47.62 | 3.87 | 2.19 | 10.58 | 0.00 | 1.59 | 0.05 | 23.223 | 0.01 | 6894 | 1142 | 1174 | 12:59:30 | 1.61 | 13885406 | 2299445 | 2365248 |
| 108 | GPT 5 Nano 2025-08-07 - minimal-thinking | 3.03 | 0.02 | 0.02 | 0.02 | 0.03 | 0.01 | 0.02 | 0.02 | 0.02 | 0.01 | 0.40 | 0.79 | 0.05 | 0.35 | 0.00 | 2.93 | 47.07 | 18.22 | 16.83 | 25.52 | 0.45 | 6.46 | 0.10 | 2.975 | 0.01 | 6894 | 386 | 0 | 01:39:51 | 1.01 | 13885406 | 777070 | 0 |
Scroll horizontally to explore all analytics. Click any column header to sort.
Start free, scale with confidence
Launch your first graph-powered agent flow quickly, then scale to enterprise throughput with reliability, support, and infrastructure options designed for production teams.
DevelopREST & Python SDK
ExecuteServerless compute
ScaleEnterprise ready
MonitorConsole & alerts