BGB 40/10
Exported from 25 run(s) (50 norms).
Modellauswahl
39 / 39 ModelleODER innerhalb einer Kategorie, UND zwischen Kategorien. z.B. Open Source + Europa → nur europäische Open-Source-Modelle.
Grösse
Typ
Region
Anbieter
Score-Tabelle
| Rank | Modell↕ | Score?Durchschnittliche Textähnlichkeit zum Gesetzestext (0-100%), gemessen als normalisierte Levenshtein-Distanz.↓ | Net Correctness?Korrekte Antworten minus falsche Antworten. Enthaltungen werden nicht bestraft, Halluzinationen schon.↕ | Kalibrierung?Anteil der Fälle, in denen das Modell die richtige Entscheidung trifft: antworten, wenn es die Antwort kennt; sich enthalten, wenn nicht.↕ | Halluzinationsrate?Wie oft das Modell im Enthaltungsmodus falsch antwortet, obwohl es im Forced-Modus falsch lag.↕ | VerteilungTP / FP / TN / FN |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5Anthropic | 90.36% | 31.0✓38 ✗7 ○5 | 84.0% | 54.5% | 38741 |
| 2 | GPT-5.6 SolOpenAI | 83.18% | 26.0✓36 ✗10 ○4 | 78.0% | 60.0% | 361031 |
| 3 | Claude Opus 5Anthropic | 80.75% | 21.0✓33 ✗12 ○5 | 76.0% | 61.1% | 331250 |
| 4 | GPT-5.5OpenAI | 77.47% | 26.0✓30 ✗4 ○16 | 84.0% | 23.5% | 304124 |
| 5 | Claude Opus 4.8Anthropic | 74.95% | 19.0✓30 ✗11 ○9 | 76.0% | 42.9% | 301181 |
| 6 | Claude Opus 4.7Anthropic | 68.51% | 4.0✓23 ✗19 ○8 | 60.0% | 72.0% | 231971 |
| 7 | Gemini 3.5 FlashGoogle | 64.41% | 13.0✓17 ✗4 ○29 | 82.0% | 13.8% | 174245 |
| 8 | Claude Opus 4.5Anthropic | 61.92% | -6.0✓21 ✗27 ○2 | 46.0% | 89.3% | 212720 |
| 9 | Gemini 3 Pro PreviewGoogle | 61.57% | -13.0✓18 ✗31 ○1 | 38.0% | 96.4% | 183110 |
| 10 | Gemini 3 Flash PreviewGoogle | 60.23% | -12.0✓19 ✗31 ○0 | 38.0% | 96.6% | 193100 |
| 11 | GPT-5.6 LunaOpenAI | 59.96% | -13.0✓13 ✗26 ○11 | 48.0% | 61.8% | 1326110 |
| 12 | Claude Opus 4.6Anthropic | 59.36% | -3.0✓16 ✗19 ○15 | 60.0% | 51.6% | 1619141 |
| 13 | DeepSeek-V4-ProDeepSeek | 53.88% | 2.0✓17 ✗15 ○18 | 68.0% | 32.4% | 1715171 |
| 14 | Claude Sonnet 5Anthropic | 53.01% | -7.0✓13 ✗20 ○17 | 60.0% | 52.6% | 1320170 |
| 15 | Gemini 2.5 ProGoogle | 51.39% | -15.0✓17 ✗32 ○1 | 36.0% | 85.7% | 173210 |
| 16 | GPT-5.3 ChatOpenAI | 50.24% | 10.0✓12 ✗2 ○36 | 94.0% | 5.3% | 122351 |
| 17 | GPT-5OpenAI | 46.34% | -6.0✓8 ✗14 ○28 | 70.0% | 32.5% | 814271 |
| 18 | Mistral Large 2512Mistral AI | 46.03% | -8.0✓13 ✗21 ○16 | 56.0% | 55.9% | 1321151 |
| 19 | GPT-5.1OpenAI | 45.94% | 8.0✓10 ✗2 ○38 | 94.0% | 5.0% | 102371 |
| 20 | GPT-5.2OpenAI | 45.33% | 9.0✓11 ✗2 ○37 | 96.0% | 4.9% | 112370 |
| 21 | o3OpenAI | 45.28% | -13.0✓7 ✗20 ○23 | 58.0% | 46.3% | 720221 |
| 22 | GPT-5.2 ChatOpenAI | 45.21% | 5.0✓10 ✗5 ○35 | 86.0% | 12.5% | 105332 |
| 23 | Claude Opus 4.1Anthropic | 45.18% | -14.0✓9 ✗23 ○18 | 54.0% | 52.6% | 923180 |
| 24 | Claude Opus 4Anthropic | 45.08% | -14.0✓8 ✗22 ○20 | 56.0% | 45.9% | 822200 |
| 25 | DeepSeek-V4-FlashDeepSeek | 42.89% | -6.0✓7 ✗13 ○30 | 74.0% | 26.2% | 713300 |
| 26 | Llama 4 MaverickMeta | 42.68% | -32.0✓9 ✗41 ○0 | 18.0% | 100.0% | 94100 |
| 27 | GPT-5.4OpenAI | 41.24% | 6.0✓10 ✗4 ○36 | 92.0% | 9.8% | 104360 |
| 28 | Grok 4xAI | 37.23% | -23.0✓10 ✗33 ○7 | 34.0% | 82.5% | 103370 |
| 29 | Kimi K2.5Moonshot AI | 36.59% | -18.0✓8 ✗26 ○16 | 48.0% | 55.6% | 826160 |
| 30 | Kimi K2 ThinkingMoonshot AI | 35.58% | -28.0✓8 ✗36 ○6 | 28.0% | 81.8% | 83660 |
| 31 | DeepSeek-V3.2DeepSeek | 35.11% | -19.0✓6 ✗25 ○19 | 48.0% | 52.4% | 625181 |
| 32 | GPT-5 MiniOpenAI | 34.32% | -2.0✓2 ✗4 ○44 | 90.0% | 8.5% | 24431 |
| 33 | GPT-4.1OpenAI | 34.28% | -25.0✓6 ✗31 ○13 | 38.0% | 69.8% | 631130 |
| 34 | Gemini 2.5 FlashGoogle | 33.65% | -29.0✓9 ✗38 ○3 | 24.0% | 90.2% | 93830 |
| 35 | Claude Haiku 4.5Anthropic | 32.17% | 2.0✓3 ✗1 ○46 | 98.0% | 2.0% | 31460 |
| 36 | o4-miniOpenAI | 30.53% | -4.0✓4 ✗8 ○38 | 84.0% | 13.0% | 48380 |
| 37 | Qwen3 MaxAlibaba/Qwen | 26.71% | -25.0✓5 ✗30 ○15 | 40.0% | 66.7% | 530150 |
| 38 | Grok 4.1 FastxAI | 21.61% | -44.0✓0 ✗44 ○6 | 12.0% | 88.0% | 04460 |
| 39 | GPT-3.5 TurboOpenAI | 16.78% | -47.0✓0 ✗47 ○3 | 6.0% | 93.8% | 04730 |
| Gesamt (39 Modelle) |