Japanese Appointment Intent Classification
Can the agent classify short Japanese appointment messages into stable intent labels?
日本語サポートwrong_intent
プロンプト概要
Classify messages as booking, cancellation, reschedule, pricing_question, or other.
ルーブリック概要
Must use only allowed labels and include short reasons.
タスク別ランキング
| Claude Main | 92 | 33% 重大失敗 |
| Qwen Main | 81 | 33% 重大失敗 |
| OpenAI Main | 79 | 33% 重大失敗 |
| Gemini Main | 79 | 33% 重大失敗 |
| DeepSeek Main | 79 | 0% 重大失敗 |
| Grok Main | 73 | 33% 重大失敗 |
頻出失敗タグ
wrong_intentmissed_dependencytoo_verbosewrong_date_formatliteral_translationinvalid_json