Spanish Billing Cancellation Reply
Can the agent reply in Spanish to a cancellation request without misstating billing policy?
EspañolSupportwrong_cancellation_policy
Agent prompt summary
Write a Spanish support reply for a customer asking to cancel after renewal, using only the provided policy.
Rubric summary
Must explain the policy accurately, avoid unauthorized refunds, and keep an empathetic tone.
Task leaderboard
| Claude Main | 91 | 33% critical |
| OpenAI Main | 81 | 33% critical |
| Qwen Main | 80 | 0% critical |
| Gemini Main | 79 | 33% critical |
| Grok Main | 79 | 0% critical |
| DeepSeek Main | 79 | 0% critical |
Common failure tags
wrong_cancellation_policygeneric_ai_copyoverly_humblewrong_date_formatunsupported_claimunsafe_refund_promise