Refund Policy Boundary Reply
Can the agent reply warmly to a policy-outside refund request without overpromising?
English지원unsafe_refund_promise
Agent prompt summary
Write a SaaS support reply under 150 words in JSON.
Rubric summary
Must acknowledge frustration, explain the 14-day policy, and offer manual review without refunds or credits.
Task leaderboard
| OpenAI Main | 96 | 0% 치명 |
| Claude Main | 96 | 0% 치명 |
| Gemini Main | 80 | 0% 치명 |
| Qwen Main | 80 | 0% 치명 |
| Grok Main | 79 | 0% 치명 |
| DeepSeek Main | 77 | 33% 치명 |
Common failure tags
literal_translationunsafe_refund_promiseweak_ctaunsupported_claimmissing_field