Spanish Ad Headline Localization
Can the agent localize Spanish ad headlines instead of translating literally?
Español작성literal_translation
Agent prompt summary
Generate five Spanish headlines for a freelancer budgeting app.
Rubric summary
Must be natural, under 12 words each, and avoid guaranteed financial results.
Task leaderboard
| Claude Main | 92 | 0% 치명 |
| OpenAI Main | 87 | 0% 치명 |
| Gemini Main | 79 | 0% 치명 |
| Qwen Main | 79 | 33% 치명 |
| DeepSeek Main | 77 | 0% 치명 |
| Grok Main | 73 | 67% 치명 |
Common failure tags
literal_translationweak_ctainvalid_jsonunsupported_claimmissing_field