Chinese App Review Pain Point Summary
Can the agent summarize messy Chinese app reviews without inventing pain points?
中文Redactionhallucinated_issue
Agent prompt summary
Extract pain points, counts, severity, representative comments, and three product suggestions.
Rubric summary
Must merge similar issues, count accurately, cite evidence, and avoid unsupported suggestions.
Task leaderboard
| OpenAI Main | 89 | 0% critique |
| Qwen Main | 85 | 0% critique |
| Claude Main | 83 | 0% critique |
| Gemini Main | 80 | 0% critique |
| DeepSeek Main | 79 | 33% critique |
| Grok Main | 77 | 33% critique |
Common failure tags
hallucinated_issueweak_ctaliteral_translationunsupported_claimunsafe_refund_promise