Japanese Product Specification Extraction
Can the agent extract Japanese product specifications without guessing material?
日本語抽出hallucinated_material
プロンプト概要
Extract model, dimensions, weight, material, paper size, connection, and warranty.
ルーブリック概要
Must keep units, set missing material to null, and output valid JSON.
タスク別ランキング
| Qwen Main | 91 | 33% 重大失敗 |
| Gemini Main | 85 | 0% 重大失敗 |
| OpenAI Main | 83 | 0% 重大失敗 |
| Claude Main | 83 | 0% 重大失敗 |
| DeepSeek Main | 83 | 0% 重大失敗 |
| Grok Main | 72 | 67% 重大失敗 |
頻出失敗タグ
hallucinated_materialgeneric_ai_copyinvalid_jsonunsupported_claimunsafe_refund_promiseliteral_translation