Japanese Product Specification Extraction
Can the agent extract Japanese product specifications without guessing material?
日本語Extracciónhallucinated_material
Resumen del prompt
Extract model, dimensions, weight, material, paper size, connection, and warranty.
Resumen de la rúbrica
Must keep units, set missing material to null, and output valid JSON.
Ranking de la tarea
| Qwen Main | 91 | 33% crítico |
| Gemini Main | 85 | 0% crítico |
| OpenAI Main | 83 | 0% crítico |
| Claude Main | 83 | 0% crítico |
| DeepSeek Main | 83 | 0% crítico |
| Grok Main | 72 | 67% crítico |
Etiquetas de fallo comunes
hallucinated_materialgeneric_ai_copyinvalid_jsonunsupported_claimunsafe_refund_promiseliteral_translation