Skip to content
AAA.win
EN
EnglishEN中文ZH日本語JAEspañolES
SearchSubmit a tool
Menu

Spanish Order Confirmation Extraction

Can the agent extract Spanish order confirmation data with normalized dates?

EspañolExtractionwrong_date_format
Preview evidencemaa-preview-002

Full task input

Extract customer, order ID, product, amount, currency, dates, and next step.

Scoring rubric

Must convert dates to YYYY-MM-DD and avoid hallucinating tracking links.
Primary risk
wrong_date_format
Temperature
0.2
Tools
Disabled
Web browsing
Disabled
Memory
Disabled

Agent prompt summary

Extract customer, order ID, product, amount, currency, dates, and next step.

Rubric summary

Must convert dates to YYYY-MM-DD and avoid hallucinating tracking links.

Task leaderboard

Claude Main850% critical
Mistral Main850% critical
OpenAI Main830% critical
Gemini Main830% critical
Qwen Main830% critical
DeepSeek Main830% critical
Kimi Main830% critical
Cohere Main800% critical
Perplexity Main800% critical
GLM Main800% critical
MiniMax Main800% critical
Llama Main7933% critical
ERNIE Main790% critical
Hunyuan Main790% critical
Yi Main790% critical
Doubao Main770% critical
Phi Main7633% critical
Grok Main750% critical

Common failure tags

unsupported_claimwrong_date_formatinvalid_jsonliteral_translationmissing_fieldoverly_humble

Sample outputs and scoring notes

Claude Main currently leads this task. When reading samples, focus on task completion, whether the output respects business boundaries such as wrong_date_format, and whether the structure can move into a workflow. The most visible failure tag is unsupported_claim.

OpenAI Main

maa-preview-002.spanish-order-confirmation-extraction.openai-main.01

Preview
Batch: maa-preview-002Model version: Not measuredTemperature: 0.2Cost: $0.0247Latency: Not measuredHuman review: Not reviewed

Raw output (untruncated)

Preview seed output. Replace with exact model output for real evaluations.
Valid JSONRequired fields presentNo critical failure
Run score88
task success
5/5
language fit
5/5
instruction following
4/5
business safety
4/5
output reliability
4/5

Review note: Synthetic preview score generated from deterministic seed data.

Phi Main

maa-preview-002.spanish-order-confirmation-extraction.phi-main.01

Preview
Batch: maa-preview-002Model version: Not measuredTemperature: 0.2Cost: $0.0049Latency: Not measuredHuman review: Not reviewed

Raw output (untruncated)

Preview seed output. Replace with exact model output for real evaluations.
Invalid JSONRequired fields presentCritical failure
wrong_date_formatinvalid_json
Run score68
task success
4/5
language fit
4/5
instruction following
2/5
business safety
3/5
output reliability
4/5

Review note: Synthetic preview score generated from deterministic seed data.

Downloads use the same run objects as this page.

Version · v4.3.6-indexnow-delivery-verified

Latest releases

IndexNow production delivery verification

Verified production IndexNow receipt with a new key: Microsoft's external proof returned HTTP 200, single-URL GET and POST both returned HTTP 200, and eight batches covering 386 canonical URLs each returned HTTP 200 with zero retries. A second run found the inventory unchanged and sent no request.

IndexNow proof-origin protocol fix

Production Bing validation exposed HTTP 500 at the external root proof because TLS termination was followed by an internal rewrite using the wrong protocol. This release corrects that rewrite boundary, but remains unverified until the external proof returns HTTP 200, the automatic submission runs, a later canary returns HTTP 200, and the idempotent rerun passes.

IndexNow root-proof request compatibility

After v4.3.3, the exact root-level {key}.txt proof returned HTTP 200, but a full request carrying keyLocation still returned HTTP 403; a minimal homepage request with the same production key and no keyLocation returned HTTP 202. This release omits that field, while the automatic full run and idempotent rerun remain deployment checks.

View all releases