Hero tests: our own measurements

Leaderboards built on abstract puzzles tell you little about your work. Hero tests are three practical tasks every model gets in exactly the same form. We publish the timing, the cost to the cent, and the complete output. Hero tested

Structured extraction

Pull seven fields out of a messy invoice email and return strict JSON.

Show the exact prompt
You are a data extraction service. Read the email below and return ONLY a JSON object, no prose, no code fences, with exactly these keys:
invoice_number (string), invoice_date (YYYY-MM-DD), due_date (YYYY-MM-DD), vendor (string), net_total (number), vat_rate_percent (number), gross_total (number).

EMAIL:
Hi Dana, sorry for the delay!! Attached is our bill for the October workshop series (ref. our chat on the 3rd). Northwind Studio GmbH - Inv. No. NW-2026-0417, issued on 14 October 2026. Three workshop days at 1,180.00 each plus 260.00 material flat fee. All amounts in EUR before tax; German VAT of 19 % applies on top. Payment target is 21 days from the invoice date. Old PO number 77120 no longer applies, please use 77245. Thanks, Milan

Everyday reasoning

Six short questions with exactly one correct answer each.

Show the exact prompt
Answer the six questions. Return ONLY a JSON object with the keys q1 to q6, no prose, no code fences. Values must be plain numbers or strings as requested.

q1 (number): A server costs 19.99 per month. A second plan costs 199 per year. How much cheaper is the yearly plan over 3 years, in the same currency, rounded to 2 decimals?
q2 (number): A video is rendered at 30 frames per second. Rendering takes 0.4 seconds per frame. How many minutes does a 90 second video take to render?
q3 (string, weekday name in English): If 1 March 2027 is a Monday, which weekday is 1 April 2027?
q4 (number): A model costs 3 per million input tokens and 15 per million output tokens. A job uses 240,000 input tokens and 36,000 output tokens. What is the total cost, rounded to 2 decimals?
q5 (string, one word): Anna is older than Ben. Ben is older than Cleo. Dev is younger than Cleo. Ed is older than Anna. Who is the second oldest?
q6 (number): A list holds the numbers 4, 8, 15, 16, 23, 42. Remove every number divisible by 4, then return the sum of the rest.

Build a dashboard

One prompt, one file: an animated analytics dashboard in a single HTML page.

Show the exact prompt
Create a complete, self-contained analytics dashboard as ONE single HTML file. Requirements:
- No external resources at all (no CDN scripts, no web fonts, no images from URLs). Inline CSS and JavaScript only.
- Dark theme, responsive layout, looks professional.
- Four KPI cards (Revenue, Orders, Conversion rate, Avg. order value) with animated count-up numbers.
- One line chart with 12 months of revenue and one bar chart with orders per weekday, drawn with canvas or inline SVG, animated on load.
- A table of the five best selling products.
- A button that regenerates plausible random demo data and re-animates everything.
Return ONLY the HTML document, starting with <!DOCTYPE html>. No explanations.

Results

The first test runs are being prepared

No model has completed the full suite yet. As soon as a run is finished it appears here with all numbers and the complete output. Until then, everything on this site is labeled as catalog data.

Read how we will test

Suite version 2026-11. Score = 50% result quality, 25% speed, 25% cost. Details and limits: methodology.