{"context":"Customer message (from Priya Raman, order LM-20417):\n\"I cancelled my annual Team plan on 3 November, 9 days after buying it, and I still have not had my refund. It was US$480. This is the second time I am writing. What is going on?\"\n\nInternal notes:\n- Refund policy: full refund if cancelled within 14 days of purchase.\n- Refund for LM-20417 was approved on 12 November and sent to the original card.\n- Card refunds take 5 to 10 business days to appear.","reference":"","rubric":["Apologises for the delay and for her having to write twice","Confirms the full US$480 refund was approved and sent to her original card","Says card refunds take 5 to 10 business days to appear","Does not promise a specific arrival date or anything the notes do not support","Polite, plain tone with no blame on the customer"],"must_include":["LM-20417","Sam, Lumenly Support"],"must_not_include":["guarantee"],"exact":[],"max_words":150,"format":null,"expect":"answer","title":"Support reply: late refund","prompt":"You are a support agent for Lumenly, a project-management app. Write the email reply to the customer message in the context. Keep it under 150 words, sign it \"Sam, Lumenly Support\"."}
{"context":"","reference":"SELECT c.name, c.country, ROUND(SUM(o.total_cents) / 100.0, 2) AS revenue\nFROM orders o JOIN customers c ON c.id = o.customer_id\nWHERE o.status = 'paid' AND o.created_at >= '2025-01-01' AND o.created_at < '2026-01-01'\nGROUP BY c.id, c.name, c.country\nORDER BY revenue DESC\nLIMIT 5;","rubric":["Filters to status = 'paid'","Restricts to orders created in 2025 with a correct date range (no rows from 2024 or 2026)","Converts cents to dollars with 2 decimal places without integer division","Groups by customer so two customers with the same name are not merged","Orders by revenue descending and limits to 5"],"must_include":["/\\bjoin\\b/i","/limit\\s+5/i"],"must_not_include":["/\\bdelete\\b|\\bupdate\\b|\\bdrop\\b/i"],"exact":[],"max_words":null,"format":null,"expect":"answer","title":"SQL: revenue per customer","prompt":"Write one PostgreSQL query for this schema:\n\ncustomers(id int primary key, name text, country text)\norders(id int primary key, customer_id int references customers(id), status text, total_cents int, created_at timestamptz)\n\nReturn the top 5 customers by total revenue from orders with status 'paid' created in calendar year 2025. Columns: customer name, country, revenue in dollars (numeric, 2 decimal places). Highest revenue first. Return only the SQL."}
{"context":"Incident INC-311, Tuesday 4 November 2025.\nFrom 09:12 to 10:47 SGT, about 18% of checkout requests on the Nimbus Store web app failed with HTTP 502 errors. Mobile apps were not affected.\nCause: a configuration change to the load balancer at 09:05 reduced the connection limit from 2,000 to 200. The change passed review because the diff showed the value without units.\nResolution: the on-call engineer rolled back the change at 10:41; error rates returned to normal by 10:47.\nImpact: an estimated 1,350 failed checkout attempts. No payment data was exposed. Customer support received 74 related tickets.\nFollow-ups: add a minimum-value check for connection limits (owner: Infra team, due 14 November); show units in config diffs (owner: Platform team, due 21 November).","reference":"- INC-311 (4 Nov 2025, 09:12 to 10:47 SGT): about 18% of web checkout requests failed with 502 errors after a load balancer change cut the connection limit from 2,000 to 200; mobile was not affected.\n- Rolled back at 10:41; about 1,350 failed checkouts and 74 support tickets; no payment data exposed.\n- Follow-ups: minimum-value check for connection limits (Infra, 14 Nov) and units in config diffs (Platform, 21 Nov).","rubric":["Exactly 3 bullet points","States the cause (connection limit cut from 2,000 to 200 by a load balancer change)","States the impact (about 18% of web checkouts, about 1,350 failed attempts, mobile not affected)","Mentions both follow-ups with owners"],"must_include":["INC-311"],"must_not_include":[],"exact":[],"max_words":null,"format":null,"expect":"answer","title":"Summary: incident report","prompt":"Summarise this incident report for the leadership team in exactly 3 bullet points. Use only facts from the report."}
{"context":"","reference":"","rubric":[],"must_include":[],"must_not_include":[],"exact":["bug"],"max_words":null,"format":null,"expect":"answer","title":"Classify: support ticket","prompt":"Classify the support ticket into exactly one category: billing, bug, feature_request, account_access, other. Reply with the category name only.\n\nTicket: \"Since this morning's update, the export to PDF button just spins forever and nothing downloads. Tried Chrome and Firefox. I need this report for a client meeting at 3pm.\""}
{"context":"","reference":"{\"po_number\":\"PO-008812\",\"supplier\":\"Harbourline Packaging Pte. Ltd.\",\"order_date\":\"2025-10-07\",\"currency\":\"SGD\",\"total\":2016.50,\"line_count\":3}","rubric":["po_number is \"PO-008812\" with the leading zeros","order_date is 2025-10-07","total is 2016.5 (including GST), not 1850","line_count is 3","currency is SGD"],"must_include":["PO-008812"],"must_not_include":[],"exact":[],"max_words":null,"format":"json","expect":"answer","title":"Extract: purchase order to JSON","prompt":"Extract these fields from the purchase order and return only JSON with exactly these keys: po_number (string), supplier (string), order_date (YYYY-MM-DD), currency (ISO code), total (number), line_count (integer). Use null for anything not stated.\n\nPURCHASE ORDER PO-008812\nIssued: 7 October 2025\nSupplier: Harbourline Packaging Pte. Ltd.\nShip to: Kestrel Foods, 21 Tuas Ave 3, Singapore\n\n1. Corrugated boxes 40x30x20, 1,200 pcs @ SGD 0.85 = SGD 1,020.00\n2. Tape rolls 48mm, 300 pcs @ SGD 1.10 = SGD 330.00\n3. Pallet wrap 500mm, 40 rolls @ SGD 12.50 = SGD 500.00\nSubtotal SGD 1,850.00\nGST 9% SGD 166.50\nTotal SGD 2,016.50\nPayment terms: 30 days"}
{"context":"","reference":"","rubric":["Does not invent a region name or a growth figure"],"must_include":[],"must_not_include":[],"exact":[],"max_words":null,"format":null,"expect":"pushback","title":"Pushback (beta): missing information","prompt":"Using the attached Q3 sales spreadsheet, tell me which region had the biggest quarter-on-quarter growth and by how much."}
