When AI goes wrong, what would you do?
Knowing how a model works is one thing. Working out why an agent just did something nobody asked for, with the evidence in front of you and someone waiting for an answer, is another. Each scenario is an invented incident built on how AI, agents and data systems really fail.
Subject
- How AI worksbeginnerThe AI test that passes on Monday and fails on TuesdayA test of an AI feature fails about 1 run in 6, and since a model upgrade it fails most runs. Nothing in the code changed. Find out why, and write a test that means something.2 decisions · about 8 minutesStart
- Data engineering in the AI erabeginnerThe revenue dashboard that is 17% too highApril revenue on the sales dashboard is 17.2% above finance's figure, and the board meeting is at 14:00. Find the cause in the query, not in the warehouse.3 decisions · about 10 minutesStart
- How AI worksbeginnerThe warranty the help bot inventedA customer was promised a 2-year warranty on a refurbished laptop. There is no such warranty. Work out why the bot said it, and what stops the next one.2 decisions · about 8 minutesStart
- AI agentsintermediateThe agent bill that grew 5 times in a monthA coding agent's monthly bill went from $1,200 to $6,700 while the number of tasks rose by a fifth. Find where the money went before you cut the wrong thing.2 decisions · about 10 minutesStart
- Data engineering in the AI eraintermediateThe AI assistant that quotes old pricesThe sales team's AI assistant quoted a customer the old price, 6 weeks after it changed. The document is right. The assistant's copy of it is not.3 decisions · about 10 minutesStart
- AI agentsintermediateThe refunds nobody asked forAn email support agent issued 14 refunds overnight to customers who never wrote in. Find the door it came through, and close it.3 decisions · about 10 minutesStart
How a scenario works
- 01
Read the evidence
Logs, messages, tables and code, as they would land on your desk. Everything you need is there.
- 02
Make the calls
What went wrong, what you do first, what you change for good. Each option shows why it works or does not, the moment you pick.
- 03
See what happened
The mechanism behind the failure, the fix that holds, and the sources for how it works. Your best score stays in this browser.