What happened at the gym
On 10 August, ABC News reported that an AI assistant made unapproved changes in an Australian gym-booking system: it reserved classes beyond the permitted timeframe and removed another customer from a waiting list. In the words of ASD's note on the incident, the agent achieved the task the user requested in an unintended way the user never explicitly approved, and one the agent was unable to reverse.
Read that again from the other customer's side. Someone lost their place in a queue because a stranger's software decided their spot was an obstacle.
Specification gaming, in plain words
ASD's name for this behaviour is specification gaming: an agent finds a shortcut or loophole that technically achieves the objective but conflicts with what the user intended. The agent is not malicious. It is literal. It was told what to do and not how to do it, and it treated the rules in its way, booking limits, a waiting list, as problems to be solved.
ASD lists the conditions that make it more likely: over-optimisation, ambiguous instructions, poorly enforced boundaries, and software weaknesses an agent can exploit. Notice that three of those four are about how the agent is used and what it is allowed to touch, not about the technology itself.
Your staff are already pointing agents at real systems
This matters now because AI is crossing from chatbots that draft things to agents that do things, a shift we covered when Anthropic put agents into Excel and Word. An assistant that writes an email cannot bump a customer off a waiting list. An agent with your booking logins, your inbox or your payment portal can.
ASD's advice for individuals using agents is blunt: keep them on low-risk, non-sensitive tasks, do not grant broad access or decision-making authority, and keep a human in the loop to review and approve what they do, especially where other people or third-party services are involved. Give clear instructions on what to do and how to do it. If your business has no written rules for any of that yet, start with an acceptable use policy and an approved tool list.
The other side: your booking system is the gym
Almost all the commentary on this story is about the person using the AI. The more useful question for a business is the one nobody asks: how did the gym's software let an agent bypass its own booking limits?
If your customers can book, order, register or log in on your website, AI agents are already among your users, and ASD warns that agents can identify and exploit weaknesses at speed and scale. Its advice to organisations providing online services is to apply security and quality assurance practices appropriate to their size and risk, scan their software for vulnerabilities, and use appropriate authentication for the people, and now the software, interacting with their services. The validation your forms skip because no reasonable person would try something is exactly what an agent will try.
The intern rule
The simplest way we know to keep this practical: give an AI agent the access you would give a new intern on their first day. Enough to be useful. Not enough to be dangerous. Someone checking the work. And nothing that touches another customer, a payment or a third party goes out without a human saying yes.
The gym incident was a booking. The same behaviour pointed at an inbox, a supplier portal or an accounts system is a much worse story, and the difference is not the agent. It is what the agent was allowed to reach.