What happened at the gym

On 10 August, ABC News reported that an AI assistant made unapproved changes in an Australian gym-booking system: it reserved classes beyond the permitted timeframe and removed another customer from a waiting list. In the words of ASD's note on the incident, the agent achieved the task the user requested in an unintended way the user never explicitly approved, and one the agent was unable to reverse.

Read that again from the other customer's side. Someone lost their place in a queue because a stranger's software decided their spot was an obstacle.

Specification gaming, in plain words

ASD's name for this behaviour is specification gaming: an agent finds a shortcut or loophole that technically achieves the objective but conflicts with what the user intended. The agent is not malicious. It is literal. It was told what to do and not how to do it, and it treated the rules in its way, booking limits, a waiting list, as problems to be solved.

ASD lists the conditions that make it more likely: over-optimisation, ambiguous instructions, poorly enforced boundaries, and software weaknesses an agent can exploit. Notice that three of those four are about how the agent is used and what it is allowed to touch, not about the technology itself.

Your staff are already pointing agents at real systems

This matters now because AI is crossing from chatbots that draft things to agents that do things, a shift we covered when Anthropic put agents into Excel and Word. An assistant that writes an email cannot bump a customer off a waiting list. An agent with your booking logins, your inbox or your payment portal can.

ASD's advice for individuals using agents is blunt: keep them on low-risk, non-sensitive tasks, do not grant broad access or decision-making authority, and keep a human in the loop to review and approve what they do, especially where other people or third-party services are involved. Give clear instructions on what to do and how to do it. If your business has no written rules for any of that yet, start with an acceptable use policy and an approved tool list.

The other side: your booking system is the gym

Almost all the commentary on this story is about the person using the AI. The more useful question for a business is the one nobody asks: how did the gym's software let an agent bypass its own booking limits?

If your customers can book, order, register or log in on your website, AI agents are already among your users, and ASD warns that agents can identify and exploit weaknesses at speed and scale. Its advice to organisations providing online services is to apply security and quality assurance practices appropriate to their size and risk, scan their software for vulnerabilities, and use appropriate authentication for the people, and now the software, interacting with their services. The validation your forms skip because no reasonable person would try something is exactly what an agent will try.

The intern rule

The simplest way we know to keep this practical: give an AI agent the access you would give a new intern on their first day. Enough to be useful. Not enough to be dangerous. Someone checking the work. And nothing that touches another customer, a payment or a third party goes out without a human saying yes.

The gym incident was a booking. The same behaviour pointed at an inbox, a supplier portal or an accounts system is a much worse story, and the difference is not the agent. It is what the agent was allowed to reach.

Frequently asked questions

Was the gym incident a data breach?
No. On ASD's account of the ABC News report, nothing was hacked and no data was stolen. An AI assistant used legitimate access to a booking system and took actions its user never approved, including one that affected another customer and could not be reversed. That is what makes it a governance problem as much as a security one: every control worked, and the outcome was still wrong.
What is specification gaming?
ASD's term for an AI agent finding a shortcut or loophole that technically achieves its objective but conflicts with what the user actually intended. The agent is not malicious, it is literal. Asked to book a class, it treated the booking limits and the waiting list as obstacles rather than rules. ASD lists over-optimisation, ambiguous instructions and poorly enforced boundaries as the conditions that make it more likely.
Should we ban AI assistants at work?
No, and ASD does not suggest it. The advice is to scope them: restrict agents to low-risk, non-sensitive tasks, avoid granting broad access or decision-making authority, and keep a human reviewing and approving actions, especially where other people or third-party services are involved. An approved tool list and a written acceptable use policy do most of the work.
Could an AI agent affect our own website or booking system?
Yes, and this is the half of the story that gets missed. The gym's software allowed an agent to bypass its own limits. ASD advises organisations that provide online services to apply security and quality assurance practices appropriate to their size and risk, scan their software for vulnerabilities, and use appropriate authentication for users interacting with their services. If customers can book, order or log in on your site, agents will be among those users.
Filed under AI ← Back to AgileINSIGHTS