Silent Upgrade Seismograph
Customers feel every change to your bot, announced or not. Catch the quake.
The job
Spots any change in an AI agent's behaviour from how customers react, from the team's own releases and knowledge base edits to a vendor quietly swapping the model. It dates each change, gives a before-and-after verdict and holds the vendor or team to account.
The moment
Each bot has its own seismograph that records shifts in how customers react to it. On 14 September it registers a magnitude 5.2 quake on the WhatsApp bot only, with nothing in the change register.
Around the centre of the quake, 38 customers say in their own words that the bot stopped understanding them.
Two days later, the vendor confirms it swapped the AI model.
The follow-up verdict on the aftershock reads "Improving".
What it does
- Register a quake
- Log a change
- Draft the vendor notice
- Email the vendor and open a task
- Open the evidence
What you see
A seismograph drum per bot with quake markers, magnitudes, felt reports pinned around the epicentre, and aftershock verdicts
What it moves
The days from an undisclosed change in behaviour to it being spotted (target under 3), and the share of recorded changes that have a before-and-after verdict.
Built for
- Frontline staff
- Partners & ecosystem
- QA, training & knowledge
