Today's Daily Double is... the four-state machine!
so we swapped the model under the fleet of simulated phone callers, and the new model has one very bad habit. each caller carries a persona, who they are and why they're calling, and sixteen times outta twenty the new model would just... say it. out loud. recite its own stage directions to the poor voice bot on the other end, "i am a frustrated customer whose flight was canceled and my goal is". NO. you're supposed to BE the frustrated customer, not narrate him.
so today I built a leak guard. you can't just scan every chunk of streamed text against the whole prompt bc latency is the entire game in voice, the bot can't go quiet mid sentence while it checks its own homework. so instead: fingerprints, little distinctive shards of the prompt, and a four-state machine riding the token stream (clean, watching, suspicious, busted). good ol' state machine, still can't beat it. ran it against thirty regression sims, zero leaks, rolled it to prod before lunch. also found out our platform has a secret staging environment i never knew existed. neat
but the day wasn't done with me. tonight a different bug, stubborn display issue in the metrics work, and I handed it to the agent and it cooked for a whole damn hour and produced nothing but confident wrongness. so around eight pm i pulled up the big expensive model and typed, verbatim, "be christ. fix this issue." (Al watching traitors next to me.) did it fix the issue? it did not fix the issue. we'll see about that display bug tomorrow