I'm working on a safety tool for AI agents aimed specifically at helping non-technical teams like Finance and Legal. The tool will create snapshots of application states before any changes are made by the AI, so if things go sideways, you can easily revert back to the previous version. This includes apps like Google Sheets, Salesforce, and others. My question is: would having a guaranteed "Undo" button ease your concerns about deploying AI automation, or do you still see AI making changes to production settings as too risky? Also, which other applications do you think can benefit from this kind of rollback feature?
1 Answer
I just can't trust AI to follow instructions properly enough as it is. The idea of it having to undo its own mistakes? Nah, that sounds risky to me.
A snapshot might be more of a rollback than truly undoing things. I'm not sure how that would play out if other tasks follow after a change; that could lead to serious issues.