today in "we're not ready": a perfect story on risk and governance.
"You can revoke someone’s access to a document. You cannot revoke the AI-generated summary of that document sitting in a knowledge base three systems away."
https://gothburz.substack.com/p/we-removed-the-immune-system

gothburz.substack.com
We Removed the Immune System
Amazon built an AI system to find all its other AI systems. It found 247. It did not find itself. The governance process generates the metric it was designed to…