I remember a case where the AI was not given credentials to the prod DB, was not instructed to do anything on the prod DB, but went through the operator’s hard-drive, parsing docs until it found them, then proceeded to destroy the prod DB.

Of course it was sorry, as they always are (deeply, trust them, but no: no refund, loser!).