I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.
A human can be held responsible. A machine cannot. If the machine writes bad code, and someone gets injured or killed because of it, who takes responsibility?
I state again: a machine cannot be held responsible.
It is never the coder that is responsible, it is the one who makes the code available to use. Often with humans, they are one and the same. With machines, they are not.