Discussion about this post

User's avatar
The Next Evolution's avatar

The accountability column is the right instinct, but it assumes organisations understand what they're actually accountable for. Most don't — yet.

The liability question isn't theoretical. Every output an AI system produces, every action an agent takes, every decision a model influences — the deploying organisation owns the consequence. Right now, most are pointing down the supply chain. The model provider. The integrator. The vendor whose API sits underneath it. But that chain doesn't distribute liability; it obscures it. The deployer is still the deployer.

Legislation will force this into focus, and the precedent is already set in an adjacent space. The UK Automated Vehicles Act places full responsibility on the motor insurer and the manufacturer when an automated vehicle causes harm — not the road, not the sensor supplier, not the algorithm. The same logic will travel. Once legislators and courts start applying it to AI agents and decision systems, the organisations currently pointing downward will find the accountability column they didn't build has been built for them, and the name in it is theirs.

The column you're proposing is governance architecture. It works when the named person had genuine input at the design stage. In most deployments, governance is retrofitted after launch — which means the accountability is real but the authority wasn't. That gap is where the next wave of liability cases will be made.

Bianca Schulz's avatar

The problem I see, is: Nobody can take this responsibility, because it is like a black box what all the agents did. No human can really understand what happened between A and B. My philosophy is, to not let agents be fully autonomous in their decisions, but bound them very tight into a closed-world vocabulary with very limited choices of actions and where they can only read, write, research.

1 more comment...

No posts

Ready for more?