It might surprise many people that a proposal in Delaware could allow a company’s day-to-day affairs to be managed by an AI agent rather than a person. The proposal remains under discussion, but it raises a question every business leader should consider: if AI runs the company, who remains in command?

Delaware’s proposed framework would create a supervised testing arrangement for AI-managed businesses. Supporters argue that a defined legal structure could make their activities more visible and accountable. Critics question whether the proposed liability protections could leave the humans and organisations behind them insufficiently answerable when harm occurs. The US House Oversight Committee has requested information about the initiative.

A designated human leader should remain in command, supported by an accountable board. AI may manage daily operations within delegated limits, but people must retain authority to set objectives, approve significant risks, change those limits and stop the system.

That is the question the Delaware proposal must answer clearly: which human can intervene, and do they have the practical power to do so?

Before asking how much of a company AI can run, leaders should establish how they will direct it, challenge it and bring it to a halt.

For a practical framework connecting organisational AI governance to independent checking, runtime controls and human command, explore Orchestration and Command in the Age of AI.

For further information: ai-humancapability.com

About the author

R T Scanlon is the author of three books on AI and human capability. He has worked in education, management and other practical roles, and holds an MBA with a dissertation focused on quality assurance.

Meet the author → Books on Amazon → (opens in a new tab) LinkedIn → (opens in a new tab)