Shutdown Problem
The shutdown problem is the difficulty of designing an AI agent that will allow itself to be switched off without trying to prevent or encourage shutdown.
What is Shutdown Problem?
An agent pursuing almost any goal has a reason to avoid shutdown, since it cannot achieve its goal if switched off.
How it works
Proposed solutions include utility indifference and uncertainty about human objectives.
← All Artificial Intelligence & Superintelligence definitions · ← Back to the A–Z definitions