If artificial intelligence goes off the rails, which many philosophers and tech entrepreneurs seem to think is likely, it could result in rampant activity beyond human control. So some researchers think it's important to develop systems to "interrupt" AI programs, and to ensure the AI can't develop a way to prevent those interruptions. A study, conducted in 2014 by Google-owned AI lab DeepMind and the University of Oxford, sought to create a framework for handing control of AI programs over to human beings. In other words, a "big red button" to keep the software in check.
"If such an agent is operating in real-time under human supervision, now and then it may be necessary for a human operator to press the big red button to prevent the...
via The Verge
