Reported by TechCrunch AI
OpenAI co-founder and CEO Sam Altman believes that people should stay in charge of the future when it comes to how AI technology impacts the world and everyone’s lives. Speaking at The New York Times Dealbook Summit on Wednesday, the AI executive referred to discussions in Silicon Valley about whether there will be a gradual handover to AI —meaning AI will eventually become the decision-making authority across every major industry and institution.
“One thing we’ve been talking a lot about recently is there’s been this thing in Silicon Valley that seems almost ridiculous to have to fight against, but we both believe very deeply that people need to stay in control of the future, and there’s increasing talk about, well, there is either going to be or there should be this sort of gradual handover to AI. And I — we both — agree that that’s a terrible idea,” said Altman, who was sharing the stage with OpenAI co-founder and President Greg Brockman.
The handoff theory stems from the idea that as AI models become increasingly more powerful, they will learn to improve themselves — a concept known as “recursive self-improvement” or RSI. As existing AI technology builds newer, smarter generations, those will eventually become a superintelligence that humans can no longer control, the belief goes.
More from the original report
Altman explained that he and Brockman only disagree over how to best accomplish the goal of keeping humans in control, or what sort of challenges we should expect to face along the way. However, Altman characterized this as more of a debate between two people who share the same larger views.
“The question of how to actually prevent [handover] from happening — how to actually ensure that we will, given all of the various pressures and given what other companies may try to do — that we are going to actually ensure that people stay in control of the future in a very deep way, and we don’t have this either accidental or intentional handover — I think we can both agree on that,” Altman said.
Brockman added that, as the models improve, there’s…
