The Super Intelligence (SI) narrative battle is forming into two camps: the doomers who believe in unproven theory and those who are grounded in reality.
There are enormous consequences for who wins this rhetorical match, as the victor will have great influence over the most consequential innovation since the internet.
In the policy and politics world, these two respective universes fundamentally disagree about what kind of problem SI can pose to the world.
The SI doomers witness the development of increasingly capable SI models and chalk it up as evidence of increasingly sentient intelligence that will eventually become an uncontrollable monster. Essentially, what amounts to Frankenstein’s monster. They understand the real limitations in today’s systems and extrapolate to scenarios in which future systems are actively trying to deceive their operators without instructions, go “rogue,” and eventually threaten the whole of humanity.
On the other side, there are those who accept the reality that we are dealing with an incredibly potent and powerful technological breakthrough. And yes, it must be tested, monitored, and even restricted at times if engineers aren’t confident about their controls.
Join the conversation as a VIP Member