And these models, as impressive as they may be now, will be quaint compared to their successors.
As many AI executives such as Sam Altman, Dario Amodei, Demis Hassabis, Elon Musk, and Mark Zuckerberg will freely admit, a primary goal of the tech industry is to build AI that can fully automate its own research and development—known as recursive self-improvement—which, if possible, would be the most crucial step toward rendering all of us obsolete.
For my reporting, I’ve spent the last three years talking to dozens of AI safety staffers at the leading companies. Typically, I have found that these genuinely well-intentioned researchers believe that AI will become superhuman across the board, but we might be able to create superhuman automated safety researchers to watch over them.
How will they be able to understand and control systems that truly outsmart us? Or catch subtle drift between what we want and how the models behave that compounds over generations? Who knows.
Read the full article here
