A group of senior artificial intelligence researchers, including Geoffrey Hinton and Yoshua Bengio, two of the scientists most closely identified with the modern development of the field, is calling on governments worldwide to prepare for the possibility of an "intelligence explosion": a scenario in which AI systems are used to conduct research and development, improve their own capabilities, and accelerate the pace of technological progress to a level that would be extremely difficult for human oversight and control.
The scenario is at the centre of a new paper titled "What if automating AI R&D triggers an intelligence explosion?" The paper is signed by more than 20 researchers, including Jack Clark, co-founder of Anthropic, and Jakub Pachocki, chief scientist at OpenAI.
