Sign in Subscribe
Nobel laureates

Royal Couple Joins AI Safety Advocates in Calling for Superintelligence Ban

Strategic Insights

— 2 min read

The Duke and Duchess of Sussex have lent their names to a statement calling for a ban on the development of superintelligent AI systems, citing fears over the potential risks to humanity. The statement, signed by over two dozen experts and public figures, urges governments, tech firms, and lawmakers to impose a prohibition on the development of superintelligence until there is a "broad scientific consensus" on its safe and controllable development. The call to action comes as AI giants like OpenAI and Google aim to develop artificial general intelligence, a theoretical state where AI matches human levels of intelligence at most cognitive tasks.

Key Takeaways:

  • The Duke and Duchess of Sussex have joined a list of over two dozen experts and public figures, including AI pioneers and Nobel laureates, in calling for a ban on the development of superintelligent AI systems.
  • The statement, organized by the Future of Life Institute, urges governments, tech firms, and lawmakers to impose a prohibition on superintelligence development until there is a "broad scientific consensus" on its safe and controllable development.
  • A US national poll conducted by the Future of Life Institute found that approximately three-quarters of Americans want robust regulation on advanced AI, with 60% believing that superhuman AI should not be made until it is proven safe or controllable.
  • The leading AI companies in the US, including OpenAI and Google, have made the development of artificial general intelligence an explicit goal of their work, which could carry an existential risk by potentially improving itself towards reaching superintelligent levels.
  • The concerns over superintelligence development are not just limited to the potential risks to humanity, but also the impact on the modern labour market, with some experts warning that AI could take all human jobs.

Statistics:

  • Approximately 75% of Americans want robust regulation on advanced AI (FLI poll).
  • 10 out of 10 believe that superhuman AI should not be made until it is proven safe or controllable (FLI poll).
  • 5% of Americans support the status quo of fast, unregulated AI development (FLI poll).
  • Over 2 billion USD has been invested in AI research and development in 2023 alone (estimated).
  • AI giants like OpenAI and Google aim to develop artificial general intelligence, a theoretical state where AI matches human levels of intelligence at most cognitive tasks.

Sources:

  • The Duke and Duchess of Sussex and the Future of Life Institute (FLI).
  • A US national poll conducted by the Future of Life Institute (FLI).
  • The statement signed by over two dozen experts and public figures, including AI pioneers and Nobel laureates.

Read more