Active Stocks
Wed Jul 24 2024 15:59:42
  1. Tata Steel share price
  2. 160.30 0.16%
  1. NTPC share price
  2. 392.55 2.67%
  1. ITC share price
  2. 494.05 0.41%
  1. State Bank Of India share price
  2. 852.25 -1.35%
  1. Wipro share price
  2. 500.05 -0.10%
Business News/ Ai / Artificial Intelligence/  Can AI destroy humanity? ChatGPT maker OpenAI forms team to study risks
BackBack

Can AI destroy humanity? ChatGPT maker OpenAI forms team to study risks

OpenAI creates team to study ‘catastrophic risks’ posed by 'frontier AI' models that include Chemical, biological, radiological, and nuclear (CBRN) threats.

FILE PHOTO: A keyboard is placed in front of a displayed OpenAI logo in this illustration taken February 21, 2023. REUTERS/Dado Ruvic/Illustration/File Photo (REUTERS)Premium
FILE PHOTO: A keyboard is placed in front of a displayed OpenAI logo in this illustration taken February 21, 2023. REUTERS/Dado Ruvic/Illustration/File Photo (REUTERS)

ChatGPT maker OpenAI is creating a team to study the catastrophic risks posed by the 'frontier A'I' models created by the company. The new team called Preparedness will look at some serious threats posed by artificial intelligence technologies including Chemical, biological, radiological, and nuclear (CBRN) threats.

In a blogpost about the new initiative, OpenAI wrote, “To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge."

“We believe that frontier AI models, which will exceed the capabilities currently present in the most advanced existing models, have the potential to benefit all of humanity. But they also pose increasingly severe risks." the Sam Altman led company noted.

OpenAI noted that the company is aiming to minimize the risks posed by AI models as they continue to improve with the new ‘Preparedness’ team that will led by Aleksander Madry, Director of Massachusetts Institute of Technology's Center for Deployable Machine Learning and will now be on leave to join OpenAI, Forbes reported. 

The new team will “tightly connect capability assessment, evaluations, and internal red teaming for frontier models, from the models we develop in the near future to those with AGI-level capabilities."

Moreover,  the Preparedness team will also track, evaluate, forecast and prepare against catastrophic risks spanning multiple categories like individualized persuasion, cybersecurity, chemical, biological, radiological, and nuclear (CBRN) threats, autonomous replication and adaptation (ARA). 

The mission of the Preparedness team will also involve developing a Risk-Informed Development Policy (RDP) which will detail OpenAI's approach to developing future AI models, taking protective measures and establishing a government structure for accountability and oversight.

Moreover, OpenAI has also launched an AI Preparedness Challenge to give ideas on catastrophic misuse prevention. The company is willing to offer $25,000 in API credits to the top 10 submissions.

 

3.6 Crore Indians visited in a single day choosing us as India's undisputed platform for General Election Results. Explore the latest updates here!

Catch all the Business News, Market News, Breaking News Events and Latest News Updates on Live Mint. Download The Mint News App to get Daily Market Updates.
More Less
Published: 27 Oct 2023, 10:31 AM IST
Next Story footLogo
Recommended For You