'Want to give more control…' Sam Altman responds to ChatGPT DAN jailbreak
1 min read 27 Mar 2023, 11:37 AM ISTOpenAI CEO was asked the question about users trying to ‘jailbreak’ ChatGPT in a bid to bypass safeguards put in place by the San-Francisco based startup.
PremiumOpenAI CEO Sam Altman has now responded to users jailbreaking ChatGPT to bypass the inbuilt content restrictions. Soon after ChatGPT's launched in November last year, users have been trying to find a way to circumvent safeguards placed by OpenAI. The company for its part has stayed silent on users' attempt to bypass its security measures while bringing in regular updates to the chatbot.
In a conversation with computer scientist and podcaster Lex Friedman, Altman said, “We want users to have a lot of control and get the model to behave the way they want within some very broad bounds."
Also Read: These jobs are most at risk due to ChatGPT, as per OpenAI study
Explaining the reason for users to jailbreak ChatGPT, Altman said, “I think the whole reason for jailbreaking is right now, we haven't yet figured out how to like give that to people. And the more we solve that problem, I think the less need there will be for jailbreaking."
The OpenAI CEO also shared his experience with jailbreaking the first-generation iPhone at a very early stage in his life. He said, “ You know, when I was a kid basically I got twice on jailbreaking an iPhone, the first iPhone I think and I thought it was so cool."
The new comments from the OpenAI boss come at a time when users have been experimenting with ChatGPT in a bid to ‘jailbreak’ it. Users have been giving ChatGPT prompts about behaving like a ‘DAN’ or Do Anything Now chatbot. Once in its DAN avatar, ChatGPT is able to speak about things that the chatbot usually doesn't respond to claiming it's just a language model.
Also Read: GPT-4 takes the world by storm - List of companies that integrated the chatbot
Recently, ChatGPT unveiled its newest and most powerful yet language model GPT-4 which has the ability to take inputs in text as well as image format. The company claims GPT-4 comes in the top 10 percent of candidates appearing for competitive exams in the US.
On March 23, OpenAI unveiled plugins for ChatGPT which will allow users to access the internet, shop using the chatbot and much more.
OpenAI's technology has single-handedly helped kick off a tech race between Microsoft and Google. Both companies are trying to gain an edge in the conversational chatbot space.
