Do we know what is at stake?
You will have seen from my posts, that I side with Ilya Sutskever (head of research) in this OpenAI struggle. Like him, I think he made the wrong decision to vote with the OpenAI Board to remove Sam Altman. I've read funny posts that show how if the OpenAI Board had asked ChatGPT what they should do, they would have received better advice on what to do! I side with Ilya because he realises what is at stake here. He realises the path that Sam and Greg were taking OpenAI down.
The reason OpenAI exists is to make sure that AGI (Artificial General Intelligence) when it arrives, makes life better for all humanity. An AGI unaligned to #AIforGood will be catastrophic. My view is that the biggest risk of AI / AGI is not limited to "bad people", but rather more likely to be the unintended consequences of the use of very powerful AI/AGI.
It appears that in the last few weeks, based on Sam Altman's public comments, that OpenAI researchers led by Ilya have developed a powerful new step towards AGI. Sam described that we will see GPT-4 Turbo as 'quaint' by this time next year. Powerful AI mustn't be released without the necessary work baking in Alignment.
领英推荐
This is important. AGI is likely to develop when AI has a capability similar to or greater than AI developers. At that stage, it will be able to use simple compute power to improve itself and there starts the potential for AI development without guardrails. It could be months, weeks or days before the AI develops into something we might define as AGI. If this has no alignment then the risks from unintended consequences become unknown.
From what I am reading at the moment, people are seeing the OpenAI troubles as similar to other corporate breakdowns. In this case, I believe it is not and it is much more than that.
Does Ilya have a choice he can make that safeguards the development of AGI? I think the best he can hope for is keeping OpenAI's mission viable. Achieving that seems more complex by the day.
*I didn't use generative AI to write this, every word is my own.
AI | Solution Architect | Developer | Advisory Board Member
1 年Ilya, after a failed Coup attempt, suffers from an immediate dose of regret… not surprising.
Premium Ghostwriter | I ghostwrite educational email courses for Functional Medicine and Corporate Wellness Founders. 15+ years Nurse Leader and obsessed with AI strategy
1 年Thanks Matt, very balanced point of view. I definitely agree. Ilya is a scientist first of all. And would have made the difficult decision to oust Altman with safety in mind. But at the end of the day innovation and AI advancement won the game. Which we hope aligns with safe exploration and implementation of AGI.
CMInstD, MEngNZ, Chair - AI Forum GenAI WG
1 年Here we go, introducing Q*
CMInstD, MEngNZ, Chair - AI Forum GenAI WG
1 年The announcement of the return of Sam Altman to CEO role of OpenAI secures their mission again, but potentially with doubts about whether safety and alignment is being held up as essential prior to progress. Ilya’s role needs to stay on the Board in my view as it is likely that Microsoft will regain a Board representative.