GPT-4 Is Coming – What We Know So Far
Bernard Marr
?? Internationally Best-selling #Author?? #KeynoteSpeaker?? #Futurist?? #Business, #Tech & #Strategy Advisor
Thank you for reading my latest article?Is?GPT-4 Is Coming – What We Know So Far.?Here at?LinkedIn?and at?Forbes?I regularly write about management and technology trends.
To read my future articles simply join my network here or click 'Follow'. Also feel free to connect with me via?Twitter ,??Facebook ,?Instagram ,?Slideshare ?or?YouTube .
---------------------------------------------------------------------------------------------------------------
ChatGPT has taken the tech world by storm, showcasing artificial intelligence (AI) with conversational abilities that go far beyond anything we’ve seen before.
The viral chatbot interface is based on GPT-3, said to be one of the largest and most complex language models ever created – trained on 175 billion “parameters” (data points).
However, it’s something of an open secret that its creator – the AI research organization OpenAI – is well into development of its successor, GPT-4. Rumor has it that GPT-4 will be far more powerful and capable than GPT-3. One source even went as far as claiming that the parameter count has been upped to the region of 100 trillion , although this has been disputed in colorful language by Sam Altman, OpenAI’s CEO.
But could it be the case that GPT-4 is already among us? Well, nothing has been announced for certain. But some have speculated that this is the version powering the newly-launched ChatGPT functionality within Microsoft’s Bing search engine. Although unexpected, it’s a claim that makes sense, given that the Seattle tech giant recently became the OpenAI’s largest single shareholder, with a $10 billion investment.
So how is GPT-4 different than what has come before it, and does it take AI closer to becoming, in the words of Google CEO Sundar Pichai , “more profound than fire or electricity” in terms of the impact it will have on society? Here’s what we know so far:
?
GPT-4 will be released some time in 2023
Although, as of writing, nothing has been announced officially, numerous outlets, including the New York Times , have reported that rumors are rife around the tech industry that GPT-4 is ready for release and is likely to see the light of day outside of OpenAI’s research laboratories this year. In fact, as we've stated, some believe that it's already here, in the form of the chat functionality recently added to Bing. Currently, users have to join a waiting list to get access to ChatGPT-powered Bing, but Microsoft has said it plans to open it to millions of users before the end of February.
If this turns out to be nonsense and Bing is, in fact, running on plain old GPT-3 or GPT-3.5 (an updated version released last year), then we may have to wait a little longer. GPT-3 was initially made available to selected partners, paying customers, and academic institutions before it became widely available to the public with the launch of ChatGPT in late 2022, and a similar controlled release may be used with GPT-4.
?
It might not be trained on much more data than GPT-3
Again, this is unconfirmed, but it seems likely to be a safe bet. Altman himself has dismissed the idea that it is trained on 100 trillion parameters as "complete bullshit," but some sources are claiming that it could be up to 100 times larger than GPT-3, which would put it in the region of 17 trillion parameters. However, Altman has also gone on record as saying it may not, in fact, be much larger than GPT-3. This is because effort may instead be put into improving its ability to utilize existing data rather than simply throwing more and more data at it. Some experts have pointed to the fact that a rival large language model (LLM) known as Megatron 3 is trained on substantially more data than GPT-3 but does not outperform OpenAI’s platform in testing as evidence that bigger is not always better in the realm of AI. Improving the efficiency of the algorithm would reduce the running cost of GPT-4 and, presumably, ChatGPT. This will be an important factor if it is going to become as widely used as the most popular search engines, as some predict.
?
领英推荐
GPT-4 will be better at generating computer code
One of the most impressive features of ChatGPT (and therefore GPT-3) is its ability to generate not just human languages but computer languages too. This means that it can easily create computer code in a variety of programming languages, including Javascript, Python, and C++ - three of the languages most commonly used in software development, web development, and data analytics.
Earlier this year, news broke that OpenAI was actively hiring programmers and software developers – and specifically, programmers with competence in using human language to describe what their code does. This leads many to predict that future products, including GPT-4, will push AI even further to break new boundaries when it comes to generating computer code. This could lead to more powerful versions of tools such as Microsoft's Github Copilot, which currently uses a fine-tuned version of GPT-3 to improve its ability to turn natural language into code.????
?
GPT-4 will not add graphics to its capabilities
There had been some speculation that the next evolution of generative AI would involve a combination of the text generation of GPT-3 with the image creation abilities of OpenAI’s other flagship tool, Dall-E 2. This is an exciting idea because it brings the possibility that it would have the ability to turn data into charts, graphics, and other visualizations – functionality missing from GPT-3. However, Altman denied that this is true and said that GPT-4 would remain as a text-only model.
?
Some people will be disappointed by GPT-4
When something causes as much excitement as GPT-3 has done, there’s an inevitability around the fact that the next iterations may not seem so groundbreaking. After all, once we’ve been amazed at a computer writing poetry, are we going to be as amazed a few years later by a computer writing slightly better poetry? This is a sentiment that’s even been expressed by Altman himself, who said in an interview in January , "The GPT-4 rumor mill is a ridiculous thing. I don't know where it all comes from … people are begging to be disappointed, and they will be.”
To stay on top of the latest on new and emerging business and tech trends, make sure to subscribe to?my newsletter , follow me on?Twitter , LinkedIn , and YouTube , and check out my books ‘Future Skills: The 20 Skills And Competencies Everyone Needs To Succeed In A Digital World ’ and ‘Business Trends in Practice , which won the 2022 Business Book of the Year award.
---------------------------------------------------------------------------------------------------------------
About Bernard Marr
Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity. He is a?best-selling author of 21 books , writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations. He has over 2 million social media followers, 1.7 million newsletter subscribers and was ranked by LinkedIn as one of the top 5 business influencers in the world and the No 1 influencer in the UK.
Bernard’s latest books are ‘Business Trends in Practice: The 25+ Trends That Are Redefining Organisations’ and ‘Future Skills: The 20 Skills and Competencies Everyone Needs To Succeed In A Digital World’.
As someone who's been following OpenAI's progress for some time now, I'm thrilled to hear about the development of GPT-4. The potential applications for this advanced language model are endless, and I'm excited to see how it can enhance and streamline various industries. It's amazing to think about the impact that GPT-4 could have on our daily lives.
Cybersecurity GRC Risk Leader | Women’s ERG Co-Lead | Thought Leader | WOC STEM Tech Rising Star | Girls Inc DC Woman of Impact | Strategy Execution Specialist | Mentor | Career Coach | SAIC Brand Ambassador
1 年Thank you for sharing these developments for GPT, Bernard Marr.
Expertise in Laundry Operations, Staff Training, and Process Optimization
1 年Dear Bernard, thank you for sharing your insights on the upcoming release of GPT-4. Your article provides a great overview of the current state of the art in language modeling and the potential capabilities of GPT-4.?? With improvements in performance and the potential for even more advanced natural language processing capabilities, GPT-4 has the potential to revolutionize the way we communicate with machines and each other.?? However, as you rightly point out, there are also concerns about the potential misuse of this technology. It is important for us as a society to have open and transparent discussions about the ethical implications of such powerful AI tools and to ensure that they are used for the greater good.?? Overall, I appreciate your thoughtful analysis of the current state of GPT-4 and the potential implications of its release. I look forward to following developments in this field and the exciting possibilities.??
Living a full life
1 年Greetings Bernard, I am fascinated by AI and the debate GPT has created in the education sphere. In the Western tradition, we have created the acquisition of knowledge to be an economic commodity, as well as seeing the acquisition of knowledge as the gateway to creating prosperous societies. The company that created GPT, is it wanting to challenge this economic paradigm?
AI Consultant @ Joseph Pareti's AI Consulting Services | AI in CAE, HPC, Health Science
1 年check it out with Nvidia: 500B parameters Megatron IS better than other LLMs. Size matters.