Is there no GPT 5?

The world of artificial intelligence is on the cusp of a major shift. OpenAI CEO Sam Altman has warned that the era of simply scaling up AI models is coming to an end. Instead, he believes that future progress will come from finding new ways to improve algorithms beyond scaling.

Altman's comments have sparked a debate in the industry and beyond, with many wondering what this means for the future of AI. As it turns out, the cost of training and running large language models has contributed to this shift.?

OpenAI's ChatGPT reportedly cost over $100 million to train and required more than 10,000 graphics processing units. In addition, the latest H100 GPUs from Nvidia can cost as much as $30,603 per unit, making the economics of scale unsustainable.

So, what does this mean for the future of AI??

Altman thinks that we can make AI better by not just making models bigger, but by improving how they work. This means we need to find new ways to make the computer smarter and more efficient.

But even though we need to change how we develop AI, there are still lots of possibilities for the future of AI. Altman's warning can help us explore new ideas and ways of making AI even better. Sure, using GPUs can be pretty expensive, but if we can find a more affordable way to do it, we might be able to make even more progress in the field.

The bottom line

AI is evolving, and researchers and companies must be ready to adapt to new trends and strategies. The era of scaling up AI models may be coming to an end, but this also presents an exciting opportunity for innovation and progress in the field. As we move forward, we can expect to see new breakthroughs in AI development that go beyond simply making models bigger.