ChatGPT Pro: It costs 10 times more, but is it 10 times better?
Rodrigo Díaz Concha
Microsoft Regional Director | 16x Microsoft MVP (Azure & Developer Technologies) | Seasoned Solutions Architect | Driving Innovation with AI | LinkedIn Learning Author | Solliance Partnering Consultant | Global Speaker
Yesterday, OpenAI's CEO Sam Altman announced ChatGPT Pro: "...$200/month. unlimited usage and even-smarter mode for using o1. more benefits to come!"
X's user, @ashbhatia, reported the result of a simple query on a car counting problem using o1 on ChatGPT Pro:
Which, as you can see, is completely wrong.
Now, I used the same image and prompt with different models:
Below are my findings:
Grok
o1
Take into account that due to the limitations of the ChatGPT Plus plan, it switched to ChatGPT-4o after I received the response because I reached the o1 limit for the plan.
GPT-4o
Claude
As can be seen, Claude nailed it, even on the free tier I'm using. It was the only model that answered this query correctly.
Conclusion
If I were to pay a subscription that’s 10x the price of what I’m currently paying, I’d definitely expect a 10x improvement in response quality. On the other hand, it might be a bit too soon to determine if ChatGPT Pro is truly worth it.
What do you think? Are you planning to pay for ChatGPT Pro? Yes/No/Why?