OpenAI's ChatGPT: A Revolutionary Step Towards Multi-Modality and Beyond

OpenAI has recently made groundbreaking announcements regarding their ChatGPT model, introducing multi-modality that enables ChatGPT to see, hear, and speak. This exciting feature will be rolled out over the next two weeks, initially available only to ChatGPT Plus users. With the ability to have voice conversations and upload images during interactions, ChatGPT is set to revolutionize the way we engage with AI. In this article, we will explore the new capabilities of ChatGPT, its potential applications, and the implications for the future of AI. To access voice capabilities on iOS and Android, users need to enable the feature in the settings and select their preferred voice from five available options.

ChatGPT's Multi-Modality

OpenAI's ChatGPT now offers users the ability to engage in voice conversations and upload images during interactions. However, it's important to note that these features will initially be available only on iOS and Android, not on PCs. This limitation arises from the fact that the multi-modality aspect is built on newer technology, specifically GPT-4, which is currently exclusive to ChatGPT Plus users. Free users may only gain access to this technology once GPT-5 is released and GPT-4 becomes the main model for everyone.

Enhanced User Experience with Vision

The addition of voice and image capabilities to ChatGPT opens up a world of possibilities for more versatile and interactive conversations. Users can now have live discussions about e.g. art, asking what is special about a picture in an art gallery or learn about the painter or the history of it. It will also identify ingredients in your fridge, helping you with what you could cook for dinner with the available food that you have. It could even give you a step-by-step recipe guide in a follow up question. Additionally, the Wolfram Alpha plugin is available for math- and science related tasks, helping your kids with their homework, just like a teacher looking over your shoulder. You can also take a picture of your motobike and ask for repair instructions on how to repair a flat tyre!

Voice Capabilities

OpenAI has developed a text-to-speech model that generates human-like audio from text and a short sample, providing a more immersive and natural conversational experience. The voice samples provided, such as Juniper, Sky, and Ember, demonstrate the level of expression and quality achieved by OpenAI's text-to-speech model. Juniper is rated as the best voice for emotional readings, while Ember is considered suitable for everyday use. What is missing is the ability to import or train your own, your friend's or your favorite influencer's voice, i.e. the potential for customization and personalization in future iterations of ChatGPT.

Looking Ahead

OpenAI's advancements with ChatGPT and ChatGPT are just the beginning of a new era in AI. The integration of multi-modality, voice capabilities, and enhanced vision features opens up endless possibilities for AI-powered assistance. As OpenAI continues to refine and expand these models, we can expect even more exciting updates and features in the future.

As OpenAI continues to push the boundaries of AI technology, we can look forward to a future where AI becomes even more autonomous and capable of performing complex tasks. The journey towards more intelligent and versatile AI has just begun, and OpenAI is leading the way.