The Rising Group of Generative AI: 5 ChatGPT-like Models

ChatGPT has been the buzzword since the early 2023 but what does it mean? GPT is the abbreviation for Generative Pre-trained Transformer, since it uses a Generative AI and a Transformer model. It is a Large Language Model that was pre-trained using a huge set of knowledge, to be exact, 570GB of internet text data ranging from books, article, Wikipedia and other writings that is approximately 300 Billion words in total. The question is, how it is trained?

Since ChatGPT is a Generative AI, it uses a semi-supervised machine learning that enable them to use their knowledge to create a new possible output.

It predicts words or sequence of words with probabilistic distributions - for instance, when it generates the sentence ‘John likes to read….’ the word ‘book’ has higher probability than the word ‘bed’. There are two methods of prediction: next-token prediction is when it predicts the next word in the sequence and if it’s predicting a missing word in the sequence, it’s called masked language modeling.

To get to a stage where it could generate human-like answers, the model went through a supervised testing stage. The developers will input a question then the AI will generate answer based on the given knowledge, if it gets wrong, the team inputs the correct answer into the system. It then goes through another several testing stage. This training process is called Reinforcement learning from Human Feedback which enables constant improvement in understanding prompts and questions. The expected end-result would be an AI that knows wide knowledge, the know-it-all.

The 5 Rising ChatGPT-like Generative AI:

Though ChatGPT is the one that made Large Language Model Generative AI widely known, there are alternatives that are similar:

1.ELEUTHER.AI

https://www.eleuther.ai/ is a leading non-profit research focused on large-scale artificial intelligence research that started out from a Discord server for talking about GPT-3. EleutherAI is focusing in training open source?large language models?inspired by OpenAI's?GPT-3. Until now Eleuther.AI has released several model series:

• GPT-Neo (125M, 1.3B, 2.7B parameter): released in March 2021
• GPT-J?(6B parameter):?released in March 2021
• GPT-NeoX (20B parameter):released in February 2022

2. HuggingFace

HuggingFace is an AI community that?promotes open source contributions. From May 2021 to May 2022, more than 1,000 researchers from 60 countries and more than 250 institutions are creating together a very large multilingual neural network language model and a very large multilingual text dataset?on the 28 petaflops Jean Zay (IDRIS) supercomputer located near Paris, France. The goal of HuggingFace is to democratize AI and Machine Learning.

3.Google Bard LaMDA

Google LaMDA which was launched on 18th May 2021 is considered to be one of the biggest competitors of ChatGPT. LaMDA is developed on a platform called ‘Transformer’, which is a Novel Neural Network Architecture for Language Understanding. LaMDA has been trained with more than 1.56 trillion words and 137 billion parameters.

4.ColossalChat

CollosalChat is based on Meta's LLaMA model. Yang Yoo, ColossalChat's developer claims in his Medium article that ColossalChat Coati model is "the first practical open-source project that includes a complete RLHF process for replicating ChatGPT-like models".

5.DeepMind Sparrow

Sparrow focuses on creating an AI that have minimal risk of unsafe and inappropriate answers. Their goal is to create a good AI that knows about the communication ethics and have the capability to decline answering questions that have potential to encourage harmful behavior.

The Future of Similar Models

With how well-received ChatGPT is in the market, we can expect that similar models will come out in the near future and more researches will be funded to create a better language model, probably, with better ethics controls.

Thing to note:

Generative AI Large Language Models works best to generate human-like answers but it cannot take actions. For example, input sales data or receive payment.

That means it cannot be used as is, hence, 3Dolphins Chatbot ecosystem serves as the encapsulating tool for the generative AI, the capability to integrate with 3rd party system as well as multiple communication channels. 3Dolphins is creating human-like Chatbot without losing its effectiveness in automation such as integration with payment gateway or customer and sales database. Essentially, turning the know-it-all knowledge into the Jack-of-all trades actions.

For instance, this solution can be utilized in an online shop where businesses can have a more human-like online sales assistant that helps customer navigate through the products and guides them until the payment process.

Going back to the foundation of Chatbot for businesses: It is not only to generate human-like answers, but also get things done for customers.