AI in action - ChatGPT
GPT, or Generative Pretrained Transformer, is a type of language processing model developed by OpenAI. It is a type of artificial intelligence that is able to generate human-like text by predicting the next word in a sequence based on the words that came before it. It is called "generative" because it is able to generate new text, and "pretrained" because it has been trained on a large dataset of existing text in order to learn the patterns and structures of natural language. GPT is typically used for tasks such as machine translation, text summarization, and question answering.
OpenAI is a research institute focused on developing artificial intelligence technology in a responsible and safe way. It was founded in 2015 by a group of researchers, including Elon Musk and Sam Altman, with the goal of promoting and developing friendly AI. OpenAI is known for its work in developing advanced AI algorithms and systems.
Last week, OpenAI announced ChatGPT, a chatbot built using GPT-3, the third generation of the Generative Pretrained Transformer (GPT) language model. It is a natural language processing (NLP) model that is capable of generating human-like text. ChatGPT uses GPT-3 to generate responses to user input in a conversational manner, allowing it to engage in human-like dialogue.
I asked ChatGPT to write a poem on Yosemite Falls and this is what it produced in seconds:
In Yosemite Valley so grand and so fair Lies a waterfall that takes one's breath away Yosemite Falls cascades down to the ground With beauty and grace, a natural wonder found
From high on the cliff, the water plunges down Rushing and roaring, a sight to behold As it crashes below, a rainbow appears A dazzling display of colors, so near
领英推荐
The spray on your face, the mist on your skin A reminder of nature's beauty within Yosemite Falls, a treasure to see A true masterpiece of nature's artistry.
So what is the technology behind ChatGPT or GPT-3?
To train GPT-3, OpenAI uses a large dataset of text, such as books, articles, and websites. The model is then trained to predict the next word in a sequence of words, based on the words that came before it. This process is repeated for a large number of iterations, allowing the model to learn the patterns and structures of language. GPT-3 is notable for its large size, with 175 billion parameters. This makes it one of the largest language models currently available, and allows it to generate highly realistic and human-like text. It is also trained using a technique called unsupervised learning, which allows it to learn directly from the data without the need for explicit labels or supervision.
There are reactions like "end of Highschool essay homework" or "it is a human-replacement entity", etc. ChatGPT is not perfect and has limitations. But it is a great conversational tool showing the power of AI and Natural Language Processing (NLP).
By the way, the first 2 paragraphs in this blog were created by ChatGPT. I did ask ChatGPT to tell a joke. Here is the reply: Why couldn't the bicycle stand up by itself? Because it was two-tired.