Insider's Edit: ChatGPT Performance Drift - a New Risk for Business
AI Business
Informing, educating and connecting the global AI community. Next up: #AISummit London, June 2024
In this edition of Insider's Edit, we bring you the most recent top reads on AI Business. Let’s get going!
ChatGPT’s performance can fluctuate wildly, with mistakes in its output increasing over time and making it "challenging" for stable integration into business workflows, according to a new study by researchers from Stanford University and UC Berkeley.
In the paper, ‘How is ChatGPT's behavior changing over time?’, scholars sought to uncover whether updates to an AI model aimed at improving aspects of the application ended up hurting its generation abilities. They chose to measure GPT-3.5 and GPT-4, the two most popular large language models in use and that power ChatGPT free and paid versions.
“It is currently opaque when and how GPT-3.5 and GPT-4 are updated, and it is unclear how each update reflects the behavior of these LLMs,” the researchers wrote.
“These unknowns make it challenging to stably integrate LLMs into larger workflows,” they concluded. If the LLM’s response to a prompt in terms of accuracy and formatting “suddenly changes, this might break the downstream pipeline. It also makes it challenging, if not impossible, to reproduce results from the ‘same’ LLM.”
Meta has unveiled the?latest version?of its popular language model, Llama. Called Llama 2, the model is now free for businesses to adopt, customize and monetize as they please.
领英推荐
Llama 2 comes in three model sizes –?seven billion parameters,?13 billion parameters?and?70 billion parameters?– and is open source, meaning it’s available for research and commercial use. Also available are versions focused on chat applications.
Meta has also released the model weights and starting code for both the pretrained and conversational fine-tuned versions of Llama 2. Users can?request access here;?the model is also available via?Hugging Face. Alternatively, Llama 2 can be?accessed?through its "preferred" partner, Microsoft, according to Meta CEO Mark Zuckerberg.
OpenAI is offering users the ability to customize ChatGPT outputs. With Custom Instructions, users can ensure ChatGPT adheres to specific rules.
Available in beta to ChatGPT Plus subscribers, users can put in place rules for ChatGPT to follow, like asking the chatbot to generate text in a specific voice and style or code in a unified format.
Business users could employ Custom Instructions to ensure marketing copy is generated in line with the brand's voice or ensure content is localized for a specific market.
Stay updated on advancements in AI. Sign up for our email newsletter for more news and insights for the enterprise.