NOTEWORTHY NEWS: OUR TAKE ON THE LATEST AI/GENAI NEWS
Noteworthy AI News for Agencies - Fourth Edition
By Jeremy Lockhorn , SVP, Creative Technologies & Innovation, 4A's
THE BIG STORY:
Last week, among other things, we talked about the importance and advancing capabilities of multi-modality in AI models. Multi-modal (ICYMI) refers to a model’s ability to accept multimedia inputs such as text, voice and imagery and deliver similar multimedia outputs. This week we’ll go from multi-modal to multi-model. Many AI solutions - including platforms developed by large agencies and holding companies - leverage multiple AI models, often matching different use cases to specific models based on cost, speed, performance, and suitability to a particular task. Sometimes referred to as “model chaining” or “model routing,” the basic idea is to create a mashup of different models, and a front end to accept user queries that then get sent to the appropriate model depending on complexity and other factors.
Digiday and AdAge both covered WPP ’s recent addition of models from Anthropic to their platform, providing great insight into the AI decision-making process and strategy at a large holding company.
But in a world where some estimates suggest there are thousands models now available, how do you go about evaluating the capabilities of different models, especially when they are changing at breakneck pace? It’s a complicated question that must start with your business objectives, level of investment and what AI expertise (either internal or external) you have available. Selecting the right tools is crucial and complex, but benchmark and ranking tools provide at least one important input into this decision process. Tools from Hugging Face and LMSYS.org’s Chatbot Arena Leaderboard are cited by many AI experts, function like a sort of like a consumer report for LLMs, helping to compare and contrast different options based on real-world performance. Scale AI just launched their SEAL Leaderboards to rank LLMs using unbiased data and expert evaluation. And on the safety and security front, the National Institute of Standards and Technology (NIST) on Tuesday announced an extensive effort to try to test large language models (LLMs) “to help improve understanding of artificial intelligence’s capabilities and impacts.”?
Our GenAI Certification for Advertising program, launching next week on June 3, touches on the importance of this and provides expert guidance for agencies.?
OTHER INTERESTING AI NEWS FOR AGENCIES:
领英推荐
RECENT AI CAMPAIGN EXAMPLES:
Visit our AI/GENAI Hub for the latest guidance from the 4A's.
Missed previous editions of Noteworthy News? Catch up here:
#AI #GenAI #ArtificialIntelligence #EmergingTechnologies