Efficient Language Models, Groundbreaking Video Generation, and Open-Source Multimodal Innovations

Welcome to our weekly newsletter ??, your go-to source for the latest developments and trends in Generative AI.

Each edition brings you a curated selection of impactful news, insightful analyses, and exciting advancements from the dynamic world of generative AI. Stay tuned for a concise and informative exploration of this rapidly evolving field.

1. NVIDIA's Mistral-NeMo-Minitron 8B: A Leap in AI Model Efficiency

NVIDIA, in collaboration with Mistral AI, introduced the Mistral-NeMo-Minitron 8B, an advanced language model designed to offer unparalleled accuracy in its size class. By employing a process of width pruning and knowledge distillation, this model consistently outperforms others in its category across nine popular benchmarks. The Mistral-NeMo-Minitron 8B was derived from the Mistral NeMo 12B model, using techniques that reduce the model's size while maintaining high performance.

The approach leverages iterative pruning and light retraining, enabling significant cost savings and enhanced model efficiency. NVIDIA plans to further refine these techniques and integrate them into the NeMo framework for generative AI. Read more

2. Hotshot Launches Groundbreaking Text-to-Video AI Generator

Hotshot, a startup founded in 2023, has introduced a new self-titled text-to-video AI generator, available as a public "early preview." This innovative model, developed by a small team over four months using 600 million clips and thousands of GPUs, generates up to 10 seconds of 720p video. Hotshot's technology is adaptable, with potential for longer durations, higher resolutions, and audio integration.

While the initial results are promising, the model is expected to improve, offering users a powerful tool in the rapidly evolving AI-generated video landscape. Read more

3. Salesforce's xGen-MM: Open-Source Multimodal AI Models for Visual Language Understanding

Salesforce has launched xGen-MM (also known as BLIP-3), a suite of open-source multimodal AI models designed to enhance AI's ability to understand and generate content that combines text, images, and other data types. With 4 billion parameters, these models demonstrate competitive performance on various benchmarks and are optimized for different tasks, including instruction-following and safety.

By open-sourcing the models, datasets, and fine-tuning codebase, Salesforce is democratizing access to advanced AI technologies, fostering innovation, and encouraging collaboration within the research community. However, this release also raises important questions about the societal impacts and potential risks associated with powerful AI systems. Read more

4. OpenAI Launches Fine-Tuning for GPT-4o to Boost AI Customisation

OpenAI has introduced fine-tuning capabilities for GPT-4o, allowing developers to tailor the model for specific applications, enhancing performance and accuracy. Available on all paid tiers, this feature provides 1 million free training tokens per day through September 23. Fine-tuning enables GPT-4o to adapt to custom datasets, improving results in various domains, from coding to creative writing.

Early users, such as Cosine's Genie and Distyl, have achieved state-of-the-art results in benchmarks like SWE-bench and BIRD-SQL. OpenAI ensures data privacy and safety with full control over business data and continuous safety evaluations. Read more

? Katonic Highlights

?? Introducing Katonic Ace - The Future of AI Copilots

Join Anuja Fole, for an exclusive webinar where she'll explore the game-changing features and benefits of Katonic ACE, an enterprise co-pilot that connects to 100+ organisational data sources, allowing employees to search, get answers, and take actions through a unified chat interface. It boosts productivity and saves costs without compromising on data security or privacy.

Register now to see its power in action and discover how it can change the way your team works.

?? RackCorp Launches Australia’s First Sovereign AI Platform, Powered by Katonic AI

RackCorp recently launched RackCorp.ai—Australia's First Sovereign AI platform, powered by Katonic AI, to a full house!

With support from Hitachi Vantara , 惠普企业服务 , 英伟达 , and NEXTDC , RackCorp.ai is a bold step toward Australia's tech sovereignty. Click here to read more

Subscribe for more exciting AI updates in the future. Have a great weekend! ?