Lore #79: Adobe To Integrate Sora, Pika, and Runway Into Premiere Pro

Good morning,

Another crazy week in AI with Adobe announcing they will be adding AI video-creation tools to Adobe Premiere Pro, OpenAI launching a new LLM model optimized for Japanese, and much more.

Before we begin, I’d like to thank everyone who supported the launch of The Next Wave, a HubSpot original podcast I am co-hosting with my friend Matt Wolfe! We’ve already reached over 4.2k subscribers on YouTube, 12,000 views, and even trended on Spotify in the news & politics section.

We just released a new episode with Greg Isenberg, in which he provides a step-by-step blueprint for using AI in your business. I hope you’ll check it out!

NEWS

Gemini 1.5 Pro Now Available in 180+ Countries; With Native Audio Understanding, System Instructions, JSON Mode and More

Google has expanded the availability of its advanced Gemini 1.5 Pro model to over 180 countries, introducing significant enhancements including native audio understanding and system instructions. This latest iteration, accessible via the Gemini API in public preview, also features a new File API and JSON mode for more precise control over outputs. Additionally, Gemini 1.5 Pro now supports audio and video modalities, allowing for complex reasoning across multiple formats. Developers can access these new capabilities and more through Google AI Studio, where they can also utilize the newly improved text embedding model that surpasses previous versions in performance.

Grok-1.5 Vision Preview

Grok-1.5V, a first-generation multimodal model from Grok, is set to be released soon to early testers and existing users. This model enhances the processing of visual data such as documents, diagrams, and photographs, and stands out in the new RealWorldQA benchmark for real-world spatial understanding.

Generative AI video tools are coming to Adobe Premiere Pro

Generative AI in Premiere Pro powered by Adobe Firefly | Adobe Video

Adobe has unveiled a suite of generative AI tools designed to transform video creation within Adobe Premiere Pro. These tools, which include capabilities for extending clips, adding or removing objects, and integrating video and audio edits, are set to streamline workflows and expand creative possibilities for professional editors. Additionally, Adobe is enhancing its platform by integrating third-party AI models from companies like OpenAI, Pika Labs, and Runway.

Microsoft to invest $2.9 billion in AI and cloud infrastructure in Japan while boosting the nation’s skills, research and cybersecurity

Microsoft announced a significant investment of $2.9 billion over two years to expand its cloud computing and AI infrastructure in Japan. This investment will enhance Japan's digital capabilities and includes plans to train over 3 million people in AI technologies, open the first Microsoft Research Asia lab in Tokyo, and strengthen cybersecurity in collaboration with the Japanese government. The announcement coincides with Japanese Prime Minister Fumio Kishida's state visit to the US, emphasizing the deepening partnership between the two nations in technology and security.

Other news

• The Forbes 2024 AI 50 is here (Link)
• Introducing OpenAI Japan (Link)

Unleash the Power of AI with Graydient (Ad)

Step into the future of AI with Graydient, your ultimate destination for unlimited Stable Diffusion and unfiltered language models on all your devices.

What Graydient AI offers:

• Unlimited Credits: Enjoy endless AI creations without worrying about running out of credits.
• Preloaded Models: Access 8 terabytes of the best AI models, ready to use without any boot time.
• Multi-Device Compatibility: Experience lightning-fast performance on your PC, Mac, tablet, or laptop.
• Diverse Applications: Explore a wide range of AI-powered tools for image generation, chatbots, and more.
• Community Engagement: Connect with like-minded AI enthusiasts in our vibrant interest groups.
• Flexible Plans: Choose from Starter, Pro, and Plus plans to suit your needs and budget.

As an exclusive offer, sign up now and get 2 months free, plus save 15% off your subscription. Don't miss out on this opportunity to join the AI revolution with Graydient.

Join Graydient today and embark on a journey of limitless AI possibilities. Plus by signing up, you help support this newsletter which we work hard on. Thank you!

FURTHER STUDY

• Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention (Link)
• OmniFusion Technical Report (Link)
• Rho-1: Not All Tokens Are What You Need (Link)
• LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders (Link)

VENTURE DEALS

• Microsoft invests $1.5B in UAE-based G42 (Link)
• Upstage raised $72M to develop LLMs (Link)
• Arcadia raised $50M to propel community solar and AI-driven energy solutions (Link)
• Bridgewise raised $21M for AI-based analysis platform for global securities (Link)
• DeepCure raised $24M to advance programs in immunology and inflammation (Link)
• Neysa raised $20M for its AI cloud and platform as a service (Link)
• Alethea Group raised $20M for AI disinfo detection (Link)
• Dot Compliance raised $17.5M for AI-enabled Quality Management System (QMS) solutions (Link)
• Udio raised $10M for AI music generation (Link)
• Lawhive raised ￡9.5M for ‘AI lawyer’ that completes admin tasks (Link)
• Qureight raised €8M to accelerate drug development in lung and heart disease (Link)
• Spines raised $6.5M to upend hundred-year-old publishing process (Link)
• HumanX raised $6M to launch the premier community for AI (Link)
• Sapien raised $5M for AI-driven data labeling (Link)
• Patlytics raised $4.5M to transform patent intelligence with AI (Link)
• Sortium raised $4M for video game development (Link)
• Inference Labs raised $2.3M to revolutionize AI with Proof of Inference (Link)

Coming up:

• Elon Musk’s xAI Takes on OpenAI: $4 Billion Funding Goal Set (Link)

That's it!

See you next week!

-Nathan Lands

If you want to support Lore, please:

1. Share this newsletter
2. Follow us on Twitter @NathanLands & Lore.