AI, MLOps, and Robotics #68

The latest developments in AI, MLOps, and Robotics: Meta LLM Compiler, Training Mixture of Experts at Scale, Fine-tuning Florence-2, Gemma 2, How Roblox Uses Generative AI, Fleshy robots, and much more!

Join me live at my fireside chat with Leo Dirac, Co-founder and CTO of Groundlight. We'll discuss the future of computer vision and robotics, two topics I've been passionate about for a long time! RSVP to attend live and get the recording.

?? AI News & Stories:

• Amazon hires founders from well-funded enterprise AI startup Adept to boost tech giant’s ‘AGI’ team - Read on GeekWire
• Agility Robotics’ Digit humanoid lands first official job - Read on The Robot Report
• University makes robotic hand 'breakthrough' - Read on BBC
• Scientists in Japan Give Robots a Fleshy Face and a Smile - Read on The New York times
• Persona AI Brings Calm Experience to the Hectic Humanoid Industry - Read on IEEE
• Cut the Noise: NVIDIA Broadcast Supercharges Livestreaming, Remote Work - Read on NVIDIA
• AI-powered scams and what you can do about them - Read on TechCrunch

?? ML Developer Tools & Resources:

• Training MoEs (Mixture of Experts) at Scale with PyTorch - Read on PyTorch
• Fine-Tuning YOLOv10 Models on Custom Dataset for Kidney Stone Detection - Read on LearnOpenCV
• Efficient data generation for source-grounded information-seeking dialogs: A use case for meeting transcripts - Read on Google Research
• Rich human feedback for text-to-image generation - Read on Google Research
• Welcome Gemma 2 - Google’s new open LLM - Read on Hugging Face
• XLSCOUT Unveils ParaEmbed 2.0: a Powerful Embedding Model Tailored for Patents and IP with Expert Support from Hugging Face - Read on Hugging Face
• Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models - Read on Hugging Face
• Introducing Synthetic Data Generation in Edge Impulse - Read on Edge Impulse
• How GenAI Provides Deep Understanding With Knowledge Graphs - Read on Neo4j
• LLMs in your project with Ollama + Flox - Read on Flox
• Finding GPT-4’s mistakes with GPT-4 - Read on OpenAI
• Expanding access to Claude for government - Read on Anthropic
• Building RAG with Self-Deployed Milvus Vector Database and Snowpark Container Services - Read on Zilliz
• Meta LLM Compiler is a state-of-the-art LLM that builds upon Code Llama - Read on Hugging Face

??? Upcoming AI Events (Ordered by date):

Like reading books? Join the AI book club, where we read a new book every month!

• Open source data ingestion for RAGs with dlt | July 8th - Register on Luma
• AI meetup (July): AI, LLMs, and ML (Seattle) | July 9th - Register on AI Camp
• Getting Started With GenAI: Pragmatic Advice for Real-World App Building - Register on Neo4j
• Mastering Data Science: The Impact of LLMs | July 17th - Register on Data Science Dojo
• Automate product descriptions with AI: Generate rich content & boost conversions | July 17th - - Register on LabelBox
• AI Book Club: AI Book Club: Prompt Engineering for Generative AI | July 23rd - RSVP on Meetup
• Python talk night at GitHub (Seattle) | July 24th - Register on Meetup
• Sora: Exploring Ethics, AI, and Personalization | July 31st - Register on DataScienceDojo
• RAG Hack Night at GitHub (SF) | August 13th - Register on Luma
• Hybrid Chatbots: Merging LLMs and Classification Models | Aug 21st - Register on DataScienceDojo

??? AI Podcasts & Interviews:

• How Roblox Uses Generative AI to Enhance User Experiences - Listen on NVIDIA
• Apple Intelligence & Advanced RAG | Practical AI Podcast - Listen on Changelog
• Earth’s Coming Population Collapse and How AI Can Help, with Simon Kuestenmacher - Listen on SuperDataScience
• Long Context Language Models and their Biological Applications with Eric Nguyen - Listen on TWiML
• State of the Art: Training >70B LLMs on 10,000 H100 clusters - Listen on Latent Space

?? Latest ML Research Papers

• Meta Large Language Model Compiler: Foundation Models of Compiler Optimization - Read on Meta AI
• AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator - Read on arXiv
• Long Context Transfer from Language to Vision - Read on arXiv
• Dataset Size Recovery from LoRA Weights - Read on arXiv
• Looking 3D: Anomaly Detection with 2D-3D Alignment - Read on arXiv
• Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space - Read on arXiv

Hello, world! Every week, I keep track of the most exciting news, resources, events, podcasts, and papers I find around AI, MLOps, and robotics. Sometimes I sprinkle in my opinions. Let me know in the comments what I missed this week!

You Can Support This Newsletter By:

?? join the Flyte MLOps Slack Group and introduce yourself!

? Give Flyte, the open-source MLOps project I work on, a GitHub star!

Connect with or follow me (Sage Elliott) for more machine learning, MLOps, and robotics content. Have a great week! ??