AI, MLOps & Robotics Newsletter #79

The latest developments in AI, MLOps, and Robotics: Introducing OpenAI o1, Fei-Fei Li’s World Labs, Rethink Robotics relaunches, Grounding AI in reality, Accelerate 1.0.0 is here, The role of VectorDBs for Agents, improve multimodal evaluations, and much more!

?? Join me live at my next workshop on 9/25: Intro to ML Pipelines: Build Reliable AI Workflows. RSVP to attend live and get the recording.

?? AI News & Stories:

• Fei-Fei Li’s World Labs comes out of stealth with $230M in funding - Read on TechCrunch
• How one Kenyan startup is working to solve local challenges with Llama - Read on Meta AI
• The slow road to smart robots - Read on Axios
• Rethink Robotics relaunches with cobots, AMRs, mobile manipulation - Read on The Robot Report
• This AI chatbot got conspiracy theorists to question their convictions - Read on nature
• AI coding assistants wave goodbye to junior developers - Read on CIO

?? ML Developer Tools & Resources:

• Introducing OpenAI o1-preview - Read on OpenAI
• Learning to Reason with LLMs - Read on OpenAI
• Building Autonomous Vehicle in Carla: Path Following with PID Control & ROS 2 - Read on LearnOpenCV
• Grounding AI in reality with a little help from Data Commons - Read on Google Research
• Accelerate 1.0.0 is here - Read on Hugging Face
• Function Calling with Open-Source LLMs - Read on BentoML
• Improve multimodal evaluations with enhanced arena style experience - Read on LabelBox
• Stable Diffusion 3 Medium Fine-tuning Tutorial - Read on Stability AI
• Composable Interventions for Language Models - Read on Arize
• The Critical Role of VectorDBs in Building Intelligent AI Agents - Read on Zilliz
• FineVideo dataset is a collection of over 43.000 YouTube videos - Read on Hugging Face\
• Build a RAG-based QnA application using Llama3 models from SageMaker JumpStart - Read on AWS
• DataGemma: Using real-world data to address AI hallucinations - Read on Google Blog
• NotebookLM now lets you listen to a conversation about your sources - Read on Google Blog

??? Upcoming AI Events (Ordered by date):

Like reading books? Join the AI book club , where we read a new book every month!

• AI Book Club: Fundamentals of Data Engineering: Week 3 discussion | Sep 17th - RSVP on Meetup
• LLMs Night (San Francisco) with NVIDIA | Sep 17th - Register on AI Camp
• AI Talks at Union (Seattle): Evaluating AI Agents & LLMs | Sep 18 - Register on Eventbrite
• Visual AI in Healthcare | Sep 19th - Register on Voxel51
• Open Source AI Hackathon #9 (Seattle) | Sep 21st - Register on Luma
• Open-Source AI and Research Infrastructure | Sep 24th - Register on AI Camp
• Intro to Object Detection & Computer Vision Pipelines | Sep 15th - Register on Union
• AI Book Club: Building Recommendation Systems in Python and JAX: Week 1 - RSVP on Meetup
• Recommender Systems: Metrics, Trends, and Challenges | Oct 2nd - Register on DataScienceDojo
• Building Intelligent Chatbots: Create an Agentic RAG Pipeline | Oct 9th - Register on Eventbrite
• Developing Your Career in ML by Studying | Oct 15th - Register on Luma

??? AI Podcasts & Interviews:

• The Positron IDE, Tidy NLP and MLOps with Dr. Julia Silge - Listen on SuperDataScience
• Cybersecurity in the GenAI age | Practical AI podcast - Listen on Changelog
• Enhancing AI Retrieval with Knowledge Graphs: A Deep Dive into GraphRAG - Listen on AI Engineering Podcast
• From no-code to AI-powered apps with Airtable’s Howie Liu - Listen on Weights & Biases YouTube
• From API to AGI: Structured Outputs, OpenAI API platform and O1 Q&A — with Michelle Pokrass & OpenAI Devrel + Strawberry team - Listen on Latent Space

?? Latest ML Research Papers

• MemoRAG: Moving towards Next-Gen RAG Via Memory-Inspired Knowledge Discovery - Read on arXiv
• SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning - Read on arXiv
• GeoCalib: Learning Single-image Calibration with Geometric Optimization - Read on arXiv
• MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies - Read on arXiv
• Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers - Read on arXiv
• LLaMA-Omni: Seamless Speech Interaction with Large Language Models - Read on arXiv

Hello, world! Every week, I keep track of the most exciting news, resources, events, podcasts, and papers I find around AI, MLOps, and robotics. Sometimes I sprinkle in my opinions. Let me know in the comments what I missed this week!

You Can Support This Newsletter By:

?? join the Flyte MLOps Slack Group and introduce yourself!

? Give Flyte , the open-source MLOps project I work on, a GitHub star !

Connect with or follow me (Sage Elliott ) for more machine learning, MLOps, and robotics content. Have a great week! ??