AI, MLOps & Robotics Newsletter #80

The latest developments in AI, MLOps, and Robotics: PyTorch Multi-Device Integration, Medical Centers Tap AI, Federated Learning, Fine-tuning LLMs to 1.58bit, tracing Groq, Mistral updates, Zipline Drones Deliver, and much more!

?? Join me live at my next workshop on 9/25: Intro to ML Pipelines: Build Reliable AI Workflows. RSVP to attend live and get the recording.

?? AI News & Stories:

• Can Amazon change how we watch football? Testing ‘Prime Vision’ on Thursday Night Football - Read on GeekWire
• AI tool uses sound to pinpoint leaky pipes, saving precious drinking water - Read on Microsoft
• Medical Centers Tap AI, Federated Learning for Better Cancer Detection - Read on NVIDIA
• Jony Ive confirms he’s working on a new device with OpenAI - Read on The Verge
• ‘It’s the robot we were all expecting – like C3PO’: why aren’t humanoids in our homes yet? - Read on the Guardian
• Zipline Drones Deliver - Watch on Spectrum IEEE
• The Amazing Ways Amazon Is Using AI Robots - Read on Forbes

?? ML Developer Tools & Resources:

• Challenges and Efforts in PyTorch Multi-Device Integration: Compatibility, Portability, and Integration Efficiencies - Read on PyTorch
• Multimodal RAG with ColPali and Gemini : Financial Report Analysis Application - Read on LearnOpenCV
• Neptune: The long orbit to benchmarking long video understanding - Read on Google Research
• Generate an entire app from a prompt using Together AI’s LlamaCoder - Read on Meta AI
• The Future of Computer Vision and Robotics - Read on Union
• Whistles, songs, boings, and biotwangs: Recognizing whale vocalizations with AI - Read on Google Research
• Fine-tuning LLMs to 1.58bit: extreme quantization made easy - Read on Hugging Face
• Exploring the World of Open-Source Text-to-Speech Models - Read on BentoML
• Unlock Greater Data Flexibility: Ingest Tabular Data - Read on Edge Impulse
• AI in abundance Mistral API updates - Read on Mistral
• Introducing Contextual Retrieval - Read on Anthropic
• Tracing a Groq Application - Read on Arize
• Harnessing Function Calling to Build Smarter LLM Applications - Read on Zilliz
• AI-Enabled eCommerce with Weaviate and TypeScript - Read on Weaviate
• Simplify, enhance, and evaluate RAG development with Pinecone Assistant, now in public preview - Read on Pineconde
• All-New YOLOv8 Integration For Label Studio - Read on Label Studio
• Launching Ginkgo Datapoints: Transforming AI Model Training in Biology - Read on Ginko

??? Upcoming AI Events (Ordered by date):

Like reading books? Join the AI book club , where we read a new book every month!

• AI Book Club: Fundamentals of Data Engineering: Week 4 discussion | Sep 24th - RSVP on Meetup
• Open-Source AI and Research Infrastructure | Sep 24th - Register on AI Camp
• Intro to Object Detection & Computer Vision Pipelines | Sep 25th - Register on Union
• AI Book Club: Building Recommendation Systems in Python and JAX: Week 1 | Oct 1st - RSVP on Meetup
• Recommender Systems: Metrics, Trends, and Challenges | Oct 2nd - Register on DataScienceDojo
• Building Intelligent Chatbots: Create an Agentic RAG Pipeline | Oct 9th - Register on Eventbrite
• Data Preparation Toolkit for LLM Application Developers | Oct 9th - Register on Data Science Dojo
• Developing Your Career in ML by Studying | Oct 15th - Register on Luma
• Build Scalable Workflows for LLM Fine-Tuning | Oct 16th - Register on Eventbrite

??? AI Podcasts & Interviews:

• SonicJobs CEO Mikhil Raja on Using AI Agents to Connect the Internet, starting with Jobs - Listen on NVIDIA
• Pausing to think about scikit-learn & OpenAI o1 | Practical AI podcast - Listen on changelog
• PyTorch: From Zero to Hero, with Luka Anicin - Listen on SuperDataScience
• Supercharging Developer Productivity with ChatGPT and Claude with Simon Willison - Listen on TWiML
• The Ultimate Guide to Prompting - Listen on Latent Space
• The Mark Zuckerberg Interview - Listen on Aquired
• Podcast: Amazon’s quest to become a startup again; Plus, 6 years of progress in driverless cars - Listen on GeekWire

?? Latest ML Research Papers

• OmniGen: Unified Image Generation - Read on arXiv
• Kolmogorov-Arnold Transformer - Read on arXiv
• Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution - Read on arXiv
• LaMamba-Diff: Linear-Time High-Fidelity Diffusion Models Based on Local Attention and Mamba - Read on arXiv

Hello, world! Every week, I keep track of the most exciting news, resources, events, podcasts, and papers I find around AI, MLOps, and robotics. Sometimes I sprinkle in my opinions. Let me know in the comments what I missed this week!

You Can Support This Newsletter By:

?? join the Flyte MLOps Slack Group and introduce yourself!

? Give Flyte , the open-source MLOps project I work on, a GitHub star !

Connect with or follow me (Sage Elliott ) for more machine learning, MLOps, and robotics content. Have a great week! ??