AI, MLOps & Robotics Newsletter #69

The latest developments in AI, MLOps, and Robotics: Humanoids Building BMWs, Reducing Data Labeling Costs, LivePortrait, Segment Anything in a CT Scan, how Tokens are a big reason today’s generative AI falls short, and much more!

Join me live at my fireside chat with Leo Dirac, Co-founder and CTO of Groundlight. We'll discuss the future of computer vision and robotics, two topics I've been passionate about for a long time! RSVP to attend live and get the recording.

?? AI News & Stories:

• Humanoids Building BMWs - Watch / Read on IEEE Spectrum
• Tokens are a big reason today’s generative AI falls short - Read on TechCrunch
• Amazon is bricking its Astro business robots less than a year after launch - Read on the Verge
• Decoding How the Generative AI Revolution BeGAN - Read on NVIDIA
• From burritos to biotech: How robotics startup Cartken found its AV niche - Read on TechCrunch

?? ML Developer Tools & Resources:

• Exploring Retrieval Augmented Generation (RAG): Chunking, LLMs, and Evaluations - Read on Zilliz
• Accelerating Protein Language Model ProtST on Intel Gaudi 2 - Read on Hugging Face
• What the focus on multimodal, generative, and 3D AI means for the future at CVPR 2024 - Read on LabelBox
• Segment Anything in a CT Scan with NVIDIA VISTA-3D - Read on Voxel51
• A new initiative for developing third-party model evaluations - Read on Anthropic
• Reducing Data Labeling Costs with Uncertainty Sampling - Read on Groundlight
• Using GPT-4 To Extract Handwritten Text from Images - Read on RoboFlow
• Orange Pi's CM5 Offers a High-Performance Alternative to the Raspberry Pi CM4 - Read on Hackster
• Our Transformers Code Agent beats the GAIA benchmark! - Read on Hugging Face
• Object Detection on Edge Device – Deploying YOLOv8 on OAK-D - Read on LearnOpenCV

??? Upcoming AI Events (Ordered by date):

Like reading books? Join the AI book club, where we read a new book every month!

• Open source data ingestion for RAGs with dlt | July 8th - Register on Luma
• AI meetup (July): AI, LLMs, and ML (Seattle) | July 9th - Register on AI Camp
• GenAI & MLOps Happy Hour (Seattle) | July 10th - Register on Meetup
• Getting Started With GenAI: Pragmatic Advice for Real-World App Building | July 11th - Register on Neo4j
• Mastering Data Science: The Impact of LLMs | July 17th - Register on Data Science Dojo
• Automate product descriptions with AI: Generate rich content & boost conversions | July 17th - - Register on LabelBox
• AI Book Club: AI Book Club: Prompt Engineering for Generative AI | July 23rd - RSVP on Meetup
• Intro to AI Pipelines: Build Reliable ML Workflows | July 24th - Register on Union.ai
• Python talk night at GitHub (Seattle) | July 24th - Register on Meetup
• From ML Engineering to AI Engineering: Navigating the Shift to Foundation Models with Chip Huyen | July 25th- Register on AI Camp
• Sora: Exploring Ethics, AI, and Personalization | July 31st - Register on DataScienceDojo
• RAG Hack Night at GitHub (SF) | August 13th - Register on Luma
• Hybrid Chatbots: Merging LLMs and Classification Models | Aug 21st - Register on DataScienceDojo
• Pre-Training LLMs on Personal Computers | Aug 28th - Register on DataScienceDojo

??? AI Podcasts & Interviews:

• How Microsoft Scales Testing and Safety for Generative AI with Sarah Bird - Listen on TWiML
• Stanford's AI Index Report 2024 | Practical AI Podcast - Listen on Changelog
• Deep Learning Classics and Trends, with Dr. Rosanne Liu - Listen on SuperDataScience

?? Latest ML Research Papers

• LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control - Read on arXiv
• Agentless: Demystifying LLM-based Software Engineering Agents - Read on arXiv
• Merlin:Empowering Multimodal LLMs with Foresight Minds - Read on arXiv
• BACON: Supercharge Your VLM with Bag-of-Concept Graph to Mitigate Hallucinations - Read on arXiv
• Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge - Read on arXiv
• LLM Internal States Reveal Hallucination Risk Faced With a Query - Read on arXiv
• Evaluating LLMs' Inherent Multi-hop Reasoning Ability - Read on arXiv

Hello, world! Every week, I keep track of the most exciting news, resources, events, podcasts, and papers I find around AI, MLOps, and robotics. Sometimes I sprinkle in my opinions. Let me know in the comments what I missed this week!

You Can Support This Newsletter By:

?? join the Flyte MLOps Slack Group and introduce yourself!

? Give Flyte, the open-source MLOps project I work on, a GitHub star!

Connect with or follow me (Sage Elliott) for more machine learning, MLOps, and robotics content. Have a great week! ??