DVC Community November Updates!

???? Hi friend!

Welcome to November!? Here's what's new!

?The Latest

??? New Research Paper Presented at ICCV!Dataset Factory: A Toolchain for Generative Computer Vision Datasets - In early October, teammates Daniel Kharitonov and Ryan Turner submitted a paper for a workshop at ICCV in Paris based on the new tool we’ve been building for the last 2 years. Please check it out and let us know what you think!

?? MLOps World/Generative AI SummitWe are just getting back from MLOps World which was held in conjunction with the Generative AI World Summit.? We had a great experience at the event with a Happy Hour we sponsored before the conference.? Dmitry Petrov and Ryan Turner gave a talk each, and Tibor Mach gave a workshop. Additionally, we had multiple in-booth demos of our new tool. Subscribe to our YouTube channel to see the videos from the conference, which will be out in the next couple of weeks! Below find scenes from our time in Austin!

?? New videos

Community Spotlights

• MLOps the Strategic Compass for AI-Driven Enterprises - Diego Kiedanski, PhD presents at MLOps Community Seattle Meetup
• DVC Extension for VS Code Product Update and Community Spotlight: Renaming Experiments - This one is BOTH a Community Spotlight and a Product update because Community member Brady Johnson contributed this new very useful feature to the extension! Many thanks, Brady! ??

Product updates

• DVC Studio Product Update: How to set the project start date to show only most recent commits - Tapa Dipti Sitaula shows the latest feature to help you keep your experiments organized
• DVC Extension for VS Code: Plots Wizard - Julie Galvan introduces the new Plots Wizard in the extension which helps you auto-generate code to create custom plots.
• DVC Extension for VS Code: Selecting Multiple Files and Metrics with the Plots Wizard - Julie Galvan shows the latest addition to the Plots Wizard that will auto-generate code into your dvc.yaml file to create custom plots from files and metrics in your repo.
• DVC Extension for VS Code: Sort Commits and Experiments by Metrics - Julie’s back to show how you have more flexibility in sorting your commits and experiments

?? What we're looking at

• I don’t like notebooks - Joel Grus - Allen Institute for Artificial Intelligence?I came across this?humor-filled video by ?? Joel Grus on the pluses and minuses of Notebooks. It's not the most recent video on the subject, but a classic and always good to learn while laughing!
• FACT SHEET: President?Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence?Recently U.S. President Biden issued an executive order built on his previous actions to set new standards for AI safety and security. The order includes new standards to protect Americans’ privacy, advance equity and civil rights, protect consumers and workers, promote innovation and competition, and advance American leadership in AI around the world. Notable are efforts to support the development and use of privacy-preserving techniques and establishing best practices for identifying AI-generated content and authenticating official content.
• How to draw beautiful software architecture diagrams (part 1) Need help with your ML workflow architectural drawings? This article by Jordan at Terrastruct can help you out with some great tips regarding minimizing distance, finding symmetry, aligning centers, and containerizing groups!
• Metadata & Its Role in Unstructured Data Management - This article by Kumar Goswami for Komprise points out what is our belief as well, that metadata is the “hidden gold” when dealing with unstructured data of Generative AI. Metadata management is the key to successful GenAI projects. Refer back to the top of this newsletter?for more on our approach.

"Innovation is the outcome of a habit, not a random act."?Sukant Ratnakar

??What's Coming!

• DVC Extension for VS Code Product Hunt Release! - We've made a ton of progress in the last year on DVC Extension for VS Code.? We will be launching it on Product Hunt on November 16th!? The Community has been so helpful with contributions and feedback so that we can improve our tools.? If you are in Product Hunt, we'd love your support and comments that day.? If not, and you'd like to help, sign up at the Product Hunt?link above!??
• DSC Europe 2023 - Mikhail Rozhkov will be speaking at the conference on?Revolutionizing AI Adoption: Harnessing No-Code Solutions for Efficient AI & ML Development?on November 23rd.

?? Community-Generated Content

• A Practical DVC Tutorial As the name suggests, this excellent tutorial from Michael Grüner of RidgeRun provides a very thorough tutorial on DVC and offers some important tips on how to think about things during your project.
• Great Practices for RAG in Production - Noé?Achache shares how to put together a production-ready pipeline using RAG, Airflow, DVC, and Streamlit in?his experience developing Hikari, a bot utilized by Theodo Group, which continuously ingests documents from the group’s Notion and HubSpot applications.
• A (Philosophical) Perspective on Skills Gaps in AI - Matt Lemay, P.Eng. writes of his experience of the skill gaps in hiring junior vs. senior applicants at his consultancy Lemay AI. He notes where the critical skill gaps are found, and provides recommendations on how to close them.
• Using DVC to Store Data Science Artifacts in Azure - Kevin Feasel created a great intro video to get you started with DVC and store data in Azure Blob Storage.
• Tutorial 6 - End-to-End Data Science Projects in Hindi- Data Versioning Using DVC - Krish Naik continues to put out more great videos teaching how to use DVC. This one is in Hindi!
• Basics of Git and GitHub -001|Data Version Control (DVC)|Git Repository|Public and Private Repos - If you need a refresher and are interested in building a portfolio on Git, AI Ki Pathshala creates a video going through the Basics of Git and DVC, going over commands, other version control systems, Git repository hosting services, and public and private repos.

We have a backlog of amazing Community Content that I'm still working my way through. Keep it coming!? I promise a longer list from the Community next month!? In the meantime, if you have any unique use cases with DVC that you would like to share with the Community, please consider contributing to our Awesome Iterative Projects Repo!

???? See you in December!?? ?

To your continued success,

Jeny

Community Manager

Iterative.AI?