Product spotlight: Native LLM & multimodal support for hybrid evaluation

Product spotlight: Native LLM & multimodal support for hybrid evaluation

What we've been up to

This quarter, we've been busy expanding our platform's native, multimodal support for labeling and hybrid evaluation, making it easier than ever to build cutting-edge Gen-AI and LLM solutions. With an enhanced user experience, optimized performance, and powerful new features, Labelbox is your ultimate tool for data labeling, model building, and agile, iterative AI development.

From streamlining labeling workflows to accelerating model deployment, our updates empower you to build game-changing AI systems. We've also scaled our platform to handle production-grade data and workflows, helping you overcome limitations and manage labeling teams like a pro.

Get a sneak-peek below and don't forget to check out our blog for the full scoop!


Exciting Announcements!

?? [Partnership] LLM Human evaluation with Vertex AI

Exciting news! Our partnership with Google Cloud brings a fully managed LLM evaluation solution to Vertex AI customers. Easily launch evaluation jobs, set criteria, and receive quality-reviewed results from skilled professionals. (Read more)


???? [Partnership] Partnership with LangSmith: Logs to conversational data with LangSmith

Labelbox + LangSmith = A match made in LLM heaven! Our collaboration brings you enterprise-grade monitoring, human evaluation, labeling, and workforce services. Seamlessly develop, test, and optimize your LLM apps with ease. (Learn more)


Making labeling & discoverability easier than ever

Labeling and data discovery just got a major upgrade! With our new LLM Human Preference Editor, Smart Select, enhanced search, and improved video annotation, you'll breeze through labeling tasks while ensuring top-notch data quality. For more details on our recently shipped labeling & annotation features, read here!


?? [Feature] The LLM human preference editor ???

This powerful tool solves the problem of comparing model responses and deciding on ideal model configurations. With support for markdown and raw modes, labelers can easily parse formatted content and code, ensuring high-quality data for training AI models. ?? Try here


?? [Guide] How to make chatbot safer ??

Want to see the LLM Human Preference Editor in action? Our guide on improving task-specific chatbots shows how to ensure safety by detecting intentions, enhance relevance through fine-tuning, and prevent staleness with continuous monitoring. Authored by Lu Zhang ?? Read here


Decreasing time from training to deployment

Say goodbye to the hassle of model building! Our latest updates, including Production Inferencing, Model Fine-Tuning, and Video Support in Foundry, make it a breeze to experiment, deploy, and analyze your models for optimal performance with a data-centric approach. Interested in how we've made it easier to automate labeling and evaluation of multimodal data? Additional details here!


?? [Features] Inference, tuning, & metrics, oh my! ???

With these features, we've supercharged labeling and evaluation orchestration. Leverage foundation models for automated pre-labeling, effortless experiments, and granular metrics. Seamlessly scale operations and build cutting-edge AI. ?? Learn more

Production Inferencing: Now offering production inferencing through HTTP REST API
Frictionless Model Experiments: Compare the distribution of annotations and predictions in each model run.
Feature-level metrics filtering: Use the "Metrics" filter then select "per prediction".


?? [Guide] How to label videos (painlessly) ??

By the way, did you know labeling videos doesn't have to be painful? Check out our guide to see how Foundry models like Gemini 1.5 Pro, Grounding DINO, and SAM automate tasks, reduce manual effort, and streamline your video labeling workflow. Authored by Rahul Sharma ?? Read more


Expanding the Labelbox platform for production-grade data & workflow requirements

We've got your back with our expanded platform, designed to tackle your toughest production-grade data and workflow challenges. Seamlessly integrate data, optimize labeling, and scale your AI projects with ease. We go into more details on how we've supercharged data I/O & the SDK (as well enhanced our data management offerings) here! ??


?? [Feature] More ways to get data in with Census ???

In order to label, one must have data. The more data, the better. What if you could get set-up with up to 25+ data sources, in less than a day? Now you can with our Census integration. ?? Learn more

[Docs] Unlocking streaming with V2 Exports

So you need to train on “Big Data” for the next record-breaking foundation model but you haven’t migrated to the Exports V2? I feel bad for you son, 99 problems but a migration guide ain’t one. ?? Read more


Building with us: training and guides

To further support our customers in their AI development journey, we've created a wealth of resources, formed strategic partnerships, and participated in industry events, including:


?? [Training] Labelbox Academy: On-Demand ??

Due to popular demand we’ve started expanding our training platform, Labelbox Academy. Our customer academy offers comprehensive training modules designed to help you dive into Labelbox like a pro. With in-depth lessons and best practices covering annotation, modeling, and cataloging, Labelbox Academy provides the resources you need to master the platform. In addition, User Enablement streamlines the onboarding process by providing step-by-step guidance for both administrators and labelers.?

??? [Guides] Solutions Hub: 10+ additional guides added! ??

This past quarter we've launched 10+ guides based on real customer use cases, spanning the gauntlet of general AI development, traditional computer vision and NLP, as well as generative AI use cases. Popular guides authored by our rad SE's (like Kushal Singh , Fergus Reid , etc) include:

.... but wait there's more! Check them all out in the blog post or check out our solutions directly!


Connect with us

Join our vibrant AI community and level up your skills! From insightful webinars and industry events to our thriving user community, we've got plenty of opportunities for you to learn, connect, and stay ahead of the game. Keep up with us here!


??? [Event] Multimodal is the new norm at Google Next ??

Labelbox CEO Manu Sharma spoke at GCP Next: Manu Sharma shared real-world use cases and best practices for building Gemini-powered applications that address compelling business use cases and how enterprises are driving transformation with Gemini on Vertex AI.

??? [Webinars] Don't miss the next webinar! ??

We've hosted a series of webinars featuring industry experts and thought leaders, covering a range of topics related to AI development, such as:

Keep an eye out on our events page as we'll be expanding and adding more sessions on building data engines for generative-AI and unstructured data

?? [Community] Learn to fine-tune,?& other Gen-AI skills - together ??

Did you know we have a vibrant Community of 500+ users sharing invaluable tips, technical assistance, and insightful How-To guides on building cool projects with custom data? For example, discover how to convert LangSmith results to Labelbox conversation data by Gabriel Underwood or how to fine-tune your models by Sravani Mutta . Sign up for a free account and join the conversation here!


?? Thanks from Labelbox!

We're excited to bring back our product spotlight newsletter, packed with the latest Labelbox features to supercharge your AI development! Don’t forget to forward or share with your network!

Newsletter brought to you by: Jackie Lu , Kiera Googins, Adam Tisdale , Uday Kiran Reddy Vatti , David Mok , Ken Olofsen , John Vega , Paul Tancré (PT) , ?????? Mikiko B.

Have feedback? Let us know in the comments & don't forget to share!

Haziqa Sajid

Data Scientist | Freelance Writer for Data, AI, B2B & SaaS | Content in Zilliz, Timescale, v7labs, Comet, Encord, Wisecube | Blogs | Whitepapers | Developer Advocate | Technical Writer | Content Marketer ??

6 个月

Excellent article particularly Expanding platform for production-grade data & workflow requirements. Thanks for sharing Labelbox ?????? Mikiko B.

回复

要查看或添加评论,请登录

社区洞察

其他会员也浏览了