OpenTelemetry Semantic Conventions for Generative AI
Drew Robbins
Engineering Leader | Driving Innovation and Observability in Generative AI Applications
Exciting news from our OpenTelemetry working group! We've just merged our first pull-request for OpenTelemetry Semantic Conventions tailored to Generative AI applications. This milestone is the result of a collaborative effort across the industry, establishing a common data model for monitoring Generative AI applications in observability systems.
Our newly defined conventions cover key aspects such as model names, versions, token usage, and even chat history tracking for better evaluation and debugging. This PR is just the beginning—it sets the stage for ongoing community contributions and broader application support.
What’s next?
We’re eager to expand these conventions and need your expertise:
Join Us!
Our meetings are open to everyone and are a great way to contribute to a leading-edge topic. Check out the meeting notes, and join our slack channel (#otel-llm-semconv-wg) to get involved.
Let’s shape the future of Generative AI monitoring together!
Co-Founder of Altrosyn and DIrector at CDTECH | Inventor | Manufacturer
7 个月It's truly commendable to see the strides taken in standardizing OpenTelemetry Semantic Conventions for Generative AI, fostering consistency and clarity in monitoring and evaluation. This initiative marks a pivotal moment in advancing observability systems, paving the way for more robust and comprehensive monitoring of Generative AI applications. As this field continues to evolve rapidly, what specific challenges do you anticipate in ensuring broad adoption of these conventions across diverse AI frameworks and platforms? Additionally, considering the dynamic nature of Generative AI, how do you envision incorporating flexibility into these conventions to accommodate emerging techniques and technologies?
AI Experts - Join our Network of AI Speakers, Consultants and AI Solution Providers. Message me for info.
7 个月Exciting progress towards standardizing Generative AI observability - looking forward to contributing too.
Growing businesses with SEO-driven content | Helped companies increase organic traffic 2-3x | I share content marketing frameworks that work
7 个月That's awesome news. Collaborating for progress in AI, impressive teamwork. Drew Robbins