Satyam M.的动态

查看Satyam M.的档案

AI-ML Software Engineer | GenAI & MLOps | Google Dev Student Club

?????? ?????????????????????????? ?? RAG based application Example cookbook built on LlamaIndex , Arize-AI for observability Observability is more than a “nice-to-have”—it’s essential!?for any system especially now when ???????? ?????????? counts in a "RAG based application". ?????????????????????????? ???????? ????: ? Spot slowdowns or errors early, pinpointing root causes quickly. ?? Identify resource bottlenecks, optimizing our infrastructure. ?? Gain insights into user behavior and system health. --------------------------- At present I have been exploring LLM observability for a production ready RAG application running on a knowledge base of multimodal data which contains pdfs, excels, videos etc.. While exploring multiple tools I tried mostly opensource and few paid tools too including: Datadog : A robust paid option LlamaIndex provides observability tools. LangChain - Langsmith -------------------------- Some of the good Observability Tools for LLM Applications ??? ? LlamaTrace (Hosted Arize Phoenix) ? Langsmith ? OpenLLMetry : Open-source project based on OpenTelemetry ? Arize AI- Phoenix (Local) ? Literal AI : Designed for team collaboration on LLM evaluation and observability ? Comet Opik ? Langfuse (YC W23) ? Weights & Biases and Biases Prompts etc, etc.... There are many observability tools available, and ranking them might not be the best approach. Each tool has its own unique strengths, and factors like: "cost, system compatibility, backward compatibility, and inference time" - play a key role in selecting the right tool for a given problem. ----------------------------- ???????? ??????????????: ?? https://lnkd.in/gPNNzXwd ?? https://lnkd.in/gTkiNfyw ?? Example: https://lnkd.in/gwDWYFzP ?? AI-ML cookbooks: https://lnkd.in/gwDWYFzP Image Credit: https://lnkd.in/g4z95EZF #RAG #LLMObservability #LLM #softwareengineering #langchain #llamaindex #al #monitoring #datadog #opensource

  • Image: https://www.heavybit.com/library/video/building-apps-with-llm-observability
Deepak Chawla

Building Gen AI Workforce | Founder of HiDevs | Youngest Jury at SIH 2024 | Ex-CTO

3 个月

I appreciate the emphasis on the importance of observability in RAG applications, especially given the crucial role of token economy. The list of tools is comprehensive and the factors for tool selection are insightful. I'm excited to explore these options further. Your shared resources and examples are extremely valuable for anyone looking to implement observability in their LLM projects.

要查看或添加评论,请登录