Comet

Comet

软件开发

New York，NY 13,620 位关注者

Where AI Developers Build

查看职位 关注

关于我们

Comet is an end-to-end model evaluation platform built with developers in mind. Track and compare your training runs, log and evaluate your LLM responses, version your models and training data, and monitor your models in production — all in one platform. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration, and visibility across teams.

网站
https://www.comet.com
所属行业
软件开发
规模
51-200 人
总部
New York，NY
类型
私人持股
创立
2017
领域
Machine Learning、Data Science、Developer Tools和Software

产品

点击此处查看Comet Comet
点击此处查看Comet

点击此处查看Comet Comet

数据科学与机器学习平台

Comet provides an end-to-end model evaluation platform for AI developers, with best-in-class LLM evaluations, experiment tracking and production monitoring. - Debug and evaluate your LLM applications with Opik - Track and visualize your training runs with Experiment Management - Monitor ML model performance in production with Production Monitoring - Store and manage your models with Model Registry - Create and version datasets with Artifacts The best part? Comet is free for individuals and academics!

地点

Comet员工

查看全部员工

动态

  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    We're excited to connect with the SF developer community next month alongside Yujian Tang, Pinecone & Komodo AI. RSVP ? https://lu.ma/x8lcld46

    查看Yujian Tang的档案，图片
    Yujian Tang

    AI Hacker

    In just a few weeks, we'll be back in SF with another round of Awesome AI Dev Tools, this time with Pinecone, Comet, and Komodo AI Along with that, as part of our mission to provide developers a complete view of the AI Dev Tool ecosystem, we've got our 2 minute demos as usual. The first five are: - TrustGraph - CloudAEye - CopilotKit?? - API-Rex - Stably AI Come join 150+ devs who've already signed up! RSVP below.

  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    ?? Building an LLM application is tough - especially when you don't have a way to confidently test its performance. In this code tutorial, you'll learn how you can leverage Opik’s native OpenAI integration to have more visibility into your LLM workflows: ?? Log traces and spans ?? Manually annotate LLM responses ?? Automatically score responses using Opik's out-of-box evaluation metrics

    OpenAI Evals: Log Datasets & Evaluate LLM Performance with Opik

    OpenAI Evals: Log Datasets & Evaluate LLM Performance with Opik

    comet.com

  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    ???? We’ll be joining Intel Software at their Seattle Developer Meetup this Thursday, November 14th! It's shaping up to be a great opportunity to connect with fellow AI developers and participate in workshops focused on AI PCs and MLOps best practices. We'll also be chatting about #Opik, our open-source LLM eval framework that's quickly gaining momentum in the #GenAI space ?? If you're in the area, we’d love for you to join us. You can register here: https://intel.ly/3YDmoCJ #AI #MLOps #LLMEval

    • 该图片无替代文字

  • Comet转发了

    查看Jacques Verré的档案，图片
    Jacques Verré

    Head of Product @ Comet ML

    ?? Opik Weekly Changelog ?? Highlight of the Week: We just launched a Prompt Library! ?? Now you can easily create and manage your prompts in the Opik platform. But there a twist ! We heard time and time again that folks preferred to have their prompts stored in code so built functionality to automatically sync the prompts stored in code with the Opik library, just wrap the prompt with the `Prompt` class and your done. We also released: ? Bedrock integration ? SDK method to search and return spans

    • 该图片无替代文字
  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    ? Opik has officially hit 2,000 GitHub Stars! ? For the last several months, the Comet team has been working on our open source LLM evaluation framework, Opik. And since releasing it in September, we’ve been absolutely blown away by the support the ML community has sent our way. Since launching, we’ve had: ?? Dozens of feedback sessions, feature requests, opened issues, and PRs from individual practitioners ?? Integrations from our friends in the open source community, including LiteLLM (YC W23) and Ragas ?? Tutorials, projects, and even an entire course (by the amazing Elvis S., no less) dedicated to running LLM evaluations with Opik And all of this has culminated in 2,039 GitHub Stars, 530 closed PRs, and thousands of users—from hobbyists to researchers to engineers at Fortune 500 companies—using Opik to build their LLM evaluation pipelines. Thank you all so much for your support so far. We're so excited to continue building with you ??

    • 该图片无替代文字
  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    ?? Exciting to see that the LLM’s Engineer’s Handbook is now live! This essential guide equips developers with a full framework for building #LLM systems, and we’re proud to see #Opik included as a tool in their LLMOps tutorials.? Big congrats to Paul Iusztin and Maxime Labonne for delivering this incredible resource. It couldn’t have come at a better time for the #GenAI community. ?? Find limited-time discount links in the comments??!

    • 该图片无替代文字
  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    Incredible to see thought-leaders like Aishwarya Srinivasan using Opik! ?? Thanks for sharing how it’s helping you tackle the trickiest parts of LLM workflows ??

    查看Aishwarya Srinivasan的档案，图片
    Aishwarya Srinivasan Aishwarya Srinivasan是领英影响力人物

    If you're an AI engineer working with LLMs, you know how tricky it can be to debug or monitor them, especially when things go wrong. I've been there too! That’s why I wanted to share an open-source tool I recently came across—Opik. It’s a game-changer for monitoring and comparing LLM workflows across platforms like OpenAI, LlamaIndex, and LangChain. Opik, developed by Comet, gives you complete visibility into your models, making it super easy to trace every step, monitor token usage, and catch issues before they escalate. Plus, it automates evaluation experiments, so you don’t have to spend hours manually testing responses. Whether you're debugging or scaling, Opik seems to solve it all for you! Trust me, if you're in the AI space, this is the tool you didn’t know you needed. Check it out! And do share it with your network to tell them about this amazing open-source LLM monitoring tool: https://lnkd.in/dDMJXTUW #ai #llm #cometpartner

  • 查看Comet的公司主页，图片
    Comet

    13,620 位关注者

    Exciting news! Opik, our new open-source #LLM framework, is now available for on-prem or VPC deployment! ?? For teams needing more flexibility and control, Opik’s latest release makes it easier to evaluate, test, and monitor your LLMs within your chosen environment. With #Opik you can now: ?? Use Opik’s built-in LLM-as-a-judge for hallucination detection, moderation, and RAG evaluation ? Store test cases as datasets and run experiments on them ?? Provide human feedback to responses via the SDK or UI ?? Run evaluations as part of your CI/CD pipeline using the PyTest integration ?? Check out the Github repo for a full rundown:?https://lnkd.in/dW4D6xMt

    • 该图片无替代文字

相似主页

查看职位

融资

Comet 共 5 轮

上一轮

B 轮

US$50,000,000.00

在 Crunchbase 上查看更多信息