Tetrate

It's free, it's hands-on, and it's in-person It's an Envoy AI Gateway workshop in London ???? Project maintainers from Tetrate and Bloomberg will be there to set you up with Envoy AI Gateway and show you how to use its core features. What You'll Learn: - Set up and configure Envoy AI Gateway - Route traffic to different AI models - Implement token-based usage limiting - Monitor and observe GenAI traffic - How to connect Envoy AI Gateway to model services Envoy AI Gateway is an open-source solution part of the Cloud Native Computing Foundation (CNCF) Envoy project. Looking forward to seeing you in London!

Tetrate and Bloomberg announced the availability of v0.1 of the open source Envoy AI Gateway project, which assists developers with enterprise AI application infrastructure. Backed by the Cloud Native Computing Foundation (CNCF), Envoy AI Gateway democratizes AI infrastructure for organizations and meets robustness, scalability, and adaptability needs in the evolving generative AI landscape. Learn more about the project here: https://bit.ly/4h1WXlj #EnterpriseAI #Developer #AI

Tetrate and Bloomberg Release Open Source Envoy AI Gateway, Built on CNCF’s Envoy Gateway Project https://lnkd.in/dPMAHxQk #MachineLearning #AdversarialAI #AI #EnterpriseAI #GenerativeAI

Recently, Bloomberg and Tetrate announced the release of the first stable version of the open source Envoy AI Gateway project and how we are using this infrastructure to accelerate our development of generative AI applications. This delivers on a joint commitment between the two open source leaders to build community-driven AI gateway features that developers and MLOps professionals can use in their enterprise AI application infrastructure. The project was originally proposed by Bloomberg’s Cloud Native Compute Services engineer and open source leader Dan Sun because of our own MLOps team’s need for such a solution. Learn more here: https://bloom.bg/4kgCs7u #AI #opensource #GenAI #GenerativeAI #MLOps #AIInfrastructure

GenAI services are booming. So are their challenges. We need scalable, secure & extensible infrastructure That’s where Envoy AI Gateway comes in Today version 0.1 is available for you to try Integrating GenAI at scale isn’t just about picking the right models and compute platforms. We must: - Control costs with granular usage rate limits - Manage multiple GenAI providers - Ensure security and compliance With version 0.1, you get: ? A unified API for LLM service integration ? Token-based rate limits to control spend ? Authorization management across providers … and as it’s built on Envoy Proxy and Envoy Gateway you can leverage all the security, observability, and extensibility of Envoy. This is just the first step. Coming soon: - Google Gemini 2.0 support - Provider fallback logic - Semantic caching GenAI is moving fast. Your infrastructure should too. Let’s build the future together. ?? Get started with Envoy AI Gateway: https://lnkd.in/gnYMrd4Y ?? Learn more on our blog: https://lnkd.in/gBh_wWAb —— ?? REPOST to share the news of Envoy AI Gateway’s first stable release ?? Like to show your support of the open source contributors building the project

Happy to share that I recently earned the 'Istio Certified Associate' certification! I spent a lot of time diving deep into the official documentation and great study resources(https://lnkd.in/gbE4XFNJ) from Tetrate, along with extensive hands-on practice, which led to this great result. I’m also looking forward to sharing what I’ve learned through blogs and other opportunities! ?? #ICA #Istio #Tetrate

Excited to share the latest updates in Envoy Gateway 1.3,? Tetrate team is honored to have had the privilege to create and serve as Maintainers of both Envoy Gateway and Envoy AI Gateway! These new features make it easier for businesses to build AI and LLM-based applications with better security, performance and visibility: API Key Authentication streamlines secure access to AI models and APIs, reducing friction for development teams. Advanced Traffic Management improves performance with efficient, low-latency data flow, essential for scaling LLM workloads. Improved Observability offers deeper visibility into system performance, enabling more effective optimization of AI infrastructure. Envoy has pretty much become a standard in the industry so these updates will have a big impact. For ex: the improved traffic management can help reduce your cloud costs, and the enhanced observability makes it easier to troubleshoot and keep your AI applications running reliably.?? ?? Check out all the details here: https://lnkd.in/gu2QPxp7 ?? Curious to hear how others are using Envoy in their AI and LLM projects. If you’ve faced challenges with traffic management, security, or observability in your infrastructure, I’d love to hear your thoughts. How are you optimizing performance and reliability in your AI workflows? #AI #LLM #EnvoyGateway #CloudNative #APISecurity #Kubernetes #DevOps #AIOps

What happens when outdated Envoy filters cause critical authentication failures in a microservices environment??? For one organization, this issue led to major service disruptions—until Tetrate stepped in. By implementing advanced troubleshooting techniques and a robust Istio delivery pipeline, we helped restore seamless authentication, improve reliability, and strengthen security. If you're navigating similar challenges in your service mesh, this case study is a must-read! ?? Read the full story here:?Tetrate?Case?Study: https://tetr8.io/40EC5ut

In distributed environments, service troubleshooting has become increasingly complex. Developers need access to service metrics for troubleshooting and optimization, but admins need their views limited to only their services. Configuring traditional APMs to manage Istio metrics and segregate by ownership is both cumbersome to achieve and difficult to maintain. Alternate OSS Istio monitoring solutions are difficult to configure for global, multi-tenant views of your entire service network. Tetrate Istio Subscription Plus solves for these problems and improves mean time to detection (MTTD) and mean time to resolution (MTTR) with a few key features that are offered through its multi-tenant and role-based access control (RBAC) controlled platform: - Bring-Your-Own Istio - Service Topology - Aggregated Metrics - Tracing & Logs and more... Join us for an insightful workshop showcasing the powerful capabilities of?Tetrate Istio Subscription Plus?(TIS+) When: Wed, Feb 19, 2025, 1:00 PM - 1:45 PM (PT) Where: Online

Did you know Envoy Gateway v1.3 is here? Let's take a look at what has changed from v1.2 to v1.3 The numbers: - 22 new features - 26 bug fixes So, there are many features to read through And the release notes can be cryptic To make it easier to find the impactful changes We summarized key highlights in a blog post Three of our favorite new features: - Track usage beyond the number of requests with dynamic API call cost - Bring your existing client API keys over and use API Key Authentication - Control access for the true client IP from X-Forwarded-For header Check out more feature highlights across Traffic Management, Security, Observability, and Operations in our blog post ?? Read now: https://lnkd.in/gu2QPxp7