Lakekeeper

?? Exciting news! Christian Thiel will be speaking at #Iceberg #Summit 2025! His session, "Securing Apache Iceberg Tables Across Engines with Open Standards," tackles one of the biggest challenges in the modern data stack: data access governance across multiple compute engines. ???? Christian will dive into: ? #OAuth2 and identity management in Iceberg ? Security mechanisms in the Iceberg REST spec ? Challenges in securing catalogs, engines, and file systems ? How open standards like Open Policy Agent and OpenFGA help enforce fine-grained security If you're working with Apache Iceberg and want to understand the security landscape for multi-engine environments, this is a must-attend session. ?? Join us at Iceberg Summit 2025 and learn how to secure your Iceberg tables the right way! Register here: https://lnkd.in/g9tPuX8T #IcebergSummit #ApacheIceberg #DataSecurity #OpenStandards #DataGovernance

Join us on March 13 for an in-depth exploration of catalog services—the backbone of modern data lakes—with Viktor Kessler Kessler and Yingjun Wu Wu!

Trino Software Foundation ?? #Lakehouse: Exciting news: Lakekeeper is now officially listed in Trino’s documentation as part of the Data Lake ecosystem! ?? Check it out here: https://lnkd.in/eemXciH6 With this update, the Trino community highlights the growing role of Iceberg-native architectures—and we’re thrilled to see Lakekeeper recognized as an open-source Iceberg catalog alongside other key technologies. Why This Matters ? Lakehouse is the Future – Open, scalable, and interoperable data platforms are becoming the standard. ? Trino + Iceberg + Lakekeeper – A powerful combination for high-performance, lock-in free analytics. ? Thriving Open Source Community – This is a testament to how collaboration drives innovation! ?? Huge thanks to the Trino community for fostering an open and extensible data ecosystem. We’re excited to continue building together! #Trino #Lakehouse #Iceberg #Lakekeeper #OpenSource

?? Lakekeeper 0.7.0 is out! ?? We’ve packed this release with powerful new features to make managing your Iceberg tables even easier: ?? Iceberg 1.8.0 Compatibility: Added a missing endpoint and integrated tests ?? Expanded S3 Support: Opt-in support for s3a:// and s3n:// table locations. for seamless compatibility. ? Simplified Configuration: No more manual LAKEKEEPER__BASE_URI setup in most scenarios! We now auto-parse headers like x-forwarded-for typically set by reverse proxies. ?? Customizable Authentication: Authentication is now fully customizable with an exposed trait. ?? New Data Statistics: Get insights into your data! Table & View counts are available now, with endpoint call stats coming soon. ?? Bonus: We’ve already updated the examples to showcase these new features! Check it out and let us know what you think! ?? #Lakehouse #Iceberg #DataPlatform #Lakekeeper #OpenSource

?? Apache Iceberg comes to Europe! ???? The Iceberg community is growing fast, and for the first time, Apache Iceberg is hosting a dedicated event in Amsterdam! ?? https://lu.ma/ewx2kuis ?? Call for Papers is now open! Whether you're building production-ready Iceberg deployments, pushing the boundaries of performance, or driving real-world adoption in enterprises—we want to hear your story! ?? Why submit a talk? ? Share your expertise with the Iceberg community ? Connect with fellow builders, engineers, and data leaders ? Be at the forefront of open data innovation ?? Submit your proposal now: https://lnkd.in/eDYKdUnS #ApacheIceberg #DataLakehouse #CallForPapers #OpenSource #DataEngineering

?? Lakekeeper 0.6.0 is here! ?? This security-focused release brings powerful new features and enhancements to make your #Lakehouse journey even smoother! ? What’s new in 0.6.0? 1?? Open Policy Agent Bridge: Easily connect shared Trino Software Foundation to Lakekeeper! 2?? New "check" endpoint simplifies permission queries. 3?? Matrix testing against multiple Iceberg Versions from 1.5 to 1.7 4?? Automatically cleaned up after table drops to save you costs. 5?? #ADLS Improvements: Fixes for proper cleanup of table files. ?? Want to get started fast? Check out our standalone example for a multi-user #Trino environment with Lakekeeper's #OPA bridge! ?? https://lnkd.in/eArzqfhQ Thank you to our community for your feedback and support—keep it coming! Let us know what you think of this release. ?? #Lakehouse #ApacheIceberg #Trino #OpenPolicyAgent #DataGovernance #ReleaseNotes #OPA Apache Iceberg Trino Software Foundation

?? Calling all data enthusiasts, practitioners, and thought leaders! The Call for Papers for the Apache Iceberg Summit is officially open! ?? This is your chance to share your story, innovations, and lessons learned with a global audience passionate about the future of data. Whether you're deep in the trenches solving complex data problems, building cutting-edge lakehouse solutions, or crafting new use cases for Apache Iceberg—your voice matters. ? Why should you submit a talk? 1?? Inspire and shape the future of Iceberg adoption. 2?? Showcase your work to a vibrant, global community. 3?? Connect with industry leaders and like-minded innovators. 4?? Grow your personal brand as an expert in open data technologies. ?? Don’t worry if this is your first time presenting—every expert was once a beginner! Your experience and perspective could be the spark someone else needs to solve their challenges or create something groundbreaking. ?? Deadline for submissions: Feb 09 2025 Submit your proposal here: https://lnkd.in/gYeBghy8 Let’s build the future of open table formats together! ?? #ApacheIceberg #DataSummit #CallForPapers #OpenSource #DataCommunity

I know the Apache Iceberg space may feel a bit crowded now that Godzilla?? and King Kong ?? have teamed up on the same table format. I've sensed a bit of an eye rolling sentiment when more Iceberg catalogs are being announced and I just want to remind you all that this is good and exactly what consumers need. We've grown too accustomed to having choices stripped away from us that we kind of now secretly desire the lack of choice because we anticipate a monopoly or oligopoly to form and so we coast on decision making until we see a "winner". I want to encourage you all not to follow that pattern as consumers in this data space. Imagine if standards like Iceberg could replace the consistency and interoperability that we as humans need and currently seek out from corporate ecosystems. Having your cake and eating it too! Imagine if the Iceberg standard becomes as ubiquitous as SQL or TCP/IP and we mold that format to meet the needs of scalable warehouse (aka lakehouse). When Tabular was purchased, I noticed a bit of a vaccum that was left its wake. We really need a permissively licensed project that provides not just a REST catalog implementation, but one that overlaps with security frameworks like OpenFGA and OpenID Foundation to continue the mission of centralizing governance around the most interoperable table format we have to date. This will continue putting pressure on our Godzillas and King Kongs and keep the will of the consumer alive in this industry. I believe Viktor and Christian have the right vision to bring a lot of what Tabular had to open and keep building a engine and vendor neutral platform that fills the Tabular void. Check out Lakekeeper! I'll be working on improving their docs along with the Iceberg docs so that those new consumers venturing into Iceberg can make informed decisions! #dataengineering

?? Big News: Lakekeeper 0.5 is Here! ?? We're thrilled to announce that Release 0.5 is officially out—and it's our biggest release yet! ?? Packed with long-awaited features, it's a major step forward for our mission to simplify and empower Lakehouse management. Here’s what’s new: ? UI: The Lakekeeper Console is here! Host it with the Lakekeeper binary or separately—it’s baked into all pre-built Docker containers and binaries. ?? Docs: Huge shoutout to @Brian for making our documentation awesome! Whether you’re just getting started or configuring authentication, check it out at docs.lakekeeper.io. ?? Access Controls: Table-level permissions are here! Fine-grained authorization made easy. ?? Authentication: - Native support for Kubernetes Service Accounts. - Better external IdP support, now with docs for EntraID and Keycloak. ?? Hierarchical Namespaces: Organize your Iceberg Warehouse more effectively. ?? Normalized DB Model: Lakekeeper now stores TableMetadata across multiple tables instead of a big binary blob—making updates faster and opening doors for powerful future endpoints. ?? Helm Chart 0.2.0: Deploy secure setups with authentication and authorization in no time! ?? Fixes & Improvements: - Performance boosts and bug fixes. - Default port switched from 8080 → 8181. - Resolved property case limitations. ?? And keep an eye out for the Lakekeeper Kubernetes Operator (https://lnkd.in/e_jNnQG7 thanks to Peter McClonski for driving this forward! This release wouldn’t have been possible without our amazing contributors and community! ?? ? If you’re excited about Lakekeeper 0.5, show your support by giving us a star on GitHub! https://lnkd.in/etDTyF5e ?? Check out the release notes for more details, and let us know what you think! https://lnkd.in/e8qNryFK #Lakehouse #OpenSource #ApacheIceberg #DataInfrastructure #Kubernetes #Lakekeeper

?? Proud to share a milestone! Our open-source repo just hit 200 ?? ! Massive kudos ?? to our team and a huge thank you to every open-source enthusiast who helpeed us get here. Your support means the world—it’s the fuel driving us to keep building a better #Lakehouse experience. If you like what we’re working on, give our repo a star and join us on this journey! https://lnkd.in/etDTyF5e #opensource #lakehouse #iceberg