Eventual

You know it’s going to be a good day when THE Mimoune Djouallah posts about Daft ????

Another amazing turnout at last week’s Apache Iceberg? SF Meetup with such high quality talks and high quality audience! Shoutout to our speakers R. Conner Howell of Daft for diving into (the pains of) implementing S3Tables, Arsham Eslami ??? of Greybeam for teaching us about all sorts of Iceberg catalogs, old and new, Emre Saglam of Dremio for giving insights into managing security at the file/bucket layer, cloud infra layer, and catalog layer, and finally Aniruth N. of Databricks for an informative background on exactly why deletions are so difficult and how to use deletion vectors with Iceberg v3. This meetup wouldn’t have been possible without our amazing supporters and sponsors from Greybeam, Dremio, Databricks, Snowflake, Amazon Web Services (AWS), and CelerData ?? Look out for recordings of each session posted on the Apache Iceberg? Meetup in a couple weeks! #Daft #Distributed #DataFrame #Meetup #ApacheIceberg

It's official - The Daft team is heading to Iceberg Summit 2025 in San Francisco on April 8! ?? Iceberg Summit 2025 brings together top experts in data engineering, cloud architecture, and analytics to exchange real-world insights and drive the future of data infrastructure. Discover cutting-edge use cases from leading organizations, engage with expert panels on the latest industry trends, and sharpen your skills through hands-on workshops showcasing Iceberg’s capabilities. Whether you're an experienced professional or new to Iceberg, you'll gain valuable knowledge and meaningful connections to propel your data initiatives forward. Secure your early bird priced ticket before 3/1! https://lnkd.in/g9tPuX8T #Daft #Distributed #DataFrame #IcebergSummit #ApacheIceberg

The fun and learning continues in the bay area too ... with the "Bay Area Apache Iceberg Community meetup" this Thursday 2/27 at the #Daft's Penthouse (Hamm's Building) in San Francisco from 5:00 PM to 8:30 PM. #ApacheIceberg Join us for a great line-up of speakers! ?? Building Iceberg S3Table Support for Daft - Conner Howell ?? The state of Iceberg Catalogs -Arsham Eslami ??? ?? Securing your Apache Iceberg data - Emre Saglam ?? The invisible Ink of Iceberg Deletions - Aniruth N. Sign up at https://lu.ma/77zbx044 ?? ?? cc: ChanChan Mao, Aihua Xu, Denny Lee, Kevin Liu, Alex Merced Databricks Amazon Web Services (AWS) Eventual Dremio Greybeam

Can’t wait until the Iceberg Summit in April and itching for another event? Join us for the next #ApacheIceberg? ?? SF Meetup on Thursday February 27! Hosted by Daft, Amazon Web Services (AWS), Databricks, Dremio, Greybeam, and Snowflake, we're bringing you a night of talks spanning the current ecosystem of Iceberg catalogs, safeguarding your Iceberg data, the magic behind deletion vectors, and scoping out Iceberg S3Table?support. You don't want to miss this one! ?? Date & Time: February 27, 2025 | Doors open at 5pm ?? Location: San Francisco While you're at it, be sure to secure your spot for #IcebergSummit2025! Explore real-world use cases from cutting edge organizations, tune in to expert panels discussing the ever-evolving landscape, and enhance your skills with hands-on workshops showcasing the capabilities of Iceberg. Take advantage of in-person networking opportunities on April 8 in San Francisco and the virtual global summit on April 9! Registration links for the meetup and summit are in the comments! ??

???Meet the Speaker: Robert Howell, Software Engineer @ Eventual (building Daft) Amazon S3Tables were launched with major excitement! The only downside was that they were only accessible via JVM-based engines like Apache Spark and AWS Athena and integrating with these tables for Python users required extra steps. (See: Iceberg-python Issue #1404 https://lnkd.in/gxHSPA2u) Conner will explore how S3Tables can be implemented for Python data engines, dive into Daft’s approach on S3Tables and look at the future of Iceberg support in Python. Can’t wait until the Iceberg Summit in April and itching for another event? We’re co-hosting the next #ApacheIceberg? SF Meetup on Thursday February 27 with Amazon Web Services (AWS), Databricks, Dremio, Greybeam, Snowflake, and CelerData! ?? Date & Time: February 27, 2025 | Doors open at 5pm ?? Location: San Francisco Register in the comments below! ?? #Daft #Distributed #DataFrame #DataEngineering #Meetup

Break free from JVM hell ???? Iceberg has been historically Java- and Spark-centric, but the landscape is shifting. Data engineers need a seamless, JVM-free way to interact with Iceberg. Enter PyIceberg + Daft ??, a pure Python solution for Iceberg-powered analytics without the headaches of JVM dependencies. At the latest Apache Iceberg? meetup in Singapore, Jay gave a brief overview of Iceberg, challenges for Python developers, and introduced PyIceberg + Daft for fast and distributed Python-native queries. Full talk linked in the comments! #Daft #Distributed #DataFrame #Python #ApacheIceberg #ML #AI #DistributedComputing

Calling all Apache Iceberg ?? enthusiasts ?? Get early access to the next meetup in San Francisco on Thursday February 27! Hear from Greybeam, Dremio, and more to be announced... ?? Register now and stay tuned for more details!

Daniel Beach called Daft one of his favorite tools, the “unsung hero,” because we’re boring??? ?? But to quote Denny Lee: “Boring is great! Boring is awesome!” Boring means we can read a 10 million line CSV file and write to Delta Lake in fewer lines of code than Polars (although slightly different example - pull data from a Unity Catalog Delta Table and write data out to a file). 10 million records (1.1 GB CSV file) ingested into Delta Lake from S3 took 3.5 minutes with Daft ?? https://lnkd.in/gkYHdnf4

The Daft team SHREDDED ???? some snow at Tahoe this past weekend ?? Join our growing team as we look ahead to a very exciting year -- MORE PASSION, MORE ENERGY ???? https://lnkd.in/gJ8s-R4b