Daft is a Distributed DataFrame designed for the cloud that exposes both SQL and Python DataFrame interfaces as first-class citizens and is written in Rust. Daft provides a snappy and delightful local interactive experience, but also seamlessly scales to petabyte-scale distributed workloads.
Daft的外部链接
??????
?? How fast can you process a 10M-row CSV into Delta Lake? Daniel Beach put Daft to the test by reading a 1.1GB CSV (10 million lines) and writing it to Delta Lake—all in just 3 minutes on AWS Lambda. ?? Watch the full webinar to explore how Polars, DuckDB, Daft, and Rust are revolutionizing Delta Lake workflows on AWS Lambda. ?? ???Dive in: https://lnkd.in/e-S55XTF #opensource #deltalake #aws #lambda #oss #daft
Daft转发了
We are excited to invite you to our upcoming meet-up on March 27th, co- hosted with Daft, where we’ll be collaborating on scaling data processing and ML training with Daft + Ray. ?? Hear from Daft Software Engineer, Desmond Cheong and Anyscale Product Manager, Ricardo Decal on developing AI applications from local production, connect with the AI community, and grab some pizza ???? Don’t miss it! Sign up now ?? https://lu.ma/u5p41kte?
Daft转发了
?? New #icebergSummit Speaker Promo! ?? This time, hear from ChanChan Mao with Eventual as she speaks to the challenges of building support for #s3 tables to #daft! ??? Register for Iceberg Summit today and let me know what #apacheIceberg topics you're most excited for at the conference! ?? https://lnkd.in/gu92JJBr
Boo JVMs ?? Yay Python ?? Tune into the Delta Lake Webinar on Monday April 7 at 10am PT with Jay Chia and ChanChan M. to explore: ? How Daft enables fast, parallel reading from Delta Lake with data skipping optimizations ? How its full-featured DataFrame API makes ML/AI data transformation seamless ? How Daft unifies modern data and ML stacks, simplifying the path from raw data to model ingestion Learn about Daft's approach to interacting with Iceberg and Delta Lake without Java dependencies ?? ?? Register now → #Daft #Distributed #DataFrame #DeltaLake #Python #OpenSource
We're missing a couple team members but here's the hardworking Daft team rocking our sick #AntiSparkSocialClub t-shirts ???? #Daft #Distributed #DataFrame
Another amazing turnout at last week’s Apache Iceberg? SF Meetup with such high quality talks and high quality audience! Shoutout to our speakers R. Conner Howell of Daft for diving into (the pains of) implementing S3Tables, Arsham Eslami ??? of Greybeam for teaching us about all sorts of Iceberg catalogs, old and new, Emre Saglam of Dremio for giving insights into managing security at the file/bucket layer, cloud infra layer, and catalog layer, and finally Aniruth N. of Databricks for an informative background on exactly why deletions are so difficult and how to use deletion vectors with Iceberg v3. This meetup wouldn’t have been possible without our amazing supporters and sponsors from Greybeam, Dremio, Databricks, Snowflake, Amazon Web Services (AWS), and CelerData ?? Look out for recordings of each session posted on the Apache Iceberg? Meetup in a couple weeks! #Daft #Distributed #DataFrame #Meetup #ApacheIceberg
You know it’s going to be a good day when THE Mimoune Djouallah posts about Daft ????
AFAIK, Daft DataFrame is the first non-Spark dataframe library with solid Iceberg REST API catalog integration! ???? #DataEngineering #Iceberg #Python #SQL #Daft
It's official - The Daft team is heading to Iceberg Summit 2025 in San Francisco on April 8! ?? Iceberg Summit 2025 brings together top experts in data engineering, cloud architecture, and analytics to exchange real-world insights and drive the future of data infrastructure. Discover cutting-edge use cases from leading organizations, engage with expert panels on the latest industry trends, and sharpen your skills through hands-on workshops showcasing Iceberg’s capabilities. Whether you're an experienced professional or new to Iceberg, you'll gain valuable knowledge and meaningful connections to propel your data initiatives forward. Secure your early bird priced ticket before 3/1! https://lnkd.in/g9tPuX8T #Daft #Distributed #DataFrame #IcebergSummit #ApacheIceberg
???Meet the Speaker: Aniruth N., Product Manager @ Databricks Efficiently handling row-level deletions has long been a challenge in large-scale data systems, but Apache Iceberg? has been evolving to make deletions faster and more efficient. Aniruth will dive into how handling deletes has improved over time, from Hive’s partition-based approach to Iceberg v2 delete files, and explore the future with Iceberg v3 Puffin-based deletion vectors for even better performance. Can’t wait until the Iceberg Summit in April and itching for another event? We’re co-hosting the next #ApacheIceberg? SF Meetup on Thursday February 27 with Amazon Web Services (AWS), Databricks, Dremio, Greybeam, Snowflake, and CelerData! ?? Date & Time: February 27, 2025 | Doors open at 5pm ?? Location: San Francisco Registration link in comments! #Daft #Distributed #DataFrame #DataEngineering