Last Week in a Byte on Delta Lake | 2022-12-06

Now you can watch or read the latest Delta Lake news a week late!

Releases

Here are the latest releases:

• Delta Lake Rust 0.5.0 release with 42 contributors and 34 new contributors #rustlang
• Delta Lake Rust Python 0.6.4 release #python
• Try out the latest test version of Delta Spark 2.2 RC1 #apachespark Apache Spark

Benchmark Results

Brooklyn Data recently released their Setting the Table: Benchmarking Open Table Formats ran a set of comprehensive workloads against Delta Lake and Apache Iceberg to test the performance of inserts and deletes, and the effect of these updates on the performance of subsequent reads. The write workloads was 1.5-3x faster and the read workloads 7-8x faster for Delta Lake.

AWS Delta Lake Announcements

Recently Amazon Web Services (AWS) announced native support for Delta Lake

• AWS Glue 4.0 includes native support for Delta Lake 2.1 with Apache Spark 3.3 #awsglue
• AWS EMR 6.9 includes native support for Delta Lake 2.1 with Apache Spark 3.3. #emr

Cool Blogs and Code

Robert Kossendey from claimsforce recently published Lakehouse — Running Delta Lake on AWS Glue Matthew Powers, CFA recently published mack - Delta Lake operations help functions

Delta Lake Docker

Thanks to Andrew Bauman for creating the Delta Lake #docker which includes #rustlang, #python, #pyspark, #spark, #scala, and #jupyternotebook. Try it out now https://go.delta.io/docker.

Connect with us!

Want to learn more about Delta Lake and chat with other users and contributors? Join us at delta.io, Slack, LinkedIn, and GitHub.