November Updates
SLURM-style job arrays on the cloud. HPC job scripts are simple and accessible to almost anyone. Oddly, they're pretty hard to replicate on the cloud, so we replicated the API with Coiled. More in our blog post.
Coiled referral program. Know someone who might have a good use case for Coiled? Receive up to $200 in Amazon gift cards when you refer someone to Coiled by Dec. 31st, 2024. Learn more.
Better performance for Xarray GroupBy.Map. Running GroupBy-Map patterns backed by Dask arrays is common in large-scale geospatial workloads. The latest version of Dask uses a new algorithm for selecting data that’s more robust. Learn more in our blog post.
Legacy Dask DataFrame is being deprecated. Now is a great time to switch to the new DataFrame implementation which includes optimizations like column projection and filter pushdown. Please report any issues that come up. See the release notes.
Events
Next Dask Demo Day on December 5th. Join us for live community demos and updates from Dask maintainers. Have something you’d like to share? Let us know.
PyData Global. Check out our talk “Dask ?? Xarray: Geoscience at Massive Scale” on Thursday Dec. 5th at 4pm UTC. Talk details here.
Just signed up for Coiled?
Watch our short demo to see how to get started. It’s easy to connect Coiled to your AWS, GCP, or Azure account.
New to Dask?
Check out our tutorials on using Dask DataFrames, parallelizing your Python code, plus more advanced use cases.