January Updates

Coiled 2024 in Review. See where we started and where we’re headed in our blog post.

Prefect Push Work Pools + Coiled. Together Prefect and Coiled make it easy to define and run complex scheduled workflows in the cloud without managing infrastructure. You can now set up the two tools to run together using Prefect’s Serverless Push Work Pools. More in our documentation.

Parallel GeoTIFF Processing with GDAL. GDAL is a powerful C++ library for transforming geospatial data. Our new example walks through reprojecting thousands of Sentinel-2 satellite images stored on AWS with Coiled Batch. It takes ~5 minutes. Try out the example in our documentation.

Zarr 3 + Dask. Zarr 3 is officially released and fully supported by Dask. This brings major IO performance improvements, better chunk size handling, and more when working with multi-dimensional datasets. More details in the V3 announcement.?

Continued Improvements to Xarray Efficiency. There have been a number of recent improvements to Dask Array, like consistent chunksizes in Xarray rolling-constructs and improved efficiency in map_overlap. As of Dask version 2024.11.2, calculating quantiles is also faster and more reliable. More in our blog post.

Just signed up for Coiled?

Watch our short demo to see how to get started. It’s easy to connect Coiled to your AWS, GCP, or Azure account.

New to Dask?

Check out our tutorials on using Dask DataFrames, parallelizing your Python code, plus more advanced use cases.