Cubed: Scalable array processing with bounded memory in Python

Recording

About the webinar

This webinar introduces Cubed, an open-source Python library designed for scalable processing of large multi-dimensional arrays with bounded memory. The session also highlights recent achievements of the EOPF Sentinel Zarr Samples Service, including the release of the new EOPF Zarr data products.

As part of the broader effort to support the adoption of the new EOPF data format, this session is one in a series of webinars aimed at developing and engaging a community of early adopters across diverse user communities.

About the speaker

Tom White is an independent software engineer specialising in open-source software for scientific computing, with a strong focus on large-scale distributed storage and array processing. He is the founder and lead developer of Cubed, and contributes to sgkit, a scalable genetics toolkit leveraging the PyData ecosystem (NumPy, Xarray, Zarr, and others).

Previously, Tom was an early engineer at Cloudera, where he worked extensively on projects within the Apache Hadoop ecosystem. He is the author of the bestselling Hadoop: The Definitive Guide, published by O’Reilly.

What you will learn

• What Cubed is and how it enables scalable array processing.
• How Cubed supports workflows using the EOPF Zarr data products.
• How to begin experimenting with Cubed through a live demonstration.
• Where to find resources and how to engage with the early-adopter community.

Programme