Pangeo
Pangeo is a community and platform for big data analysis in the geoscience and beyond. You can learn more about Pangeo at https://pangeo.io. This channel hosts content generated by the Pangeo Community at our meetings, including the Pangeo Showcase seminar series.
Ensemble Weather Forecast Data Streaming with Kerchunk / VirtualiZarr
Zarr Summit Review: Unlocking scalable and accessible open science on the cloud
Tensors and back again: Xbatcher for filtering, resampling and assembling deep learning model output
Let’s solve the problem of object storage
Rechunking using SLURM-like job arrays with Coiled
Speeding up Zarr data access with obstore
Organizing model predictions stored in Zarr with STAC…a journey + example
Visualizing multidimensional climate data on the web - the OAE Efficiency Atlas
Use-cases for parquet datasets in oceanography
A n00b tries to scale geospatial zonal statistics
Dask Array: Scaling Up for Terabyte-Level Performance
Real-time collaboration and collaborative editing for GIS workflows with Jupyter and QGIS
Building Scalable Mosaic Workflows with Flyte/UnionAI, GDAL, and Xarray
Zarr Python 3 and beyond
FROST: Federated Registry Of Scientific Things
High-performance Python STAC tooling, backed by Rust
Xpublish at Scale(s)
Arkouda as an XArray backend for HPC!
xdggs: discrete global grid systems with xarray
Xarray’s GroupBy, oh my!
VEDA: NASA’s Platform for Open Science
Awesome Panel
Icechunk: An Open-Source Transactional Storage Engine for Zarr
HYCOM-OceanTrack: From 17,518 NetCDF files to an Analysis-Ready Cloud-Optimized dataset in the cloud
marimo: an open-source reactive notebook for Python
Project Pythia Cookbooks: challenges and progress in breaking down barriers to Open Science
Geospatial reprojection in Python 2024 - what’s available and what’s next
Pangeo ML: Open source tools and pipelines for scalable machine learning using NASA EO data
CoCalc for Pangeans
Zarr-Python 3 and why you should be excited!