WORKSHOP || Code of the Month Vol. 14 – ESIWACE3

Описание: Online Laboratory for Climate Science and Meteorology, and associated Online Compression Laboratory

Presenter: Juniper Tyree, University of Helsinki / ESiWACE CoE

While the output volumes from high-resolution weather and climate models are increasing exponentially, data storage, access, and analysis methods have not kept up. Lossy data compression is a vital tool to keep up with this increase in data production. However, information loss sounds scary and a convincing argument for lossy data compression can only be made by domain scientists themselves by trying it out for themselves.

Interactive code notebooks (e.g. Jupyter) have become popular for sharing and communicating computational experiments, analyses, and visualizations. While sharing the notebooks is easy, running them requires hosting a JupyterLab server and installing all Python and system libraries required for the notebook. This initial setup cost hinders quickly experimenting with a shared notebook and testing, e.g. a practical example of lossy data compression for oneself.

As part of the EuroHPC ESiWACE, Phase 3, Centre of Excellence (https://www.esiwace.eu/), we have been developing an Online Laboratory for Climate Science and Meteorology (https://lab.climet.eu), a JupyterLab instance that runs serverless just within your web browser and comes with many libraries pre-installed. With the online lab, running and exploring a shared notebook can start within a minute. We use the online laboratory to provide domain scientists with an online compression laboratory, https://compression.lab.climet.eu, to reduce the barrier to experimenting with the effect of lossy compression on their own data. We have also been working on allowing the online laboratory to be used for sharing open science and interactive documentation by the broader community.


Powered by CASTIEL 2

CASTIEL 2 has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101102047. The JU receives support from the European Union‘s Digital Europe Programme and Germany, Italy, Spain, France, Belgium, Austria, Estonia.