FOSS4G 2025 | Faster, simpler access to cloud-based geospatial data with Obstore

Описание: Presented by Kyle Barron on 19 November 2025 11:00, at FOSS4G 2025 Auckland. Track: Cloud, APIs & Data Infrastructure
Full presentation details - https://talks.osgeo.org/foss4g-2025/t... BUHEKS

Obstore is the simplest, highest-throughput Python interface to Amazon S3, Google Cloud Storage, Azure Storage. This talk will explain what Obstore is, how it differs from existing Python libraries for cloud data access, and how it's being used to speed up cloud-based geospatial workflows.

[Obstore](https://developmentseed.org/obstore/l...) is a Python library that abstracts how to access data on commercial cloud storage providers, like Amazon S3, Google Cloud Storage, and Azure Storage. Instead of writing code for each provider and manually creating the abstractions, use Obstore’s singular API for data access.

While at its face Obstore is similar to [fsspec](https://github.com/fsspec/filesystem_... both provide abstracted interfaces to cloud storage—Obstore presents some core improvements:

Minimal API with native synchronous and asynchronous support.
Fast with no Python dependencies: obstore wraps the Rust `object_store` library, meaning that your Python environment stays small and you won’t face dependency conflicts.
Streaming downloads, uploads, and listings without manual pagination.
Full type hinting for easier use in Python IDE environments.
Simple access to [NASA Earthdata](https://developmentseed.org/obstore/l...) and [Microsoft Planetary Computer](https://developmentseed.org/obstore/l...) data collections with *automatic credential refreshing* when short-lived tokens expire.

While Obstore is a foundational technology that can be used across many domains, this talk will focus on its use in geospatial-related projects:

[Zarr](https://zarr.dev/)\-Python introduced an [Obstore-based backend](https://zarr.readthedocs.io/en/latest...) that can be [3x faster than the default fsspec-based backend](https://github.com/maxrjones/zarr-obs...) when reading Zarr datasets.
[VirtualiZarr](https://github.com/zarr-developers/Vi..., a library to present non-cloud-native file formats like netCDF as virtual Zarr datasets, is being rewritten to use Obstore by default.
[Async-tiff](https://github.com/developmentseed/as..., a fast, asynchronous, Python TIFF, GeoTIFF, and Cloud-Optimized GeoTIFF reader, uses Obstore under the hood to power its data fetching.
A [new Python GeoParquet library](https://geoarrow.org/geoarrow-rs/pyth...) uses Obstore as well.

This talk will explain what Obstore is, how it differs from existing Python libraries, and how you might use it in your own projects to speed up your own data access.

===

https://2025.foss4g.org/
‪@FOSS4G‬