Introducing Polaris Catalog: An Open Source Catalog For Apache Iceberg

Описание: Open source file and table formats have garnered much interest in the data industry because of their potential for interoperability – unlocking the ability for many technologies to safely operate over a single copy of data. Greater interoperability not only reduces the complexity and costs associated with using many tools and processing engines in parallel, but it also reduces potential risks associated with vendor lock-in.

In an effort to improve interoperability, the Apache Iceberg community has developed an open standard of a REST protocol in the Iceberg project. The open API specification is a big step towards achieving interoperability, and the ecosystem could further benefit from open source catalog implementations and open standards for security features like role-based access control and storage layer security to implement secure, vendor-neutral storage.

Polaris Catalog is an open source catalog that builds on standards created by the Iceberg community.
Instead of moving and copying data for different engines and catalogs, you can interoperate many engines on a single copy of data from one place, saving you duplicative storage and ETL costs.
You can manage role-based access control and storage layer security across many engines consistently from one place.
You can host it from Snowflake or your infrastructure of choice and retain security controls; no lock-in.

Learn more here: https://www.snowflake.com/blog/introd...

Subscribe for more! http://www.snowflake.com/YTsubscribe/

Explore sample code, download tools, and connect with peers: https://developers.snowflake.com/