Skip to content

README.md

Latest commit

 

History

History
22 lines (13 loc) · 1.05 KB

README.md

File metadata and controls

22 lines (13 loc) · 1.05 KB
Raw

🧊 iceberg-puddle

For the love of god I don't need an entire lake.

Do you just want to get some development work done? Do you just want to stand up a local Iceberg REST catalog & some S3 compatible object storage? Do you just want to get pyiceberg or duckdb or spark-iceberg working? Yeah, me too.

⚠️ It should go without saying but do not use this in production. Do not put this on the public internet. This is explicitly for local/development usage and there's zero security on anything in here. Don't do it!

Components

Usage

docker compose up or podman compose up depending on what flavor of psycho you are.

The initial bootstrap script will generate the following files in the configs/ directory:

  • configs/.pyiceberg.yaml: PyIceberg configuration
  • configs/awscli.env: AWS environment configuration variables
  • configs/duckdb.sql: DuckDB Iceberg/S3/REST Catalog configuration