Skip to content

kaiju/iceberg-puddle

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🧊 iceberg-puddle

For the love of god I don't need an entire lake.

Do you just want to get some development work done? Do you just want to stand up a local Iceberg REST catalog & some S3 compatible object storage? Do you just want to get pyiceberg or duckdb or spark-iceberg working? Yeah, me too.

⚠️ It should go without saying but do not use this in production. Do not put this on the public internet. This is explicitly for local/development usage and there's zero security on anything in here. Don't do it!

Components

Usage

docker compose up or podman compose up depending on what flavor of psycho you are.

The initial bootstrap script will generate the following files in the configs/ directory:

  • configs/.pyiceberg.yaml: PyIceberg configuration
  • configs/awscli.env: AWS environment configuration variables
  • configs/duckdb.sql: DuckDB Iceberg/S3/REST Catalog configuration

Releases

No releases published

Packages

 
 
 

Contributors