Skip to content

feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script #4273

Open
mengw15 wants to merge 3 commits intoapache:mainfrom
mengw15:Lakekeeper-bootstrap-script
Open

feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script #4273
mengw15 wants to merge 3 commits intoapache:mainfrom
mengw15:Lakekeeper-bootstrap-script

Conversation

@mengw15
Copy link
Contributor

@mengw15 mengw15 commented Mar 9, 2026

What changes were proposed in this PR?

This is PR 2 of a decomposed series from #4242, adding the Lakekeeper bootstrap script for local development setup.

New files:

  • bin/bootstrap-lakekeeper.sh (~525 lines): idempotent script that automates Lakekeeper setup:
    1. Starts Lakekeeper if not already running
    2. Bootstraps the Lakekeeper server (creates default project)
    3. Creates MinIO bucket if needed
    4. Creates the warehouse with S3 storage configuration
  • bin/parse-storage-config.py: HOCON config parser utility used by the bootstrap script to read values from
    storage.conf

Post-merge setup for developers:

  1. Create the Lakekeeper database:
    psql -f sql/texera_lakekeeper.sql
  2. Download the Lakekeeper binary from the Lakekeeper releases page
  3. Edit bin/bootstrap-lakekeeper.sh user configuration section:
  • LAKEKEEPER_BINARY_PATH — path to the downloaded binary
  • LAKEKEEPER__PG_DATABASE_URL_READ/WRITE — PostgreSQL connection URL
    (postgres://user:password@host:5432/texera_lakekeeper)
  1. Run the script:
    ./bin/bootstrap-lakekeeper.sh

Any related issues, documentation, discussions?

Part of #4126. Depends on #4272 (catalog migration).

How was this PR tested?

Manually tested

Was this PR authored or co-authored using generative AI tooling?

Co-authored with Claude Code

@mengw15 mengw15 changed the title feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script Mar 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant