Skip to content

Restore the SQLite metastore from its backup when the local database is empty - #9894

Open
begelundmuller wants to merge 2 commits into
mainfrom
begelundmuller/restore-sqlite-metastore-from-backup
Open

begelundmuller wants to merge 2 commits into
mainfrom
begelundmuller/restore-sqlite-metastore-from-backup

Conversation

@begelundmuller

@begelundmuller begelundmuller commented Sep 16, 2026

Copy link
Copy Markdown
Contributor
  • Restores snapshot.db from the backup bucket on startup when the metastore has no migrations applied, which also covers a zero-length file or a previous startup that crashed before migrating.
  • Adds RILL_RUNTIME_METASTORE_BACKUPS_ENABLE (default true), gating both the daily backup and the restore.
  • A failed restore fails startup rather than booting empty, since the next nightly backup would otherwise overwrite the snapshot.
  • Raises backupMaxSizeBytes from 5 GB to 15 GB so the largest metastores are backed up (and therefore restorable) at all, and bounds a restore at 30 minutes, which is enough to download a snapshot at that limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area:CLI Size:M Medium change: 100-499 lines Type:Improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants