Repository navigation
Conversation
npe2api committed ~40 MB of JSON under public/ to main every two hours; its history was 62,585 commits, 86% of them data. Here the data lives in its own repository, napari/plugin-api-data, which keeps every snapshot since 2022 without weighing down this one. Workflows check it out into public/, so no script changes: bigquery.py, fetch_manifests.py and reindex.py still read and write public/ as before. - update.yml checks out the latest snapshot into public/ with DATA_DEPLOY_KEY (a deploy key with write access to the data repository only), validates the result with tests/test_output.py (new: invalid data is no longer committed) and commits it there. A concurrency group stops two runs committing at once. Pull requests check out the data read-only and commit nothing. - python-test.yml checks out the data so tests/test_output.py has some. - public/ is ignored; CONTRIBUTING.md explains cloning the data with --depth 1 for local work. - The old Next.js build in the Test workflow gets the data checkout too, until the next PR removes the app. - Python Test runs with read-only contents permission.
TimMonko
force-pushed
the
cf/01-data-repo
branch
from
November 20, 2026 06:33
7e0d531 to
57dc300
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
npe2api committed ~40 MB of JSON under public/ to main every two hours;
its history was 62,585 commits, 86% of them data. Here the data lives in
its own repository, napari/plugin-api-data, which keeps every snapshot
since 2022 without weighing down this one. Workflows check it out into
public/, so no script changes: bigquery.py, fetch_manifests.py and
reindex.py still read and write public/ as before.
DATA_DEPLOY_KEY (a deploy key with write access to the data repository
only), validates the result with tests/test_output.py (new: invalid
data is no longer committed) and commits it there. A concurrency group
stops two runs committing at once. Pull requests check out the data
read-only and commit nothing.
--depth 1 for local work.
Stack created with GitHub Stacks CLI • Give Feedback 💬