Skip to content

feat: reuse parsed snapshot manifests across scans - #948

Draft
manuzhang wants to merge 3 commits into
apache:mainfrom
manuzhang:agent/add-parsed-snapshot-cache
Draft

manuzhang wants to merge 3 commits into
apache:mainfrom
manuzhang:agent/add-parsed-snapshot-cache

Conversation

@manuzhang

Copy link
Copy Markdown
Member

Summary

  • reuse parsed manifest-list entries across separate SnapshotCache wrappers and scans
  • store parsed entries in FileIO-owned state without changing Snapshot's public layout
  • coalesce concurrent parsing and tie parsed-entry lifetime to metadata byte-cache eviction
  • keep existing manifest spans valid after shared-cache eviction and expose them as immutable spans

Why

PR #875 avoids repeated storage reads for immutable metadata, but each new scan still reparses cached manifest-list bytes. This follow-up reuses the parsed ManifestFile entries while the corresponding byte-cache entry remains alive.

Parsed entries are not retained for oversized content that bypasses the byte cache, and failures are shared with current waiters without becoming permanent cached failures.

Dependency

Depends on #875. Until #875 merges, GitHub's comparison against main includes the lower metadata-content-cache commit; the isolated change is commit d93c92c.

Validation

  • pre-commit run --show-diff-on-failure --all-files
  • focused C++23 syntax checks for snapshot caching, snapshot expiration, and manifest writer tests

Co-authored-by: Codex <codex@openai.com>
Copilot AI lite review requested due to automatic review settings September 20, 2026 06:06

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@manuzhang
manuzhang marked this pull request as draft September 20, 2026 06:10
Copilot AI review requested due to automatic review settings September 21, 2026 04:22

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@manuzhang
manuzhang force-pushed the agent/add-parsed-snapshot-cache branch from 97b9847 to c39ae81 Compare September 21, 2026 05:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants