Skip to content

Optimize HitSet seeking and counting - #6885

Open
PSeitz wants to merge 2 commits into
quickwit-oss:mainfrom
PSeitz:large_query
Open

PSeitz wants to merge 2 commits into
quickwit-oss:mainfrom
PSeitz:large_query

Conversation

@PSeitz

@PSeitz PSeitz commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

Description

  • Implement block-aware HitSet::seek and seek_danger to skip blocks and search within the current block.
  • Return the stored hit count without consuming the scorer.
  • Update Tantivy and tantivy-common to latest main revision e988ecb7a11109d89f9f4582b386089fc3a2fec0.
  • Rebase onto Quickwit main to include its existing tie-breaker compatibility changes.

How was this PR tested?

Adds tests for seeking, seek_danger misses, counting without consuming hits, block boundaries, and termination.

  • make fmt passed.
  • cargo check -p quickwit-query passed.
  • cargo nextest run --locked -p quickwit-query test_hit_set: 5 passed.
  • cargo nextest run --locked -p quickwit-query: 188 passed.

Update Tantivy to main revision e988ecb7, implement block-aware seek and exact-hit seek_danger, and return the stored hit count directly. Add coverage for iteration, seeking, and counting.
@PSeitz
PSeitz marked this pull request as ready for review October 17, 2026 07:03
@PSeitz
PSeitz requested a review from a team as a code owner October 17, 2026 07:03
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 17, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-17T08:54:52.857198Z f644768 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant