Skip to content

Fix: reduce recall calculation time at small batch - #2513

Merged
rapids-bot[bot] merged 3 commits into
NVIDIA:mainfrom
sherylll:fix-recall-calculation
Sep 3, 2026
Merged

Fix: reduce recall calculation time at small batch#2513
rapids-bot[bot] merged 3 commits into
NVIDIA:mainfrom
sherylll:fix-recall-calculation

Conversation

@sherylll

Copy link
Copy Markdown
Contributor

Decoupes work assignment in recall calculatoin loop from batch size (n_queries) used for search. This prevents each worker from having very little to do when batch size is small.

Fixes #2487

Decoupes work assignment in recall calculatoin loop from batch size (n_queries) used for search.
This prevents each worker from having very little to do when batch size is small.
@sherylll
sherylll requested a review from a team as a code owner August 27, 2026 09:07
@copy-pr-bot

copy-pr-bot Bot commented Aug 27, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@achirkin achirkin added improvement Improves an existing functionality non-breaking Introduces a non-breaking change Enhancement labels Sep 3, 2026

@achirkin achirkin left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, good catch!

@achirkin

achirkin commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

/ok to test df9a967

@achirkin

achirkin commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

/ok to test d1ce725

@achirkin

achirkin commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

/merge

@rapids-bot
rapids-bot Bot merged commit 32203ac into NVIDIA:main Sep 3, 2026
88 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Enhancement improvement Improves an existing functionality non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Recall calculation is very slow for small batch

2 participants