Skip to content

Analyze SM log volume and reduce gcmgr noise (Change 1). - #466

Merged
Besroy merged 1 commit into
eBay:stable/v4.xfrom
Besroy:log_analyze
Sep 21, 2026
Merged

Besroy merged 1 commit into
eBay:stable/v4.xfrom
Besroy:log_analyze

Conversation

@Besroy

@Besroy Besroy commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@codecov-commenter

codecov-commenter commented Sep 17, 2026

Copy link
Copy Markdown

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (stable/v4.x@3887bc9). Learn more about missing BASE report.

Files with missing lines Patch % Lines
src/lib/homestore_backend/gc_manager.cpp 0.00% 2 Missing ⚠️
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@              Coverage Diff               @@
##             stable/v4.x     #466   +/-   ##
==============================================
  Coverage               ?   54.81%           
==============================================
  Files                  ?       39           
  Lines                  ?     6881           
  Branches               ?      944           
==============================================
  Hits                   ?     3772           
  Misses                 ?     2707           
  Partials               ?      402           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@xiaoxichen xiaoxichen left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@Besroy
Besroy merged commit d9a17ca into eBay:stable/v4.x Sep 21, 2026
88 of 97 checks passed
Besroy added a commit to Besroy/HomeObject that referenced this pull request Sep 21, 2026
Co-authored-by: yawzhang <yawzhang@ebay.com>
Besroy added a commit to Besroy/HomeObject that referenced this pull request Sep 21, 2026
Co-authored-by: yawzhang <yawzhang@ebay.com>
Besroy added a commit to Besroy/HomeObject that referenced this pull request Sep 21, 2026
Co-authored-by: yawzhang <yawzhang@ebay.com>
Besroy added a commit that referenced this pull request Sep 21, 2026
* Fix snapshot receiver progress on replay

Snapshot receiver progress could be counted repeatedly when a same-LSN
baseline resync replayed shard metadata. Batch retries after a failed
batch could also roll back the preceding batch contribution.

Track the current shard contribution separately, reset it on shard
replay, and clear stale batch rollback state when accepting a new
batch.

Also fixed a minor bug in the handling of unexpected blob corruption by
returning after collecting detached futures.

Reference: SDSTOR-24120

* Fix batch resend bug caused by prefetch limit (#454)

Retained look-ahead data could exhaust the donor prefetch budget while
rebuilding a resent batch, preventing a required earlier blob from being
loaded and causing each retry to fail at the same cursor, sticking the
resync progress at the same point.

Allow blobs preceding the retained prefetch frontier to bypass the
bounded look-ahead budget, and cover the scenario with a focused
regression test.

* Improve baseline resync logging (#455)

Eliminate inconsistent terminology, context, and severity levels across
existing BR read/write logs. Add structured lifecycle, payload, retry,
and failure records with consistent PG, shard, batch, blob, and block
identifiers. Keep key object and payload transitions at INFO while
moving per-blob details to TRACE to reduce routine log noise.

* Analyze SM log volume and reduce gcmgr noise (Change 1) (#466)

Co-authored-by: yawzhang <yawzhang@ebay.com>

---------

Co-authored-by: KOU Jilong <108138320+koujl@users.noreply.github.com>
Co-authored-by: yawzhang <yawzhang@ebay.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants