feat(hg_analytics): the scale thesis, measured — parallel + distributed + out-of-core#26

Merged

mdheller merged 30 commits into

mainfrom

feat/rust-parallel-analytics

Jul 10, 2026

Commits on Jul 9, 2026

feat(hg_analytics): rayon-parallel PageRank + betweenness (the scale thesis, measured)
mdheller
committed
style: cargo fmt (rustfmt CI)
mdheller
committed
feat(hg_analytics): distributed (BSP) PageRank over sharded partitions — the federation wedge
mdheller
committed
feat(hg_analytics): out-of-core mmap CSR PageRank — kill the RAM ceiling
mdheller
committed
feat(hg_analytics): streaming O(n)-heap CSR builder — ingest graphs larger than RAM
mdheller
committed
bench(ooc): 100M-edge out-of-core PageRank — RAM-ceiling break at scale
mdheller
committed
feat(ooc): bucketed external-memory CSR builder — fully-sequential-I/O ingest of >RAM graphs
mdheller
committed
feat(dist): REAL multi-process distributed PageRank over TCP sockets
mdheller
committed
feat(cc): distributed connected components — the partition-native model generalizes
mdheller
committed
bench(warm): incremental warm-start PageRank — honest number
mdheller
committed
bench(ooc): billion-scale runner — honest single-box ceiling is ~500M edges
mdheller
committed

Commits on Jul 10, 2026