Adaptive (runtime, stats-based) conjunct reordering for FilterExec - #22698

Open

adriangb wants to merge 27 commits into

apache:mainfrom

pydantic:lift-selectivity-stats

Commits on Sep 16, 2026

feat(physical-plan): adaptive conjunct reordering in FilterExec (compact-once core)

adriangb
and
claude
committed
d69afa4
feat(physical-plan): pool adaptive measurements across partition streams

adriangb
and
claude
committed
ffe07f4
feat(physical-plan): use compact-once only in service of a reorder

adriangb
and
claude
committed
e2055c4
fix(physical-plan): address review feedback on adaptive filter

adriangb
and
claude
committed
8beea6c
fix(physical-plan): reset adaptive filter state on re-execution

adriangb
and
claude
committed
fdbbf14
fix(physical-plan): harden adaptive filter edge cases

adriangb
and
claude
committed
b99a92a
test(sqllogictest): drive adaptive filter across the settle boundary

adriangb
and
claude
committed
66e8900
docs: tighten adaptive filter behavior claims

adriangb
and
claude
committed
1f0a68e
refactor(physical-plan): FilterExec owns the enable gate; trace per-batch strategy

adriangb
and
claude
committed
c9c7c36
refactor(physical-plan): drop redundant adaptive filter epoch

adriangb
and
claude
committed
1bf6b20
feat(physical-plan): report adaptive filter reordering in FilterExec metrics

adriangb
and
claude
committed
f76986b
test(physical-plan): deterministic adaptive filter tests and flag-on FilterExec coverage

adriangb
and
claude
committed
c94e22d
docs(physical-plan): tighten adaptive filter documentation

adriangb
and
claude
committed
113b05c
refactor(physical-plan): evaluate the adopted order as a right-nested AND

adriangb
and
claude
committed
2b04353
refactor(physical-plan): measure conjuncts through BinaryExpr instead of a private evaluation loop

adriangb
and
claude
committed
eeecd9d
refactor(physical-plan): keep FilterExecMetrics::new signature; add with_adaptive_reorder_metrics

adriangb
and
claude
committed
8dac5ee
refactor(physical-plan): rank conjuncts by Velox's discards-per-time key

adriangb
and
claude
committed
19c8120
perf(physical-plan): right-nest the kept written order; pool without a pre-evaluation lock

adriangb
and
claude
committed
15a5be3
refactor(physical-plan): trim adaptive filter to its essentials

adriangb
and
claude
committed
9dbdffe
docs(physical-plan): drop stale order wording and fused test name

adriangb
and
claude
committed
784e085
docs(physical-plan): cut comment bloat in adaptive filter

adriangb
and
claude
committed
1e4c62c
refactor(physical-expr): share the AND pre-selection rule with its callers

adriangb
and
claude
committed
571a388
fix(physical-plan): keep the written AND tree, and cost it as AND runs it

adriangb
and
claude
committed
c54d917
test(physical-plan): pin the 30% downstream weight directly

adriangb
and
claude
committed
df919f9
fix(physical-expr): do not link private check_short_circuit from public docs

adriangb
and
claude
committed
0c0642e
refactor(physical-expr): hide the shared AND pre-selection rule from public docs

adriangb
and
claude
committed
8385e54
docs(physical-plan): describe the adaptive pool as node state, not per-execution

adriangb
and
claude
committed
8f5dcd1

Navigation Menu

Uh oh!

Adaptive (runtime, stats-based) conjunct reordering for FilterExec - #22698

Adaptive (runtime, stats-based) conjunct reordering for FilterExec#22698
adriangb wants to merge 27 commits into
apache:mainfrom
pydantic:lift-selectivity-stats

Commits on Sep 16, 2026

feat(physical-plan): adaptive conjunct reordering in FilterExec (compact-once core)

feat(physical-plan): pool adaptive measurements across partition streams

feat(physical-plan): use compact-once only in service of a reorder

fix(physical-plan): address review feedback on adaptive filter

fix(physical-plan): reset adaptive filter state on re-execution

fix(physical-plan): harden adaptive filter edge cases

test(sqllogictest): drive adaptive filter across the settle boundary

docs: tighten adaptive filter behavior claims

refactor(physical-plan): FilterExec owns the enable gate; trace per-batch strategy

refactor(physical-plan): drop redundant adaptive filter epoch

feat(physical-plan): report adaptive filter reordering in FilterExec metrics

test(physical-plan): deterministic adaptive filter tests and flag-on FilterExec coverage

docs(physical-plan): tighten adaptive filter documentation

refactor(physical-plan): evaluate the adopted order as a right-nested AND

refactor(physical-plan): measure conjuncts through BinaryExpr instead of a private evaluation loop

refactor(physical-plan): keep FilterExecMetrics::new signature; add with_adaptive_reorder_metrics

refactor(physical-plan): rank conjuncts by Velox's discards-per-time key

perf(physical-plan): right-nest the kept written order; pool without a pre-evaluation lock

refactor(physical-plan): trim adaptive filter to its essentials

docs(physical-plan): drop stale order wording and fused test name

docs(physical-plan): cut comment bloat in adaptive filter

refactor(physical-expr): share the AND pre-selection rule with its callers

fix(physical-plan): keep the written AND tree, and cost it as AND runs it

test(physical-plan): pin the 30% downstream weight directly

fix(physical-expr): do not link private check_short_circuit from public docs

refactor(physical-expr): hide the shared AND pre-selection rule from public docs

docs(physical-plan): describe the adaptive pool as node state, not per-execution