Skip to content

duckdb: user file path as footer cache - #9733

Open
myrrc wants to merge 5 commits into
developfrom
myrrc/duckdb-fast-footer-key
Open

duckdb: user file path as footer cache#9733
myrrc wants to merge 5 commits into
developfrom
myrrc/duckdb-fast-footer-key

Conversation

@myrrc

@myrrc myrrc commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Use raw duckdb path (user input) for opening the file (and saving the footer) and retrieving the footer. This is fine since duckdb uses the same raw string for footer cache. Unlike duckdb, we don't save any etag to check whether file has changed since, but this diff doesn't change the state.

Make Vortex file's open_cached get an explicit key which is probed before source.uri().

Also, remove "ordered" flag while constructing a scan since it wasn't used internally anyway.

A couple of micro-optimizations on top of that:

  • Allow convering an extension scalar to its storage primitive. Since
    most extension types are Temporal (which are backed by a Primitive) this
    is a reasonable shortcut that's also useful for FileStatistics.
  • Avoid extra allocation in parsing Footer.

Main improvements are clickbench q0 and q6

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc requested a review from joseph-isaacs September 2, 2026 16:52
@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration labels Sep 2, 2026
@myrrc
myrrc enabled auto-merge (squash) September 2, 2026 16:53
@codspeed-hq

codspeed-hq Bot commented Sep 2, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 16.95%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
✅ 2177 untouched benchmarks
⏩ 206 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decompress[u64, (4000, 1024)] 85.7 µs 70.4 µs +21.81%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.7 µs +21.28%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%
Simulation allocate_drop_bytes[0] 520.2 ns 466 ns +11.62%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-fast-footer-key (2ac8893) with develop (dab1684)

Open in CodSpeed

Footnotes

  1. 206 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@myrrc myrrc added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 2, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 2, 2026
Comment thread vortex-array/src/scalar/typed_view/extension/mod.rs Outdated
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 981163b string-bench 1 Explore Profiling Data
Previous Runs (10)
Status Commit Job Attempt Link
🟢 Done 3b36373 statpopgen 1 Explore Profiling Data
🟢 Done 3b36373 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 3b36373 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 3b36373 fineweb-s3 1 Explore Profiling Data
🟢 Done 3b36373 fineweb 1 Explore Profiling Data
🟢 Done 3b36373 clickbench-nvme 1 Explore Profiling Data
🟢 Done 3b36373 tpcds-nvme 1 Explore Profiling Data
🟢 Done 3b36373 polarsignals 1 Explore Profiling Data
🟢 Done 3b36373 tpch-s3 1 Explore Profiling Data
🟢 Done 3b36373 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 3b363739 vs base b4863a1d
Vortex (geomean): hot 1.000x ➖ · cold 1.003x ➖


datafusion / vortex-file-compressed / ns (1.000x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 110875341 / 93479350 / +18.6% 🔴 205870864 / 202297897 / +1.8% 0.54 / 0.46 / +16.6%
polarsignals_q01/datafusion:vortex-file-compressed 157120090 / 156889603 / +0.1% 275832933 / 272678074 / +1.2% 0.57 / 0.58 / -1.0%
polarsignals_q02/datafusion:vortex-file-compressed 51704211 / 52086376 / -0.7% 124617139 / 121679904 / +2.4% 0.41 / 0.43 / -3.1%
polarsignals_q03/datafusion:vortex-file-compressed 155832252 / 161037641 / -3.2% 275912626 / 275191948 / +0.3% 0.56 / 0.59 / -3.5%
polarsignals_q04/datafusion:vortex-file-compressed 10703604 / 10265856 / +4.3% 78287358 / 82456294 / -5.1% 0.14 / 0.12 / +9.8%
polarsignals_q05/datafusion:vortex-file-compressed 14145468 / 13065531 / +8.3% 91100697 / 92270422 / -1.3% 0.16 / 0.14 / +9.7%
polarsignals_q06/datafusion:vortex-file-compressed 28817042 / 31357374 / -8.1% 104439558 / 95486568 / +9.4% 0.28 / 0.33 / -16.0%
polarsignals_q07/datafusion:vortex-file-compressed 12150952 / 11977213 / +1.5% 85511326 / 87670026 / -2.5% 0.14 / 0.14 / +4.0%
polarsignals_q08/datafusion:vortex-file-compressed 289489854 / 285483478 / +1.4% 400467527 / 402199591 / -0.4% 0.72 / 0.71 / +1.8%
polarsignals_q09/datafusion:vortex-file-compressed 10768606 / 13088532 / -17.7% 🟢 80204888 / 81534438 / -1.6% 0.13 / 0.16 / -16.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (-2.2%, low confidence) · DuckDB No clear signal (+3.6%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.966x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 8927148 / 8633462 / +3.4% 36718087 / 37398966 / -1.8% 0.24 / 0.23 / +5.3%
fineweb_q01/datafusion:vortex-file-compressed 26465224 / 27070906 / -2.2% 94489461 / 96191696 / -1.8% 0.28 / 0.28 / -0.5%
fineweb_q02/datafusion:vortex-file-compressed 28517984 / 29569434 / -3.6% 93602632 / 97777611 / -4.3% 0.30 / 0.30 / +0.7%
fineweb_q03/datafusion:vortex-file-compressed 44221496 / 45612409 / -3.0% 183807642 / 185128749 / -0.7% 0.24 / 0.25 / -2.4%
fineweb_q04/datafusion:vortex-file-compressed 202736318 / 203797832 / -0.5% 330408012 / 323072025 / +2.3% 0.61 / 0.63 / -2.7%
fineweb_q05/datafusion:vortex-file-compressed 150078254 / 151453432 / -0.9% 282930639 / 289235008 / -2.2% 0.53 / 0.52 / +1.3%
fineweb_q06/datafusion:vortex-file-compressed 41227270 / 39734022 / +3.8% 188639567 / 189465622 / -0.4% 0.22 / 0.21 / +4.2%
fineweb_q07/datafusion:vortex-file-compressed 36903411 / 37066566 / -0.4% 182094964 / 180593232 / +0.8% 0.20 / 0.21 / -1.3%
fineweb_q08/datafusion:vortex-file-compressed 15116528 / 19821896 / -23.7% 🟢 69281962 / 80416392 / -13.8% 🟢 0.22 / 0.25 / -11.5%
datafusion / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 8577941 / 9257584 / -7.3% 55545683 / 52579047 / +5.6% 0.15 / 0.18 / -12.3%
fineweb_q01/datafusion:parquet 188831926 / 192372631 / -1.8% 279606153 / 286174771 / -2.3% 0.68 / 0.67 / +0.5%
fineweb_q02/datafusion:parquet 191538718 / 188521028 / +1.6% 279829153 / 284995995 / -1.8% 0.68 / 0.66 / +3.5%
fineweb_q03/datafusion:parquet 191491344 / 190839438 / +0.3% 283717768 / 287289367 / -1.2% 0.67 / 0.66 / +1.6%
fineweb_q04/datafusion:parquet 206312077 / 210015060 / -1.8% 303721320 / 304904928 / -0.4% 0.68 / 0.69 / -1.4%
fineweb_q05/datafusion:parquet 204406924 / 207170826 / -1.3% 294288849 / 297229015 / -1.0% 0.69 / 0.70 / -0.3%
fineweb_q06/datafusion:parquet 190200562 / 190982212 / -0.4% 285785676 / 284147602 / +0.6% 0.67 / 0.67 / -1.0%
fineweb_q07/datafusion:parquet 190393040 / 189726866 / +0.4% 283492726 / 278290620 / +1.9% 0.67 / 0.68 / -1.5%
fineweb_q08/datafusion:parquet 190779944 / 191198208 / -0.2% 284612351 / 285413116 / -0.3% 0.67 / 0.67 / +0.1%
duckdb / vortex-file-compressed / ns (1.031x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 4263437 / 3596375 / +18.5% 🔴 16637360 / 12918535 / +28.8% 🔴 0.26 / 0.28 / -8.0%
fineweb_q01/duckdb:vortex-file-compressed 39094269 / 43607842 / -10.4% 🟢 116402864 / 130095699 / -10.5% 🟢 0.34 / 0.34 / +0.2%
fineweb_q02/duckdb:vortex-file-compressed 43892024 / 41829331 / +4.9% 116210891 / 114338366 / +1.6% 0.38 / 0.37 / +3.2%
fineweb_q03/duckdb:vortex-file-compressed 62527996 / 63122802 / -0.9% 191194461 / 198818491 / -3.8% 0.33 / 0.32 / +3.0%
fineweb_q04/duckdb:vortex-file-compressed 271120774 / 280385448 / -3.3% 367677206 / 419774538 / -12.4% 🟢 0.74 / 0.67 / +10.4%
fineweb_q05/duckdb:vortex-file-compressed 213278317 / 218307696 / -2.3% 317661794 / 324605639 / -2.1% 0.67 / 0.67 / -0.2%
fineweb_q06/duckdb:vortex-file-compressed 64963066 / 62447620 / +4.0% 291730042 / 293467807 / -0.6% 0.22 / 0.21 / +4.6%
fineweb_q07/duckdb:vortex-file-compressed 59425032 / 60203434 / -1.3% 195781734 / 199079087 / -1.7% 0.30 / 0.30 / +0.4%
fineweb_q08/duckdb:vortex-file-compressed 31426824 / 25607779 / +22.7% 🔴 138989372 / 93992621 / +47.9% 🔴 0.23 / 0.27 / -17.0%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 34352269 / 35792713 / -4.0% 40959636 / 44583100 / -8.1% 0.84 / 0.80 / +4.5%
fineweb_q01/duckdb:parquet 76808560 / 75218118 / +2.1% 108416677 / 110965258 / -2.3% 0.71 / 0.68 / +4.5%
fineweb_q02/duckdb:parquet 77874204 / 77959008 / -0.1% 106063066 / 108358645 / -2.1% 0.73 / 0.72 / +2.1%
fineweb_q03/duckdb:parquet 206134978 / 207751607 / -0.8% 415986069 / 425742252 / -2.3% 0.50 / 0.49 / +1.5%
fineweb_q04/duckdb:parquet 234431632 / 231537781 / +1.2% 422185414 / 431667073 / -2.2% 0.56 / 0.54 / +3.5%
fineweb_q05/duckdb:parquet 203727442 / 204448313 / -0.4% 397896030 / 411049115 / -3.2% 0.51 / 0.50 / +2.9%
fineweb_q06/duckdb:parquet 141854272 / 143673945 / -1.3% 274380289 / 279132377 / -1.7% 0.52 / 0.51 / +0.4%
fineweb_q07/duckdb:parquet 144686360 / 143069428 / +1.1% 333327906 / 335804341 / -0.7% 0.43 / 0.43 / +1.9%
fineweb_q08/duckdb:parquet 37703524 / 38416806 / -1.9% 42178189 / 40399983 / +4.4% 0.89 / 0.95 / -6.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+1.4%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 1.014x ➖
Parquet (geomean): hot 0.989x ➖ · cold 1.024x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 42295696 / 42331047 / -0.1% 102507438 / 99880852 / +2.6% 0.41 / 0.42 / -2.6%
tpch_q02/datafusion:vortex-file-compressed 23270589 / 23671860 / -1.7% 68777368 / 68003239 / +1.1% 0.34 / 0.35 / -2.8%
tpch_q03/datafusion:vortex-file-compressed 27055695 / 27356287 / -1.1% 98881963 / 93501172 / +5.8% 0.27 / 0.29 / -6.5%
tpch_q04/datafusion:vortex-file-compressed 15331440 / 15591771 / -1.7% 65187488 / 64896935 / +0.4% 0.24 / 0.24 / -2.1%
tpch_q05/datafusion:vortex-file-compressed 46865292 / 46505481 / +0.8% 124512375 / 123273339 / +1.0% 0.38 / 0.38 / -0.2%
tpch_q06/datafusion:vortex-file-compressed 8291184 / 8268324 / +0.3% 58650731 / 55855207 / +5.0% 0.14 / 0.15 / -4.5%
tpch_q07/datafusion:vortex-file-compressed 55436647 / 56658288 / -2.2% 133449829 / 129714887 / +2.9% 0.42 / 0.44 / -4.9%
tpch_q08/datafusion:vortex-file-compressed 46053866 / 46645702 / -1.3% 116367074 / 118074832 / -1.4% 0.40 / 0.40 / +0.2%
tpch_q09/datafusion:vortex-file-compressed 54484639 / 53790659 / +1.3% 131089961 / 127817426 / +2.6% 0.42 / 0.42 / -1.2%
tpch_q10/datafusion:vortex-file-compressed 27651343 / 27286756 / +1.3% 100609084 / 100878843 / -0.3% 0.27 / 0.27 / +1.6%
tpch_q11/datafusion:vortex-file-compressed 17942010 / 17751623 / +1.1% 64894252 / 67785205 / -4.3% 0.28 / 0.26 / +5.6%
tpch_q12/datafusion:vortex-file-compressed 23379622 / 24241377 / -3.6% 80548248 / 72621526 / +10.9% 🔴 0.29 / 0.33 / -13.0%
tpch_q13/datafusion:vortex-file-compressed 23551107 / 23892094 / -1.4% 77372005 / 74968218 / +3.2% 0.30 / 0.32 / -4.5%
tpch_q14/datafusion:vortex-file-compressed 16570014 / 16310581 / +1.6% 74313392 / 75455817 / -1.5% 0.22 / 0.22 / +3.2%
tpch_q15/datafusion:vortex-file-compressed 20731976 / 21296435 / -2.7% 80750041 / 81591203 / -1.0% 0.26 / 0.26 / -1.6%
tpch_q16/datafusion:vortex-file-compressed 22948926 / 22664076 / +1.3% 73009841 / 73899852 / -1.2% 0.31 / 0.31 / +2.5%
tpch_q17/datafusion:vortex-file-compressed 54408327 / 54294317 / +0.2% 124953461 / 124787520 / +0.1% 0.44 / 0.44 / +0.1%
tpch_q18/datafusion:vortex-file-compressed 64141306 / 61838388 / +3.7% 125667609 / 118975022 / +5.6% 0.51 / 0.52 / -1.8%
tpch_q19/datafusion:vortex-file-compressed 15045215 / 15758226 / -4.5% 73892537 / 72157241 / +2.4% 0.20 / 0.22 / -6.8%
tpch_q20/datafusion:vortex-file-compressed 26395337 / 26963575 / -2.1% 90063238 / 88115392 / +2.2% 0.29 / 0.31 / -4.2%
tpch_q21/datafusion:vortex-file-compressed 58933610 / 58907716 / +0.0% 142392007 / 139409234 / +2.1% 0.41 / 0.42 / -2.1%
tpch_q22/datafusion:vortex-file-compressed 13788274 / 13903015 / -0.8% 61450143 / 62386881 / -1.5% 0.22 / 0.22 / +0.7%
datafusion / parquet / ns (0.980x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 111600442 / 110796912 / +0.7% 237057201 / 227241648 / +4.3% 0.47 / 0.49 / -3.4%
tpch_q02/datafusion:parquet 69734846 / 68761107 / +1.4% 120479126 / 113966383 / +5.7% 0.58 / 0.60 / -4.1%
tpch_q03/datafusion:parquet 87033101 / 97379346 / -10.6% 🟢 156315316 / 144634739 / +8.1% 0.56 / 0.67 / -17.3%
tpch_q04/datafusion:parquet 53594216 / 52968478 / +1.2% 114170421 / 98692470 / +15.7% 🔴 0.47 / 0.54 / -12.5%
tpch_q05/datafusion:parquet 108704979 / 113267559 / -4.0% 192271367 / 184938622 / +4.0% 0.57 / 0.61 / -7.7%
tpch_q06/datafusion:parquet 39531007 / 45912588 / -13.9% 🟢 90196215 / 95623866 / -5.7% 0.44 / 0.48 / -8.7%
tpch_q07/datafusion:parquet 111303881 / 110350380 / +0.9% 209057567 / 184245725 / +13.5% 🔴 0.53 / 0.60 / -11.1%
tpch_q08/datafusion:parquet 103912575 / 103688725 / +0.2% 176411506 / 174285110 / +1.2% 0.59 / 0.59 / -1.0%
tpch_q09/datafusion:parquet 133784006 / 130921161 / +2.2% 226006919 / 217719850 / +3.8% 0.59 / 0.60 / -1.6%
tpch_q10/datafusion:parquet 117669853 / 114587334 / +2.7% 194250300 / 192806435 / +0.7% 0.61 / 0.59 / +1.9%
tpch_q11/datafusion:parquet 49641028 / 50389652 / -1.5% 105687623 / 108955261 / -3.0% 0.47 / 0.46 / +1.6%
tpch_q12/datafusion:parquet 98548644 / 98451019 / +0.1% 154570222 / 151086238 / +2.3% 0.64 / 0.65 / -2.2%
tpch_q13/datafusion:parquet 212428095 / 210972860 / +0.7% 267681639 / 266639406 / +0.4% 0.79 / 0.79 / +0.3%
tpch_q14/datafusion:parquet 47853168 / 50715411 / -5.6% 108813149 / 109634696 / -0.7% 0.44 / 0.46 / -4.9%
tpch_q15/datafusion:parquet 64843686 / 64244393 / +0.9% 118905570 / 116961825 / +1.7% 0.55 / 0.55 / -0.7%
tpch_q16/datafusion:parquet 52099468 / 52334449 / -0.4% 104164519 / 105919909 / -1.7% 0.50 / 0.49 / +1.2%
tpch_q17/datafusion:parquet 130330409 / 154085027 / -15.4% 🟢 218380849 / 213858307 / +2.1% 0.60 / 0.72 / -17.2%
tpch_q18/datafusion:parquet 159218475 / 162738549 / -2.2% 221537377 / 211023812 / +5.0% 0.72 / 0.77 / -6.8%
tpch_q19/datafusion:parquet 80883173 / 79903322 / +1.2% 158173986 / 127783940 / +23.8% 🔴 0.51 / 0.63 / -18.2%
tpch_q20/datafusion:parquet 74541089 / 74756102 / -0.3% 143839956 / 141087920 / +2.0% 0.52 / 0.53 / -2.2%
tpch_q21/datafusion:parquet 130486036 / 129765806 / +0.6% 193285869 / 201949156 / -4.3% 0.68 / 0.64 / +5.1%
tpch_q22/datafusion:parquet 56603841 / 55938431 / +1.2% 98616060 / 103195053 / -4.4% 0.57 / 0.54 / +5.9%
duckdb / vortex-file-compressed / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 23254909 / 23288749 / -0.1% 61029293 / 64676502 / -5.6% 0.38 / 0.36 / +5.8%
tpch_q02/duckdb:vortex-file-compressed 29122881 / 30512746 / -4.6% 56790146 / 51471440 / +10.3% 🔴 0.51 / 0.59 / -13.5%
tpch_q03/duckdb:vortex-file-compressed 33991767 / 36253753 / -6.2% 89330654 / 86610580 / +3.1% 0.38 / 0.42 / -9.1%
tpch_q04/duckdb:vortex-file-compressed 31394262 / 31074107 / +1.0% 68869816 / 71323595 / -3.4% 0.46 / 0.44 / +4.6%
tpch_q05/duckdb:vortex-file-compressed 41043255 / 42179279 / -2.7% 83009797 / 81595940 / +1.7% 0.49 / 0.52 / -4.4%
tpch_q06/duckdb:vortex-file-compressed 9163796 / 9385407 / -2.4% 34555922 / 39662931 / -12.9% 🟢 0.27 / 0.24 / +12.1%
tpch_q07/duckdb:vortex-file-compressed 39871909 / 38572975 / +3.4% 81367263 / 77245014 / +5.3% 0.49 / 0.50 / -1.9%
tpch_q08/duckdb:vortex-file-compressed 43863488 / 47571935 / -7.8% 95381174 / 85422812 / +11.7% 🔴 0.46 / 0.56 / -17.4%
tpch_q09/duckdb:vortex-file-compressed 57808154 / 62517908 / -7.5% 105630070 / 109601409 / -3.6% 0.55 / 0.57 / -4.1%
tpch_q10/duckdb:vortex-file-compressed 49371385 / 49066050 / +0.6% 88105404 / 93357894 / -5.6% 0.56 / 0.53 / +6.6%
tpch_q11/duckdb:vortex-file-compressed 17088990 / 17941689 / -4.8% 41010185 / 33434584 / +22.7% 🔴 0.42 / 0.54 / -22.3%
tpch_q12/duckdb:vortex-file-compressed 26044935 / 26637139 / -2.2% 63166114 / 59173165 / +6.7% 0.41 / 0.45 / -8.4%
tpch_q13/duckdb:vortex-file-compressed 43412820 / 43439802 / -0.1% 118567664 / 114890338 / +3.2% 0.37 / 0.38 / -3.2%
tpch_q14/duckdb:vortex-file-compressed 22241303 / 21675952 / +2.6% 58309429 / 57094444 / +2.1% 0.38 / 0.38 / +0.5%
tpch_q15/duckdb:vortex-file-compressed 17610478 / 17609342 / +0.0% 57282313 / 60242929 / -4.9% 0.31 / 0.29 / +5.2%
tpch_q16/duckdb:vortex-file-compressed 30853913 / 30031873 / +2.7% 47105462 / 51992674 / -9.4% 0.65 / 0.58 / +13.4%
tpch_q17/duckdb:vortex-file-compressed 32111470 / 32822612 / -2.2% 82426936 / 85946356 / -4.1% 0.39 / 0.38 / +2.0%
tpch_q18/duckdb:vortex-file-compressed 49553340 / 49621094 / -0.1% 76567731 / 81616128 / -6.2% 0.65 / 0.61 / +6.4%
tpch_q19/duckdb:vortex-file-compressed 35609647 / 39047340 / -8.8% 70743820 / 63457258 / +11.5% 🔴 0.50 / 0.62 / -18.2%
tpch_q20/duckdb:vortex-file-compressed 35368537 / 33931058 / +4.2% 87030813 / 83149459 / +4.7% 0.41 / 0.41 / -0.4%
tpch_q21/duckdb:vortex-file-compressed 118546102 / 117344978 / +1.0% 161506292 / 157198578 / +2.7% 0.73 / 0.75 / -1.7%
tpch_q22/duckdb:vortex-file-compressed 20145882 / 21205669 / -5.0% 42195160 / 40434617 / +4.4% 0.48 / 0.52 / -9.0%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 81574891 / 81737333 / -0.2% 93171825 / 93133922 / +0.0% 0.88 / 0.88 / -0.2%
tpch_q02/duckdb:parquet 45795045 / 45654520 / +0.3% 62887564 / 69106587 / -9.0% 0.73 / 0.66 / +10.2%
tpch_q03/duckdb:parquet 80400908 / 81002546 / -0.7% 101666341 / 100771743 / +0.9% 0.79 / 0.80 / -1.6%
tpch_q04/duckdb:parquet 57836136 / 58053647 / -0.4% 76441563 / 75610748 / +1.1% 0.76 / 0.77 / -1.5%
tpch_q05/duckdb:parquet 78314737 / 78966087 / -0.8% 101305431 / 99278774 / +2.0% 0.77 / 0.80 / -2.8%
tpch_q06/duckdb:parquet 24780629 / 25097191 / -1.3% 34529651 / 34311800 / +0.6% 0.72 / 0.73 / -1.9%
tpch_q07/duckdb:parquet 80026432 / 79903715 / +0.2% 102457677 / 100660327 / +1.8% 0.78 / 0.79 / -1.6%
tpch_q08/duckdb:parquet 96462307 / 96633328 / -0.2% 123775222 / 120420371 / +2.8% 0.78 / 0.80 / -2.9%
tpch_q09/duckdb:parquet 148484293 / 148188044 / +0.2% 198562019 / 170082835 / +16.7% 🔴 0.75 / 0.87 / -14.2%
tpch_q10/duckdb:parquet 141869673 / 141944406 / -0.1% 166126099 / 165150664 / +0.6% 0.85 / 0.86 / -0.6%
tpch_q11/duckdb:parquet 25457138 / 25387661 / +0.3% 35226656 / 34694982 / +1.5% 0.72 / 0.73 / -1.2%
tpch_q12/duckdb:parquet 53780098 / 53424798 / +0.7% 68733441 / 81817407 / -16.0% 🟢 0.78 / 0.65 / +19.8%
tpch_q13/duckdb:parquet 284122858 / 289318925 / -1.8% 305695480 / 306170311 / -0.2% 0.93 / 0.94 / -1.6%
tpch_q14/duckdb:parquet 55794034 / 56202049 / -0.7% 71971950 / 71053803 / +1.3% 0.78 / 0.79 / -2.0%
tpch_q15/duckdb:parquet 30887396 / 30796155 / +0.3% 44076700 / 44130656 / -0.1% 0.70 / 0.70 / +0.4%
tpch_q16/duckdb:parquet 67153499 / 67245544 / -0.1% 84668862 / 82641541 / +2.5% 0.79 / 0.81 / -2.5%
tpch_q17/duckdb:parquet 58621481 / 58438535 / +0.3% 78426079 / 75707547 / +3.6% 0.75 / 0.77 / -3.2%
tpch_q18/duckdb:parquet 128844617 / 127130407 / +1.3% 148524559 / 146008321 / +1.7% 0.87 / 0.87 / -0.4%
tpch_q19/duckdb:parquet 77520087 / 77826405 / -0.4% 99258121 / 95825150 / +3.6% 0.78 / 0.81 / -3.8%
tpch_q20/duckdb:parquet 77813312 / 77883937 / -0.1% 107433410 / 101506228 / +5.8% 0.72 / 0.77 / -5.6%
tpch_q21/duckdb:parquet 188404381 / 189697540 / -0.7% 244751112 / 208762407 / +17.2% 🔴 0.77 / 0.91 / -15.3%
tpch_q22/duckdb:parquet 64221922 / 65115506 / -1.4% 80197885 / 78514173 / +2.1% 0.80 / 0.83 / -3.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-1.1%, environment too noisy confidence)
Vortex (geomean): hot 0.985x ➖ · cold 1.015x ➖
Parquet (geomean): hot 0.988x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 424214436 / 467678756 / -9.3% 945850448 / 741521989 / +27.6% 🔴 0.45 / 0.63 / -28.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed 27467386 / 26114705 / +5.2% 92089695 / 93306712 / -1.3% 0.30 / 0.28 / +6.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 27073443 / 25542006 / +6.0% 94681725 / 90243195 / +4.9% 0.29 / 0.28 / +1.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed 51464306 / 51052922 / +0.8% 133515957 / 126247316 / +5.8% 0.39 / 0.40 / -4.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 39464730 / 40505058 / -2.6% 112544726 / 109442019 / +2.8% 0.35 / 0.37 / -5.3%
clickbench-sorted_q38/datafusion:vortex-file-compressed 50626348 / 50512429 / +0.2% 111852918 / 116591530 / -4.1% 0.45 / 0.43 / +4.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed 124478388 / 124368476 / +0.1% 202252794 / 205302470 / -1.5% 0.62 / 0.61 / +1.6%
clickbench-sorted_q40/datafusion:vortex-file-compressed 21122648 / 21016414 / +0.5% 80541920 / 81372958 / -1.0% 0.26 / 0.26 / +1.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 19029964 / 19706152 / -3.4% 78905552 / 86024526 / -8.3% 0.24 / 0.23 / +5.3%
clickbench-sorted_q42/datafusion:vortex-file-compressed 16147734 / 16622014 / -2.9% 72868482 / 65817676 / +10.7% 🔴 0.22 / 0.25 / -12.3%
datafusion / parquet / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 2488106444 / 2484410189 / +0.1% 2949953774 / 2920478026 / +1.0% 0.84 / 0.85 / -0.9%
clickbench-sorted_q24/datafusion:parquet 16752894 / 16135730 / +3.8% 115492529 / 112440375 / +2.7% 0.15 / 0.14 / +1.1%
clickbench-sorted_q26/datafusion:parquet 16717887 / 19030683 / -12.2% 🟢 117921799 / 116414214 / +1.3% 0.14 / 0.16 / -13.3%
clickbench-sorted_q36/datafusion:parquet 148589913 / 152986974 / -2.9% 284955745 / 262612147 / +8.5% 0.52 / 0.58 / -10.5%
clickbench-sorted_q37/datafusion:parquet 97793614 / 100635787 / -2.8% 203611767 / 212236102 / -4.1% 0.48 / 0.47 / +1.3%
clickbench-sorted_q38/datafusion:parquet 143652992 / 143932576 / -0.2% 262174859 / 272664546 / -3.8% 0.55 / 0.53 / +3.8%
clickbench-sorted_q39/datafusion:parquet 274602504 / 269281453 / +2.0% 415991921 / 412018122 / +1.0% 0.66 / 0.65 / +1.0%
clickbench-sorted_q40/datafusion:parquet 60592694 / 60331409 / +0.4% 180178062 / 176459137 / +2.1% 0.34 / 0.34 / -1.6%
clickbench-sorted_q41/datafusion:parquet 59375935 / 58759367 / +1.0% 172210762 / 165514030 / +4.0% 0.34 / 0.36 / -2.9%
clickbench-sorted_q42/datafusion:parquet 33718652 / 33906830 / -0.6% 132934531 / 138258312 / -3.9% 0.25 / 0.25 / +3.4%
duckdb / vortex-file-compressed / ns (0.977x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 123081885 / 114595988 / +7.4% 208185033 / 188466976 / +10.5% 🔴 0.59 / 0.61 / -2.8%
clickbench-sorted_q24/duckdb:vortex-file-compressed 30583168 / 32212908 / -5.1% 75929042 / 77353508 / -1.8% 0.40 / 0.42 / -3.3%
clickbench-sorted_q26/duckdb:vortex-file-compressed 26667677 / 30392941 / -12.3% 🟢 83813760 / 68543943 / +22.3% 🔴 0.32 / 0.44 / -28.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 74840201 / 76470166 / -2.1% 183953854 / 181754160 / +1.2% 0.41 / 0.42 / -3.3%
clickbench-sorted_q37/duckdb:vortex-file-compressed 59011586 / 62564160 / -5.7% 146664924 / 166980698 / -12.2% 🟢 0.40 / 0.37 / +7.4%
clickbench-sorted_q38/duckdb:vortex-file-compressed 79300483 / 76825911 / +3.2% 180815469 / 172131899 / +5.0% 0.44 / 0.45 / -1.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed 169681376 / 168811586 / +0.5% 253708215 / 273770561 / -7.3% 0.67 / 0.62 / +8.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed 34892122 / 34527913 / +1.1% 115522985 / 114826846 / +0.6% 0.30 / 0.30 / +0.4%
clickbench-sorted_q41/duckdb:vortex-file-compressed 32878608 / 33311966 / -1.3% 118414872 / 129601084 / -8.6% 0.28 / 0.26 / +8.0%
clickbench-sorted_q42/duckdb:vortex-file-compressed 28199582 / 30427110 / -7.3% 102856672 / 110204101 / -6.7% 0.27 / 0.28 / -0.7%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 219707252 / 219791160 / -0.0% 267813263 / 259993374 / +3.0% 0.82 / 0.85 / -3.0%
clickbench-sorted_q24/duckdb:parquet 33452777 / 33602167 / -0.4% 56669933 / 61939098 / -8.5% 0.59 / 0.54 / +8.8%
clickbench-sorted_q26/duckdb:parquet 25746866 / 23769008 / +8.3% 47824299 / 58251043 / -17.9% 🟢 0.54 / 0.41 / +31.9%
clickbench-sorted_q36/duckdb:parquet 69474335 / 70459390 / -1.4% 100955011 / 99992611 / +1.0% 0.69 / 0.70 / -2.3%
clickbench-sorted_q37/duckdb:parquet 54991672 / 58631342 / -6.2% 92737959 / 94375540 / -1.7% 0.59 / 0.62 / -4.6%
clickbench-sorted_q38/duckdb:parquet 64320410 / 59988148 / +7.2% 94080166 / 92481814 / +1.7% 0.68 / 0.65 / +5.4%
clickbench-sorted_q39/duckdb:parquet 111027543 / 110878795 / +0.1% 158706451 / 156840716 / +1.2% 0.70 / 0.71 / -1.0%
clickbench-sorted_q40/duckdb:parquet 29480467 / 30861916 / -4.5% 69890095 / 71794566 / -2.7% 0.42 / 0.43 / -1.9%
clickbench-sorted_q41/duckdb:parquet 28728929 / 31482616 / -8.7% 61552785 / 64560120 / -4.7% 0.47 / 0.49 / -4.3%
clickbench-sorted_q42/duckdb:parquet 21006862 / 22213516 / -5.4% 44069673 / 44944760 / -1.9% 0.48 / 0.49 / -3.6%

File Size Changes (100 files changed, -0.0% overall, 48↑ 52↓)
File Scale Format Base HEAD Change %
hits_090.vortex 1.0 vortex-file-compressed 191.32 MB 193.71 MB +2.40 MB +1.3%
hits_060.vortex 1.0 vortex-file-compressed 191.97 MB 193.50 MB +1.53 MB +0.8%
hits_056.vortex 1.0 vortex-file-compressed 134.45 MB 135.52 MB +1.07 MB +0.8%
hits_011.vortex 1.0 vortex-file-compressed 197.53 MB 198.77 MB +1.24 MB +0.6%
hits_055.vortex 1.0 vortex-file-compressed 198.00 MB 199.03 MB +1.03 MB +0.5%
hits_028.vortex 1.0 vortex-file-compressed 150.91 MB 151.70 MB +800.11 KB +0.5%
hits_045.vortex 1.0 vortex-file-compressed 138.67 MB 139.35 MB +688.55 KB +0.5%
hits_014.vortex 1.0 vortex-file-compressed 171.36 MB 172.06 MB +715.47 KB +0.4%
hits_000.vortex 1.0 vortex-file-compressed 130.57 MB 131.07 MB +506.79 KB +0.4%
hits_072.vortex 1.0 vortex-file-compressed 101.63 MB 102.00 MB +376.99 KB +0.4%
hits_094.vortex 1.0 vortex-file-compressed 157.28 MB 157.83 MB +571.39 KB +0.4%
hits_081.vortex 1.0 vortex-file-compressed 199.23 MB 199.91 MB +699.44 KB +0.3%
hits_040.vortex 1.0 vortex-file-compressed 142.16 MB 142.59 MB +438.76 KB +0.3%
hits_058.vortex 1.0 vortex-file-compressed 154.21 MB 154.64 MB +445.16 KB +0.3%
hits_047.vortex 1.0 vortex-file-compressed 153.53 MB 153.89 MB +369.30 KB +0.2%
hits_095.vortex 1.0 vortex-file-compressed 153.37 MB 153.66 MB +291.32 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 158.88 MB 159.16 MB +289.66 KB +0.2%
hits_019.vortex 1.0 vortex-file-compressed 139.50 MB 139.74 MB +247.38 KB +0.2%
hits_027.vortex 1.0 vortex-file-compressed 188.75 MB 189.06 MB +319.61 KB +0.2%
hits_046.vortex 1.0 vortex-file-compressed 100.46 MB 100.62 MB +161.59 KB +0.2%
hits_022.vortex 1.0 vortex-file-compressed 198.26 MB 198.57 MB +316.27 KB +0.2%
hits_075.vortex 1.0 vortex-file-compressed 188.20 MB 188.43 MB +233.48 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.40 MB 153.59 MB +187.54 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 199.35 MB 199.57 MB +231.40 KB +0.1%
hits_066.vortex 1.0 vortex-file-compressed 162.91 MB 163.07 MB +163.82 KB +0.1%
hits_001.vortex 1.0 vortex-file-compressed 187.89 MB 188.07 MB +186.82 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.14 MB 168.29 MB +155.54 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 190.23 MB 190.38 MB +153.62 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.57 MB 130.66 MB +95.33 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 159.46 MB 159.56 MB +92.94 KB +0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.21 MB 130.28 MB +74.11 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 145.77 MB 145.84 MB +75.32 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.22 MB 179.30 MB +78.43 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.15 MB 126.19 MB +37.69 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.07 MB 159.11 MB +46.38 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 159.98 MB 160.02 MB +42.16 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 166.76 MB 166.79 MB +33.52 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 130.98 MB 131.01 MB +24.05 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 170.42 MB 170.45 MB +30.61 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.30 MB 160.33 MB +28.70 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 189.94 MB 189.97 MB +32.09 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.43 MB 176.46 MB +26.87 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.61 MB 153.63 MB +21.27 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 198.19 MB 198.21 MB +22.02 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.78 MB 130.79 MB +10.16 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.23 MB 191.24 MB +12.31 KB +0.0%
hits_068.vortex 1.0 vortex-file-compressed 159.55 MB 159.55 MB +3.12 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.15 MB 199.15 MB +760 B +0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.24 MB 130.24 MB 2.30 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 188.92 MB 188.91 MB 18.46 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.67 MB 125.66 MB 16.14 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 198.87 MB 198.85 MB 27.12 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 159.99 MB 159.97 MB 22.41 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.56 MB 130.54 MB 21.35 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 199.03 MB 198.99 MB 38.76 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.71 MB 135.67 MB 37.26 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 198.68 MB 198.63 MB 56.09 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 160.10 MB 160.06 MB 49.87 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.97 MB 159.92 MB 53.82 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 129.97 MB 129.93 MB 44.30 KB -0.0%
hits_096.vortex 1.0 vortex-file-compressed 198.92 MB 198.86 MB 70.46 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.22 MB 160.16 MB 57.23 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 160.09 MB 160.03 MB 59.94 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 158.81 MB 158.75 MB 64.43 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 198.84 MB 198.75 MB 94.49 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.16 MB 146.09 MB 72.18 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.88 MB 125.82 MB 62.34 KB -0.0%
hits_051.vortex 1.0 vortex-file-compressed 171.84 MB 171.75 MB 90.64 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.76 MB 100.70 MB 54.16 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 198.10 MB 197.99 MB 116.45 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.01 MB 171.90 MB 106.94 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.22 MB 171.12 MB 109.12 KB -0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.72 MB 199.58 MB 142.81 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.20 MB 156.09 MB 113.37 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 170.74 MB 170.59 MB 151.12 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.87 MB 153.72 MB 154.14 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.83 MB 130.69 MB 142.16 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.28 MB 102.17 MB 116.04 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 141.73 MB 141.57 MB 161.82 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.18 MB 130.04 MB 150.02 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 180.84 MB 180.64 MB 210.77 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 171.74 MB 171.53 MB 213.31 KB -0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.50 MB 194.21 MB 291.97 KB -0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.29 MB 198.96 MB 332.27 KB -0.2%
hits_044.vortex 1.0 vortex-file-compressed 199.70 MB 199.35 MB 358.73 KB -0.2%
hits_071.vortex 1.0 vortex-file-compressed 139.55 MB 139.30 MB 265.02 KB -0.2%
hits_077.vortex 1.0 vortex-file-compressed 172.13 MB 171.78 MB 361.21 KB -0.2%
hits_089.vortex 1.0 vortex-file-compressed 130.76 MB 130.47 MB 296.05 KB -0.2%
hits_079.vortex 1.0 vortex-file-compressed 180.41 MB 179.98 MB 437.57 KB -0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.72 MB 130.40 MB 332.26 KB -0.2%
hits_098.vortex 1.0 vortex-file-compressed 137.19 MB 136.82 MB 376.24 KB -0.3%
hits_008.vortex 1.0 vortex-file-compressed 139.18 MB 138.80 MB 383.38 KB -0.3%
hits_042.vortex 1.0 vortex-file-compressed 201.07 MB 200.36 MB 720.02 KB -0.3%
hits_082.vortex 1.0 vortex-file-compressed 139.24 MB 138.60 MB 649.28 KB -0.5%
hits_062.vortex 1.0 vortex-file-compressed 170.64 MB 169.80 MB 851.53 KB -0.5%
hits_054.vortex 1.0 vortex-file-compressed 146.90 MB 146.06 MB 860.02 KB -0.6%
hits_076.vortex 1.0 vortex-file-compressed 159.98 MB 158.55 MB 1.43 MB -0.9%
hits_064.vortex 1.0 vortex-file-compressed 191.78 MB 190.03 MB 1.74 MB -0.9%
hits_038.vortex 1.0 vortex-file-compressed 193.14 MB 191.19 MB 1.95 MB -1.0%
hits_097.vortex 1.0 vortex-file-compressed 193.91 MB 191.81 MB 2.10 MB -1.1%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.88 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 29773212 / 29370167 / +1.4% 81377150 / 85894493 / -5.3% 0.37 / 0.34 / +7.0%
tpcds_q02/datafusion:vortex-file-compressed 51236344 / 51534202 / -0.6% 106456672 / 105530942 / +0.9% 0.48 / 0.49 / -1.4%
tpcds_q03/datafusion:vortex-file-compressed 15274878 / 14627382 / +4.4% 60346461 / 61710194 / -2.2% 0.25 / 0.24 / +6.8%
tpcds_q04/datafusion:vortex-file-compressed 198730072 / 196678482 / +1.0% 272010460 / 265875501 / +2.3% 0.73 / 0.74 / -1.2%
tpcds_q05/datafusion:vortex-file-compressed 61743919 / 62439390 / -1.1% 126419285 / 126601976 / -0.1% 0.49 / 0.49 / -1.0%
tpcds_q06/datafusion:vortex-file-compressed 26976172 / 26785541 / +0.7% 84941601 / 78710439 / +7.9% 0.32 / 0.34 / -6.7%
tpcds_q07/datafusion:vortex-file-compressed 40860342 / 42086070 / -2.9% 109741057 / 107322655 / +2.3% 0.37 / 0.39 / -5.1%
tpcds_q08/datafusion:vortex-file-compressed 30560216 / 30784654 / -0.7% 82634865 / 83561817 / -1.1% 0.37 / 0.37 / +0.4%
tpcds_q09/datafusion:vortex-file-compressed 25135334 / 25474144 / -1.3% 68312189 / 69448795 / -1.6% 0.37 / 0.37 / +0.3%
tpcds_q10/datafusion:vortex-file-compressed 38316663 / 38694294 / -1.0% 94892411 / 92384919 / +2.7% 0.40 / 0.42 / -3.6%
tpcds_q11/datafusion:vortex-file-compressed 103771592 / 106845484 / -2.9% 179771785 / 174347221 / +3.1% 0.58 / 0.61 / -5.8%
tpcds_q12/datafusion:vortex-file-compressed 19370822 / 20101386 / -3.6% 68034118 / 60250045 / +12.9% 🔴 0.28 / 0.33 / -14.7%
tpcds_q13/datafusion:vortex-file-compressed 42284032 / 43043414 / -1.8% 96886233 / 99994441 / -3.1% 0.44 / 0.43 / +1.4%
tpcds_q14/datafusion:vortex-file-compressed 140918286 / 140909347 / +0.0% 212450666 / 204069542 / +4.1% 0.66 / 0.69 / -3.9%
tpcds_q15/datafusion:vortex-file-compressed 29322830 / 29565086 / -0.8% 82988774 / 83638461 / -0.8% 0.35 / 0.35 / -0.0%
tpcds_q16/datafusion:vortex-file-compressed 25453195 / 26077880 / -2.4% 78005638 / 73526351 / +6.1% 0.33 / 0.35 / -8.0%
tpcds_q17/datafusion:vortex-file-compressed 68638133 / 68915092 / -0.4% 140912081 / 141156638 / -0.2% 0.49 / 0.49 / -0.2%
tpcds_q18/datafusion:vortex-file-compressed 82117773 / 82930719 / -1.0% 153414200 / 151273495 / +1.4% 0.54 / 0.55 / -2.4%
tpcds_q19/datafusion:vortex-file-compressed 23840037 / 25686991 / -7.2% 76549709 / 77333321 / -1.0% 0.31 / 0.33 / -6.2%
tpcds_q20/datafusion:vortex-file-compressed 24859006 / 24821765 / +0.2% 71778649 / 69972729 / +2.6% 0.35 / 0.35 / -2.4%
tpcds_q21/datafusion:vortex-file-compressed 28429503 / 29704992 / -4.3% 86545246 / 82821057 / +4.5% 0.33 / 0.36 / -8.4%
tpcds_q22/datafusion:vortex-file-compressed 105966086 / 113428809 / -6.6% 191968474 / 190371366 / +0.8% 0.55 / 0.60 / -7.4%
tpcds_q23/datafusion:vortex-file-compressed 126688742 / 127377926 / -0.5% 202286437 / 200655415 / +0.8% 0.63 / 0.63 / -1.3%
tpcds_q24/datafusion:vortex-file-compressed 83336502 / 83284326 / +0.1% 149699255 / 149775651 / -0.1% 0.56 / 0.56 / +0.1%
tpcds_q25/datafusion:vortex-file-compressed 65083130 / 65176936 / -0.1% 139733100 / 139199365 / +0.4% 0.47 / 0.47 / -0.5%
tpcds_q26/datafusion:vortex-file-compressed 36016158 / 37726489 / -4.5% 93525399 / 96092416 / -2.7% 0.39 / 0.39 / -1.9%
tpcds_q27/datafusion:vortex-file-compressed 87934082 / 92624822 / -5.1% 175372477 / 165725853 / +5.8% 0.50 / 0.56 / -10.3%
tpcds_q28/datafusion:vortex-file-compressed 23046730 / 23168318 / -0.5% 72356923 / 69241255 / +4.5% 0.32 / 0.33 / -4.8%
tpcds_q29/datafusion:vortex-file-compressed 66812278 / 67871855 / -1.6% 134608436 / 131888334 / +2.1% 0.50 / 0.51 / -3.6%
tpcds_q30/datafusion:vortex-file-compressed 33090616 / 34140960 / -3.1% 79679494 / 81574167 / -2.3% 0.42 / 0.42 / -0.8%
tpcds_q31/datafusion:vortex-file-compressed 73381596 / 74483945 / -1.5% 144635741 / 144564340 / +0.0% 0.51 / 0.52 / -1.5%
tpcds_q32/datafusion:vortex-file-compressed 18737250 / 18664496 / +0.4% 62178720 / 61306324 / +1.4% 0.30 / 0.30 / -1.0%
tpcds_q33/datafusion:vortex-file-compressed 33237183 / 33418764 / -0.5% 89977455 / 88732397 / +1.4% 0.37 / 0.38 / -1.9%
tpcds_q34/datafusion:vortex-file-compressed 25337610 / 25059228 / +1.1% 74945809 / 78757862 / -4.8% 0.34 / 0.32 / +6.3%
tpcds_q35/datafusion:vortex-file-compressed 49078126 / 48076480 / +2.1% 103501488 / 102314033 / +1.2% 0.47 / 0.47 / +0.9%
tpcds_q36/datafusion:vortex-file-compressed 59684757 / 60677633 / -1.6% 130814683 / 128284623 / +2.0% 0.46 / 0.47 / -3.5%
tpcds_q37/datafusion:vortex-file-compressed 16749396 / 17251940 / -2.9% 63092522 / 61524951 / +2.5% 0.27 / 0.28 / -5.3%
tpcds_q38/datafusion:vortex-file-compressed 38702102 / 38258048 / +1.2% 94927716 / 95597685 / -0.7% 0.41 / 0.40 / +1.9%
tpcds_q39/datafusion:vortex-file-compressed 95086264 / 94607844 / +0.5% 157234828 / 156874185 / +0.2% 0.60 / 0.60 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 31313094 / 31280423 / +0.1% 92001869 / 93215443 / -1.3% 0.34 / 0.34 / +1.4%
tpcds_q41/datafusion:vortex-file-compressed 17525522 / 18516890 / -5.4% 57024729 / 56793654 / +0.4% 0.31 / 0.33 / -5.7%
tpcds_q42/datafusion:vortex-file-compressed 13962405 / 14478924 / -3.6% 57665285 / 55101661 / +4.7% 0.24 / 0.26 / -7.9%
tpcds_q43/datafusion:vortex-file-compressed 17881932 / 17081369 / +4.7% 65964143 / 65862079 / +0.2% 0.27 / 0.26 / +4.5%
tpcds_q44/datafusion:vortex-file-compressed 31718878 / 33161154 / -4.3% 88986789 / 87404213 / +1.8% 0.36 / 0.38 / -6.1%
tpcds_q45/datafusion:vortex-file-compressed 32742213 / 33026616 / -0.9% 84333740 / 88636498 / -4.9% 0.39 / 0.37 / +4.2%
tpcds_q46/datafusion:vortex-file-compressed 31674177 / 32943056 / -3.9% 97274634 / 96067768 / +1.3% 0.33 / 0.34 / -5.0%
tpcds_q47/datafusion:vortex-file-compressed 120517752 / 119493068 / +0.9% 192857295 / 193569222 / -0.4% 0.62 / 0.62 / +1.2%
tpcds_q48/datafusion:vortex-file-compressed 33277243 / 32931602 / +1.0% 84922228 / 85450662 / -0.6% 0.39 / 0.39 / +1.7%
tpcds_q49/datafusion:vortex-file-compressed 63061472 / 62887393 / +0.3% 122324640 / 130809400 / -6.5% 0.52 / 0.48 / +7.2%
tpcds_q50/datafusion:vortex-file-compressed 42314154 / 43832482 / -3.5% 102366382 / 98532082 / +3.9% 0.41 / 0.44 / -7.1%
tpcds_q51/datafusion:vortex-file-compressed 72756206 / 71390467 / +1.9% 133189695 / 137908981 / -3.4% 0.55 / 0.52 / +5.5%
tpcds_q52/datafusion:vortex-file-compressed 14234600 / 13690074 / +4.0% 57980351 / 58903245 / -1.6% 0.25 / 0.23 / +5.6%
tpcds_q53/datafusion:vortex-file-compressed 22220676 / 22025287 / +0.9% 73136938 / 70634280 / +3.5% 0.30 / 0.31 / -2.6%
tpcds_q54/datafusion:vortex-file-compressed 36657920 / 37503544 / -2.3% 93263766 / 93251761 / +0.0% 0.39 / 0.40 / -2.3%
tpcds_q55/datafusion:vortex-file-compressed 14085108 / 13599014 / +3.6% 55033626 / 55374257 / -0.6% 0.26 / 0.25 / +4.2%
tpcds_q56/datafusion:vortex-file-compressed 33243796 / 31854256 / +4.4% 93358129 / 88409144 / +5.6% 0.36 / 0.36 / -1.2%
tpcds_q57/datafusion:vortex-file-compressed 96015272 / 94195168 / +1.9% 157455994 / 161223533 / -2.3% 0.61 / 0.58 / +4.4%
tpcds_q58/datafusion:vortex-file-compressed 54789971 / 53705264 / +2.0% 120720790 / 121370052 / -0.5% 0.45 / 0.44 / +2.6%
tpcds_q59/datafusion:vortex-file-compressed 52193884 / 51883001 / +0.6% 104158545 / 108730559 / -4.2% 0.50 / 0.48 / +5.0%
tpcds_q60/datafusion:vortex-file-compressed 32116387 / 32402428 / -0.9% 89972140 / 90704626 / -0.8% 0.36 / 0.36 / -0.1%
tpcds_q61/datafusion:vortex-file-compressed 37729369 / 38265650 / -1.4% 97661413 / 102400577 / -4.6% 0.39 / 0.37 / +3.4%
tpcds_q62/datafusion:vortex-file-compressed 23110507 / 23154411 / -0.2% 72302482 / 73748824 / -2.0% 0.32 / 0.31 / +1.8%
tpcds_q63/datafusion:vortex-file-compressed 22041670 / 22035607 / +0.0% 74156357 / 72316581 / +2.5% 0.30 / 0.30 / -2.5%
tpcds_q64/datafusion:vortex-file-compressed 367181902 / 375413126 / -2.2% 485882046 / 497118486 / -2.3% 0.76 / 0.76 / +0.1%
tpcds_q65/datafusion:vortex-file-compressed 66276902 / 66048048 / +0.3% 128444041 / 127473681 / +0.8% 0.52 / 0.52 / -0.4%
tpcds_q66/datafusion:vortex-file-compressed 71683857 / 71525501 / +0.2% 134558451 / 135883540 / -1.0% 0.53 / 0.53 / +1.2%
tpcds_q67/datafusion:vortex-file-compressed 113056104 / 112587570 / +0.4% 195407226 / 194192641 / +0.6% 0.58 / 0.58 / -0.2%
tpcds_q68/datafusion:vortex-file-compressed 30350396 / 30468846 / -0.4% 96294362 / 100208618 / -3.9% 0.32 / 0.30 / +3.7%
tpcds_q69/datafusion:vortex-file-compressed 38473349 / 37777524 / +1.8% 91891336 / 90290796 / +1.8% 0.42 / 0.42 / +0.1%
tpcds_q70/datafusion:vortex-file-compressed 110196390 / 110869664 / -0.6% 173594510 / 172110818 / +0.9% 0.63 / 0.64 / -1.5%
tpcds_q71/datafusion:vortex-file-compressed 25087908 / 24819520 / +1.1% 76123801 / 75783558 / +0.4% 0.33 / 0.33 / +0.6%
tpcds_q72/datafusion:vortex-file-compressed 1430620877 / 1427901776 / +0.2% 1572997946 / 1530910439 / +2.7% 0.91 / 0.93 / -2.5%
tpcds_q73/datafusion:vortex-file-compressed 23574875 / 23910110 / -1.4% 76665822 / 75918704 / +1.0% 0.31 / 0.31 / -2.4%
tpcds_q74/datafusion:vortex-file-compressed 67661307 / 69261073 / -2.3% 133844760 / 133595261 / +0.2% 0.51 / 0.52 / -2.5%
tpcds_q75/datafusion:vortex-file-compressed 132101690 / 133131648 / -0.8% 216363809 / 221255057 / -2.2% 0.61 / 0.60 / +1.5%
tpcds_q76/datafusion:vortex-file-compressed 40646778 / 41334086 / -1.7% 98755785 / 95675712 / +3.2% 0.41 / 0.43 / -4.7%
tpcds_q77/datafusion:vortex-file-compressed 42121627 / 42561838 / -1.0% 106509178 / 102911562 / +3.5% 0.40 / 0.41 / -4.4%
tpcds_q78/datafusion:vortex-file-compressed 105376218 / 107055424 / -1.6% 186390387 / 178934042 / +4.2% 0.57 / 0.60 / -5.5%
tpcds_q79/datafusion:vortex-file-compressed 26963297 / 27600470 / -2.3% 82647453 / 85735411 / -3.6% 0.33 / 0.32 / +1.3%
tpcds_q80/datafusion:vortex-file-compressed 96297414 / 98934242 / -2.7% 194570676 / 189348326 / +2.8% 0.49 / 0.52 / -5.3%
tpcds_q81/datafusion:vortex-file-compressed 36347786 / 37722886 / -3.6% 83264384 / 79804444 / +4.3% 0.44 / 0.47 / -7.6%
tpcds_q82/datafusion:vortex-file-compressed 18016022 / 19248732 / -6.4% 62588592 / 66326336 / -5.6% 0.29 / 0.29 / -0.8%
tpcds_q83/datafusion:vortex-file-compressed 45736435 / 46724536 / -2.1% 97480793 / 99254095 / -1.8% 0.47 / 0.47 / -0.3%
tpcds_q84/datafusion:vortex-file-compressed 16065554 / 16046895 / +0.1% 55223527 / 55871171 / -1.2% 0.29 / 0.29 / +1.3%
tpcds_q85/datafusion:vortex-file-compressed 64349634 / 64154300 / +0.3% 135731757 / 131447926 / +3.3% 0.47 / 0.49 / -2.9%
tpcds_q86/datafusion:vortex-file-compressed 19115610 / 19634462 / -2.6% 63602391 / 63869852 / -0.4% 0.30 / 0.31 / -2.2%
tpcds_q87/datafusion:vortex-file-compressed 38956894 / 38646302 / +0.8% 92577627 / 96550838 / -4.1% 0.42 / 0.40 / +5.1%
tpcds_q88/datafusion:vortex-file-compressed 50089346 / 51067246 / -1.9% 114806247 / 108440537 / +5.9% 0.44 / 0.47 / -7.4%
tpcds_q89/datafusion:vortex-file-compressed 25651846 / 25102144 / +2.2% 77831684 / 72294982 / +7.7% 0.33 / 0.35 / -5.1%
tpcds_q90/datafusion:vortex-file-compressed 15014838 / 14093473 / +6.5% 56096051 / 53615451 / +4.6% 0.27 / 0.26 / +1.8%
tpcds_q91/datafusion:vortex-file-compressed 22979906 / 22640210 / +1.5% 69221186 / 71024394 / -2.5% 0.33 / 0.32 / +4.1%
tpcds_q92/datafusion:vortex-file-compressed 17114664 / 17963622 / -4.7% 63839740 / 62066907 / +2.9% 0.27 / 0.29 / -7.4%
tpcds_q93/datafusion:vortex-file-compressed 31045536 / 30657279 / +1.3% 83680753 / 85049439 / -1.6% 0.37 / 0.36 / +2.9%
tpcds_q94/datafusion:vortex-file-compressed 24329514 / 23367680 / +4.1% 69782635 / 67525593 / +3.3% 0.35 / 0.35 / +0.7%
tpcds_q95/datafusion:vortex-file-compressed 52436932 / 51830799 / +1.2% 113426759 / 113707399 / -0.2% 0.46 / 0.46 / +1.4%
tpcds_q96/datafusion:vortex-file-compressed 11850242 / 11785238 / +0.6% 53686899 / 52108429 / +3.0% 0.22 / 0.23 / -2.4%
tpcds_q97/datafusion:vortex-file-compressed 27964102 / 27109558 / +3.2% 83403487 / 83994703 / -0.7% 0.34 / 0.32 / +3.9%
tpcds_q98/datafusion:vortex-file-compressed 22151338 / 22075926 / +0.3% 77555047 / 77387014 / +0.2% 0.29 / 0.29 / +0.1%
tpcds_q99/datafusion:vortex-file-compressed 29189850 / 28041318 / +4.1% 80109122 / 79695671 / +0.5% 0.36 / 0.35 / +3.6%
datafusion / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 34499176 / 34827934 / -0.9% 79428644 / 79839211 / -0.5% 0.43 / 0.44 / -0.4%
tpcds_q02/datafusion:parquet 52170136 / 52727579 / -1.1% 99138879 / 99013759 / +0.1% 0.53 / 0.53 / -1.2%
tpcds_q03/datafusion:parquet 22180276 / 22496944 / -1.4% 61234280 / 64652142 / -5.3% 0.36 / 0.35 / +4.1%
tpcds_q04/datafusion:parquet 291635410 / 284796058 / +2.4% 348825316 / 341241437 / +2.2% 0.84 / 0.83 / +0.2%
tpcds_q05/datafusion:parquet 71189091 / 72776192 / -2.2% 135953994 / 138360342 / -1.7% 0.52 / 0.53 / -0.4%
tpcds_q06/datafusion:parquet 36877508 / 38976432 / -5.4% 82310337 / 84177475 / -2.2% 0.45 / 0.46 / -3.2%
tpcds_q07/datafusion:parquet 59207832 / 56490272 / +4.8% 115334496 / 117431961 / -1.8% 0.51 / 0.48 / +6.7%
tpcds_q08/datafusion:parquet 43423904 / 41858645 / +3.7% 94394860 / 94435544 / -0.0% 0.46 / 0.44 / +3.8%
tpcds_q09/datafusion:parquet 32246970 / 33423554 / -3.5% 87543882 / 82324356 / +6.3% 0.37 / 0.41 / -9.3%
tpcds_q10/datafusion:parquet 54380004 / 55185810 / -1.5% 100966674 / 100848592 / +0.1% 0.54 / 0.55 / -1.6%
tpcds_q11/datafusion:parquet 138968752 / 137334190 / +1.2% 195950175 / 201838821 / -2.9% 0.71 / 0.68 / +4.2%
tpcds_q12/datafusion:parquet 30353952 / 30124199 / +0.8% 72980945 / 63888607 / +14.2% 🔴 0.42 / 0.47 / -11.8%
tpcds_q13/datafusion:parquet 60557002 / 59509784 / +1.8% 116915729 / 115585488 / +1.2% 0.52 / 0.51 / +0.6%
tpcds_q14/datafusion:parquet 173065544 / 174235964 / -0.7% 237248192 / 240550623 / -1.4% 0.73 / 0.72 / +0.7%
tpcds_q15/datafusion:parquet 30952756 / 30872286 / +0.3% 81154310 / 79220605 / +2.4% 0.38 / 0.39 / -2.1%
tpcds_q16/datafusion:parquet 36017101 / 36252250 / -0.6% 84055021 / 85387982 / -1.6% 0.43 / 0.42 / +0.9%
tpcds_q17/datafusion:parquet 77394083 / 79429361 / -2.6% 156666389 / 156902222 / -0.2% 0.49 / 0.51 / -2.4%
tpcds_q18/datafusion:parquet 65630312 / 62372684 / +5.2% 125175016 / 125246071 / -0.1% 0.52 / 0.50 / +5.3%
tpcds_q19/datafusion:parquet 38424038 / 38925930 / -1.3% 89700668 / 84498219 / +6.2% 0.43 / 0.46 / -7.0%
tpcds_q20/datafusion:parquet 33813866 / 32836452 / +3.0% 74294005 / 71432111 / +4.0% 0.46 / 0.46 / -1.0%
tpcds_q21/datafusion:parquet 24331459 / 24611976 / -1.1% 66098032 / 67910138 / -2.7% 0.37 / 0.36 / +1.6%
tpcds_q22/datafusion:parquet 127282028 / 122340391 / +4.0% 218849374 / 189013080 / +15.8% 🔴 0.58 / 0.65 / -10.1%
tpcds_q23/datafusion:parquet 159961180 / 163561523 / -2.2% 234710326 / 236872923 / -0.9% 0.68 / 0.69 / -1.3%
tpcds_q24/datafusion:parquet 104390152 / 103720565 / +0.6% 176193641 / 172655345 / +2.0% 0.59 / 0.60 / -1.4%
tpcds_q25/datafusion:parquet 81321478 / 80824704 / +0.6% 160473072 / 155764703 / +3.0% 0.51 / 0.52 / -2.3%
tpcds_q26/datafusion:parquet 46395690 / 48159930 / -3.7% 94281382 / 97342022 / -3.1% 0.49 / 0.49 / -0.5%
tpcds_q27/datafusion:parquet 109877314 / 108814934 / +1.0% 202767311 / 192249358 / +5.5% 0.54 / 0.57 / -4.3%
tpcds_q28/datafusion:parquet 35640470 / 36453966 / -2.2% 90289394 / 87596745 / +3.1% 0.39 / 0.42 / -5.1%
tpcds_q29/datafusion:parquet 80180754 / 80647444 / -0.6% 161402776 / 158348312 / +1.9% 0.50 / 0.51 / -2.5%
tpcds_q30/datafusion:parquet 54243372 / 57229170 / -5.2% 107213948 / 102562988 / +4.5% 0.51 / 0.56 / -9.3%
tpcds_q31/datafusion:parquet 92087734 / 91506961 / +0.6% 150893845 / 148816385 / +1.4% 0.61 / 0.61 / -0.8%
tpcds_q32/datafusion:parquet 26792295 / 27389173 / -2.2% 66303543 / 69316621 / -4.3% 0.40 / 0.40 / +2.3%
tpcds_q33/datafusion:parquet 43863980 / 43492230 / +0.9% 94619754 / 96361805 / -1.8% 0.46 / 0.45 / +2.7%
tpcds_q34/datafusion:parquet 31305692 / 31072060 / +0.8% 70240526 / 71237588 / -1.4% 0.45 / 0.44 / +2.2%
tpcds_q35/datafusion:parquet 71761252 / 68865002 / +4.2% 121715668 / 122376999 / -0.5% 0.59 / 0.56 / +4.8%
tpcds_q36/datafusion:parquet 67265936 / 67211500 / +0.1% 141527220 / 141867689 / -0.2% 0.48 / 0.47 / +0.3%
tpcds_q37/datafusion:parquet 25871166 / 25352220 / +2.0% 68493826 / 70282424 / -2.5% 0.38 / 0.36 / +4.7%
tpcds_q38/datafusion:parquet 51081136 / 52320987 / -2.4% 108250754 / 107257078 / +0.9% 0.47 / 0.49 / -3.3%
tpcds_q39/datafusion:parquet 83731044 / 83749694 / -0.0% 142065708 / 141252530 / +0.6% 0.59 / 0.59 / -0.6%
tpcds_q40/datafusion:parquet 31952850 / 33064590 / -3.4% 86399475 / 88018548 / -1.8% 0.37 / 0.38 / -1.6%
tpcds_q41/datafusion:parquet 22739558 / 22029865 / +3.2% 62758740 / 60463941 / +3.8% 0.36 / 0.36 / -0.6%
tpcds_q42/datafusion:parquet 21200800 / 20676392 / +2.5% 60232442 / 58266860 / +3.4% 0.35 / 0.35 / -0.8%
tpcds_q43/datafusion:parquet 24767407 / 24894026 / -0.5% 64685891 / 64784312 / -0.2% 0.38 / 0.38 / -0.4%
tpcds_q44/datafusion:parquet 39478439 / 39887478 / -1.0% 95426750 / 92686625 / +3.0% 0.41 / 0.43 / -3.9%
tpcds_q45/datafusion:parquet 39335880 / 39060504 / +0.7% 96579990 / 90017056 / +7.3% 0.41 / 0.43 / -6.1%
tpcds_q46/datafusion:parquet 40747106 / 39345243 / +3.6% 95520881 / 97270631 / -1.8% 0.43 / 0.40 / +5.5%
tpcds_q47/datafusion:parquet 140307386 / 139963023 / +0.2% 213098978 / 213748355 / -0.3% 0.66 / 0.65 / +0.6%
tpcds_q48/datafusion:parquet 50897494 / 51964874 / -2.1% 107455816 / 101947897 / +5.4% 0.47 / 0.51 / -7.1%
tpcds_q49/datafusion:parquet 78270284 / 77536277 / +0.9% 145181655 / 150499620 / -3.5% 0.54 / 0.52 / +4.6%
tpcds_q50/datafusion:parquet 55649886 / 57094794 / -2.5% 117749182 / 114782846 / +2.6% 0.47 / 0.50 / -5.0%
tpcds_q51/datafusion:parquet 81011716 / 82357187 / -1.6% 139749020 / 140500454 / -0.5% 0.58 / 0.59 / -1.1%
tpcds_q52/datafusion:parquet 20527248 / 20800951 / -1.3% 60529998 / 60928142 / -0.7% 0.34 / 0.34 / -0.7%
tpcds_q53/datafusion:parquet 26359306 / 25428768 / +3.7% 74671064 / 72390535 / +3.2% 0.35 / 0.35 / +0.5%
tpcds_q54/datafusion:parquet 53370456 / 53022660 / +0.7% 101320733 / 99653624 / +1.7% 0.53 / 0.53 / -1.0%
tpcds_q55/datafusion:parquet 20185888 / 20499419 / -1.5% 58541251 / 61508478 / -4.8% 0.34 / 0.33 / +3.5%
tpcds_q56/datafusion:parquet 44463747 / 44218329 / +0.6% 102060856 / 97540734 / +4.6% 0.44 / 0.45 / -3.9%
tpcds_q57/datafusion:parquet 119353070 / 122790355 / -2.8% 201079388 / 180456408 / +11.4% 🔴 0.59 / 0.68 / -12.8%
tpcds_q58/datafusion:parquet 73712644 / 74345113 / -0.9% 129500666 / 132215986 / -2.1% 0.57 / 0.56 / +1.2%
tpcds_q59/datafusion:parquet 70904042 / 71708848 / -1.1% 125540427 / 118558828 / +5.9% 0.56 / 0.60 / -6.6%
tpcds_q60/datafusion:parquet 45629898 / 44085234 / +3.5% 98408451 / 99494324 / -1.1% 0.46 / 0.44 / +4.6%
tpcds_q61/datafusion:parquet 50654131 / 50682728 / -0.1% 110831786 / 106710372 / +3.9% 0.46 / 0.47 / -3.8%
tpcds_q62/datafusion:parquet 27685259 / 31477884 / -12.0% 🟢 76079050 / 77513970 / -1.9% 0.36 / 0.41 / -10.4%
tpcds_q63/datafusion:parquet 25413536 / 26647600 / -4.6% 74475550 / 74376648 / +0.1% 0.34 / 0.36 / -4.8%
tpcds_q64/datafusion:parquet 281332854 / 277613408 / +1.3% 370833177 / 363136082 / +2.1% 0.76 / 0.76 / -0.8%
tpcds_q65/datafusion:parquet 43210454 / 45939072 / -5.9% 95862815 / 96038143 / -0.2% 0.45 / 0.48 / -5.8%
tpcds_q66/datafusion:parquet 80888806 / 79767465 / +1.4% 136469395 / 135735450 / +0.5% 0.59 / 0.59 / +0.9%
tpcds_q67/datafusion:parquet 138939650 / 138451484 / +0.4% 198808775 / 195368712 / +1.8% 0.70 / 0.71 / -1.4%
tpcds_q68/datafusion:parquet 38059266 / 37696492 / +1.0% 97963199 / 95734523 / +2.3% 0.39 / 0.39 / -1.3%
tpcds_q69/datafusion:parquet 57270058 / 56776966 / +0.9% 104676312 / 99145550 / +5.6% 0.55 / 0.57 / -4.5%
tpcds_q70/datafusion:parquet 46807816 / 46644190 / +0.4% 94093069 / 91379935 / +3.0% 0.50 / 0.51 / -2.5%
tpcds_q71/datafusion:parquet 33690160 / 34449831 / -2.2% 85819687 / 83750509 / +2.5% 0.39 / 0.41 / -4.6%
tpcds_q72/datafusion:parquet 390347907 / 394918985 / -1.2% 511003210 / 506616749 / +0.9% 0.76 / 0.78 / -2.0%
tpcds_q73/datafusion:parquet 30579726 / 30018822 / +1.9% 73855663 / 73406157 / +0.6% 0.41 / 0.41 / +1.2%
tpcds_q74/datafusion:parquet 92537175 / 90828032 / +1.9% 146268106 / 151376056 / -3.4% 0.63 / 0.60 / +5.4%
tpcds_q75/datafusion:parquet 147615352 / 146244344 / +0.9% 232738967 / 234640833 / -0.8% 0.63 / 0.62 / +1.8%
tpcds_q76/datafusion:parquet 46461597 / 47982366 / -3.2% 105449110 / 109976948 / -4.1% 0.44 / 0.44 / +1.0%
tpcds_q77/datafusion:parquet 58734568 / 59574856 / -1.4% 116953466 / 116024616 / +0.8% 0.50 / 0.51 / -2.2%
tpcds_q78/datafusion:parquet 118770638 / 119315828 / -0.5% 208086559 / 207708725 / +0.2% 0.57 / 0.57 / -0.6%
tpcds_q79/datafusion:parquet 35464295 / 35122824 / +1.0% 86089131 / 87050247 / -1.1% 0.41 / 0.40 / +2.1%
tpcds_q80/datafusion:parquet 96059340 / 96825346 / -0.8% 194151902 / 189117733 / +2.7% 0.49 / 0.51 / -3.4%
tpcds_q81/datafusion:parquet 52121672 / 50021420 / +4.2% 95535595 / 97259873 / -1.8% 0.55 / 0.51 / +6.1%
tpcds_q82/datafusion:parquet 27379420 / 27437472 / -0.2% 69791971 / 74950121 / -6.9% 0.39 / 0.37 / +7.2%
tpcds_q83/datafusion:parquet 61139045 / 62194828 / -1.7% 108181505 / 108775696 / -0.5% 0.57 / 0.57 / -1.2%
tpcds_q84/datafusion:parquet 33978912 / 33762224 / +0.6% 70155255 / 74516066 / -5.9% 0.48 / 0.45 / +6.9%
tpcds_q85/datafusion:parquet 89955660 / 91238798 / -1.4% 155177227 / 153554313 / +1.1% 0.58 / 0.59 / -2.4%
tpcds_q86/datafusion:parquet 25110718 / 24642786 / +1.9% 69010685 / 60020463 / +15.0% 🔴 0.36 / 0.41 / -11.4%
tpcds_q87/datafusion:parquet 50398596 / 52307212 / -3.6% 106318145 / 99111309 / +7.3% 0.47 / 0.53 / -10.2%
tpcds_q88/datafusion:parquet 57334697 / 56726734 / +1.1% 114659398 / 122138301 / -6.1% 0.50 / 0.46 / +7.7%
tpcds_q89/datafusion:parquet 29811614 / 30048421 / -0.8% 81071782 / 81741690 / -0.8% 0.37 / 0.37 / +0.0%
tpcds_q90/datafusion:parquet 20473520 / 20996982 / -2.5% 57491729 / 56632790 / +1.5% 0.36 / 0.37 / -3.9%
tpcds_q91/datafusion:parquet 43233799 / 43824696 / -1.3% 84147384 / 85512733 / -1.6% 0.51 / 0.51 / +0.3%
tpcds_q92/datafusion:parquet 26204092 / 26869266 / -2.5% 64480803 / 69740733 / -7.5% 0.41 / 0.39 / +5.5%
tpcds_q93/datafusion:parquet 33996128 / 33940792 / +0.2% 92367241 / 87793363 / +5.2% 0.37 / 0.39 / -4.8%
tpcds_q94/datafusion:parquet 34691322 / 36824386 / -5.8% 74167041 / 73535383 / +0.9% 0.47 / 0.50 / -6.6%
tpcds_q95/datafusion:parquet 61554194 / 61085185 / +0.8% 118742062 / 117531597 / +1.0% 0.52 / 0.52 / -0.3%
tpcds_q96/datafusion:parquet 18299818 / 19158402 / -4.5% 53450153 / 51367728 / +4.1% 0.34 / 0.37 / -8.2%
tpcds_q97/datafusion:parquet 40934563 / 40224044 / +1.8% 88885287 / 93500991 / -4.9% 0.46 / 0.43 / +7.1%
tpcds_q98/datafusion:parquet 31394836 / 31160964 / +0.8% 81768763 / 74092829 / +10.4% 🔴 0.38 / 0.42 / -8.7%
tpcds_q99/datafusion:parquet 34131356 / 34464383 / -1.0% 76419471 / 78722135 / -2.9% 0.45 / 0.44 / +2.0%
duckdb / vortex-file-compressed / ns (1.001x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 23933366 / 25158152 / -4.9% 42945435 / 45197689 / -5.0% 0.56 / 0.56 / +0.1%
tpcds_q02/duckdb:vortex-file-compressed 27753249 / 28955742 / -4.2% 47843146 / 49164412 / -2.7% 0.58 / 0.59 / -1.5%
tpcds_q03/duckdb:vortex-file-compressed 20942992 / 19393190 / +8.0% 43119334 / 43156999 / -0.1% 0.49 / 0.45 / +8.1%
tpcds_q04/duckdb:vortex-file-compressed 91580314 / 89947575 / +1.8% 124836366 / 123926464 / +0.7% 0.73 / 0.73 / +1.1%
tpcds_q05/duckdb:vortex-file-compressed 35656713 / 32845817 / +8.6% 58138963 / 54050370 / +7.6% 0.61 / 0.61 / +0.9%
tpcds_q06/duckdb:vortex-file-compressed 44422426 / 45089014 / -1.5% 70303550 / 72815185 / -3.4% 0.63 / 0.62 / +2.0%
tpcds_q07/duckdb:vortex-file-compressed 32090765 / 29669518 / +8.2% 59488278 / 58275621 / +2.1% 0.54 / 0.51 / +6.0%
tpcds_q08/duckdb:vortex-file-compressed 35359036 / 35632924 / -0.8% 60758833 / 60285013 / +0.8% 0.58 / 0.59 / -1.5%
tpcds_q09/duckdb:vortex-file-compressed 17264057 / 17182084 / +0.5% 54647461 / 52183428 / +4.7% 0.32 / 0.33 / -4.1%
tpcds_q10/duckdb:vortex-file-compressed 51055332 / 50450387 / +1.2% 87618318 / 85122040 / +2.9% 0.58 / 0.59 / -1.7%
tpcds_q11/duckdb:vortex-file-compressed 75011908 / 72881614 / +2.9% 105355436 / 99650124 / +5.7% 0.71 / 0.73 / -2.7%
tpcds_q12/duckdb:vortex-file-compressed 16491406 / 17454452 / -5.5% 32767071 / 33278896 / -1.5% 0.50 / 0.52 / -4.0%
tpcds_q13/duckdb:vortex-file-compressed 38279998 / 37268432 / +2.7% 67591497 / 69379999 / -2.6% 0.57 / 0.54 / +5.4%
tpcds_q14/duckdb:vortex-file-compressed 104517465 / 108022982 / -3.2% 144196411 / 137888799 / +4.6% 0.72 / 0.78 / -7.5%
tpcds_q15/duckdb:vortex-file-compressed 34105748 / 31857626 / +7.1% 49489716 / 55611987 / -11.0% 🟢 0.69 / 0.57 / +20.3%
tpcds_q16/duckdb:vortex-file-compressed 29809034 / 31649157 / -5.8% 54857611 / 50745129 / +8.1% 0.54 / 0.62 / -12.9%
tpcds_q17/duckdb:vortex-file-compressed 51127574 / 49378503 / +3.5% 84931242 / 82753045 / +2.6% 0.60 / 0.60 / +0.9%
tpcds_q18/duckdb:vortex-file-compressed 47799395 / 47766223 / +0.1% 75052140 / 73255789 / +2.5% 0.64 / 0.65 / -2.3%
tpcds_q19/duckdb:vortex-file-compressed 38721899 / 39230590 / -1.3% 69087595 / 71248402 / -3.0% 0.56 / 0.55 / +1.8%
tpcds_q20/duckdb:vortex-file-compressed 15882070 / 17772333 / -10.6% 🟢 36983634 / 34996630 / +5.7% 0.43 / 0.51 / -15.4%
tpcds_q21/duckdb:vortex-file-compressed 23297590 / 19744458 / +18.0% 🔴 54907847 / 58302286 / -5.8% 0.42 / 0.34 / +25.3%
tpcds_q22/duckdb:vortex-file-compressed 66061982 / 65969750 / +0.1% 90838587 / 93942525 / -3.3% 0.73 / 0.70 / +3.6%
tpcds_q23/duckdb:vortex-file-compressed 71504788 / 70452090 / +1.5% 110952986 / 112270519 / -1.2% 0.64 / 0.63 / +2.7%
tpcds_q24/duckdb:vortex-file-compressed 48845822 / 50272358 / -2.8% 80360838 / 80247866 / +0.1% 0.61 / 0.63 / -3.0%
tpcds_q25/duckdb:vortex-file-compressed 45219050 / 40796599 / +10.8% 🔴 79732388 / 71774391 / +11.1% 🔴 0.57 / 0.57 / -0.2%
tpcds_q26/duckdb:vortex-file-compressed 22835482 / 22942195 / -0.5% 45289061 / 40864679 / +10.8% 🔴 0.50 / 0.56 / -10.2%
tpcds_q27/duckdb:vortex-file-compressed 30841158 / 31814392 / -3.1% 66154019 / 63947012 / +3.5% 0.47 / 0.50 / -6.3%
tpcds_q28/duckdb:vortex-file-compressed 12147983 / 11952496 / +1.6% 31568413 / 27526531 / +14.7% 🔴 0.38 / 0.43 / -11.4%
tpcds_q29/duckdb:vortex-file-compressed 50305482 / 48944056 / +2.8% 85435493 / 83726683 / +2.0% 0.59 / 0.58 / +0.7%
tpcds_q30/duckdb:vortex-file-compressed 33590853 / 31008642 / +8.3% 59239411 / 51315066 / +15.4% 🔴 0.57 / 0.60 / -6.2%
tpcds_q31/duckdb:vortex-file-compressed 33342885 / 31402522 / +6.2% 60594395 / 57744400 / +4.9% 0.55 / 0.54 / +1.2%
tpcds_q32/duckdb:vortex-file-compressed 18950588 / 17353201 / +9.2% 34022849 / 38898271 / -12.5% 🟢 0.56 / 0.45 / +24.9%
tpcds_q33/duckdb:vortex-file-compressed 29195504 / 30078375 / -2.9% 62209584 / 66978039 / -7.1% 0.47 / 0.45 / +4.5%
tpcds_q34/duckdb:vortex-file-compressed 24874252 / 24019464 / +3.6% 45106993 / 47105803 / -4.2% 0.55 / 0.51 / +8.1%
tpcds_q35/duckdb:vortex-file-compressed 76645938 / 78028457 / -1.8% 105213080 / 113661749 / -7.4% 0.73 / 0.69 / +6.1%
tpcds_q36/duckdb:vortex-file-compressed 30180713 / 27145532 / +11.2% 🔴 60317573 / 60720440 / -0.7% 0.50 / 0.45 / +11.9%
tpcds_q37/duckdb:vortex-file-compressed 26020272 / 26571912 / -2.1% 52648344 / 51549483 / +2.1% 0.49 / 0.52 / -4.1%
tpcds_q38/duckdb:vortex-file-compressed 38767096 / 38762427 / +0.0% 65138575 / 58875355 / +10.6% 🔴 0.60 / 0.66 / -9.6%
tpcds_q39/duckdb:vortex-file-compressed 34593936 / 33942796 / +1.9% 71310626 / 69658052 / +2.4% 0.49 / 0.49 / -0.4%
tpcds_q40/duckdb:vortex-file-compressed 21878312 / 23725712 / -7.8% 37518646 / 39941205 / -6.1% 0.58 / 0.59 / -1.8%
tpcds_q41/duckdb:vortex-file-compressed 10638437 / 9343246 / +13.9% 🔴 20784833 / 20323103 / +2.3% 0.51 / 0.46 / +11.3%
tpcds_q42/duckdb:vortex-file-compressed 17157904 / 15630584 / +9.8% 43348316 / 38807438 / +11.7% 🔴 0.40 / 0.40 / -1.7%
tpcds_q43/duckdb:vortex-file-compressed 21701076 / 20292714 / +6.9% 39650921 / 40521728 / -2.1% 0.55 / 0.50 / +9.3%
tpcds_q44/duckdb:vortex-file-compressed 24062363 / 24927322 / -3.5% 66617725 / 61686375 / +8.0% 0.36 / 0.40 / -10.6%
tpcds_q45/duckdb:vortex-file-compressed 35766904 / 35161230 / +1.7% 50529452 / 50384477 / +0.3% 0.71 / 0.70 / +1.4%
tpcds_q46/duckdb:vortex-file-compressed 33954787 / 31082599 / +9.2% 61860021 / 63398167 / -2.4% 0.55 / 0.49 / +12.0%
tpcds_q47/duckdb:vortex-file-compressed 56217622 / 54885950 / +2.4% 82062350 / 83157012 / -1.3% 0.69 / 0.66 / +3.8%
tpcds_q48/duckdb:vortex-file-compressed 34121352 / 35656614 / -4.3% 66480990 / 64853637 / +2.5% 0.51 / 0.55 / -6.6%
tpcds_q49/duckdb:vortex-file-compressed 32587033 / 32481594 / +0.3% 71429070 / 69518670 / +2.7% 0.46 / 0.47 / -2.4%
tpcds_q50/duckdb:vortex-file-compressed 30979514 / 30078170 / +3.0% 59864301 / 58699474 / +2.0% 0.52 / 0.51 / +1.0%
tpcds_q51/duckdb:vortex-file-compressed 97372728 / 131386918 / -25.9% 🟢 122088884 / 119526101 / +2.1% 0.80 / 1.10 / -27.4%
tpcds_q52/duckdb:vortex-file-compressed 16202588 / 17259844 / -6.1% 41049574 / 39087687 / +5.0% 0.39 / 0.44 / -10.6%
tpcds_q53/duckdb:vortex-file-compressed 22434890 / 23846248 / -5.9% 51041181 / 48278597 / +5.7% 0.44 / 0.49 / -11.0%
tpcds_q54/duckdb:vortex-file-compressed 36434464 / 35750346 / +1.9% 63042012 / 60568893 / +4.1% 0.58 / 0.59 / -2.1%
tpcds_q55/duckdb:vortex-file-compressed 15798463 / 16226638 / -2.6% 40472966 / 38687170 / +4.6% 0.39 / 0.42 / -6.9%
tpcds_q56/duckdb:vortex-file-compressed 29359700 / 32414003 / -9.4% 63526302 / 63506785 / +0.0% 0.46 / 0.51 / -9.5%
tpcds_q57/duckdb:vortex-file-compressed 38655908 / 41727520 / -7.4% 64218715 / 57860903 / +11.0% 🔴 0.60 / 0.72 / -16.5%
tpcds_q58/duckdb:vortex-file-compressed 31410650 / 33730744 / -6.9% 57289309 / 58402595 / -1.9% 0.55 / 0.58 / -5.1%
tpcds_q59/duckdb:vortex-file-compressed 37790446 / 38135728 / -0.9% 62748401 / 54129592 / +15.9% 🔴 0.60 / 0.70 / -14.5%
tpcds_q60/duckdb:vortex-file-compressed 30033442 / 30335018 / -1.0% 62222473 / 58114940 / +7.1% 0.48 / 0.52 / -7.5%
tpcds_q61/duckdb:vortex-file-compressed 36563802 / 35540378 / +2.9% 74516723 / 71674038 / +4.0% 0.49 / 0.50 / -1.0%
tpcds_q62/duckdb:vortex-file-compressed 18324342 / 20157984 / -9.1% 34671486 / 37145212 / -6.7% 0.53 / 0.54 / -2.6%
tpcds_q63/duckdb:vortex-file-compressed 23600016 / 23045535 / +2.4% 50434559 / 48715054 / +3.5% 0.47 / 0.47 / -1.1%
tpcds_q64/duckdb:vortex-file-compressed 108517160 / 105909402 / +2.5% 149212581 / 144406942 / +3.3% 0.73 / 0.73 / -0.8%
tpcds_q65/duckdb:vortex-file-compressed 24778863 / 23770695 / +4.2% 46971465 / 46964055 / +0.0% 0.53 / 0.51 / +4.2%
tpcds_q66/duckdb:vortex-file-compressed 39662384 / 38128700 / +4.0% 70345012 / 62793348 / +12.0% 🔴 0.56 / 0.61 / -7.1%
tpcds_q67/duckdb:vortex-file-compressed 125518604 / 128492909 / -2.3% 157226174 / 179522576 / -12.4% 🟢 0.80 / 0.72 / +11.5%
tpcds_q68/duckdb:vortex-file-compressed 30869220 / 29730788 / +3.8% 63046861 / 64164816 / -1.7% 0.49 / 0.46 / +5.7%
tpcds_q69/duckdb:vortex-file-compressed 54267940 / 51933214 / +4.5% 90188657 / 84994301 / +6.1% 0.60 / 0.61 / -1.5%
tpcds_q70/duckdb:vortex-file-compressed 37082036 / 35774266 / +3.7% 63318141 / 69332441 / -8.7% 0.59 / 0.52 / +13.5%
tpcds_q71/duckdb:vortex-file-compressed 25505666 / 24072477 / +6.0% 58161214 / 55478153 / +4.8% 0.44 / 0.43 / +1.1%
tpcds_q72/duckdb:vortex-file-compressed 147235344 / 142514814 / +3.3% 195838666 / 192698942 / +1.6% 0.75 / 0.74 / +1.7%
tpcds_q73/duckdb:vortex-file-compressed 24350699 / 23648604 / +3.0% 44666907 / 46038746 / -3.0% 0.55 / 0.51 / +6.1%
tpcds_q74/duckdb:vortex-file-compressed 49595606 / 47997838 / +3.3% 78031859 / 73913662 / +5.6% 0.64 / 0.65 / -2.1%
tpcds_q75/duckdb:vortex-file-compressed 51587603 / 52456811 / -1.7% 91651993 / 90148972 / +1.7% 0.56 / 0.58 / -3.3%
tpcds_q76/duckdb:vortex-file-compressed 23799378 / 24530193 / -3.0% 56757292 / 59557126 / -4.7% 0.42 / 0.41 / +1.8%
tpcds_q77/duckdb:vortex-file-compressed 27707284 / 28595550 / -3.1% 53800089 / 57931403 / -7.1% 0.52 / 0.49 / +4.3%
tpcds_q78/duckdb:vortex-file-compressed 73419060 / 74145906 / -1.0% 96943669 / 96302848 / +0.7% 0.76 / 0.77 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 25167586 / 27558751 / -8.7% 59326932 / 56066272 / +5.8% 0.42 / 0.49 / -13.7%
tpcds_q80/duckdb:vortex-file-compressed 49921726 / 49785496 / +0.3% 86772299 / 86959252 / -0.2% 0.58 / 0.57 / +0.5%
tpcds_q81/duckdb:vortex-file-compressed 40520504 / 36960796 / +9.6% 58553302 / 60067264 / -2.5% 0.69 / 0.62 / +12.5%
tpcds_q82/duckdb:vortex-file-compressed 51994712 / 52109428 / -0.2% 78372031 / 75234293 / +4.2% 0.66 / 0.69 / -4.2%
tpcds_q83/duckdb:vortex-file-compressed 31307340 / 33549132 / -6.7% 44780022 / 45762657 / -2.1% 0.70 / 0.73 / -4.6%
tpcds_q84/duckdb:vortex-file-compressed 24586638 / 23843752 / +3.1% 39578497 / 42257024 / -6.3% 0.62 / 0.56 / +10.1%
tpcds_q85/duckdb:vortex-file-compressed 49513774 / 51568230 / -4.0% 72889318 / 70283986 / +3.7% 0.68 / 0.73 / -7.4%
tpcds_q86/duckdb:vortex-file-compressed 18283045 / 20484744 / -10.7% 🟢 39701101 / 39732582 / -0.1% 0.46 / 0.52 / -10.7%
tpcds_q87/duckdb:vortex-file-compressed 42040242 / 41044956 / +2.4% 61889398 / 59114485 / +4.7% 0.68 / 0.69 / -2.2%
tpcds_q88/duckdb:vortex-file-compressed 61009650 / 59807412 / +2.0% 123709105 / 119534712 / +3.5% 0.49 / 0.50 / -1.4%
tpcds_q89/duckdb:vortex-file-compressed 23431905 / 24860626 / -5.7% 59159576 / 51405401 / +15.1% 🔴 0.40 / 0.48 / -18.1%
tpcds_q90/duckdb:vortex-file-compressed 15397697 / 14548740 / +5.8% 30020632 / 34258686 / -12.4% 🟢 0.51 / 0.42 / +20.8%
tpcds_q91/duckdb:vortex-file-compressed 26893780 / 29197920 / -7.9% 42288785 / 44402210 / -4.8% 0.64 / 0.66 / -3.3%
tpcds_q92/duckdb:vortex-file-compressed 22921878 / 21682972 / +5.7% 43073822 / 43044240 / +0.1% 0.53 / 0.50 / +5.6%
tpcds_q93/duckdb:vortex-file-compressed 27566265 / 29904454 / -7.8% 55483254 / 51397391 / +7.9% 0.50 / 0.58 / -14.6%
tpcds_q94/duckdb:vortex-file-compressed 27997126 / 29188769 / -4.1% 56060498 / 46853651 / +19.7% 🔴 0.50 / 0.62 / -19.8%
tpcds_q95/duckdb:vortex-file-compressed 147440200 / 143435402 / +2.8% 160828620 / 166133647 / -3.2% 0.92 / 0.86 / +6.2%
tpcds_q96/duckdb:vortex-file-compressed 16361469 / 17857588 / -8.4% 33652921 / 39563608 / -14.9% 🟢 0.49 / 0.45 / +7.7%
tpcds_q97/duckdb:vortex-file-compressed 38616000 / 40604334 / -4.9% 67550171 / 60962526 / +10.8% 🔴 0.57 / 0.67 / -14.2%
tpcds_q98/duckdb:vortex-file-compressed 22772114 / 23055450 / -1.2% 49707067 / 50663590 / -1.9% 0.46 / 0.46 / +0.7%
tpcds_q99/duckdb:vortex-file-compressed 25144022 / 24322634 / +3.4% 39528955 / 39345116 / +0.5% 0.64 / 0.62 / +2.9%
duckdb / parquet / ns (1.000x ➖, 5↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 32485345 / 31635283 / +2.7% 48071544 / 45946660 / +4.6% 0.68 / 0.69 / -1.9%
tpcds_q02/duckdb:parquet 25052430 / 26435720 / -5.2% 38278034 / 31211419 / +22.6% 🔴 0.65 / 0.85 / -22.7%
tpcds_q03/duckdb:parquet 12306450 / 14709195 / -16.3% 🟢 23018962 / 23728090 / -3.0% 0.53 / 0.62 / -13.8%
tpcds_q04/duckdb:parquet 196669528 / 190581458 / +3.2% 205968066 / 203294353 / +1.3% 0.95 / 0.94 / +1.9%
tpcds_q05/duckdb:parquet 32848932 / 32456682 / +1.2% 48604294 / 45432642 / +7.0% 0.68 / 0.71 / -5.4%
tpcds_q06/duckdb:parquet 35615927 / 38092226 / -6.5% 55919653 / 56102292 / -0.3% 0.64 / 0.68 / -6.2%
tpcds_q07/duckdb:parquet 21308534 / 21507928 / -0.9% 36064102 / 34660817 / +4.0% 0.59 / 0.62 / -4.8%
tpcds_q08/duckdb:parquet 33230126 / 33690170 / -1.4% 47812828 / 45147627 / +5.9% 0.70 / 0.75 / -6.9%
tpcds_q09/duckdb:parquet 30307488 / 30896894 / -1.9% 41940894 / 37597225 / +11.6% 🔴 0.72 / 0.82 / -12.1%
tpcds_q10/duckdb:parquet 42158779 / 40441592 / +4.2% 59644187 / 60460343 / -1.3% 0.71 / 0.67 / +5.7%
tpcds_q11/duckdb:parquet 103713653 / 99419173 / +4.3% 118485146 / 123680175 / -4.2% 0.88 / 0.80 / +8.9%
tpcds_q12/duckdb:parquet 17642768 / 17870136 / -1.3% 28018425 / 26954935 / +3.9% 0.63 / 0.66 / -5.0%
tpcds_q13/duckdb:parquet 40257416 / 34815892 / +15.6% 🔴 54731593 / 50353310 / +8.7% 0.74 / 0.69 / +6.4%
tpcds_q14/duckdb:parquet 104774495 / 105588370 / -0.8% 122919068 / 119703270 / +2.7% 0.85 / 0.88 / -3.4%
tpcds_q15/duckdb:parquet 35618592 / 36067648 / -1.2% 49761955 / 48047106 / +3.6% 0.72 / 0.75 / -4.6%
tpcds_q16/duckdb:parquet 27665047 / 27547164 / +0.4% 43071242 / 42663046 / +1.0% 0.64 / 0.65 / -0.5%
tpcds_q17/duckdb:parquet 44597448 / 45082729 / -1.1% 57798300 / 58289984 / -0.8% 0.77 / 0.77 / -0.2%
tpcds_q18/duckdb:parquet 57013442 / 57688770 / -1.2% 79289716 / 78298764 / +1.3% 0.72 / 0.74 / -2.4%
tpcds_q19/duckdb:parquet 33502012 / 33816886 / -0.9% 45818734 / 45968757 / -0.3% 0.73 / 0.74 / -0.6%
tpcds_q20/duckdb:parquet 19297864 / 19554414 / -1.3% 29892847 / 29709657 / +0.6% 0.65 / 0.66 / -1.9%
tpcds_q21/duckdb:parquet 14091089 / 14231014 / -1.0% 23661902 / 27916618 / -15.2% 🟢 0.60 / 0.51 / +16.8%
tpcds_q22/duckdb:parquet 56896992 / 65880929 / -13.6% 🟢 58530688 / 80498695 / -27.3% 🟢 0.97 / 0.82 / +18.8%
tpcds_q23/duckdb:parquet 67675108 / 68309606 / -0.9% 81326440 / 85300918 / -4.7% 0.83 / 0.80 / +3.9%
tpcds_q24/duckdb:parquet 49979208 / 50720938 / -1.5% 73018604 / 73752452 / -1.0% 0.68 / 0.69 / -0.5%
tpcds_q25/duckdb:parquet 42064602 / 42568485 / -1.2% 60283170 / 57593913 / +4.7% 0.70 / 0.74 / -5.6%
tpcds_q26/duckdb:parquet 43694348 / 45064194 / -3.0% 58474342 / 56938959 / +2.7% 0.75 / 0.79 / -5.6%
tpcds_q27/duckdb:parquet 51426442 / 52602172 / -2.2% 73194341 / 72512219 / +0.9% 0.70 / 0.73 / -3.1%
tpcds_q28/duckdb:parquet 28363435 / 29333621 / -3.3% 41408062 / 38721008 / +6.9% 0.68 / 0.76 / -9.6%
tpcds_q29/duckdb:parquet 43030822 / 42397808 / +1.5% 56755710 / 56250491 / +0.9% 0.76 / 0.75 / +0.6%
tpcds_q30/duckdb:parquet 43679550 / 44384072 / -1.6% 59159602 / 62365205 / -5.1% 0.74 / 0.71 / +3.7%
tpcds_q31/duckdb:parquet 29897530 / 29770584 / +0.4% 42657205 / 39666122 / +7.5% 0.70 / 0.75 / -6.6%
tpcds_q32/duckdb:parquet 15233550 / 15428573 / -1.3% 27774856 / 25652893 / +8.3% 0.55 / 0.60 / -8.8%
tpcds_q33/duckdb:parquet 23446180 / 24242404 / -3.3% 40713250 / 39483500 / +3.1% 0.58 / 0.61 / -6.2%
tpcds_q34/duckdb:parquet 21699699 / 21935482 / -1.1% 34090850 / 34442670 / -1.0% 0.64 / 0.64 / -0.1%
tpcds_q35/duckdb:parquet 67283014 / 68649092 / -2.0% 89911248 / 86555733 / +3.9% 0.75 / 0.79 / -5.6%
tpcds_q36/duckdb:parquet 22509682 / 22215116 / +1.3% 39716088 / 45770296 / -13.2% 🟢 0.57 / 0.49 / +16.8%
tpcds_q37/duckdb:parquet 17895408 / 17397366 / +2.9% 29614619 / 30464012 / -2.8% 0.60 / 0.57 / +5.8%
tpcds_q38/duckdb:parquet 41003810 / 40242562 / +1.9% 49576360 / 51335705 / -3.4% 0.83 / 0.78 / +5.5%
tpcds_q39/duckdb:parquet 38241251 / 37502517 / +2.0% 50786354 / 49101033 / +3.4% 0.75 / 0.76 / -1.4%
tpcds_q40/duckdb:parquet 22815562 / 22854368 / -0.2% 31199864 / 31813581 / -1.9% 0.73 / 0.72 / +1.8%
tpcds_q41/duckdb:parquet 11008277 / 10599496 / +3.9% 22224036 / 20876968 / +6.5% 0.50 / 0.51 / -2.4%
tpcds_q42/duckdb:parquet 11787640 / 13023966 / -9.5% 23213620 / 23643261 / -1.8% 0.51 / 0.55 / -7.8%
tpcds_q43/duckdb:parquet 19400994 / 15139138 / +28.2% 🔴 29872186 / 26681081 / +12.0% 🔴 0.65 / 0.57 / +14.5%
tpcds_q44/duckdb:parquet 25332147 / 25105161 / +0.9% 39240847 / 39879530 / -1.6% 0.65 / 0.63 / +2.5%
tpcds_q45/duckdb:parquet 32715701 / 32155278 / +1.7% 43284157 / 43962453 / -1.5% 0.76 / 0.73 / +3.3%
tpcds_q46/duckdb:parquet 54120358 / 52469890 / +3.1% 70805808 / 64747690 / +9.4% 0.76 / 0.81 / -5.7%
tpcds_q47/duckdb:parquet 49105254 / 51633726 / -4.9% 65094604 / 63637024 / +2.3% 0.75 / 0.81 / -7.0%
tpcds_q48/duckdb:parquet 30136620 / 35842828 / -15.9% 🟢 43461761 / 44928483 / -3.3% 0.69 / 0.80 / -13.1%
tpcds_q49/duckdb:parquet 28090216 / 28925204 / -2.9% 44339455 / 43118747 / +2.8% 0.63 / 0.67 / -5.6%
tpcds_q50/duckdb:parquet 24795780 / 25189945 / -1.6% 43309111 / 38632513 / +12.1% 🔴 0.57 / 0.65 / -12.2%
tpcds_q51/duckdb:parquet 96482957 / 94917731 / +1.6% 113968392 / 115220231 / -1.1% 0.85 / 0.82 / +2.8%
tpcds_q52/duckdb:parquet 13666760 / 13643197 / +0.2% 23287424 / 24902813 / -6.5% 0.59 / 0.55 / +7.1%
tpcds_q53/duckdb:parquet 16228526 / 16773665 / -3.2% 29682163 / 29361607 / +1.1% 0.55 / 0.57 / -4.3%
tpcds_q54/duckdb:parquet 30326182 / 30263764 / +0.2% 51627360 / 48179502 / +7.2% 0.59 / 0.63 / -6.5%
tpcds_q55/duckdb:parquet 13413794 / 11752641 / +14.1% 🔴 23030462 / 22409950 / +2.8% 0.58 / 0.52 / +11.1%
tpcds_q56/duckdb:parquet 25001173 / 24736737 / +1.1% 39317637 / 41877121 / -6.1% 0.64 / 0.59 / +7.6%
tpcds_q57/duckdb:parquet 42579908 / 44107004 / -3.5% 55628536 / 55173099 / +0.8% 0.77 / 0.80 / -4.3%
tpcds_q58/duckdb:parquet 27405932 / 28275021 / -3.1% 40068681 / 39508717 / +1.4% 0.68 / 0.72 / -4.4%
tpcds_q59/duckdb:parquet 30256546 / 30226164 / +0.1% 42660938 / 41404492 / +3.0% 0.71 / 0.73 / -2.8%
tpcds_q60/duckdb:parquet 25901863 / 24383138 / +6.2% 40374180 / 44758782 / -9.8% 0.64 / 0.54 / +17.8%
tpcds_q61/duckdb:parquet 33947657 / 31580408 / +7.5% 48078266 / 47176980 / +1.9% 0.71 / 0.67 / +5.5%
tpcds_q62/duckdb:parquet 14854590 / 14608638 / +1.7% 23346498 / 23807032 / -1.9% 0.64 / 0.61 / +3.7%
tpcds_q63/duckdb:parquet 15441058 / 15315406 / +0.8% 30425380 / 27682812 / +9.9% 0.51 / 0.55 / -8.3%
tpcds_q64/duckdb:parquet 79606212 / 85552362 / -7.0% 101746503 / 103615050 / -1.8% 0.78 / 0.83 / -5.2%
tpcds_q65/duckdb:parquet 24948319 / 24499804 / +1.8% 39734322 / 35651252 / +11.5% 🔴 0.63 / 0.69 / -8.6%
tpcds_q66/duckdb:parquet 35319843 / 35265970 / +0.2% 48401517 / 48237397 / +0.3% 0.73 / 0.73 / -0.2%
tpcds_q67/duckdb:parquet 124491774 / 124901733 / -0.3% 155457839 / 155370305 / +0.1% 0.80 / 0.80 / -0.4%
tpcds_q68/duckdb:parquet 38955784 / 41837517 / -6.9% 65554926 / 64063415 / +2.3% 0.59 / 0.65 / -9.0%
tpcds_q69/duckdb:parquet 41568350 / 41868024 / -0.7% 58470071 / 59658062 / -2.0% 0.71 / 0.70 / +1.3%
tpcds_q70/duckdb:parquet 26128924 / 29770191 / -12.2% 🟢 48084840 / 44168430 / +8.9% 0.54 / 0.67 / -19.4%
tpcds_q71/duckdb:parquet 21507392 / 22212874 / -3.2% 34323944 / 35096010 / -2.2% 0.63 / 0.63 / -1.0%
tpcds_q72/duckdb:parquet 185431859 / 120992185 / +53.3% 🔴 202694614 / 135667681 / +49.4% 🔴 0.91 / 0.89 / +2.6%
tpcds_q73/duckdb:parquet 18629714 / 21230684 / -12.3% 🟢 32672975 / 33184839 / -1.5% 0.57 / 0.64 / -10.9%
tpcds_q74/duckdb:parquet 145904028 / 145897390 / +0.0% 152319007 / 159242709 / -4.3% 0.96 / 0.92 / +4.6%
tpcds_q75/duckdb:parquet 61540418 / 59965552 / +2.6% 79705103 / 81711237 / -2.5% 0.77 / 0.73 / +5.2%
tpcds_q76/duckdb:parquet 21561631 / 20043150 / +7.6% 34220842 / 32173557 / +6.4% 0.63 / 0.62 / +1.1%
tpcds_q77/duckdb:parquet 26383117 / 25376893 / +4.0% 38189274 / 38641276 / -1.2% 0.69 / 0.66 / +5.2%
tpcds_q78/duckdb:parquet 77366508 / 77482350 / -0.1% 94908029 / 91560860 / +3.7% 0.82 / 0.85 / -3.7%
tpcds_q79/duckdb:parquet 27779570 / 28154830 / -1.3% 46071235 / 43273253 / +6.5% 0.60 / 0.65 / -7.3%
tpcds_q80/duckdb:parquet 47633800 / 49249424 / -3.3% 64403635 / 62783106 / +2.6% 0.74 / 0.78 / -5.7%
tpcds_q81/duckdb:parquet 40510202 / 40631829 / -0.3% 61226809 / 57365751 / +6.7% 0.66 / 0.71 / -6.6%
tpcds_q82/duckdb:parquet 18557091 / 19464522 / -4.7% 32988613 / 32909609 / +0.2% 0.56 / 0.59 / -4.9%
tpcds_q83/duckdb:parquet 22500375 / 22975311 / -2.1% 33429325 / 32198552 / +3.8% 0.67 / 0.71 / -5.7%
tpcds_q84/duckdb:parquet 24027926 / 24083448 / -0.2% 35919858 / 33844473 / +6.1% 0.67 / 0.71 / -6.0%
tpcds_q85/duckdb:parquet 48047243 / 47585422 / +1.0% 65515979 / 66970616 / -2.2% 0.73 / 0.71 / +3.2%
tpcds_q86/duckdb:parquet 15202556 / 15150734 / +0.3% 26797551 / 24457010 / +9.6% 0.57 / 0.62 / -8.4%
tpcds_q87/duckdb:parquet 43804896 / 43542744 / +0.6% 56433542 / 54621410 / +3.3% 0.78 / 0.80 / -2.6%
tpcds_q88/duckdb:parquet 42904790 / 42575540 / +0.8% 51933908 / 56161479 / -7.5% 0.83 / 0.76 / +9.0%
tpcds_q89/duckdb:parquet 20709830 / 18978137 / +9.1% 35485500 / 33013663 / +7.5% 0.58 / 0.57 / +1.5%
tpcds_q90/duckdb:parquet 9984280 / 9867737 / +1.2% 21501411 / 21206669 / +1.4% 0.46 / 0.47 / -0.2%
tpcds_q91/duckdb:parquet 27707810 / 27986082 / -1.0% 43645340 / 43708782 / -0.1% 0.63 / 0.64 / -0.9%
tpcds_q92/duckdb:parquet 15842263 / 15721694 / +0.8% 26911695 / 31014826 / -13.2% 🟢 0.59 / 0.51 / +16.1%
tpcds_q93/duckdb:parquet 34098506 / 31268342 / +9.1% 47976091 / 48341525 / -0.8% 0.71 / 0.65 / +9.9%
tpcds_q94/duckdb:parquet 21893778 / 21914942 / -0.1% 34715534 / 34508839 / +0.6% 0.63 / 0.64 / -0.7%
tpcds_q95/duckdb:parquet 137211526 / 139115378 / -1.4% 157279186 / 149742687 / +5.0% 0.87 / 0.93 / -6.1%
tpcds_q96/duckdb:parquet 10086748 / 10255258 / -1.6% 17766372 / 17965877 / -1.1% 0.57 / 0.57 / -0.5%
tpcds_q97/duckdb:parquet 39175431 / 39042439 / +0.3% 51453969 / 51729768 / -0.5% 0.76 / 0.75 / +0.9%
tpcds_q98/duckdb:parquet 21747774 / 22522652 / -3.4% 36361612 / 36486855 / -0.3% 0.60 / 0.62 / -3.1%
tpcds_q99/duckdb:parquet 23787752 / 24024672 / -1.0% 32978573 / 34234890 / -3.7% 0.72 / 0.70 / +2.8%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-1.6%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.016x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 320369864 / 340563439 / -5.9% 463963330 / 463204140 / +0.2% 0.69 / 0.74 / -6.1%
tpch_q02/datafusion:vortex-file-compressed 94896528 / 96684878 / -1.8% 179157076 / 173637734 / +3.2% 0.53 / 0.56 / -4.9%
tpch_q03/datafusion:vortex-file-compressed 137754624 / 142094227 / -3.1% 293027043 / 291354551 / +0.6% 0.47 / 0.49 / -3.6%
tpch_q04/datafusion:vortex-file-compressed 56990732 / 57414190 / -0.7% 149392363 / 132053257 / +13.1% 🔴 0.38 / 0.43 / -12.3%
tpch_q05/datafusion:vortex-file-compressed 258554557 / 262128419 / -1.4% 470277322 / 456811399 / +2.9% 0.55 / 0.57 / -4.2%
tpch_q06/datafusion:vortex-file-compressed 22937138 / 23135987 / -0.9% 145225541 / 127947991 / +13.5% 🔴 0.16 / 0.18 / -12.7%
tpch_q07/datafusion:vortex-file-compressed 348808867 / 347874226 / +0.3% 506045279 / 503372019 / +0.5% 0.69 / 0.69 / -0.3%
tpch_q08/datafusion:vortex-file-compressed 270980833 / 267364601 / +1.4% 488388679 / 474645934 / +2.9% 0.55 / 0.56 / -1.5%
tpch_q09/datafusion:vortex-file-compressed 458085341 / 464780786 / -1.4% 703790457 / 637846206 / +10.3% 🔴 0.65 / 0.73 / -10.7%
tpch_q10/datafusion:vortex-file-compressed 160695414 / 160096953 / +0.4% 310686176 / 315780534 / -1.6% 0.52 / 0.51 / +2.0%
tpch_q11/datafusion:vortex-file-compressed 68186061 / 68420253 / -0.3% 135751301 / 135760816 / -0.0% 0.50 / 0.50 / -0.3%
tpch_q12/datafusion:vortex-file-compressed 81963304 / 78310035 / +4.7% 176943753 / 174042150 / +1.7% 0.46 / 0.45 / +2.9%
tpch_q13/datafusion:vortex-file-compressed 115205034 / 114956822 / +0.2% 188578673 / 193876687 / -2.7% 0.61 / 0.59 / +3.0%
tpch_q14/datafusion:vortex-file-compressed 36987761 / 38018019 / -2.7% 171750239 / 175229960 / -2.0% 0.22 / 0.22 / -0.7%
tpch_q15/datafusion:vortex-file-compressed 67342479 / 67518448 / -0.3% 193138635 / 192274710 / +0.4% 0.35 / 0.35 / -0.7%
tpch_q16/datafusion:vortex-file-compressed 60271405 / 60114875 / +0.3% 139139082 / 135151225 / +3.0% 0.43 / 0.44 / -2.6%
tpch_q17/datafusion:vortex-file-compressed 419121651 / 408459033 / +2.6% 530452441 / 559926121 / -5.3% 0.79 / 0.73 / +8.3%
tpch_q18/datafusion:vortex-file-compressed 625062855 / 608488698 / +2.7% 775685710 / 812349802 / -4.5% 0.81 / 0.75 / +7.6%
tpch_q19/datafusion:vortex-file-compressed 54083624 / 51900196 / +4.2% 176385606 / 175701573 / +0.4% 0.31 / 0.30 / +3.8%
tpch_q20/datafusion:vortex-file-compressed 122006697 / 123738637 / -1.4% 256195210 / 268477426 / -4.6% 0.48 / 0.46 / +3.3%
tpch_q21/datafusion:vortex-file-compressed 435179984 / 422890824 / +2.9% 579908114 / 548655935 / +5.7% 0.75 / 0.77 / -2.6%
tpch_q22/datafusion:vortex-file-compressed 37265943 / 36446012 / +2.2% 98071039 / 95885860 / +2.3% 0.38 / 0.38 / -0.0%
datafusion / parquet / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 324434437 / 326131829 / -0.5% 412968502 / 410810564 / +0.5% 0.79 / 0.79 / -1.0%
tpch_q02/datafusion:parquet 185473619 / 184738355 / +0.4% 272745012 / 250781634 / +8.8% 0.68 / 0.74 / -7.7%
tpch_q03/datafusion:parquet 212456463 / 215558828 / -1.4% 362364501 / 355162308 / +2.0% 0.59 / 0.61 / -3.4%
tpch_q04/datafusion:parquet 88517603 / 87910653 / +0.7% 191984922 / 190345938 / +0.9% 0.46 / 0.46 / -0.2%
tpch_q05/datafusion:parquet 339795180 / 342112415 / -0.7% 505347107 / 503126485 / +0.4% 0.67 / 0.68 / -1.1%
tpch_q06/datafusion:parquet 66722877 / 67845539 / -1.7% 164261013 / 163677286 / +0.4% 0.41 / 0.41 / -2.0%
tpch_q07/datafusion:parquet 487938516 / 480238266 / +1.6% 687901050 / 661367479 / +4.0% 0.71 / 0.73 / -2.3%
tpch_q08/datafusion:parquet 375201808 / 372568611 / +0.7% 551787984 / 542343661 / +1.7% 0.68 / 0.69 / -1.0%
tpch_q09/datafusion:parquet 650220476 / 648914053 / +0.2% 822963105 / 817257571 / +0.7% 0.79 / 0.79 / -0.5%
tpch_q10/datafusion:parquet 514939821 / 512723929 / +0.4% 694336502 / 686274026 / +1.2% 0.74 / 0.75 / -0.7%
tpch_q11/datafusion:parquet 115757977 / 131338739 / -11.9% 🟢 198448285 / 208652240 / -4.9% 0.58 / 0.63 / -7.3%
tpch_q12/datafusion:parquet 138040952 / 138352767 / -0.2% 249021667 / 252359862 / -1.3% 0.55 / 0.55 / +1.1%
tpch_q13/datafusion:parquet 335610585 / 329928642 / +1.7% 420344491 / 392223464 / +7.2% 0.80 / 0.84 / -5.1%
tpch_q14/datafusion:parquet 112144698 / 112118803 / +0.0% 233189854 / 238367687 / -2.2% 0.48 / 0.47 / +2.2%
tpch_q15/datafusion:parquet 184768405 / 184108936 / +0.4% 287030818 / 282577725 / +1.6% 0.64 / 0.65 / -1.2%
tpch_q16/datafusion:parquet 120695270 / 120924866 / -0.2% 210841192 / 195898382 / +7.6% 0.57 / 0.62 / -7.3%
tpch_q17/datafusion:parquet 444086934 / 442796058 / +0.3% 560874163 / 565837480 / -0.9% 0.79 / 0.78 / +1.2%
tpch_q18/datafusion:parquet 681270611 / 670460134 / +1.6% 862772272 / 839677183 / +2.8% 0.79 / 0.80 / -1.1%
tpch_q19/datafusion:parquet 180672056 / 179656901 / +0.6% 311730933 / 310104970 / +0.5% 0.58 / 0.58 / +0.0%
tpch_q20/datafusion:parquet 267357287 / 269965648 / -1.0% 407514427 / 401164048 / +1.6% 0.66 / 0.67 / -2.5%
tpch_q21/datafusion:parquet 552634929 / 553267089 / -0.1% 786478526 / 774312754 / +1.6% 0.70 / 0.71 / -1.7%
tpch_q22/datafusion:parquet 222995910 / 223646133 / -0.3% 284554138 / 282219540 / +0.8% 0.78 / 0.79 / -1.1%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 102065613 / 104664602 / -2.5% 202518195 / 205032052 / -1.2% 0.50 / 0.51 / -1.3%
tpch_q02/duckdb:vortex-file-compressed 67053079 / 67732538 / -1.0% 111369028 / 109776283 / +1.5% 0.60 / 0.62 / -2.4%
tpch_q03/duckdb:vortex-file-compressed 131104665 / 126726658 / +3.5% 253812148 / 235461087 / +7.8% 0.52 / 0.54 / -4.0%
tpch_q04/duckdb:vortex-file-compressed 161280312 / 160446172 / +0.5% 252317371 / 239574347 / +5.3% 0.64 / 0.67 / -4.6%
tpch_q05/duckdb:vortex-file-compressed 143417004 / 140003649 / +2.4% 262008560 / 241260940 / +8.6% 0.55 / 0.58 / -5.7%
tpch_q06/duckdb:vortex-file-compressed 37834076 / 36932668 / +2.4% 133656780 / 127507645 / +4.8% 0.28 / 0.29 / -2.3%
tpch_q07/duckdb:vortex-file-compressed 120049570 / 120974212 / -0.8% 272296128 / 265590858 / +2.5% 0.44 / 0.46 / -3.2%
tpch_q08/duckdb:vortex-file-compressed 169901160 / 172625508 / -1.6% 283736580 / 283308962 / +0.2% 0.60 / 0.61 / -1.7%
tpch_q09/duckdb:vortex-file-compressed 305547883 / 301364940 / +1.4% 440006546 / 436998118 / +0.7% 0.69 / 0.69 / +0.7%
tpch_q10/duckdb:vortex-file-compressed 216729442 / 210418632 / +3.0% 352183810 / 355984746 / -1.1% 0.62 / 0.59 / +4.1%
tpch_q11/duckdb:vortex-file-compressed 40532367 / 40193229 / +0.8% 94462284 / 90356911 / +4.5% 0.43 / 0.44 / -3.5%
tpch_q12/duckdb:vortex-file-compressed 112533132 / 110837537 / +1.5% 190993868 / 180794342 / +5.6% 0.59 / 0.61 / -3.9%
tpch_q13/duckdb:vortex-file-compressed 200332508 / 194788889 / +2.8% 301947404 / 286197634 / +5.5% 0.66 / 0.68 / -2.5%
tpch_q14/duckdb:vortex-file-compressed 55355395 / 57760913 / -4.2% 173680884 / 180890339 / -4.0% 0.32 / 0.32 / -0.2%
tpch_q15/duckdb:vortex-file-compressed 77776119 / 71681681 / +8.5% 184214170 / 184200860 / +0.0% 0.42 / 0.39 / +8.5%
tpch_q16/duckdb:vortex-file-compressed 88155930 / 86562178 / +1.8% 127642769 / 122122221 / +4.5% 0.69 / 0.71 / -2.6%
tpch_q17/duckdb:vortex-file-compressed 101716039 / 109160873 / -6.8% 232631646 / 222053211 / +4.8% 0.44 / 0.49 / -11.1%
tpch_q18/duckdb:vortex-file-compressed 260875066 / 264650655 / -1.4% 339682039 / 350444870 / -3.1% 0.77 / 0.76 / +1.7%
tpch_q19/duckdb:vortex-file-compressed 88741938 / 84054763 / +5.6% 205759616 / 210146586 / -2.1% 0.43 / 0.40 / +7.8%
tpch_q20/duckdb:vortex-file-compressed 128893283 / 135396718 / -4.8% 248372192 / 257957270 / -3.7% 0.52 / 0.52 / -1.1%
tpch_q21/duckdb:vortex-file-compressed 479105492 / 477529819 / +0.3% 532789044 / 558679454 / -4.6% 0.90 / 0.85 / +5.2%
tpch_q22/duckdb:vortex-file-compressed 71837070 / 74148704 / -3.1% 126412159 / 126753772 / -0.3% 0.57 / 0.58 / -2.9%
duckdb / parquet / ns (1.019x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 144396768 / 96811392 / +49.2% 🔴 194843970 / 177449696 / +9.8% 0.74 / 0.55 / +35.8%
tpch_q02/duckdb:parquet 101728897 / 99788935 / +1.9% 121962314 / 121466776 / +0.4% 0.83 / 0.82 / +1.5%
tpch_q03/duckdb:parquet 166817988 / 160162664 / +4.2% 219043547 / 233157759 / -6.1% 0.76 / 0.69 / +10.9%
tpch_q04/duckdb:parquet 119376472 / 115443776 / +3.4% 165312007 / 164536180 / +0.5% 0.72 / 0.70 / +2.9%
tpch_q05/duckdb:parquet 187034544 / 195574441 / -4.4% 248180121 / 262675066 / -5.5% 0.75 / 0.74 / +1.2%
tpch_q06/duckdb:parquet 59393925 / 59240676 / +0.3% 101888857 / 94682147 / +7.6% 0.58 / 0.63 / -6.8%
tpch_q07/duckdb:parquet 143072549 / 138274941 / +3.5% 215655445 / 244744994 / -11.9% 🟢 0.66 / 0.56 / +17.4%
tpch_q08/duckdb:parquet 216973025 / 217872547 / -0.4% 302429614 / 290976985 / +3.9% 0.72 / 0.75 / -4.2%
tpch_q09/duckdb:parquet 347153903 / 345861007 / +0.4% 429956593 / 482824462 / -10.9% 🟢 0.81 / 0.72 / +12.7%
tpch_q10/duckdb:parquet 657743674 / 659855229 / -0.3% 737824667 / 737471319 / +0.0% 0.89 / 0.89 / -0.4%
tpch_q11/duckdb:parquet 41781916 / 41682274 / +0.2% 54105633 / 54219655 / -0.2% 0.77 / 0.77 / +0.5%
tpch_q12/duckdb:parquet 116112957 / 116599592 / -0.4% 156585977 / 148653482 / +5.3% 0.74 / 0.78 / -5.5%
tpch_q13/duckdb:parquet 398938065 / 399588672 / -0.2% 431656298 / 420679077 / +2.6% 0.92 / 0.95 / -2.7%
tpch_q14/duckdb:parquet 154572587 / 153477926 / +0.7% 211559655 / 214912349 / -1.6% 0.73 / 0.71 / +2.3%
tpch_q15/duckdb:parquet 80359474 / 79082804 / +1.6% 131123686 / 129650283 / +1.1% 0.61 / 0.61 / +0.5%
tpch_q16/duckdb:parquet 156271631 / 154672866 / +1.0% 172415111 / 173382895 / -0.6% 0.91 / 0.89 / +1.6%
tpch_q17/duckdb:parquet 115293597 / 119888864 / -3.8% 204852327 / 202357276 / +1.2% 0.56 / 0.59 / -5.0%
tpch_q18/duckdb:parquet 284637742 / 297565260 / -4.3% 304352950 / 313030099 / -2.8% 0.94 / 0.95 / -1.6%
tpch_q19/duckdb:parquet 245078085 / 243372852 / +0.7% 296567369 / 310908591 / -4.6% 0.83 / 0.78 / +5.6%
tpch_q20/duckdb:parquet 197020487 / 196840322 / +0.1% 274314490 / 265142004 / +3.5% 0.72 / 0.74 / -3.3%
tpch_q21/duckdb:parquet 431696602 / 435660114 / -0.9% 466037494 / 491652521 / -5.2% 0.93 / 0.89 / +4.5%
tpch_q22/duckdb:parquet 334685273 / 336764494 / -0.6% 358497120 / 357638551 / +0.2% 0.93 / 0.94 / -0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.015x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 12308982 / 12292690 / +0.1% 13675192 / 13531959 / +1.1% 0.90 / 0.91 / -0.9%
statpopgen_q01/duckdb:vortex-file-compressed 13868244 / 14193553 / -2.3% 21416755 / 21851483 / -2.0% 0.65 / 0.65 / -0.3%
statpopgen_q02/duckdb:vortex-file-compressed 633616274 / 619156403 / +2.3% 632099151 / 695439289 / -9.1% 1.00 / 0.89 / +12.6%
statpopgen_q03/duckdb:vortex-file-compressed 1618795288 / 1587491066 / +2.0% 1838956374 / 1347942218 / +36.4% 🔴 0.88 / 1.18 / -25.3%
statpopgen_q04/duckdb:vortex-file-compressed 1381415842 / 1532422427 / -9.9% 1845968870 / 1399270421 / +31.9% 🔴 0.75 / 1.10 / -31.7%
statpopgen_q05/duckdb:vortex-file-compressed 648555597 / 665625526 / -2.6% 665632579 / 934991792 / -28.8% 🟢 0.97 / 0.71 / +36.9%
statpopgen_q06/duckdb:vortex-file-compressed 1848361997 / 1809326597 / +2.2% 1780511589 / 1787422112 / -0.4% 1.04 / 1.01 / +2.6%
statpopgen_q07/duckdb:vortex-file-compressed 263013806 / 255348863 / +3.0% 314306556 / 307293552 / +2.3% 0.84 / 0.83 / +0.7%
statpopgen_q08/duckdb:vortex-file-compressed 276257255 / 268058672 / +3.1% 326735513 / 334773708 / -2.4% 0.85 / 0.80 / +5.6%
statpopgen_q09/duckdb:vortex-file-compressed 1248015649 / 1100938147 / +13.4% 🔴 1065037462 / 1056425724 / +0.8% 1.17 / 1.04 / +12.4%
statpopgen_q10/duckdb:vortex-file-compressed 2951896397 / 3134877295 / -5.8% 3229912501 / 3187956876 / +1.3% 0.91 / 0.98 / -7.1%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 378372240 / 376895772 / +0.4% 380201783 / 378096153 / +0.6% 1.00 / 1.00 / -0.2%
statpopgen_q01/duckdb:parquet 466976580 / 467649190 / -0.1% 472870575 / 471247487 / +0.3% 0.99 / 0.99 / -0.5%
statpopgen_q02/duckdb:parquet 772259716 / 772149155 / +0.0% 811034895 / 805185666 / +0.7% 0.95 / 0.96 / -0.7%
statpopgen_q03/duckdb:parquet 1062103611 / 1051084148 / +1.0% 1124057077 / 1118665186 / +0.5% 0.94 / 0.94 / +0.6%
statpopgen_q04/duckdb:parquet 1046563512 / 1044680788 / +0.2% 1087791333 / 1097564996 / -0.9% 0.96 / 0.95 / +1.1%
statpopgen_q05/duckdb:parquet 773401404 / 760521832 / +1.7% 798326291 / 800780597 / -0.3% 0.97 / 0.95 / +2.0%
statpopgen_q06/duckdb:parquet 1018361086 / 1015247025 / +0.3% 1050079519 / 1073261539 / -2.2% 0.97 / 0.95 / +2.5%
statpopgen_q07/duckdb:parquet 957680492 / 949479925 / +0.9% 1170139508 / 1127055279 / +3.8% 0.82 / 0.84 / -2.9%
statpopgen_q08/duckdb:parquet 964277843 / 964626905 / -0.0% 1146304799 / 1118411226 / +2.5% 0.84 / 0.86 / -2.5%
statpopgen_q09/duckdb:parquet 996448224 / 990746260 / +0.6% 1045225361 / 1044013036 / +0.1% 0.95 / 0.95 / +0.5%
statpopgen_q10/duckdb:parquet 1650336925 / 1650616576 / -0.0% 1693580100 / 1695940594 / -0.1% 0.97 / 0.97 / +0.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.6%
Engines: DataFusion No clear signal (-7.9%, environment too noisy confidence) · DuckDB No clear signal (+25.8%, environment too noisy confidence)
Vortex (geomean): hot 1.028x ➖ · cold 1.079x ➖
Parquet (geomean): hot 0.956x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -4.4% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.961x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 40225180 / 51837776 / -22.4% 211558635 / 205280218 / +3.1% 0.19 / 0.25 / -24.7%
fineweb_q01/datafusion:vortex-file-compressed 610033291 / 414178674 / +47.3% 🔴 983995714 / 1255138564 / -21.6% 0.62 / 0.33 / +87.9%
fineweb_q02/datafusion:vortex-file-compressed 392566638 / 379282687 / +3.5% 2141951240 / 410733169 / +421.5% 🔴 0.18 / 0.92 / -80.2%
fineweb_q03/datafusion:vortex-file-compressed 563790591 / 621969412 / -9.4% 1085010053 / 1132004488 / -4.2% 0.52 / 0.55 / -5.4%
fineweb_q04/datafusion:vortex-file-compressed 640538488 / 759068358 / -15.6% 475863901 / 666469574 / -28.6% 1.35 / 1.14 / +18.2%
fineweb_q05/datafusion:vortex-file-compressed 574260354 / 570286628 / +0.7% 436478345 / 471012641 / -7.3% 1.32 / 1.21 / +8.7%
fineweb_q06/datafusion:vortex-file-compressed 708175145 / 866488485 / -18.3% 685065237 / 708203397 / -3.3% 1.03 / 1.22 / -15.5%
fineweb_q07/datafusion:vortex-file-compressed 480064374 / 569799086 / -15.7% 498633269 / 705775217 / -29.3% 0.96 / 0.81 / +19.3%
fineweb_q08/datafusion:vortex-file-compressed 201671752 / 180443444 / +11.8% 214539502 / 215705152 / -0.5% 0.94 / 0.84 / +12.4%
datafusion / parquet / ns (1.044x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 645312902 / 687704286 / -6.2% 1417806915 / 1420736273 / -0.2% 0.46 / 0.48 / -6.0%
fineweb_q01/datafusion:parquet 1207858448 / 911326920 / +32.5% 🔴 1054491744 / 994286051 / +6.1% 1.15 / 0.92 / +25.0%
fineweb_q02/datafusion:parquet 973018140 / 944288494 / +3.0% 1251261587 / 1049614854 / +19.2% 0.78 / 0.90 / -13.6%
fineweb_q03/datafusion:parquet 1078003030 / 1029074180 / +4.8% 1215132320 / 1086618232 / +11.8% 0.89 / 0.95 / -6.3%
fineweb_q04/datafusion:parquet 1222146868 / 1466205582 / -16.6% 1576305589 / 1564338957 / +0.8% 0.78 / 0.94 / -17.3%
fineweb_q05/datafusion:parquet 1132900640 / 969807055 / +16.8% 1206705117 / 979719537 / +23.2% 0.94 / 0.99 / -5.2%
fineweb_q06/datafusion:parquet 1223214539 / 1335011418 / -8.4% 1096711690 / 1314683154 / -16.6% 1.12 / 1.02 / +9.8%
fineweb_q07/datafusion:parquet 1114963004 / 948730128 / +17.5% 1150150094 / 1150316549 / -0.0% 0.97 / 0.82 / +17.5%
fineweb_q08/datafusion:parquet 1081434066 / 1033956537 / +4.6% 1172336271 / 1183464959 / -0.9% 0.92 / 0.87 / +5.6%
duckdb / vortex-file-compressed / ns (1.100x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 95163749 / 76950644 / +23.7% 122951362 / 157110097 / -21.7% 0.77 / 0.49 / +58.0%
fineweb_q01/duckdb:vortex-file-compressed 530282702 / 538365821 / -1.5% 824282907 / 763350519 / +8.0% 0.64 / 0.71 / -8.8%
fineweb_q02/duckdb:vortex-file-compressed 728484894 / 663356053 / +9.8% 782919049 / 737938393 / +6.1% 0.93 / 0.90 / +3.5%
fineweb_q03/duckdb:vortex-file-compressed 1571627730 / 1501251519 / +4.7% 1867715678 / 1649365916 / +13.2% 0.84 / 0.91 / -7.6%
fineweb_q04/duckdb:vortex-file-compressed 2747164951 / 1639762742 / +67.5% 🔴 2693511207 / 1695460661 / +58.9% 🔴 1.02 / 0.97 / +5.5%
fineweb_q05/duckdb:vortex-file-compressed 1690752645 / 1565636464 / +8.0% 1702183166 / 1543131291 / +10.3% 0.99 / 1.01 / -2.1%
fineweb_q06/duckdb:vortex-file-compressed 1687892274 / 1673543038 / +0.9% 1901080629 / 1649899679 / +15.2% 0.89 / 1.01 / -12.5%
fineweb_q07/duckdb:vortex-file-compressed 1438999750 / 1484350854 / -3.1% 1613807607 / 1477047785 / +9.3% 0.89 / 1.00 / -11.3%
fineweb_q08/duckdb:vortex-file-compressed 604701188 / 633582290 / -4.6% 674142044 / 702621886 / -4.1% 0.90 / 0.90 / -0.5%
duckdb / parquet / ns (0.875x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 2917859517 / 5254824734 / -44.5% 🟢 600243053 / 554904132 / +8.2% 4.86 / 9.47 / -48.7%
fineweb_q01/duckdb:parquet 5304269678 / 5315352208 / -0.2% 731874452 / 643547537 / +13.7% 7.25 / 8.26 / -12.3%
fineweb_q02/duckdb:parquet 5315459784 / 5310151158 / +0.1% 655042017 / 705735201 / -7.2% 8.11 / 7.52 / +7.8%
fineweb_q03/duckdb:parquet 5389840226 / 3368766886 / +60.0% 🔴 1246551052 / 1338647611 / -6.9% 4.32 / 2.52 / +71.8%
fineweb_q04/duckdb:parquet 5307697687 / 3071028920 / +72.8% 🔴 844505576 / 1043636798 / -19.1% 6.28 / 2.94 / +113.6%
fineweb_q05/duckdb:parquet 5312901663 / 3092339912 / +71.8% 🔴 999731867 / 927070214 / +7.8% 5.31 / 3.34 / +59.3%
fineweb_q06/duckdb:parquet 5372597674 / 5382395838 / -0.2% 1466981042 / 1383022420 / +6.1% 3.66 / 3.89 / -5.9%
fineweb_q07/duckdb:parquet 1106478996 / 5335963502 / -79.3% 🟢 1022448656 / 1043398202 / -2.0% 1.08 / 5.11 / -78.8%
fineweb_q08/duckdb:parquet 2892215918 / 5251847614 / -44.9% 🟢 556014921 / 637337644 / -12.8% 5.20 / 8.24 / -36.9%

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.967x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1855546 / 1933090 / -4.0% 40900456 / 41230793 / -0.8% 0.05 / 0.05 / -3.2%
clickbench_q01/datafusion:vortex-file-compressed 12661698 / 12286308 / +3.1% 61237161 / 63452548 / -3.5% 0.21 / 0.19 / +6.8%
clickbench_q02/datafusion:vortex-file-compressed 26764347 / 26739696 / +0.1% 72592057 / 75005252 / -3.2% 0.37 / 0.36 / +3.4%
clickbench_q03/datafusion:vortex-file-compressed 27974812 / 27369886 / +2.2% 91021862 / 99532190 / -8.6% 0.31 / 0.27 / +11.8%
clickbench_q04/datafusion:vortex-file-compressed 159659483 / 159722672 / -0.0% 235827680 / 239014288 / -1.3% 0.68 / 0.67 / +1.3%
clickbench_q05/datafusion:vortex-file-compressed 224511230 / 217279515 / +3.3% 297164185 / 308134758 / -3.6% 0.76 / 0.71 / +7.1%
clickbench_q06/datafusion:vortex-file-compressed 1910063 / 1921050 / -0.6% 38014536 / 40141084 / -5.3% 0.05 / 0.05 / +5.0%
clickbench_q07/datafusion:vortex-file-compressed 19053289 / 19370906 / -1.6% 66947900 / 66945751 / +0.0% 0.28 / 0.29 / -1.6%
clickbench_q08/datafusion:vortex-file-compressed 223987028 / 220850458 / +1.4% 309620180 / 307886540 / +0.6% 0.72 / 0.72 / +0.9%
clickbench_q09/datafusion:vortex-file-compressed 350642069 / 348181249 / +0.7% 422468231 / 437056985 / -3.3% 0.83 / 0.80 / +4.2%
clickbench_q10/datafusion:vortex-file-compressed 66127146 / 66406643 / -0.4% 130788863 / 134987223 / -3.1% 0.51 / 0.49 / +2.8%
clickbench_q11/datafusion:vortex-file-compressed 86828372 / 87766386 / -1.1% 147920239 / 148549761 / -0.4% 0.59 / 0.59 / -0.6%
clickbench_q12/datafusion:vortex-file-compressed 200053251 / 197868041 / +1.1% 285673268 / 288163206 / -0.9% 0.70 / 0.69 / +2.0%
clickbench_q13/datafusion:vortex-file-compressed 337724920 / 335670756 / +0.6% 448720012 / 447167084 / +0.3% 0.75 / 0.75 / +0.3%
clickbench_q14/datafusion:vortex-file-compressed 197123920 / 197816430 / -0.4% 290254935 / 286585784 / +1.3% 0.68 / 0.69 / -1.6%
clickbench_q15/datafusion:vortex-file-compressed 185752497 / 186166822 / -0.2% 263650920 / 264291024 / -0.2% 0.70 / 0.70 / +0.0%
clickbench_q16/datafusion:vortex-file-compressed 466579677 / 469338909 / -0.6% 565427228 / 575419158 / -1.7% 0.83 / 0.82 / +1.2%
clickbench_q17/datafusion:vortex-file-compressed 471450994 / 470385353 / +0.2% 569635058 / 561965488 / +1.4% 0.83 / 0.84 / -1.1%
clickbench_q18/datafusion:vortex-file-compressed 885983058 / 886720348 / -0.1% 986629773 / 1009361409 / -2.3% 0.90 / 0.88 / +2.2%
clickbench_q19/datafusion:vortex-file-compressed 16835719 / 16731959 / +0.6% 82342878 / 89004387 / -7.5% 0.20 / 0.19 / +8.8%
clickbench_q20/datafusion:vortex-file-compressed 184046231 / 184933263 / -0.5% 377530540 / 378410846 / -0.2% 0.49 / 0.49 / -0.2%
clickbench_q21/datafusion:vortex-file-compressed 265117570 / 266276757 / -0.4% 463419312 / 477091617 / -2.9% 0.57 / 0.56 / +2.5%
clickbench_q22/datafusion:vortex-file-compressed 329103226 / 326487127 / +0.8% 572332883 / 602287033 / -5.0% 0.58 / 0.54 / +6.1%
clickbench_q23/datafusion:vortex-file-compressed 609127819 / 594417986 / +2.5% 921495916 / 998139330 / -7.7% 0.66 / 0.60 / +11.0%
clickbench_q24/datafusion:vortex-file-compressed 40533079 / 41095274 / -1.4% 113762549 / 122665848 / -7.3% 0.36 / 0.34 / +6.4%
clickbench_q25/datafusion:vortex-file-compressed 54187611 / 54800086 / -1.1% 121958486 / 123374816 / -1.1% 0.44 / 0.44 / +0.0%
clickbench_q26/datafusion:vortex-file-compressed 42240032 / 42113512 / +0.3% 114219639 / 120932456 / -5.6% 0.37 / 0.35 / +6.2%
clickbench_q27/datafusion:vortex-file-compressed 271973614 / 275548498 / -1.3% 465819117 / 456978453 / +1.9% 0.58 / 0.60 / -3.2%
clickbench_q28/datafusion:vortex-file-compressed 1430778587 / 1425311524 / +0.4% 1505231149 / 1580248726 / -4.7% 0.95 / 0.90 / +5.4%
clickbench_q29/datafusion:vortex-file-compressed 38825866 / 39186017 / -0.9% 89824651 / 91719787 / -2.1% 0.43 / 0.43 / +1.2%
clickbench_q30/datafusion:vortex-file-compressed 175921043 / 171067096 / +2.8% 260556419 / 265727394 / -1.9% 0.68 / 0.64 / +4.9%
clickbench_q31/datafusion:vortex-file-compressed 195420038 / 196639042 / -0.6% 320019072 / 322474572 / -0.8% 0.61 / 0.61 / +0.1%
clickbench_q32/datafusion:vortex-file-compressed 827998068 / 825489476 / +0.3% 942624020 / 951645265 / -0.9% 0.88 / 0.87 / +1.3%
clickbench_q33/datafusion:vortex-file-compressed 1022718474 / 1020659011 / +0.2% 1227860058 / 1214301675 / +1.1% 0.83 / 0.84 / -0.9%
clickbench_q34/datafusion:vortex-file-compressed 1025263419 / 1022393552 / +0.3% 1193558296 / 1188323865 / +0.4% 0.86 / 0.86 / -0.2%
clickbench_q35/datafusion:vortex-file-compressed 152327448 / 153802562 / -1.0% 228117929 / 229881811 / -0.8% 0.67 / 0.67 / -0.2%
clickbench_q36/datafusion:vortex-file-compressed 55916630 / 56185188 / -0.5% 121125785 / 121997142 / -0.7% 0.46 / 0.46 / +0.2%
clickbench_q37/datafusion:vortex-file-compressed 28852986 / 28574608 / +1.0% 81594507 / 81704718 / -0.1% 0.35 / 0.35 / +1.1%
clickbench_q38/datafusion:vortex-file-compressed 16184606 / 15453974 / +4.7% 67544939 / 67547955 / -0.0% 0.24 / 0.23 / +4.7%
clickbench_q39/datafusion:vortex-file-compressed 113981268 / 111508350 / +2.2% 182299794 / 181954717 / +0.2% 0.63 / 0.61 / +2.0%
clickbench_q40/datafusion:vortex-file-compressed 13943512 / 13681374 / +1.9% 64012056 / 65800563 / -2.7% 0.22 / 0.21 / +4.8%
clickbench_q41/datafusion:vortex-file-compressed 12719108 / 12937974 / -1.7% 62343771 / 63795685 / -2.3% 0.20 / 0.20 / +0.6%
clickbench_q42/datafusion:vortex-file-compressed 14029313 / 13141124 / +6.8% 60022216 / 61973560 / -3.1% 0.23 / 0.21 / +10.2%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1905288 / 1892434 / +0.7% 75297465 / 79205489 / -4.9% 0.03 / 0.02 / +5.9%
clickbench_q01/datafusion:parquet 15922089 / 16235967 / -1.9% 112049660 / 112832982 / -0.7% 0.14 / 0.14 / -1.2%
clickbench_q02/datafusion:parquet 31649165 / 32859635 / -3.7% 140618464 / 134804973 / +4.3% 0.23 / 0.24 / -7.7%
clickbench_q03/datafusion:parquet 27806420 / 26677472 / +4.2% 132812244 / 130859002 / +1.5% 0.21 / 0.20 / +2.7%
clickbench_q04/datafusion:parquet 171510550 / 173029918 / -0.9% 301228025 / 304732130 / -1.1% 0.57 / 0.57 / +0.3%
clickbench_q05/datafusion:parquet 235119990 / 238167682 / -1.3% 361586997 / 370198234 / -2.3% 0.65 / 0.64 / +1.1%
clickbench_q06/datafusion:parquet 1904728 / 1971842 / -3.4% 75027629 / 77583030 / -3.3% 0.03 / 0.03 / -0.1%
clickbench_q07/datafusion:parquet 18260293 / 19053513 / -4.2% 111834940 / 119363621 / -6.3% 0.16 / 0.16 / +2.3%
clickbench_q08/datafusion:parquet 229459576 / 231975514 / -1.1% 381838794 / 387333480 / -1.4% 0.60 / 0.60 / +0.3%
clickbench_q09/datafusion:parquet 357909526 / 363631832 / -1.6% 500008232 / 495161756 / +1.0% 0.72 / 0.73 / -2.5%
clickbench_q10/datafusion:parquet 73404466 / 73938278 / -0.7% 188032952 / 195194693 / -3.7% 0.39 / 0.38 / +3.1%
clickbench_q11/datafusion:parquet 89813186 / 87410317 / +2.7% 209473570 / 209409603 / +0.0% 0.43 / 0.42 / +2.7%
clickbench_q12/datafusion:parquet 247503424 / 241009864 / +2.7% 374992072 / 369803888 / +1.4% 0.66 / 0.65 / +1.3%
clickbench_q13/datafusion:parquet 397443998 / 382834436 / +3.8% 544376539 / 539581753 / +0.9% 0.73 / 0.71 / +2.9%
clickbench_q14/datafusion:parquet 250469666 / 254118210 / -1.4% 386892386 / 395794066 / -2.2% 0.65 / 0.64 / +0.8%
clickbench_q15/datafusion:parquet 194023116 / 192791104 / +0.6% 320998643 / 325900762 / -1.5% 0.60 / 0.59 / +2.2%
clickbench_q16/datafusion:parquet 473842424 / 485289394 / -2.4% 623691592 / 626487422 / -0.4% 0.76 / 0.77 / -1.9%
clickbench_q17/datafusion:parquet 468605904 / 476258427 / -1.6% 629509538 / 634351345 / -0.8% 0.74 / 0.75 / -0.9%
clickbench_q18/datafusion:parquet 905519188 / 895889899 / +1.1% 1076144046 / 1071558079 / +0.4% 0.84 / 0.84 / +0.6%
clickbench_q19/datafusion:parquet 23654894 / 23737073 / -0.3% 123559365 / 116755737 / +5.8% 0.19 / 0.20 / -5.8%
clickbench_q20/datafusion:parquet 458776939 / 460797435 / -0.4% 598147325 / 612771734 / -2.4% 0.77 / 0.75 / +2.0%
clickbench_q21/datafusion:parquet 441111752 / 443723154 / -0.6% 608116092 / 604821731 / +0.5% 0.73 / 0.73 / -1.1%
clickbench_q22/datafusion:parquet 615412012 / 608600158 / +1.1% 824094526 / 835657196 / -1.4% 0.75 / 0.73 / +2.5%
clickbench_q23/datafusion:parquet 2433926771 / 2378085976 / +2.3% 2784975629 / 2777558588 / +0.3% 0.87 / 0.86 / +2.1%
clickbench_q24/datafusion:parquet 41093278 / 43396934 / -5.3% 138528694 / 138985805 / -0.3% 0.30 / 0.31 / -5.0%
clickbench_q25/datafusion:parquet 89936516 / 89290480 / +0.7% 201225859 / 205429649 / -2.0% 0.45 / 0.43 / +2.8%
clickbench_q26/datafusion:parquet 44214722 / 43763479 / +1.0% 139796999 / 136636536 / +2.3% 0.32 / 0.32 / -1.3%
clickbench_q27/datafusion:parquet 529057846 / 520874846 / +1.6% 688562129 / 685661852 / +0.4% 0.77 / 0.76 / +1.1%
clickbench_q28/datafusion:parquet 1502809545 / 1534244983 / -2.0% 1659625328 / 1650327789 / +0.6% 0.91 / 0.93 / -2.6%
clickbench_q29/datafusion:parquet 39221342 / 38577638 / +1.7% 143870805 / 142028929 / +1.3% 0.27 / 0.27 / +0.4%
clickbench_q30/datafusion:parquet 232608302 / 231027192 / +0.7% 386777777 / 391095912 / -1.1% 0.60 / 0.59 / +1.8%
clickbench_q31/datafusion:parquet 268760722 / 263954363 / +1.8% 440605869 / 427787423 / +3.0% 0.61 / 0.62 / -1.1%
clickbench_q32/datafusion:parquet 837436332 / 844796394 / -0.9% 1013125148 / 1018876770 / -0.6% 0.83 / 0.83 / -0.3%
clickbench_q33/datafusion:parquet 1087293778 / 1073591284 / +1.3% 1281130821 / 1276958546 / +0.3% 0.85 / 0.84 / +0.9%
clickbench_q34/datafusion:parquet 1092471111 / 1088127234 / +0.4% 1283670602 / 1335792155 / -3.9% 0.85 / 0.81 / +4.5%
clickbench_q35/datafusion:parquet 162220356 / 163176816 / -0.6% 282450836 / 289189528 / -2.3% 0.57 / 0.56 / +1.8%
clickbench_q36/datafusion:parquet 108831051 / 107236506 / +1.5% 211161385 / 213740322 / -1.2% 0.52 / 0.50 / +2.7%
clickbench_q37/datafusion:parquet 48842637 / 50052990 / -2.4% 139983681 / 143375285 / -2.4% 0.35 / 0.35 / -0.1%
clickbench_q38/datafusion:parquet 65504828 / 66925480 / -2.1% 162035814 / 169437980 / -4.4% 0.40 / 0.39 / +2.3%
clickbench_q39/datafusion:parquet 210480623 / 202354388 / +4.0% 321662494 / 324281458 / -0.8% 0.65 / 0.62 / +4.9%
clickbench_q40/datafusion:parquet 26319884 / 25748252 / +2.2% 122606054 / 123440029 / -0.7% 0.21 / 0.21 / +2.9%
clickbench_q41/datafusion:parquet 25556687 / 26618290 / -4.0% 114008077 / 119571918 / -4.7% 0.22 / 0.22 / +0.7%
clickbench_q42/datafusion:parquet 25749712 / 26418306 / -2.5% 113121483 / 116841346 / -3.2% 0.23 / 0.23 / +0.7%
duckdb / vortex-file-compressed / ns (0.992x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1840500 / 2102448 / -12.5% 🟢 61154782 / 80303433 / -23.8% 🟢 0.03 / 0.03 / +15.0%
clickbench_q01/duckdb:vortex-file-compressed 17933055 / 19283534 / -7.0% 94085396 / 102791177 / -8.5% 0.19 / 0.19 / +1.6%
clickbench_q02/duckdb:vortex-file-compressed 24383948 / 25237238 / -3.4% 115923719 / 108513527 / +6.8% 0.21 / 0.23 / -9.6%
clickbench_q03/duckdb:vortex-file-compressed 33264468 / 33176298 / +0.3% 103424876 / 105765578 / -2.2% 0.32 / 0.31 / +2.5%
clickbench_q04/duckdb:vortex-file-compressed 134674528 / 133970214 / +0.5% 218243257 / 210145959 / +3.9% 0.62 / 0.64 / -3.2%
clickbench_q05/duckdb:vortex-file-compressed 154167768 / 157060198 / -1.8% 245872395 / 238883907 / +2.9% 0.63 / 0.66 / -4.6%
clickbench_q06/duckdb:vortex-file-compressed 2284756 / 2636502 / -13.3% 🟢 98680209 / 110692865 / -10.9% 🟢 0.02 / 0.02 / -2.8%
clickbench_q07/duckdb:vortex-file-compressed 21800626 / 22201974 / -1.8% 93244141 / 105492792 / -11.6% 🟢 0.23 / 0.21 / +11.1%
clickbench_q08/duckdb:vortex-file-compressed 173564592 / 174414962 / -0.5% 282664815 / 291244525 / -2.9% 0.61 / 0.60 / +2.5%
clickbench_q09/duckdb:vortex-file-compressed 215455188 / 213028832 / +1.1% 322156180 / 346047256 / -6.9% 0.67 / 0.62 / +8.6%
clickbench_q10/duckdb:vortex-file-compressed 74203906 / 74362100 / -0.2% 167300168 / 178907096 / -6.5% 0.44 / 0.42 / +6.7%
clickbench_q11/duckdb:vortex-file-compressed 90065782 / 95359216 / -5.6% 195612891 / 202259631 / -3.3% 0.46 / 0.47 / -2.3%
clickbench_q12/duckdb:vortex-file-compressed 180001114 / 179187550 / +0.5% 284873941 / 298723096 / -4.6% 0.63 / 0.60 / +5.3%
clickbench_q13/duckdb:vortex-file-compressed 320750468 / 322701177 / -0.6% 461189458 / 454855505 / +1.4% 0.70 / 0.71 / -2.0%
clickbench_q14/duckdb:vortex-file-compressed 193697286 / 192851384 / +0.4% 306658024 / 306676921 / -0.0% 0.63 / 0.63 / +0.4%
clickbench_q15/duckdb:vortex-file-compressed 189978650 / 188978415 / +0.5% 294646325 / 298728180 / -1.4% 0.64 / 0.63 / +1.9%
clickbench_q16/duckdb:vortex-file-compressed 384617291 / 379084694 / +1.5% 486428858 / 508585090 / -4.4% 0.79 / 0.75 / +6.1%
clickbench_q17/duckdb:vortex-file-compressed 374506837 / 368234477 / +1.7% 483691570 / 494909568 / -2.3% 0.77 / 0.74 / +4.1%
clickbench_q18/duckdb:vortex-file-compressed 745540408 / 738563170 / +0.9% 870314905 / 905354484 / -3.9% 0.86 / 0.82 / +5.0%
clickbench_q19/duckdb:vortex-file-compressed 25953825 / 25981520 / -0.1% 102061435 / 119300548 / -14.5% 🟢 0.25 / 0.22 / +16.8%
clickbench_q20/duckdb:vortex-file-compressed 241069442 / 246678885 / -2.3% 439679629 / 452938669 / -2.9% 0.55 / 0.54 / +0.7%
clickbench_q21/duckdb:vortex-file-compressed 364262258 / 373338343 / -2.4% 642437962 / 644051678 / -0.3% 0.57 / 0.58 / -2.2%
clickbench_q22/duckdb:vortex-file-compressed 555106694 / 551126212 / +0.7% 943657547 / 968680521 / -2.6% 0.59 / 0.57 / +3.4%
clickbench_q23/duckdb:vortex-file-compressed 122393548 / 129373682 / -5.4% 238458451 / 230190103 / +3.6% 0.51 / 0.56 / -8.7%
clickbench_q24/duckdb:vortex-file-compressed 40669638 / 38464202 / +5.7% 98544143 / 104268773 / -5.5% 0.41 / 0.37 / +11.9%
clickbench_q25/duckdb:vortex-file-compressed 60951040 / 60880602 / +0.1% 140094459 / 139268345 / +0.6% 0.44 / 0.44 / -0.5%
clickbench_q26/duckdb:vortex-file-compressed 32298259 / 35445822 / -8.9% 95586167 / 94203935 / +1.5% 0.34 / 0.38 / -10.2%
clickbench_q27/duckdb:vortex-file-compressed 249661586 / 244680248 / +2.0% 508737214 / 518722197 / -1.9% 0.49 / 0.47 / +4.0%
clickbench_q28/duckdb:vortex-file-compressed 1375019610 / 1146209183 / +20.0% 🔴 1469578689 / 1575105087 / -6.7% 0.94 / 0.73 / +28.6%
clickbench_q29/duckdb:vortex-file-compressed 31026460 / 30562808 / +1.5% 104886449 / 109713275 / -4.4% 0.30 / 0.28 / +6.2%
clickbench_q30/duckdb:vortex-file-compressed 165665934 / 174968842 / -5.3% 287240315 / 285375057 / +0.7% 0.58 / 0.61 / -5.9%
clickbench_q31/duckdb:vortex-file-compressed 309073640 / 290523484 / +6.4% 501507516 / 506069212 / -0.9% 0.62 / 0.57 / +7.4%
clickbench_q32/duckdb:vortex-file-compressed 933282196 / 927434663 / +0.6% 1058790354 / 1071395338 / -1.2% 0.88 / 0.87 / +1.8%
clickbench_q33/duckdb:vortex-file-compressed 1020924000 / 1054233462 / -3.2% 1295490640 / 1327230299 / -2.4% 0.79 / 0.79 / -0.8%
clickbench_q34/duckdb:vortex-file-compressed 1058776394 / 1096996624 / -3.5% 1382389539 / 1350066036 / +2.4% 0.77 / 0.81 / -5.7%
clickbench_q35/duckdb:vortex-file-compressed 208686307 / 212565378 / -1.8% 290398976 / 296381752 / -2.0% 0.72 / 0.72 / +0.2%
clickbench_q36/duckdb:vortex-file-compressed 30093000 / 29855049 / +0.8% 91819402 / 122966765 / -25.3% 🟢 0.33 / 0.24 / +35.0%
clickbench_q37/duckdb:vortex-file-compressed 20327204 / 18954544 / +7.2% 85747228 / 110335804 / -22.3% 🟢 0.24 / 0.17 / +38.0%
clickbench_q38/duckdb:vortex-file-compressed 22891891 / 24393658 / -6.2% 116723694 / 124126048 / -6.0% 0.20 / 0.20 / -0.2%
clickbench_q39/duckdb:vortex-file-compressed 47008736 / 47417146 / -0.9% 147450448 / 130258260 / +13.2% 🔴 0.32 / 0.36 / -12.4%
clickbench_q40/duckdb:vortex-file-compressed 16194328 / 16639541 / -2.7% 81623920 / 85253845 / -4.3% 0.20 / 0.20 / +1.7%
clickbench_q41/duckdb:vortex-file-compressed 18939320 / 17807510 / +6.4% 85063895 / 93544837 / -9.1% 0.22 / 0.19 / +17.0%
clickbench_q42/duckdb:vortex-file-compressed 19671387 / 19641148 / +0.2% 83879607 / 94050161 / -10.8% 🟢 0.23 / 0.21 / +12.3%
duckdb / parquet / ns (0.995x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 16217266 / 15861345 / +2.2% 42854105 / 40243510 / +6.5% 0.38 / 0.39 / -4.0%
clickbench_q01/duckdb:parquet 15883848 / 18388047 / -13.6% 🟢 37078354 / 39208665 / -5.4% 0.43 / 0.47 / -8.7%
clickbench_q02/duckdb:parquet 25166590 / 24731642 / +1.8% 56074497 / 57333082 / -2.2% 0.45 / 0.43 / +4.0%
clickbench_q03/duckdb:parquet 26545499 / 27131586 / -2.2% 83183202 / 87793587 / -5.3% 0.32 / 0.31 / +3.3%
clickbench_q04/duckdb:parquet 133396904 / 134229201 / -0.6% 181716071 / 179218052 / +1.4% 0.73 / 0.75 / -2.0%
clickbench_q05/duckdb:parquet 183637946 / 192963246 / -4.8% 256944495 / 260512440 / -1.4% 0.71 / 0.74 / -3.5%
clickbench_q06/duckdb:parquet 23756718 / 27405232 / -13.3% 🟢 46212748 / 45194684 / +2.3% 0.51 / 0.61 / -15.2%
clickbench_q07/duckdb:parquet 19527530 / 19306575 / +1.1% 37826285 / 41948459 / -9.8% 0.52 / 0.46 / +12.2%
clickbench_q08/duckdb:parquet 164266776 / 164559374 / -0.2% 240615734 / 254269252 / -5.4% 0.68 / 0.65 / +5.5%
clickbench_q09/duckdb:parquet 231589510 / 228322714 / +1.4% 309745578 / 304784848 / +1.6% 0.75 / 0.75 / -0.2%
clickbench_q10/duckdb:parquet 68826453 / 66264218 / +3.9% 115690025 / 110108005 / +5.1% 0.59 / 0.60 / -1.1%
clickbench_q11/duckdb:parquet 70519099 / 69207448 / +1.9% 130618901 / 132275541 / -1.3% 0.54 / 0.52 / +3.2%
clickbench_q12/duckdb:parquet 174785561 / 177184711 / -1.4% 286411420 / 288602168 / -0.8% 0.61 / 0.61 / -0.6%
clickbench_q13/duckdb:parquet 310795530 / 311561326 / -0.2% 432494268 / 437203038 / -1.1% 0.72 / 0.71 / +0.8%
clickbench_q14/duckdb:parquet 197384250 / 189559496 / +4.1% 293117716 / 291409937 / +0.6% 0.67 / 0.65 / +3.5%
clickbench_q15/duckdb:parquet 189306994 / 187449339 / +1.0% 231420999 / 226096526 / +2.4% 0.82 / 0.83 / -1.3%
clickbench_q16/duckdb:parquet 348563896 / 355437596 / -1.9% 486319698 / 467031935 / +4.1% 0.72 / 0.76 / -5.8%
clickbench_q17/duckdb:parquet 361954080 / 359486763 / +0.7% 471902638 / 474180987 / -0.5% 0.77 / 0.76 / +1.2%
clickbench_q18/duckdb:parquet 690096065 / 690589826 / -0.1% 886144311 / 913125577 / -3.0% 0.78 / 0.76 / +3.0%
clickbench_q19/duckdb:parquet 23267216 / 23849592 / -2.4% 64813066 / 67817087 / -4.4% 0.36 / 0.35 / +2.1%
clickbench_q20/duckdb:parquet 259475511 / 256699478 / +1.1% 443895654 / 465071063 / -4.6% 0.58 / 0.55 / +5.9%
clickbench_q21/duckdb:parquet 324391018 / 323268042 / +0.3% 577261923 / 610139675 / -5.4% 0.56 / 0.53 / +6.1%
clickbench_q22/duckdb:parquet 465326397 / 471337070 / -1.3% 720442478 / 766381244 / -6.0% 0.65 / 0.62 / +5.0%
clickbench_q23/duckdb:parquet 262147516 / 255402014 / +2.6% 335050754 / 314277585 / +6.6% 0.78 / 0.81 / -3.7%
clickbench_q24/duckdb:parquet 70527583 / 76770409 / -8.1% 111519812 / 123264635 / -9.5% 0.63 / 0.62 / +1.5%
clickbench_q25/duckdb:parquet 76899990 / 76195286 / +0.9% 171576174 / 179804247 / -4.6% 0.45 / 0.42 / +5.8%
clickbench_q26/duckdb:parquet 54562108 / 54603971 / -0.1% 87191435 / 101061038 / -13.7% 🟢 0.63 / 0.54 / +15.8%
clickbench_q27/duckdb:parquet 276081016 / 279975311 / -1.4% 505593391 / 508971715 / -0.7% 0.55 / 0.55 / -0.7%
clickbench_q28/duckdb:parquet 1702419977 / 1728535087 / -1.5% 2187891104 / 2228914035 / -1.8% 0.78 / 0.78 / +0.3%
clickbench_q29/duckdb:parquet 29836424 / 31058187 / -3.9% 58307437 / 60209295 / -3.2% 0.51 / 0.52 / -0.8%
clickbench_q30/duckdb:parquet 179243872 / 178590875 / +0.4% 328771060 / 335058562 / -1.9% 0.55 / 0.53 / +2.3%
clickbench_q31/duckdb:parquet 318673627 / 299904915 / +6.3% 549010373 / 552983708 / -0.7% 0.58 / 0.54 / +7.0%
clickbench_q32/duckdb:parquet 911730160 / 914276608 / -0.3% 1027939529 / 1048768600 / -2.0% 0.89 / 0.87 / +1.7%
clickbench_q33/duckdb:parquet 792623346 / 794564358 / -0.2% 1003588013 / 1028254449 / -2.4% 0.79 / 0.77 / +2.2%
clickbench_q34/duckdb:parquet 800278566 / 806808490 / -0.8% 968214115 / 1129453373 / -14.3% 🟢 0.83 / 0.71 / +15.7%
clickbench_q35/duckdb:parquet 210548486 / 212411740 / -0.9% 247817712 / 243650429 / +1.7% 0.85 / 0.87 / -2.5%
clickbench_q36/duckdb:parquet 53169728 / 49062406 / +8.4% 71538304 / 72693951 / -1.6% 0.74 / 0.67 / +10.1%
clickbench_q37/duckdb:parquet 37361136 / 37921774 / -1.5% 59180428 / 56914694 / +4.0% 0.63 / 0.67 / -5.3%
clickbench_q38/duckdb:parquet 42315596 / 41107898 / +2.9% 58888399 / 60811627 / -3.2% 0.72 / 0.68 / +6.3%
clickbench_q39/duckdb:parquet 88002936 / 89502564 / -1.7% 121843741 / 111021073 / +9.7% 0.72 / 0.81 / -10.4%
clickbench_q40/duckdb:parquet 20517596 / 20341738 / +0.9% 43436166 / 44272373 / -1.9% 0.47 / 0.46 / +2.8%
clickbench_q41/duckdb:parquet 21869358 / 20752135 / +5.4% 41161442 / 43500788 / -5.4% 0.53 / 0.48 / +11.4%
clickbench_q42/duckdb:parquet 24136540 / 24526948 / -1.6% 44049434 / 45083156 / -2.3% 0.55 / 0.54 / +0.7%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 3b363739 vs base b4863a1d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+0.7%, environment too noisy confidence) · DuckDB No clear signal (+1.3%, environment too noisy confidence)
Vortex (geomean): hot 1.056x ➖ · cold 1.056x ➖
Parquet (geomean): hot 1.046x ➖ · cold 1.063x ➖
Shifts: Parquet (control) +4.6% · Median polish +4.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.048x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 244606103 / 245732206 / -0.5% 870593364 / 864641065 / +0.7% 0.28 / 0.28 / -1.1%
tpch_q02/datafusion:vortex-file-compressed 353020428 / 348002600 / +1.4% 766413252 / 775527091 / -1.2% 0.46 / 0.45 / +2.6%
tpch_q03/datafusion:vortex-file-compressed 343350682 / 347199599 / -1.1% 1244018582 / 1167812691 / +6.5% 0.28 / 0.30 / -7.2%
tpch_q04/datafusion:vortex-file-compressed 190179568 / 169678476 / +12.1% 443604181 / 431191246 / +2.9% 0.43 / 0.39 / +8.9%
tpch_q05/datafusion:vortex-file-compressed 374518465 / 379540888 / -1.3% 644607344 / 665870803 / -3.2% 0.58 / 0.57 / +1.9%
tpch_q06/datafusion:vortex-file-compressed 392536362 / 309812266 / +26.7% 455664579 / 476142836 / -4.3% 0.86 / 0.65 / +32.4%
tpch_q07/datafusion:vortex-file-compressed 363694572 / 406481951 / -10.5% 536105597 / 576066321 / -6.9% 0.68 / 0.71 / -3.9%
tpch_q08/datafusion:vortex-file-compressed 491283260 / 416369440 / +18.0% 727491521 / 578309796 / +25.8% 0.68 / 0.72 / -6.2%
tpch_q09/datafusion:vortex-file-compressed 287131122 / 301372032 / -4.7% 543936744 / 532233990 / +2.2% 0.53 / 0.57 / -6.8%
tpch_q10/datafusion:vortex-file-compressed 339553215 / 323423807 / +5.0% 559007460 / 492214938 / +13.6% 0.61 / 0.66 / -7.6%
tpch_q11/datafusion:vortex-file-compressed 284105707 / 274003769 / +3.7% 475162450 / 516349831 / -8.0% 0.60 / 0.53 / +12.7%
tpch_q12/datafusion:vortex-file-compressed 365387335 / 479119746 / -23.7% 708605103 / 786530500 / -9.9% 0.52 / 0.61 / -15.4%
tpch_q13/datafusion:vortex-file-compressed 139419526 / 129106960 / +8.0% 565595118 / 397891577 / +42.1% 🔴 0.25 / 0.32 / -24.0%
tpch_q14/datafusion:vortex-file-compressed 198663899 / 174843420 / +13.6% 536278743 / 305512596 / +75.5% 🔴 0.37 / 0.57 / -35.3%
tpch_q15/datafusion:vortex-file-compressed 297421608 / 471064465 / -36.9% 🟢 554890307 / 837685066 / -33.8% 🟢 0.54 / 0.56 / -4.7%
tpch_q16/datafusion:vortex-file-compressed 207086015 / 169029120 / +22.5% 334688085 / 355351201 / -5.8% 0.62 / 0.48 / +30.1%
tpch_q17/datafusion:vortex-file-compressed 454636207 / 299405469 / +51.8% 🔴 737182740 / 553615475 / +33.2% 🔴 0.62 / 0.54 / +14.0%
tpch_q18/datafusion:vortex-file-compressed 400453241 / 225804001 / +77.3% 🔴 445675705 / 440969996 / +1.1% 0.90 / 0.51 / +75.5%
tpch_q19/datafusion:vortex-file-compressed 330763602 / 346093340 / -4.4% 502409501 / 479925331 / +4.7% 0.66 / 0.72 / -8.7%
tpch_q20/datafusion:vortex-file-compressed 296291002 / 281598361 / +5.2% 461207066 / 453305425 / +1.7% 0.64 / 0.62 / +3.4%
tpch_q21/datafusion:vortex-file-compressed 494508082 / 512878513 / -3.6% 711948109 / 648819166 / +9.7% 0.69 / 0.79 / -12.1%
tpch_q22/datafusion:vortex-file-compressed 187091633 / 194993849 / -4.1% 370456904 / 348036707 / +6.4% 0.51 / 0.56 / -9.9%
datafusion / parquet / ns (1.040x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 237649173 / 205898817 / +15.4% 634370768 / 646103599 / -1.8% 0.37 / 0.32 / +17.6%
tpch_q02/datafusion:parquet 284239826 / 282853925 / +0.5% 540660156 / 537332567 / +0.6% 0.53 / 0.53 / -0.1%
tpch_q03/datafusion:parquet 292833203 / 293330577 / -0.2% 966683312 / 852280261 / +13.4% 0.30 / 0.34 / -12.0%
tpch_q04/datafusion:parquet 159030769 / 171656109 / -7.4% 455863291 / 412585192 / +10.5% 0.35 / 0.42 / -16.2%
tpch_q05/datafusion:parquet 369296263 / 361991491 / +2.0% 550981078 / 539978581 / +2.0% 0.67 / 0.67 / -0.0%
tpch_q06/datafusion:parquet 137946744 / 138822532 / -0.6% 274790682 / 275433905 / -0.2% 0.50 / 0.50 / -0.4%
tpch_q07/datafusion:parquet 376624672 / 369411228 / +2.0% 508296885 / 527483829 / -3.6% 0.74 / 0.70 / +5.8%
tpch_q08/datafusion:parquet 453153698 / 443825924 / +2.1% 560560465 / 563545750 / -0.5% 0.81 / 0.79 / +2.6%
tpch_q09/datafusion:parquet 448121151 / 469675323 / -4.6% 714522213 / 632977577 / +12.9% 0.63 / 0.74 / -15.5%
tpch_q10/datafusion:parquet 402153606 / 405166674 / -0.7% 535059042 / 551253761 / -2.9% 0.75 / 0.73 / +2.3%
tpch_q11/datafusion:parquet 282850676 / 275455384 / +2.7% 472211369 / 535639673 / -11.8% 0.60 / 0.51 / +16.5%
tpch_q12/datafusion:parquet 225807728 / 207812527 / +8.7% 448077830 / 440322114 / +1.8% 0.50 / 0.47 / +6.8%
tpch_q13/datafusion:parquet 446493923 / 445607244 / +0.2% 656758725 / 669286559 / -1.9% 0.68 / 0.67 / +2.1%
tpch_q14/datafusion:parquet 247345511 / 175157586 / +41.2% 🔴 402713906 / 341508499 / +17.9% 0.61 / 0.51 / +19.8%
tpch_q15/datafusion:parquet 297113658 / 281965689 / +5.4% 504198998 / 478187025 / +5.4% 0.59 / 0.59 / -0.1%
tpch_q16/datafusion:parquet 137955621 / 124100446 / +11.2% 306718347 / 415108722 / -26.1% 0.45 / 0.30 / +50.4%
tpch_q17/datafusion:parquet 333689835 / 330842289 / +0.9% 545884752 / 520449671 / +4.9% 0.61 / 0.64 / -3.8%
tpch_q18/datafusion:parquet 458511031 / 464170174 / -1.2% 829724689 / 589120580 / +40.8% 🔴 0.55 / 0.79 / -29.9%
tpch_q19/datafusion:parquet 191349157 / 187959784 / +1.8% 390964788 / 333252021 / +17.3% 0.49 / 0.56 / -13.2%
tpch_q20/datafusion:parquet 289597102 / 254814621 / +13.7% 569966468 / 456880072 / +24.8% 0.51 / 0.56 / -8.9%
tpch_q21/datafusion:parquet 333151569 / 397332153 / -16.2% 505961946 / 563691228 / -10.2% 0.66 / 0.70 / -6.6%
tpch_q22/datafusion:parquet 209543845 / 168997740 / +24.0% 447995745 / 366321613 / +22.3% 0.47 / 0.46 / +1.4%
duckdb / vortex-file-compressed / ns (1.065x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 212979735 / 208133835 / +2.3% 273352981 / 293126711 / -6.7% 0.78 / 0.71 / +9.7%
tpch_q02/duckdb:vortex-file-compressed 396621990 / 391373890 / +1.3% 403402756 / 484439210 / -16.7% 0.98 / 0.81 / +21.7%
tpch_q03/duckdb:vortex-file-compressed 458811256 / 406897901 / +12.8% 510732257 / 497090619 / +2.7% 0.90 / 0.82 / +9.7%
tpch_q04/duckdb:vortex-file-compressed 333006817 / 463270156 / -28.1% 342103713 / 364763258 / -6.2% 0.97 / 1.27 / -23.4%
tpch_q05/duckdb:vortex-file-compressed 480072223 / 371948538 / +29.1% 486514493 / 495939523 / -1.9% 0.99 / 0.75 / +31.6%
tpch_q06/duckdb:vortex-file-compressed 266008802 / 265879994 / +0.0% 315792953 / 287611514 / +9.8% 0.84 / 0.92 / -8.9%
tpch_q07/duckdb:vortex-file-compressed 442008661 / 458419772 / -3.6% 520180393 / 506793058 / +2.6% 0.85 / 0.90 / -6.1%
tpch_q08/duckdb:vortex-file-compressed 564462471 / 564681865 / -0.0% 627945008 / 661103027 / -5.0% 0.90 / 0.85 / +5.2%
tpch_q09/duckdb:vortex-file-compressed 485789478 / 454743107 / +6.8% 502272267 / 526870622 / -4.7% 0.97 / 0.86 / +12.1%
tpch_q10/duckdb:vortex-file-compressed 442617558 / 420597622 / +5.2% 557192606 / 476221569 / +17.0% 0.79 / 0.88 / -10.1%
tpch_q11/duckdb:vortex-file-compressed 150001713 / 176277626 / -14.9% 227393762 / 163914174 / +38.7% 🔴 0.66 / 1.08 / -38.7%
tpch_q12/duckdb:vortex-file-compressed 432554847 / 426923592 / +1.3% 694059805 / 536287089 / +29.4% 0.62 / 0.80 / -21.7%
tpch_q13/duckdb:vortex-file-compressed 435536491 / 329296750 / +32.3% 🔴 474814790 / 398085555 / +19.3% 0.92 / 0.83 / +10.9%
tpch_q14/duckdb:vortex-file-compressed 244447690 / 233934470 / +4.5% 364122858 / 347209186 / +4.9% 0.67 / 0.67 / -0.4%
tpch_q15/duckdb:vortex-file-compressed 167231792 / 142936837 / +17.0% 308862715 / 238202415 / +29.7% 0.54 / 0.60 / -9.8%
tpch_q16/duckdb:vortex-file-compressed 210946037 / 202222454 / +4.3% 237327923 / 209622993 / +13.2% 0.89 / 0.96 / -7.9%
tpch_q17/duckdb:vortex-file-compressed 466148673 / 404110595 / +15.4% 489753076 / 530153213 / -7.6% 0.95 / 0.76 / +24.9%
tpch_q18/duckdb:vortex-file-compressed 348372258 / 303861491 / +14.6% 415283349 / 346233651 / +19.9% 0.84 / 0.88 / -4.4%
tpch_q19/duckdb:vortex-file-compressed 348249136 / 327984244 / +6.2% 447373536 / 378584892 / +18.2% 0.78 / 0.87 / -10.1%
tpch_q20/duckdb:vortex-file-compressed 477291971 / 372757340 / +28.0% 412283795 / 480910945 / -14.3% 1.16 / 0.78 / +49.4%
tpch_q21/duckdb:vortex-file-compressed 802094538 / 584054583 / +37.3% 🔴 725241654 / 660623077 / +9.8% 1.11 / 0.88 / +25.1%
tpch_q22/duckdb:vortex-file-compressed 119204297 / 125982740 / -5.4% 199576859 / 188010627 / +6.2% 0.60 / 0.67 / -10.9%
duckdb / parquet / ns (1.051x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 349299870 / 340949712 / +2.4% 333482398 / 334700785 / -0.4% 1.05 / 1.02 / +2.8%
tpch_q02/duckdb:parquet 757079617 / 714756342 / +5.9% 764511119 / 767188849 / -0.3% 0.99 / 0.93 / +6.3%
tpch_q03/duckdb:parquet 842173023 / 813262435 / +3.6% 970158390 / 954781716 / +1.6% 0.87 / 0.85 / +1.9%
tpch_q04/duckdb:parquet 532490119 / 528280239 / +0.8% 515038483 / 553532611 / -7.0% 1.03 / 0.95 / +8.3%
tpch_q05/duckdb:parquet 1033069261 / 969703624 / +6.5% 1308360333 / 1066702065 / +22.7% 0.79 / 0.91 / -13.1%
tpch_q06/duckdb:parquet 323856247 / 313180332 / +3.4% 429903765 / 296639409 / +44.9% 🔴 0.75 / 1.06 / -28.6%
tpch_q07/duckdb:parquet 976598671 / 927423230 / +5.3% 973012885 / 873884884 / +11.3% 1.00 / 1.06 / -5.4%
tpch_q08/duckdb:parquet 1272535292 / 1127963414 / +12.8% 1155961577 / 1135813846 / +1.8% 1.10 / 0.99 / +10.9%
tpch_q09/duckdb:parquet 1140907350 / 1088828519 / +4.8% 1124476532 / 1176654847 / -4.4% 1.01 / 0.93 / +9.6%
tpch_q10/duckdb:parquet 1102354904 / 1066689465 / +3.3% 1123209453 / 1074222403 / +4.6% 0.98 / 0.99 / -1.2%
tpch_q11/duckdb:parquet 488873608 / 462789060 / +5.6% 503327016 / 510480498 / -1.4% 0.97 / 0.91 / +7.1%
tpch_q12/duckdb:parquet 740679832 / 560289467 / +32.2% 🔴 709001863 / 638222035 / +11.1% 1.04 / 0.88 / +19.0%
tpch_q13/duckdb:parquet 883015322 / 838453979 / +5.3% 923919869 / 1098398679 / -15.9% 0.96 / 0.76 / +25.2%
tpch_q14/duckdb:parquet 557266366 / 519703650 / +7.2% 625856051 / 540495479 / +15.8% 0.89 / 0.96 / -7.4%
tpch_q15/duckdb:parquet 428942309 / 393655149 / +9.0% 406128417 / 372303149 / +9.1% 1.06 / 1.06 / -0.1%
tpch_q16/duckdb:parquet 560013480 / 560244357 / -0.0% 544743753 / 534242958 / +2.0% 1.03 / 1.05 / -2.0%
tpch_q17/duckdb:parquet 519515784 / 528049357 / -1.6% 551723501 / 543664026 / +1.5% 0.94 / 0.97 / -3.1%
tpch_q18/duckdb:parquet 715889827 / 746403258 / -4.1% 852830018 / 767731037 / +11.1% 0.84 / 0.97 / -13.7%
tpch_q19/duckdb:parquet 643119576 / 610230330 / +5.4% 649038394 / 735907907 / -11.8% 0.99 / 0.83 / +19.5%
tpch_q20/duckdb:parquet 936614825 / 873190017 / +7.3% 1775448194 / 993485811 / +78.7% 🔴 0.53 / 0.88 / -40.0%
tpch_q21/duckdb:parquet 766088063 / 754767020 / +1.5% 794687824 / 818053707 / -2.9% 0.96 / 0.92 / +4.5%
tpch_q22/duckdb:parquet 450994156 / 451272775 / -0.1% 711126286 / 483399991 / +47.1% 🔴 0.63 / 0.93 / -32.1%

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc requested a review from robert3005 September 3, 2026 09:21
Comment thread vortex-duckdb/src/file_reader.rs Outdated
@myrrc

myrrc commented Sep 3, 2026

Copy link
Copy Markdown
Contributor Author

We've also talked with @joseph-isaacs about using expiring the footer if file's mtime changed. This is what duckdb does, but this logic is invisible to the consumer and isn't propagated to MultiFileReader. We can wire it up later.

@joseph-isaacs joseph-isaacs added the action/bench-string Run only the string encoding benchmark on this PR label Sep 3, 2026
@github-actions github-actions Bot removed the action/bench-string Run only the string encoding benchmark on this PR label Sep 3, 2026
@github-actions

github-actions Bot commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 981163b1 vs base b4863a1d


vortex / vortex-file-compressed / ms (1.041x ➖, 0↑ 2↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 53.119844 / 53.693973 / -1.1%
read/clickbench/URL/shard-0/onpair-12 37.78472 / 38.240862 / -1.2%
read/tpch/l_comment/fsst 111.38203 / 112.421305 / -0.9%
read/tpch/l_comment/onpair-12 109.267909 / 111.205789 / -1.7%
write/clickbench/URL/shard-0/fsst 884.570942 / 889.357007 / -0.5%
write/clickbench/URL/shard-0/onpair-12 2555.68068 / 2059.39962 / +24.1% 🔴
write/tpch/l_comment/fsst 3170.31823 / 3205.7001 / -1.1%
write/tpch/l_comment/onpair-12 4857.53075 / 4107.01375 / +18.3% 🔴
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 46.3396054 / 46.3396054 / +0.0%
size/clickbench/URL/shard-0/onpair-12 29.7416746 / 29.7416746 / +0.0%
size/tpch/l_comment/fsst 26.8917553 / 26.8917553 / +0.0%
size/tpch/l_comment/onpair-12 22.6667744 / 22.6667744 / +0.0%

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc changed the title duckdb: fast footer key duckdb: user file path as footer cache Sep 3, 2026
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc requested review from joseph-isaacs and removed request for joseph-isaacs September 3, 2026 14:47
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants