Skip to content

Convert trivial filters into slices during reduction, MaskValues::last uses BitBuffer::last_set_index - #9831

Open
robert3005 wants to merge 1 commit into
developfrom
rk/trivialfilter
Open

Convert trivial filters into slices during reduction, MaskValues::last uses BitBuffer::last_set_index#9831
robert3005 wants to merge 1 commit into
developfrom
rk/trivialfilter

Conversation

@robert3005

Copy link
Copy Markdown
Contributor

Optimise more filters away

@robert3005 robert3005 added the changelog/performance A performance improvement label Sep 10, 2026
@robert3005
robert3005 enabled auto-merge (squash) September 10, 2026 15:53
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 10, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 10, 2026
@codspeed-hq

codspeed-hq Bot commented Sep 10, 2026

Copy link
Copy Markdown

Merging this PR will regress 15 benchmarks

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 21 improved benchmarks
❌ 15 regressed benchmarks
✅ 2161 untouched benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 12.3 µs 20.4 µs -39.88%
Simulation random_i8[0.5] 67.8 µs 93.1 µs -27.14%
Simulation take_filter_primitive_nullable_slice_mask_random_indices[4096, 1000] 99.9 µs 130.9 µs -23.68%
Simulation take_filter_primitive_nullable_slice_mask_random_indices[16384, 1000] 118.4 µs 151.1 µs -21.6%
Simulation filter_list_primitive_short[Sparse] 132.6 µs 168.3 µs -21.18%
Simulation filter_list_primitive_wide[Sparse] 133.5 µs 168.9 µs -20.94%
Simulation filter_list_primitive_short[Clustered] 134.2 µs 168.4 µs -20.3%
Simulation filter_list_primitive_short[Prefix] 137.8 µs 169.6 µs -18.74%
Simulation filter_list_primitive_wide[Clustered] 137.9 µs 169.2 µs -18.52%
Simulation filter_list_primitive_wide[Prefix] 138.2 µs 169 µs -18.22%
Simulation filter_powerlaw_by_random[10000] 32.3 µs 37.9 µs -14.83%
Simulation take_filter_primitive_slice_mask_sequential_indices[16384, 1000] 52.8 µs 61 µs -13.48%
WallTime dict_canonicalize_gt_u8_neon[1000000] 486.9 µs 560 µs -13.05%
WallTime words_gather_scalar_avx2[65536] 8.2 µs 9.4 µs -12.24%
WallTime dict_canonicalize_gt_u8_neon[16000000] 8.4 ms 9.3 ms -10.07%
Simulation density_sweep_single_slice[0.9999] 84.2 µs 27.3 µs ×3.1
Simulation density_sweep_single_slice[0.999] 84 µs 27.3 µs ×3.1
Simulation density_sweep_single_slice[0.99] 83.7 µs 27.3 µs ×3.1
Simulation density_sweep_single_slice[0.95] 82.2 µs 27.3 µs ×3
Simulation density_sweep_single_slice[0.9] 80.4 µs 27.3 µs ×2.9
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing rk/trivialfilter (d997574) with develop (8e2aa05)

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 548ac37 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 548ac37 fineweb 1 Explore Profiling Data
🟢 Done 548ac37 statpopgen 1 Explore Profiling Data
🟢 Done 548ac37 tpcds-nvme 1 Explore Profiling Data
🟢 Done 548ac37 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 548ac37 tpch-nvme 1 Explore Profiling Data
🟢 Done 548ac37 fineweb-s3 1 Explore Profiling Data
🟢 Done 548ac37 clickbench-nvme 1 Explore Profiling Data
🟢 Done 548ac37 polarsignals 1 Explore Profiling Data
🟢 Done 548ac37 tpch-s3 1 Explore Profiling Data
Previous Runs (10)
Status Commit Job Attempt Link
🟢 Done cb291ec clickbench-nvme 1 Explore Profiling Data
🟢 Done cb291ec statpopgen 1 Explore Profiling Data
🟢 Done cb291ec clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done cb291ec tpch-nvme-10 1 Explore Profiling Data
🟢 Done cb291ec fineweb-s3 1 Explore Profiling Data
🟢 Done cb291ec fineweb 1 Explore Profiling Data
🟢 Done cb291ec tpcds-nvme 1 Explore Profiling Data
🟢 Done cb291ec polarsignals 1 Explore Profiling Data
🟢 Done cb291ec tpch-s3 1 Explore Profiling Data
🟢 Done cb291ec tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 548ac378 vs base d6037bc2
Vortex (geomean): hot 1.016x ➖ · cold 0.992x ➖


datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45215572 / 45207531 / +0.0% 96311186 / 100423818 / -4.1% 0.47 / 0.45 / +4.3%
polarsignals_q01/datafusion:vortex-file-compressed 51329155 / 51548402 / -0.4% 121571130 / 126772034 / -4.1% 0.42 / 0.41 / +3.8%
polarsignals_q02/datafusion:vortex-file-compressed 44026208 / 35555650 / +23.8% 🔴 93398866 / 93231970 / +0.2% 0.47 / 0.38 / +23.6%
polarsignals_q03/datafusion:vortex-file-compressed 53454594 / 53810724 / -0.7% 126764537 / 124982753 / +1.4% 0.42 / 0.43 / -2.1%
polarsignals_q04/datafusion:vortex-file-compressed 9482555 / 9487734 / -0.1% 56863505 / 56409474 / +0.8% 0.17 / 0.17 / -0.9%
polarsignals_q05/datafusion:vortex-file-compressed 11426985 / 11400775 / +0.2% 60564305 / 60489634 / +0.1% 0.19 / 0.19 / +0.1%
polarsignals_q06/datafusion:vortex-file-compressed 20898650 / 20963290 / -0.3% 68495189 / 70100996 / -2.3% 0.31 / 0.30 / +2.0%
polarsignals_q07/datafusion:vortex-file-compressed 10776804 / 11389236 / -5.4% 60755307 / 60009510 / +1.2% 0.18 / 0.19 / -6.5%
polarsignals_q08/datafusion:vortex-file-compressed 100669921 / 100751864 / -0.1% 171379844 / 174097497 / -1.6% 0.59 / 0.58 / +1.5%
polarsignals_q09/datafusion:vortex-file-compressed 10038516 / 9901679 / +1.4% 56669664 / 56250509 / +0.7% 0.18 / 0.18 / +0.6%

File Size Changes (1 files changed, +8.6% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 631.61 MB 685.88 MB +54.27 MB +8.6%

Totals:

  • vortex-file-compressed: 631.61 MB → 685.88 MB (+8.6%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 548ac378 vs base 272bf1db
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.972x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.987x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16471318 / 16860656 / -2.3% 43567719 / 43572654 / -0.0% 0.38 / 0.39 / -2.3%
tpch_q02/datafusion:vortex-file-compressed 17452587 / 17437527 / +0.1% 35348591 / 36337547 / -2.7% 0.49 / 0.48 / +2.9%
tpch_q03/datafusion:vortex-file-compressed 19773292 / 19620657 / +0.8% 47012477 / 47433162 / -0.9% 0.42 / 0.41 / +1.7%
tpch_q04/datafusion:vortex-file-compressed 9995866 / 10339704 / -3.3% 30572632 / 31890373 / -4.1% 0.33 / 0.32 / +0.8%
tpch_q05/datafusion:vortex-file-compressed 36975646 / 37187310 / -0.6% 62878169 / 62670467 / +0.3% 0.59 / 0.59 / -0.9%
tpch_q06/datafusion:vortex-file-compressed 6290605 / 6297728 / -0.1% 28065653 / 30638850 / -8.4% 0.22 / 0.21 / +9.0%
tpch_q07/datafusion:vortex-file-compressed 51658624 / 52597778 / -1.8% 81093073 / 80591858 / +0.6% 0.64 / 0.65 / -2.4%
tpch_q08/datafusion:vortex-file-compressed 51881412 / 51294740 / +1.1% 80281122 / 79967416 / +0.4% 0.65 / 0.64 / +0.7%
tpch_q09/datafusion:vortex-file-compressed 49136460 / 49191428 / -0.1% 78437471 / 76717276 / +2.2% 0.63 / 0.64 / -2.3%
tpch_q10/datafusion:vortex-file-compressed 16955064 / 17315840 / -2.1% 47338269 / 47709106 / -0.8% 0.36 / 0.36 / -1.3%
tpch_q11/datafusion:vortex-file-compressed 14981570 / 15045706 / -0.4% 31286767 / 33527332 / -6.7% 0.48 / 0.45 / +6.7%
tpch_q12/datafusion:vortex-file-compressed 22676173 / 22866873 / -0.8% 44412246 / 47773608 / -7.0% 0.51 / 0.48 / +6.7%
tpch_q13/datafusion:vortex-file-compressed 20344641 / 20158292 / +0.9% 36655215 / 40573230 / -9.7% 0.56 / 0.50 / +11.7%
tpch_q14/datafusion:vortex-file-compressed 14777562 / 14860873 / -0.6% 39525799 / 40499388 / -2.4% 0.37 / 0.37 / +1.9%
tpch_q15/datafusion:vortex-file-compressed 18758077 / 18769806 / -0.1% 44469635 / 46138756 / -3.6% 0.42 / 0.41 / +3.7%
tpch_q16/datafusion:vortex-file-compressed 18565603 / 18796488 / -1.2% 36181842 / 38859415 / -6.9% 0.51 / 0.48 / +6.1%
tpch_q17/datafusion:vortex-file-compressed 28101357 / 28207139 / -0.4% 56616069 / 58978444 / -4.0% 0.50 / 0.48 / +3.8%
tpch_q18/datafusion:vortex-file-compressed 36635771 / 37252438 / -1.7% 57877531 / 58897668 / -1.7% 0.63 / 0.63 / +0.1%
tpch_q19/datafusion:vortex-file-compressed 13897227 / 14081843 / -1.3% 37333775 / 39592613 / -5.7% 0.37 / 0.36 / +4.7%
tpch_q20/datafusion:vortex-file-compressed 20763624 / 20813992 / -0.2% 43970300 / 45269850 / -2.9% 0.47 / 0.46 / +2.7%
tpch_q21/datafusion:vortex-file-compressed 39992616 / 39201752 / +2.0% 66314891 / 63564533 / +4.3% 0.60 / 0.62 / -2.2%
tpch_q22/datafusion:vortex-file-compressed 11194909 / 11418208 / -2.0% 31257583 / 31304905 / -0.2% 0.36 / 0.36 / -1.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 66930337 / 66808954 / +0.2% 84239558 / 87053129 / -3.2% 0.79 / 0.77 / +3.5%
tpch_q02/datafusion:parquet 53329938 / 52420359 / +1.7% 71615918 / 70688470 / +1.3% 0.74 / 0.74 / +0.4%
tpch_q03/datafusion:parquet 72369835 / 72321843 / +0.1% 94542691 / 98560433 / -4.1% 0.77 / 0.73 / +4.3%
tpch_q04/datafusion:parquet 39977506 / 39374446 / +1.5% 58098078 / 64261741 / -9.6% 0.69 / 0.61 / +12.3%
tpch_q05/datafusion:parquet 87543749 / 88206490 / -0.8% 115309251 / 120480185 / -4.3% 0.76 / 0.73 / +3.7%
tpch_q06/datafusion:parquet 27804617 / 28008316 / -0.7% 46811617 / 49212978 / -4.9% 0.59 / 0.57 / +4.4%
tpch_q07/datafusion:parquet 93563109 / 96535541 / -3.1% 120689168 / 121917040 / -1.0% 0.78 / 0.79 / -2.1%
tpch_q08/datafusion:parquet 95895204 / 93957474 / +2.1% 122292777 / 121962386 / +0.3% 0.78 / 0.77 / +1.8%
tpch_q09/datafusion:parquet 112796112 / 113441180 / -0.6% 142471988 / 145047089 / -1.8% 0.79 / 0.78 / +1.2%
tpch_q10/datafusion:parquet 79224226 / 79259032 / -0.0% 108999005 / 113335116 / -3.8% 0.73 / 0.70 / +3.9%
tpch_q11/datafusion:parquet 39076329 / 38042254 / +2.7% 60336432 / 62238696 / -3.1% 0.65 / 0.61 / +6.0%
tpch_q12/datafusion:parquet 61897260 / 62652958 / -1.2% 85129100 / 88203617 / -3.5% 0.73 / 0.71 / +2.4%
tpch_q13/datafusion:parquet 159639990 / 159381095 / +0.2% 179376524 / 182228281 / -1.6% 0.89 / 0.87 / +1.8%
tpch_q14/datafusion:parquet 39730120 / 39366131 / +0.9% 63753710 / 67616824 / -5.7% 0.62 / 0.58 / +7.0%
tpch_q15/datafusion:parquet 46425326 / 46801081 / -0.8% 67781347 / 72450390 / -6.4% 0.68 / 0.65 / +6.0%
tpch_q16/datafusion:parquet 38386541 / 38476892 / -0.2% 59118560 / 54459247 / +8.6% 0.65 / 0.71 / -8.1%
tpch_q17/datafusion:parquet 115983801 / 116553896 / -0.5% 139785688 / 140762871 / -0.7% 0.83 / 0.83 / +0.2%
tpch_q18/datafusion:parquet 114167194 / 114538070 / -0.3% 135905022 / 137054740 / -0.8% 0.84 / 0.84 / +0.5%
tpch_q19/datafusion:parquet 50313182 / 49559686 / +1.5% 74893835 / 77925174 / -3.9% 0.67 / 0.64 / +5.6%
tpch_q20/datafusion:parquet 58406243 / 58110173 / +0.5% 85597548 / 82131388 / +4.2% 0.68 / 0.71 / -3.6%
tpch_q21/datafusion:parquet 97768656 / 98146342 / -0.4% 120722952 / 123216373 / -2.0% 0.81 / 0.80 / +1.7%
tpch_q22/datafusion:parquet 41540535 / 42291027 / -1.8% 60192414 / 59726402 / +0.8% 0.69 / 0.71 / -2.5%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10079883 / 9805848 / +2.8% 21149393 / 21861123 / -3.3% 0.48 / 0.45 / +6.3%
tpch_q02/duckdb:vortex-file-compressed 17370432 / 17664460 / -1.7% 24394914 / 26165801 / -6.8% 0.71 / 0.68 / +5.5%
tpch_q03/duckdb:vortex-file-compressed 17767291 / 18603624 / -4.5% 32074847 / 36170301 / -11.3% 🟢 0.55 / 0.51 / +7.7%
tpch_q04/duckdb:vortex-file-compressed 17050333 / 16810856 / +1.4% 29728541 / 28524539 / +4.2% 0.57 / 0.59 / -2.7%
tpch_q05/duckdb:vortex-file-compressed 22193610 / 22021566 / +0.8% 36141142 / 35502861 / +1.8% 0.61 / 0.62 / -1.0%
tpch_q06/duckdb:vortex-file-compressed 6126332 / 5542479 / +10.5% 🔴 13062628 / 15071151 / -13.3% 🟢 0.47 / 0.37 / +27.5%
tpch_q07/duckdb:vortex-file-compressed 20654374 / 20652119 / +0.0% 36573484 / 38595015 / -5.2% 0.56 / 0.54 / +5.5%
tpch_q08/duckdb:vortex-file-compressed 23452227 / 24392162 / -3.9% 38896058 / 45020182 / -13.6% 🟢 0.60 / 0.54 / +11.3%
tpch_q09/duckdb:vortex-file-compressed 28936076 / 29346148 / -1.4% 48563643 / 49995611 / -2.9% 0.60 / 0.59 / +1.5%
tpch_q10/duckdb:vortex-file-compressed 29044703 / 28989839 / +0.2% 46868110 / 43912347 / +6.7% 0.62 / 0.66 / -6.1%
tpch_q11/duckdb:vortex-file-compressed 8289827 / 8148216 / +1.7% 15287584 / 15252694 / +0.2% 0.54 / 0.53 / +1.5%
tpch_q12/duckdb:vortex-file-compressed 15605873 / 15621200 / -0.1% 28974772 / 26459964 / +9.5% 0.54 / 0.59 / -8.8%
tpch_q13/duckdb:vortex-file-compressed 22244626 / 22317276 / -0.3% 40003856 / 42670335 / -6.2% 0.56 / 0.52 / +6.3%
tpch_q14/duckdb:vortex-file-compressed 13882807 / 13343710 / +4.0% 22562647 / 27373983 / -17.6% 🟢 0.62 / 0.49 / +26.2%
tpch_q15/duckdb:vortex-file-compressed 10420708 / 9898349 / +5.3% 19014202 / 19062227 / -0.3% 0.55 / 0.52 / +5.5%
tpch_q16/duckdb:vortex-file-compressed 18533181 / 18428771 / +0.6% 24396256 / 24294862 / +0.4% 0.76 / 0.76 / +0.1%
tpch_q17/duckdb:vortex-file-compressed 16610494 / 14994274 / +10.8% 🔴 32645865 / 28749039 / +13.6% 🔴 0.51 / 0.52 / -2.4%
tpch_q18/duckdb:vortex-file-compressed 25459329 / 24720504 / +3.0% 36887906 / 37788654 / -2.4% 0.69 / 0.65 / +5.5%
tpch_q19/duckdb:vortex-file-compressed 23370809 / 23226344 / +0.6% 34717370 / 35807836 / -3.0% 0.67 / 0.65 / +3.8%
tpch_q20/duckdb:vortex-file-compressed 17840285 / 17739473 / +0.6% 32272235 / 35229020 / -8.4% 0.55 / 0.50 / +9.8%
tpch_q21/duckdb:vortex-file-compressed 65918061 / 65791775 / +0.2% 83818048 / 80736502 / +3.8% 0.79 / 0.81 / -3.5%
tpch_q22/duckdb:vortex-file-compressed 11896043 / 12005142 / -0.9% 22144611 / 22511231 / -1.6% 0.54 / 0.53 / +0.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60307064 / 60108414 / +0.3% 67035804 / 65814822 / +1.9% 0.90 / 0.91 / -1.5%
tpch_q02/duckdb:parquet 34542269 / 34696714 / -0.4% 43480041 / 42421886 / +2.5% 0.79 / 0.82 / -2.9%
tpch_q03/duckdb:parquet 61932372 / 62049950 / -0.2% 72772050 / 73328940 / -0.8% 0.85 / 0.85 / +0.6%
tpch_q04/duckdb:parquet 45246061 / 46204000 / -2.1% 52501247 / 55301833 / -5.1% 0.86 / 0.84 / +3.2%
tpch_q05/duckdb:parquet 60623241 / 60592440 / +0.1% 72310459 / 72689585 / -0.5% 0.84 / 0.83 / +0.6%
tpch_q06/duckdb:parquet 20005095 / 20191194 / -0.9% 24182588 / 24377202 / -0.8% 0.83 / 0.83 / -0.1%
tpch_q07/duckdb:parquet 60608564 / 60538837 / +0.1% 70805401 / 71882419 / -1.5% 0.86 / 0.84 / +1.6%
tpch_q08/duckdb:parquet 73068643 / 73338055 / -0.4% 85998914 / 86808909 / -0.9% 0.85 / 0.84 / +0.6%
tpch_q09/duckdb:parquet 113943458 / 113661301 / +0.2% 126947260 / 127480238 / -0.4% 0.90 / 0.89 / +0.7%
tpch_q10/duckdb:parquet 108013000 / 108503387 / -0.5% 122551234 / 122971491 / -0.3% 0.88 / 0.88 / -0.1%
tpch_q11/duckdb:parquet 19876416 / 20020727 / -0.7% 23842077 / 23758128 / +0.4% 0.83 / 0.84 / -1.1%
tpch_q12/duckdb:parquet 41231029 / 41240995 / -0.0% 48765120 / 49199000 / -0.9% 0.85 / 0.84 / +0.9%
tpch_q13/duckdb:parquet 238532189 / 238565420 / -0.0% 247032218 / 247985309 / -0.4% 0.97 / 0.96 / +0.4%
tpch_q14/duckdb:parquet 43644186 / 43448727 / +0.4% 52018764 / 51506055 / +1.0% 0.84 / 0.84 / -0.5%
tpch_q15/duckdb:parquet 27387341 / 25080290 / +9.2% 31142635 / 31403140 / -0.8% 0.88 / 0.80 / +10.1%
tpch_q16/duckdb:parquet 49753932 / 49840092 / -0.2% 57764704 / 56707948 / +1.9% 0.86 / 0.88 / -2.0%
tpch_q17/duckdb:parquet 44366852 / 44471719 / -0.2% 53644210 / 54061364 / -0.8% 0.83 / 0.82 / +0.5%
tpch_q18/duckdb:parquet 89588222 / 89332602 / +0.3% 98832990 / 101556702 / -2.7% 0.91 / 0.88 / +3.0%
tpch_q19/duckdb:parquet 61125118 / 61077673 / +0.1% 70338400 / 70277128 / +0.1% 0.87 / 0.87 / -0.0%
tpch_q20/duckdb:parquet 58663117 / 58647374 / +0.0% 70853645 / 70790899 / +0.1% 0.83 / 0.83 / -0.1%
tpch_q21/duckdb:parquet 136740795 / 136487781 / +0.2% 147879008 / 148032968 / -0.1% 0.92 / 0.92 / +0.3%
tpch_q22/duckdb:parquet 50467479 / 50336807 / +0.3% 57946091 / 57795576 / +0.3% 0.87 / 0.87 / -0.0%

File Size Changes (8 files changed, +16.7% overall, 6↑ 2↓)
File Scale Format Base HEAD Change %
partsupp.vortex 1.0 vortex-file-compressed 23.60 MB 35.84 MB +12.25 MB +51.9%
customer.vortex 1.0 vortex-file-compressed 8.35 MB 10.51 MB +2.16 MB +25.9%
supplier.vortex 1.0 vortex-file-compressed 580.38 KB 706.16 KB +125.79 KB +21.7%
orders.vortex 1.0 vortex-file-compressed 35.95 MB 43.45 MB +7.50 MB +20.9%
part.vortex 1.0 vortex-file-compressed 4.87 MB 5.45 MB +590.03 KB +11.8%
lineitem.vortex 1.0 vortex-file-compressed 155.89 MB 171.53 MB +15.64 MB +10.0%
nation.vortex 1.0 vortex-file-compressed 10.76 KB 10.54 KB 224 B -2.0%
region.vortex 1.0 vortex-file-compressed 6.73 KB 6.52 KB 224 B -3.2%

Totals:

  • vortex-file-compressed: 229.50 MB → 267.74 MB (+16.7%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 548ac378 vs base d6037bc2
Verdict: No clear signal (medium confidence)
Attributed Vortex impact: -6.6%
Engines: DataFusion No clear signal (-2.4%, low confidence) · DuckDB No clear signal (-10.5%, medium confidence)
Vortex (geomean): hot 0.955x ➖ · cold 1.177x ❌
Parquet (geomean): hot 1.022x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +2.2% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7079124 / 7026196 / +0.8% 20934519 / 20660787 / +1.3% 0.34 / 0.34 / -0.6%
fineweb_q01/datafusion:vortex-file-compressed 10201530 / 13782804 / -26.0% 🟢 51364872 / 47283648 / +8.6% 0.20 / 0.29 / -31.9%
fineweb_q02/datafusion:vortex-file-compressed 10801296 / 13491562 / -19.9% 🟢 54268298 / 48550488 / +11.8% 🔴 0.20 / 0.28 / -28.4%
fineweb_q03/datafusion:vortex-file-compressed 20430156 / 20674226 / -1.2% 123596749 / 104581605 / +18.2% 🔴 0.17 / 0.20 / -16.4%
fineweb_q04/datafusion:vortex-file-compressed 89572230 / 78354000 / +14.3% 🔴 174703425 / 162836892 / +7.3% 0.51 / 0.48 / +6.6%
fineweb_q05/datafusion:vortex-file-compressed 87196491 / 60967234 / +43.0% 🔴 168416493 / 141734474 / +18.8% 🔴 0.52 / 0.43 / +20.4%
fineweb_q06/datafusion:vortex-file-compressed 19989625 / 19554022 / +2.2% 133664448 / 107046710 / +24.9% 🔴 0.15 / 0.18 / -18.1%
fineweb_q07/datafusion:vortex-file-compressed 18407295 / 18664849 / -1.4% 125097820 / 101030981 / +23.8% 🔴 0.15 / 0.18 / -20.4%
fineweb_q08/datafusion:vortex-file-compressed 10245916 / 11545579 / -11.3% 🟢 59426041 / 40657636 / +46.2% 🔴 0.17 / 0.28 / -39.3%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9494766 / 9650254 / -1.6% 34852054 / 34142570 / +2.1% 0.27 / 0.28 / -3.6%
fineweb_q01/datafusion:parquet 76032182 / 75321674 / +0.9% 151576458 / 145708321 / +4.0% 0.50 / 0.52 / -3.0%
fineweb_q02/datafusion:parquet 74697722 / 74237256 / +0.6% 157285132 / 147886243 / +6.4% 0.47 / 0.50 / -5.4%
fineweb_q03/datafusion:parquet 74352247 / 73450124 / +1.2% 145161344 / 147128566 / -1.3% 0.51 / 0.50 / +2.6%
fineweb_q04/datafusion:parquet 83051923 / 81649730 / +1.7% 153331223 / 147113043 / +4.2% 0.54 / 0.56 / -2.4%
fineweb_q05/datafusion:parquet 81271709 / 82126242 / -1.0% 156093774 / 148163666 / +5.4% 0.52 / 0.55 / -6.1%
fineweb_q06/datafusion:parquet 76634307 / 73960496 / +3.6% 152358132 / 143967166 / +5.8% 0.50 / 0.51 / -2.1%
fineweb_q07/datafusion:parquet 74514848 / 73724456 / +1.1% 154451414 / 146345160 / +5.5% 0.48 / 0.50 / -4.2%
fineweb_q08/datafusion:parquet 73597096 / 72790050 / +1.1% 153797157 / 144102480 / +6.7% 0.48 / 0.51 / -5.3%
duckdb / vortex-file-compressed / ns (0.926x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1948220 / 4038426 / -51.8% 🟢 5034911 / 4960106 / +1.5% 0.39 / 0.81 / -52.5%
fineweb_q01/duckdb:vortex-file-compressed 22419434 / 23644731 / -5.2% 67856813 / 61457771 / +10.4% 🔴 0.33 / 0.38 / -14.1%
fineweb_q02/duckdb:vortex-file-compressed 16316186 / 17951792 / -9.1% 57548863 / 43434352 / +32.5% 🔴 0.28 / 0.41 / -31.4%
fineweb_q03/duckdb:vortex-file-compressed 20149864 / 35629844 / -43.4% 🟢 119932517 / 218901339 / -45.2% 🟢 0.17 / 0.16 / +3.2%
fineweb_q04/duckdb:vortex-file-compressed 87097260 / 74132342 / +17.5% 🔴 158677503 / 116975690 / +35.6% 🔴 0.55 / 0.63 / -13.4%
fineweb_q05/duckdb:vortex-file-compressed 88321280 / 60673156 / +45.6% 🔴 198573508 / 100686047 / +97.2% 🔴 0.44 / 0.60 / -26.2%
fineweb_q06/duckdb:vortex-file-compressed 46827844 / 33500702 / +39.8% 🔴 167201176 / 106150672 / +57.5% 🔴 0.28 / 0.32 / -11.3%
fineweb_q07/duckdb:vortex-file-compressed 31346224 / 29401304 / +6.6% 133719687 / 105109825 / +27.2% 🔴 0.23 / 0.28 / -16.2%
fineweb_q08/duckdb:vortex-file-compressed 6138840 / 7330588 / -16.3% 🟢 14937162 / 14588009 / +2.4% 0.41 / 0.50 / -18.2%
duckdb / parquet / ns (1.035x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23455356 / 22507987 / +4.2% 24175437 / 23020774 / +5.0% 0.97 / 0.98 / -0.8%
fineweb_q01/duckdb:parquet 44099224 / 44380128 / -0.6% 55108055 / 55499457 / -0.7% 0.80 / 0.80 / +0.1%
fineweb_q02/duckdb:parquet 43943282 / 43261716 / +1.6% 53274219 / 53611045 / -0.6% 0.82 / 0.81 / +2.2%
fineweb_q03/duckdb:parquet 94846148 / 94583245 / +0.3% 190964939 / 178572611 / +6.9% 0.50 / 0.53 / -6.2%
fineweb_q04/duckdb:parquet 155112716 / 150366988 / +3.2% 208758154 / 205160764 / +1.8% 0.74 / 0.73 / +1.4%
fineweb_q05/duckdb:parquet 152329128 / 142436676 / +6.9% 191687121 / 199977550 / -4.1% 0.79 / 0.71 / +11.6%
fineweb_q06/duckdb:parquet 71956682 / 69987735 / +2.8% 127805805 / 126112735 / +1.3% 0.56 / 0.55 / +1.5%
fineweb_q07/duckdb:parquet 73155038 / 71874205 / +1.8% 152204724 / 154443730 / -1.4% 0.48 / 0.47 / +3.3%
fineweb_q08/duckdb:parquet 24685536 / 21975485 / +12.3% 🔴 24732624 / 27013605 / -8.4% 1.00 / 0.81 / +22.7%

File Size Changes (1 files changed, +25.7% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.79 GB +375.45 MB +25.7%

Totals:

  • vortex-file-compressed: 1.43 GB → 1.79 GB (+25.7%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 548ac378 vs base 272bf1db
Verdict: Likely improvement (high confidence)
Attributed Vortex impact: -27.1%
Engines: DataFusion Likely improvement (-26.9%, high confidence) · DuckDB Likely improvement (-27.3%, medium confidence)
Vortex (geomean): hot 0.728x ✅ · cold 1.005x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.089x ➖
Shifts: Parquet (control) -0.2% · Median polish -12.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.736x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 190889077 / 219584210 / -13.1% 🟢 848044720 / 590885641 / +43.5% 🔴 0.23 / 0.37 / -39.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11479202 / 13498680 / -15.0% 🟢 50887943 / 50361598 / +1.0% 0.23 / 0.27 / -15.8%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11769398 / 13477430 / -12.7% 🟢 51938516 / 49010130 / +6.0% 0.23 / 0.27 / -17.6%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23876462 / 29520992 / -19.1% 🟢 71127937 / 63159255 / +12.6% 🔴 0.34 / 0.47 / -28.2%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18790225 / 24729754 / -24.0% 🟢 65173441 / 55740851 / +16.9% 🔴 0.29 / 0.44 / -35.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17916450 / 34714520 / -48.4% 🟢 62021603 / 71321347 / -13.0% 🟢 0.29 / 0.49 / -40.7%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41684144 / 87864098 / -52.6% 🟢 99390919 / 118703929 / -16.3% 🟢 0.42 / 0.74 / -43.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed 13868844 / 16312598 / -15.0% 🟢 46621022 / 45585077 / +2.3% 0.30 / 0.36 / -16.9%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11902280 / 15897434 / -25.1% 🟢 44053744 / 42552903 / +3.5% 0.27 / 0.37 / -27.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10023966 / 13366455 / -25.0% 🟢 37587133 / 38000409 / -1.1% 0.27 / 0.35 / -24.2%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 762426302 / 760818838 / +0.2% 979052475 / 948162986 / +3.3% 0.78 / 0.80 / -3.0%
clickbench-sorted_q24/datafusion:parquet 9245590 / 9211303 / +0.4% 73178288 / 70997014 / +3.1% 0.13 / 0.13 / -2.6%
clickbench-sorted_q26/datafusion:parquet 9216832 / 9180556 / +0.4% 73689302 / 70795423 / +4.1% 0.13 / 0.13 / -3.5%
clickbench-sorted_q36/datafusion:parquet 93510218 / 93314808 / +0.2% 171002654 / 168520785 / +1.5% 0.55 / 0.55 / -1.2%
clickbench-sorted_q37/datafusion:parquet 64443422 / 63834879 / +1.0% 132724412 / 130788676 / +1.5% 0.49 / 0.49 / -0.5%
clickbench-sorted_q38/datafusion:parquet 87645685 / 86723018 / +1.1% 163601351 / 161375058 / +1.4% 0.54 / 0.54 / -0.3%
clickbench-sorted_q39/datafusion:parquet 160306799 / 158751336 / +1.0% 237995427 / 234238944 / +1.6% 0.67 / 0.68 / -0.6%
clickbench-sorted_q40/datafusion:parquet 44437198 / 44237028 / +0.5% 117074447 / 110975183 / +5.5% 0.38 / 0.40 / -4.8%
clickbench-sorted_q41/datafusion:parquet 42336899 / 41958540 / +0.9% 111346608 / 109162261 / +2.0% 0.38 / 0.38 / -1.1%
clickbench-sorted_q42/datafusion:parquet 26341550 / 26207860 / +0.5% 85930891 / 86841358 / -1.0% 0.31 / 0.30 / +1.6%
duckdb / vortex-file-compressed / ns (0.720x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 57276203 / 66202433 / -13.5% 🟢 95730919 / 86066799 / +11.2% 🔴 0.60 / 0.77 / -22.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21546940 / 20269334 / +6.3% 36213539 / 29411347 / +23.1% 🔴 0.59 / 0.69 / -13.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14767976 / 16572420 / -10.9% 🟢 28037868 / 30209476 / -7.2% 0.53 / 0.55 / -4.0%
clickbench-sorted_q36/duckdb:vortex-file-compressed 32450961 / 45163340 / -28.1% 🟢 70328003 / 76283807 / -7.8% 0.46 / 0.59 / -22.1%
clickbench-sorted_q37/duckdb:vortex-file-compressed 25059006 / 37147750 / -32.5% 🟢 58957260 / 62662096 / -5.9% 0.43 / 0.59 / -28.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26926801 / 47648364 / -43.5% 🟢 67603395 / 74848067 / -9.7% 0.40 / 0.64 / -37.4%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48811247 / 118469542 / -58.8% 🟢 113044566 / 144989856 / -22.0% 🟢 0.43 / 0.82 / -47.2%
clickbench-sorted_q40/duckdb:vortex-file-compressed 16133036 / 20697158 / -22.1% 🟢 39778562 / 38913856 / +2.2% 0.41 / 0.53 / -23.7%
clickbench-sorted_q41/duckdb:vortex-file-compressed 16629060 / 21546378 / -22.8% 🟢 41067076 / 40480758 / +1.4% 0.40 / 0.53 / -23.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed 13067336 / 19541864 / -33.1% 🟢 34482338 / 38730091 / -11.0% 🟢 0.38 / 0.50 / -24.9%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 123691523 / 124536020 / -0.7% 147498061 / 141340556 / +4.4% 0.84 / 0.88 / -4.8%
clickbench-sorted_q24/duckdb:parquet 18460094 / 18368558 / +0.5% 33152003 / 29951977 / +10.7% 🔴 0.56 / 0.61 / -9.2%
clickbench-sorted_q26/duckdb:parquet 13255150 / 14716861 / -9.9% 25328600 / 21136090 / +19.8% 🔴 0.52 / 0.70 / -24.8%
clickbench-sorted_q36/duckdb:parquet 42366564 / 44272747 / -4.3% 70065797 / 60824810 / +15.2% 🔴 0.60 / 0.73 / -16.9%
clickbench-sorted_q37/duckdb:parquet 31059270 / 29913068 / +3.8% 55836274 / 46395451 / +20.3% 🔴 0.56 / 0.64 / -13.7%
clickbench-sorted_q38/duckdb:parquet 41824846 / 39321416 / +6.4% 64713565 / 54888740 / +17.9% 🔴 0.65 / 0.72 / -9.8%
clickbench-sorted_q39/duckdb:parquet 73353284 / 74105479 / -1.0% 94614759 / 86885994 / +8.9% 0.78 / 0.85 / -9.1%
clickbench-sorted_q40/duckdb:parquet 16747164 / 17036562 / -1.7% 46894587 / 35258336 / +33.0% 🔴 0.36 / 0.48 / -26.1%
clickbench-sorted_q41/duckdb:parquet 16754345 / 17001125 / -1.5% 46737980 / 36791090 / +27.0% 🔴 0.36 / 0.46 / -22.4%
clickbench-sorted_q42/duckdb:parquet 11003772 / 11186195 / -1.6% 24207516 / 22979239 / +5.3% 0.45 / 0.49 / -6.6%

File Size Changes (100 files changed, +26.4% overall, 100↑ 0↓)
File Scale Format Base HEAD Change %
hits_042.vortex 1.0 vortex-file-compressed 200.60 MB 279.76 MB +79.16 MB +39.5%
hits_053.vortex 1.0 vortex-file-compressed 188.99 MB 255.50 MB +66.52 MB +35.2%
hits_079.vortex 1.0 vortex-file-compressed 180.43 MB 242.27 MB +61.84 MB +34.3%
hits_023.vortex 1.0 vortex-file-compressed 194.26 MB 260.77 MB +66.51 MB +34.2%
hits_016.vortex 1.0 vortex-file-compressed 180.96 MB 240.55 MB +59.59 MB +32.9%
hits_001.vortex 1.0 vortex-file-compressed 190.50 MB 252.47 MB +61.97 MB +32.5%
hits_090.vortex 1.0 vortex-file-compressed 191.50 MB 253.69 MB +62.19 MB +32.5%
hits_097.vortex 1.0 vortex-file-compressed 192.18 MB 254.25 MB +62.07 MB +32.3%
hits_060.vortex 1.0 vortex-file-compressed 192.50 MB 254.66 MB +62.16 MB +32.3%
hits_005.vortex 1.0 vortex-file-compressed 166.58 MB 220.32 MB +53.74 MB +32.3%
hits_012.vortex 1.0 vortex-file-compressed 190.06 MB 251.11 MB +61.06 MB +32.1%
hits_049.vortex 1.0 vortex-file-compressed 190.45 MB 251.60 MB +61.14 MB +32.1%
hits_064.vortex 1.0 vortex-file-compressed 190.17 MB 251.04 MB +60.87 MB +32.0%
hits_075.vortex 1.0 vortex-file-compressed 188.51 MB 248.63 MB +60.12 MB +31.9%
hits_038.vortex 1.0 vortex-file-compressed 189.23 MB 249.18 MB +59.95 MB +31.7%
hits_031.vortex 1.0 vortex-file-compressed 158.43 MB 208.02 MB +49.59 MB +31.3%
hits_068.vortex 1.0 vortex-file-compressed 159.53 MB 209.27 MB +49.73 MB +31.2%
hits_057.vortex 1.0 vortex-file-compressed 159.06 MB 208.62 MB +49.57 MB +31.2%
hits_027.vortex 1.0 vortex-file-compressed 190.34 MB 249.26 MB +58.91 MB +31.0%
hits_086.vortex 1.0 vortex-file-compressed 193.23 MB 253.02 MB +59.79 MB +30.9%
hits_094.vortex 1.0 vortex-file-compressed 157.91 MB 206.21 MB +48.30 MB +30.6%
hits_083.vortex 1.0 vortex-file-compressed 156.09 MB 203.70 MB +47.61 MB +30.5%
hits_020.vortex 1.0 vortex-file-compressed 160.06 MB 208.69 MB +48.63 MB +30.4%
hits_034.vortex 1.0 vortex-file-compressed 180.89 MB 235.71 MB +54.82 MB +30.3%
hits_070.vortex 1.0 vortex-file-compressed 197.93 MB 256.57 MB +58.64 MB +29.6%
hits_033.vortex 1.0 vortex-file-compressed 198.03 MB 256.56 MB +58.53 MB +29.6%
hits_022.vortex 1.0 vortex-file-compressed 197.46 MB 255.24 MB +57.77 MB +29.3%
hits_048.vortex 1.0 vortex-file-compressed 198.91 MB 256.15 MB +57.24 MB +28.8%
hits_081.vortex 1.0 vortex-file-compressed 199.40 MB 256.77 MB +57.37 MB +28.8%
hits_007.vortex 1.0 vortex-file-compressed 199.39 MB 256.71 MB +57.33 MB +28.8%
hits_029.vortex 1.0 vortex-file-compressed 199.08 MB 256.29 MB +57.21 MB +28.7%
hits_085.vortex 1.0 vortex-file-compressed 199.21 MB 256.40 MB +57.19 MB +28.7%
hits_092.vortex 1.0 vortex-file-compressed 198.83 MB 255.90 MB +57.06 MB +28.7%
hits_055.vortex 1.0 vortex-file-compressed 199.19 MB 256.20 MB +57.01 MB +28.6%
hits_059.vortex 1.0 vortex-file-compressed 198.44 MB 255.18 MB +56.75 MB +28.6%
hits_074.vortex 1.0 vortex-file-compressed 198.57 MB 255.22 MB +56.65 MB +28.5%
hits_018.vortex 1.0 vortex-file-compressed 199.44 MB 256.23 MB +56.79 MB +28.5%
hits_044.vortex 1.0 vortex-file-compressed 199.81 MB 256.56 MB +56.75 MB +28.4%
hits_011.vortex 1.0 vortex-file-compressed 198.87 MB 255.34 MB +56.46 MB +28.4%
hits_096.vortex 1.0 vortex-file-compressed 198.80 MB 255.18 MB +56.38 MB +28.4%
hits_013.vortex 1.0 vortex-file-compressed 160.21 MB 204.38 MB +44.17 MB +27.6%
hits_076.vortex 1.0 vortex-file-compressed 160.01 MB 204.03 MB +44.02 MB +27.5%
hits_050.vortex 1.0 vortex-file-compressed 159.94 MB 203.90 MB +43.96 MB +27.5%
hits_087.vortex 1.0 vortex-file-compressed 159.90 MB 203.85 MB +43.94 MB +27.5%
hits_039.vortex 1.0 vortex-file-compressed 160.14 MB 204.09 MB +43.96 MB +27.4%
hits_002.vortex 1.0 vortex-file-compressed 160.00 MB 203.91 MB +43.92 MB +27.4%
hits_061.vortex 1.0 vortex-file-compressed 159.90 MB 203.61 MB +43.70 MB +27.3%
hits_065.vortex 1.0 vortex-file-compressed 160.25 MB 204.04 MB +43.79 MB +27.3%
hits_024.vortex 1.0 vortex-file-compressed 160.16 MB 203.19 MB +43.03 MB +26.9%
hits_043.vortex 1.0 vortex-file-compressed 125.81 MB 158.89 MB +33.08 MB +26.3%
hits_080.vortex 1.0 vortex-file-compressed 126.11 MB 159.20 MB +33.09 MB +26.2%
hits_006.vortex 1.0 vortex-file-compressed 125.62 MB 158.54 MB +32.92 MB +26.2%
hits_037.vortex 1.0 vortex-file-compressed 176.25 MB 221.96 MB +45.71 MB +25.9%
hits_032.vortex 1.0 vortex-file-compressed 153.71 MB 192.43 MB +38.72 MB +25.2%
hits_095.vortex 1.0 vortex-file-compressed 153.50 MB 192.12 MB +38.62 MB +25.2%
hits_021.vortex 1.0 vortex-file-compressed 153.36 MB 191.73 MB +38.38 MB +25.0%
hits_084.vortex 1.0 vortex-file-compressed 153.70 MB 192.17 MB +38.46 MB +25.0%
hits_047.vortex 1.0 vortex-file-compressed 153.57 MB 191.93 MB +38.36 MB +25.0%
hits_058.vortex 1.0 vortex-file-compressed 154.33 MB 192.88 MB +38.55 MB +25.0%
hits_069.vortex 1.0 vortex-file-compressed 141.60 MB 176.45 MB +34.85 MB +24.6%
hits_028.vortex 1.0 vortex-file-compressed 150.62 MB 186.34 MB +35.72 MB +23.7%
hits_073.vortex 1.0 vortex-file-compressed 171.82 MB 211.72 MB +39.89 MB +23.2%
hits_036.vortex 1.0 vortex-file-compressed 170.63 MB 210.23 MB +39.60 MB +23.2%
hits_014.vortex 1.0 vortex-file-compressed 171.36 MB 211.11 MB +39.75 MB +23.2%
hits_051.vortex 1.0 vortex-file-compressed 171.67 MB 211.41 MB +39.74 MB +23.2%
hits_077.vortex 1.0 vortex-file-compressed 171.66 MB 211.39 MB +39.72 MB +23.1%
hits_088.vortex 1.0 vortex-file-compressed 171.32 MB 210.76 MB +39.44 MB +23.0%
hits_099.vortex 1.0 vortex-file-compressed 170.50 MB 209.58 MB +39.08 MB +22.9%
hits_010.vortex 1.0 vortex-file-compressed 168.12 MB 206.59 MB +38.47 MB +22.9%
hits_025.vortex 1.0 vortex-file-compressed 171.38 MB 210.46 MB +39.07 MB +22.8%
hits_062.vortex 1.0 vortex-file-compressed 170.62 MB 209.00 MB +38.37 MB +22.5%
hits_040.vortex 1.0 vortex-file-compressed 142.18 MB 173.86 MB +31.69 MB +22.3%
hits_098.vortex 1.0 vortex-file-compressed 136.59 MB 166.83 MB +30.24 MB +22.1%
hits_071.vortex 1.0 vortex-file-compressed 138.80 MB 169.14 MB +30.35 MB +21.9%
hits_008.vortex 1.0 vortex-file-compressed 138.61 MB 168.84 MB +30.23 MB +21.8%
hits_017.vortex 1.0 vortex-file-compressed 145.84 MB 177.62 MB +31.78 MB +21.8%
hits_091.vortex 1.0 vortex-file-compressed 146.14 MB 177.92 MB +31.78 MB +21.7%
hits_082.vortex 1.0 vortex-file-compressed 138.64 MB 168.62 MB +29.98 MB +21.6%
hits_054.vortex 1.0 vortex-file-compressed 146.50 MB 177.82 MB +31.32 MB +21.4%
hits_045.vortex 1.0 vortex-file-compressed 139.41 MB 169.17 MB +29.77 MB +21.4%
hits_066.vortex 1.0 vortex-file-compressed 162.39 MB 196.58 MB +34.19 MB +21.1%
hits_019.vortex 1.0 vortex-file-compressed 140.33 MB 169.75 MB +29.42 MB +21.0%
hits_056.vortex 1.0 vortex-file-compressed 134.47 MB 161.90 MB +27.43 MB +20.4%
hits_003.vortex 1.0 vortex-file-compressed 135.73 MB 163.30 MB +27.57 MB +20.3%
hits_030.vortex 1.0 vortex-file-compressed 130.94 MB 154.43 MB +23.49 MB +17.9%
hits_078.vortex 1.0 vortex-file-compressed 129.97 MB 153.25 MB +23.28 MB +17.9%
hits_063.vortex 1.0 vortex-file-compressed 130.73 MB 154.13 MB +23.40 MB +17.9%
hits_093.vortex 1.0 vortex-file-compressed 130.76 MB 154.10 MB +23.34 MB +17.9%
hits_026.vortex 1.0 vortex-file-compressed 130.36 MB 153.59 MB +23.23 MB +17.8%
hits_004.vortex 1.0 vortex-file-compressed 130.38 MB 153.62 MB +23.23 MB +17.8%
hits_015.vortex 1.0 vortex-file-compressed 130.15 MB 153.30 MB +23.15 MB +17.8%
hits_067.vortex 1.0 vortex-file-compressed 130.80 MB 154.06 MB +23.26 MB +17.8%
hits_089.vortex 1.0 vortex-file-compressed 130.70 MB 153.79 MB +23.09 MB +17.7%
hits_052.vortex 1.0 vortex-file-compressed 130.17 MB 152.98 MB +22.81 MB +17.5%
hits_000.vortex 1.0 vortex-file-compressed 130.75 MB 153.59 MB +22.85 MB +17.5%
hits_041.vortex 1.0 vortex-file-compressed 130.86 MB 153.39 MB +22.53 MB +17.2%
hits_072.vortex 1.0 vortex-file-compressed 101.77 MB 116.56 MB +14.79 MB +14.5%
hits_009.vortex 1.0 vortex-file-compressed 100.64 MB 115.25 MB +14.61 MB +14.5%
hits_035.vortex 1.0 vortex-file-compressed 102.21 MB 116.67 MB +14.45 MB +14.1%
hits_046.vortex 1.0 vortex-file-compressed 100.56 MB 114.60 MB +14.04 MB +14.0%

Totals:

  • vortex-file-compressed: 15.88 GB → 20.06 GB (+26.4%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 548ac378 vs base d6037bc2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-2.0%, environment too noisy confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.968x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.995x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23794089 / 24399548 / -2.5% 42344679 / 44103278 / -4.0% 0.56 / 0.55 / +1.6%
tpcds_q02/datafusion:vortex-file-compressed 44659164 / 45177461 / -1.1% 61917689 / 62618339 / -1.1% 0.72 / 0.72 / -0.0%
tpcds_q03/datafusion:vortex-file-compressed 11693121 / 11511708 / +1.6% 28084486 / 29458322 / -4.7% 0.42 / 0.39 / +6.5%
tpcds_q04/datafusion:vortex-file-compressed 112295144 / 112552974 / -0.2% 138536526 / 136974279 / +1.1% 0.81 / 0.82 / -1.4%
tpcds_q05/datafusion:vortex-file-compressed 60006071 / 60036244 / -0.1% 81849091 / 81707752 / +0.2% 0.73 / 0.73 / -0.2%
tpcds_q06/datafusion:vortex-file-compressed 23993062 / 23332818 / +2.8% 43957901 / 43998517 / -0.1% 0.55 / 0.53 / +2.9%
tpcds_q07/datafusion:vortex-file-compressed 32512550 / 31941078 / +1.8% 56186654 / 56589683 / -0.7% 0.58 / 0.56 / +2.5%
tpcds_q08/datafusion:vortex-file-compressed 25628388 / 26194690 / -2.2% 43246886 / 46309352 / -6.6% 0.59 / 0.57 / +4.8%
tpcds_q09/datafusion:vortex-file-compressed 17420004 / 17924829 / -2.8% 33470543 / 34615991 / -3.3% 0.52 / 0.52 / +0.5%
tpcds_q10/datafusion:vortex-file-compressed 29403348 / 29324514 / +0.3% 48566893 / 50782440 / -4.4% 0.61 / 0.58 / +4.8%
tpcds_q11/datafusion:vortex-file-compressed 62568508 / 59746112 / +4.7% 86923307 / 83821746 / +3.7% 0.72 / 0.71 / +1.0%
tpcds_q12/datafusion:vortex-file-compressed 16151132 / 16495472 / -2.1% 32230568 / 31847169 / +1.2% 0.50 / 0.52 / -3.3%
tpcds_q13/datafusion:vortex-file-compressed 35703802 / 36972470 / -3.4% 52790368 / 60241114 / -12.4% 🟢 0.68 / 0.61 / +10.2%
tpcds_q14/datafusion:vortex-file-compressed 90520074 / 92344486 / -2.0% 121307037 / 117818236 / +3.0% 0.75 / 0.78 / -4.8%
tpcds_q15/datafusion:vortex-file-compressed 23931207 / 25082732 / -4.6% 42682081 / 44495113 / -4.1% 0.56 / 0.56 / -0.5%
tpcds_q16/datafusion:vortex-file-compressed 21220162 / 20836804 / +1.8% 40159789 / 42961518 / -6.5% 0.53 / 0.49 / +8.9%
tpcds_q17/datafusion:vortex-file-compressed 58350442 / 54241355 / +7.6% 85199229 / 83371551 / +2.2% 0.68 / 0.65 / +5.3%
tpcds_q18/datafusion:vortex-file-compressed 67430210 / 68552398 / -1.6% 90126833 / 93339309 / -3.4% 0.75 / 0.73 / +1.9%
tpcds_q19/datafusion:vortex-file-compressed 18686202 / 17676118 / +5.7% 40286563 / 41327664 / -2.5% 0.46 / 0.43 / +8.4%
tpcds_q20/datafusion:vortex-file-compressed 17494581 / 17832842 / -1.9% 33255381 / 34785755 / -4.4% 0.53 / 0.51 / +2.6%
tpcds_q21/datafusion:vortex-file-compressed 16910962 / 16489099 / +2.6% 37898316 / 40133680 / -5.6% 0.45 / 0.41 / +8.6%
tpcds_q22/datafusion:vortex-file-compressed 49703909 / 49342713 / +0.7% 71393181 / 69968489 / +2.0% 0.70 / 0.71 / -1.3%
tpcds_q23/datafusion:vortex-file-compressed 72851006 / 72504390 / +0.5% 99762464 / 95097012 / +4.9% 0.73 / 0.76 / -4.2%
tpcds_q24/datafusion:vortex-file-compressed 70230797 / 69632965 / +0.9% 93287404 / 95980549 / -2.8% 0.75 / 0.73 / +3.8%
tpcds_q25/datafusion:vortex-file-compressed 51689734 / 54421348 / -5.0% 73597459 / 81402706 / -9.6% 0.70 / 0.67 / +5.1%
tpcds_q26/datafusion:vortex-file-compressed 29529774 / 31081816 / -5.0% 50101958 / 50538958 / -0.9% 0.59 / 0.62 / -4.2%
tpcds_q27/datafusion:vortex-file-compressed 66060702 / 63439988 / +4.1% 88316220 / 91245649 / -3.2% 0.75 / 0.70 / +7.6%
tpcds_q28/datafusion:vortex-file-compressed 17934322 / 18672442 / -4.0% 36766733 / 38660012 / -4.9% 0.49 / 0.48 / +1.0%
tpcds_q29/datafusion:vortex-file-compressed 61353743 / 60995323 / +0.6% 74177854 / 83991078 / -11.7% 🟢 0.83 / 0.73 / +13.9%
tpcds_q30/datafusion:vortex-file-compressed 27835252 / 27737518 / +0.4% 45137177 / 44451317 / +1.5% 0.62 / 0.62 / -1.2%
tpcds_q31/datafusion:vortex-file-compressed 65019072 / 63951297 / +1.7% 90676727 / 89423378 / +1.4% 0.72 / 0.72 / +0.3%
tpcds_q32/datafusion:vortex-file-compressed 13705001 / 14095239 / -2.8% 30395463 / 30960856 / -1.8% 0.45 / 0.46 / -1.0%
tpcds_q33/datafusion:vortex-file-compressed 26872504 / 26822922 / +0.2% 48160946 / 48579532 / -0.9% 0.56 / 0.55 / +1.1%
tpcds_q34/datafusion:vortex-file-compressed 18515419 / 18001266 / +2.9% 38434483 / 37959622 / +1.3% 0.48 / 0.47 / +1.6%
tpcds_q35/datafusion:vortex-file-compressed 35563256 / 34866800 / +2.0% 57511250 / 56816537 / +1.2% 0.62 / 0.61 / +0.8%
tpcds_q36/datafusion:vortex-file-compressed 48349632 / 48026406 / +0.7% 68252139 / 69208423 / -1.4% 0.71 / 0.69 / +2.1%
tpcds_q37/datafusion:vortex-file-compressed 12932718 / 13092668 / -1.2% 33120967 / 35964204 / -7.9% 0.39 / 0.36 / +7.3%
tpcds_q38/datafusion:vortex-file-compressed 30361860 / 30197609 / +0.5% 50454088 / 51154218 / -1.4% 0.60 / 0.59 / +1.9%
tpcds_q39/datafusion:vortex-file-compressed 65588766 / 65054536 / +0.8% 93683053 / 90974119 / +3.0% 0.70 / 0.72 / -2.1%
tpcds_q40/datafusion:vortex-file-compressed 24824363 / 25493856 / -2.6% 44251535 / 43534774 / +1.6% 0.56 / 0.59 / -4.2%
tpcds_q41/datafusion:vortex-file-compressed 16426319 / 16620438 / -1.2% 30934339 / 30588224 / +1.1% 0.53 / 0.54 / -2.3%
tpcds_q42/datafusion:vortex-file-compressed 11375908 / 11162966 / +1.9% 26614366 / 28553133 / -6.8% 0.43 / 0.39 / +9.3%
tpcds_q43/datafusion:vortex-file-compressed 13487935 / 12963074 / +4.0% 31937201 / 31578469 / +1.1% 0.42 / 0.41 / +2.9%
tpcds_q44/datafusion:vortex-file-compressed 25925100 / 26279076 / -1.3% 50200221 / 49252953 / +1.9% 0.52 / 0.53 / -3.2%
tpcds_q45/datafusion:vortex-file-compressed 27806103 / 28354808 / -1.9% 45984877 / 51738236 / -11.1% 🟢 0.60 / 0.55 / +10.3%
tpcds_q46/datafusion:vortex-file-compressed 24427666 / 23446816 / +4.2% 46863950 / 47621698 / -1.6% 0.52 / 0.49 / +5.9%
tpcds_q47/datafusion:vortex-file-compressed 77714196 / 76726424 / +1.3% 103009389 / 105021620 / -1.9% 0.75 / 0.73 / +3.3%
tpcds_q48/datafusion:vortex-file-compressed 31140412 / 31815548 / -2.1% 50508421 / 52795720 / -4.3% 0.62 / 0.60 / +2.3%
tpcds_q49/datafusion:vortex-file-compressed 59167145 / 60309459 / -1.9% 80298189 / 84454692 / -4.9% 0.74 / 0.71 / +3.2%
tpcds_q50/datafusion:vortex-file-compressed 34347956 / 33506198 / +2.5% 54267623 / 52761911 / +2.9% 0.63 / 0.64 / -0.3%
tpcds_q51/datafusion:vortex-file-compressed 60896286 / 61149042 / -0.4% 82321925 / 82554279 / -0.3% 0.74 / 0.74 / -0.1%
tpcds_q52/datafusion:vortex-file-compressed 11780359 / 11615596 / +1.4% 28274167 / 28440405 / -0.6% 0.42 / 0.41 / +2.0%
tpcds_q53/datafusion:vortex-file-compressed 18461408 / 18249028 / +1.2% 37645088 / 38827685 / -3.0% 0.49 / 0.47 / +4.3%
tpcds_q54/datafusion:vortex-file-compressed 33850478 / 33329752 / +1.6% 56583953 / 58540645 / -3.3% 0.60 / 0.57 / +5.1%
tpcds_q55/datafusion:vortex-file-compressed 11129482 / 10980938 / +1.4% 27406950 / 27876283 / -1.7% 0.41 / 0.39 / +3.1%
tpcds_q56/datafusion:vortex-file-compressed 27169202 / 26699310 / +1.8% 48691966 / 47490051 / +2.5% 0.56 / 0.56 / -0.8%
tpcds_q57/datafusion:vortex-file-compressed 73265886 / 73711550 / -0.6% 95036599 / 96034992 / -1.0% 0.77 / 0.77 / +0.4%
tpcds_q58/datafusion:vortex-file-compressed 41016637 / 40934770 / +0.2% 65216488 / 65408875 / -0.3% 0.63 / 0.63 / +0.5%
tpcds_q59/datafusion:vortex-file-compressed 32534060 / 31288470 / +4.0% 52943914 / 51993241 / +1.8% 0.61 / 0.60 / +2.1%
tpcds_q60/datafusion:vortex-file-compressed 26455298 / 25927618 / +2.0% 48541770 / 46499183 / +4.4% 0.55 / 0.56 / -2.3%
tpcds_q61/datafusion:vortex-file-compressed 24774249 / 24278832 / +2.0% 47092992 / 45578954 / +3.3% 0.53 / 0.53 / -1.2%
tpcds_q62/datafusion:vortex-file-compressed 17055738 / 17505090 / -2.6% 35332401 / 35250183 / +0.2% 0.48 / 0.50 / -2.8%
tpcds_q63/datafusion:vortex-file-compressed 18434272 / 18416131 / +0.1% 38647128 / 39121241 / -1.2% 0.48 / 0.47 / +1.3%
tpcds_q64/datafusion:vortex-file-compressed 320649670 / 332041250 / -3.4% 351345898 / 352918264 / -0.4% 0.91 / 0.94 / -3.0%
tpcds_q65/datafusion:vortex-file-compressed 75545005 / 74936724 / +0.8% 93312702 / 93152613 / +0.2% 0.81 / 0.80 / +0.6%
tpcds_q66/datafusion:vortex-file-compressed 52966398 / 52791760 / +0.3% 75126975 / 74775894 / +0.5% 0.71 / 0.71 / -0.1%
tpcds_q67/datafusion:vortex-file-compressed 55883786 / 55078896 / +1.5% 84493247 / 82617975 / +2.3% 0.66 / 0.67 / -0.8%
tpcds_q68/datafusion:vortex-file-compressed 24281722 / 22878631 / +6.1% 48463108 / 48249366 / +0.4% 0.50 / 0.47 / +5.7%
tpcds_q69/datafusion:vortex-file-compressed 29428443 / 27948594 / +5.3% 49194758 / 48384769 / +1.7% 0.60 / 0.58 / +3.6%
tpcds_q70/datafusion:vortex-file-compressed 70930906 / 69692778 / +1.8% 91509660 / 90381576 / +1.2% 0.78 / 0.77 / +0.5%
tpcds_q71/datafusion:vortex-file-compressed 19915468 / 19923009 / -0.0% 38949505 / 40134753 / -3.0% 0.51 / 0.50 / +3.0%
tpcds_q72/datafusion:vortex-file-compressed 452656874 / 450468334 / +0.5% 483641984 / 483761378 / -0.0% 0.94 / 0.93 / +0.5%
tpcds_q73/datafusion:vortex-file-compressed 17288897 / 17066094 / +1.3% 37045140 / 35528831 / +4.3% 0.47 / 0.48 / -2.8%
tpcds_q74/datafusion:vortex-file-compressed 45541594 / 44700060 / +1.9% 68652209 / 67851244 / +1.2% 0.66 / 0.66 / +0.7%
tpcds_q75/datafusion:vortex-file-compressed 130414595 / 129753166 / +0.5% 156109067 / 156069041 / +0.0% 0.84 / 0.83 / +0.5%
tpcds_q76/datafusion:vortex-file-compressed 43209730 / 44094140 / -2.0% 62649736 / 60885950 / +2.9% 0.69 / 0.72 / -4.8%
tpcds_q77/datafusion:vortex-file-compressed 35531130 / 34852496 / +1.9% 57010752 / 58703883 / -2.9% 0.62 / 0.59 / +5.0%
tpcds_q78/datafusion:vortex-file-compressed 79724260 / 79415490 / +0.4% 106727931 / 106936337 / -0.2% 0.75 / 0.74 / +0.6%
tpcds_q79/datafusion:vortex-file-compressed 21233133 / 20339480 / +4.4% 41664420 / 41377578 / +0.7% 0.51 / 0.49 / +3.7%
tpcds_q80/datafusion:vortex-file-compressed 77776522 / 77063866 / +0.9% 105912061 / 105898205 / +0.0% 0.73 / 0.73 / +0.9%
tpcds_q81/datafusion:vortex-file-compressed 27927986 / 27938698 / -0.0% 45311349 / 44751360 / +1.3% 0.62 / 0.62 / -1.3%
tpcds_q82/datafusion:vortex-file-compressed 13218613 / 14249769 / -7.2% 35773977 / 37112275 / -3.6% 0.37 / 0.38 / -3.8%
tpcds_q83/datafusion:vortex-file-compressed 36592270 / 36104518 / +1.4% 56861573 / 53516558 / +6.3% 0.64 / 0.67 / -4.6%
tpcds_q84/datafusion:vortex-file-compressed 11956006 / 12296723 / -2.8% 27092967 / 28733536 / -5.7% 0.44 / 0.43 / +3.1%
tpcds_q85/datafusion:vortex-file-compressed 60079358 / 62334178 / -3.6% 81396068 / 85420667 / -4.7% 0.74 / 0.73 / +1.1%
tpcds_q86/datafusion:vortex-file-compressed 16498818 / 16389846 / +0.7% 32808080 / 33143624 / -1.0% 0.50 / 0.49 / +1.7%
tpcds_q87/datafusion:vortex-file-compressed 29780004 / 29573240 / +0.7% 51068790 / 49882658 / +2.4% 0.58 / 0.59 / -1.6%
tpcds_q88/datafusion:vortex-file-compressed 34150110 / 31718280 / +7.7% 59490794 / 59794400 / -0.5% 0.57 / 0.53 / +8.2%
tpcds_q89/datafusion:vortex-file-compressed 21344006 / 20785700 / +2.7% 40843886 / 41913608 / -2.6% 0.52 / 0.50 / +5.4%
tpcds_q90/datafusion:vortex-file-compressed 10469655 / 10497372 / -0.3% 26504909 / 26902312 / -1.5% 0.40 / 0.39 / +1.2%
tpcds_q91/datafusion:vortex-file-compressed 17285968 / 17096558 / +1.1% 35573667 / 36788079 / -3.3% 0.49 / 0.46 / +4.6%
tpcds_q92/datafusion:vortex-file-compressed 13713726 / 13837458 / -0.9% 30303868 / 31308089 / -3.2% 0.45 / 0.44 / +2.4%
tpcds_q93/datafusion:vortex-file-compressed 23679836 / 23263329 / +1.8% 43337717 / 46687812 / -7.2% 0.55 / 0.50 / +9.7%
tpcds_q94/datafusion:vortex-file-compressed 19694910 / 19958160 / -1.3% 37701860 / 38633890 / -2.4% 0.52 / 0.52 / +1.1%
tpcds_q95/datafusion:vortex-file-compressed 46324486 / 46424406 / -0.2% 68462233 / 69437859 / -1.4% 0.68 / 0.67 / +1.2%
tpcds_q96/datafusion:vortex-file-compressed 9704752 / 8344972 / +16.3% 🔴 25449243 / 23843438 / +6.7% 0.38 / 0.35 / +9.0%
tpcds_q97/datafusion:vortex-file-compressed 20907708 / 20970473 / -0.3% 41805612 / 42548881 / -1.7% 0.50 / 0.49 / +1.5%
tpcds_q98/datafusion:vortex-file-compressed 16897210 / 16908055 / -0.1% 36249208 / 35230679 / +2.9% 0.47 / 0.48 / -2.9%
tpcds_q99/datafusion:vortex-file-compressed 19317923 / 20293213 / -4.8% 38403837 / 38754807 / -0.9% 0.50 / 0.52 / -3.9%
datafusion / parquet / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 34393574 / 30935998 / +11.2% 🔴 50726631 / 50562502 / +0.3% 0.68 / 0.61 / +10.8%
tpcds_q02/datafusion:parquet 45284734 / 45200922 / +0.2% 59756334 / 59041692 / +1.2% 0.76 / 0.77 / -1.0%
tpcds_q03/datafusion:parquet 18802307 / 18926213 / -0.7% 33839516 / 31509095 / +7.4% 0.56 / 0.60 / -7.5%
tpcds_q04/datafusion:parquet 193737331 / 194939764 / -0.6% 225018684 / 223126562 / +0.8% 0.86 / 0.87 / -1.5%
tpcds_q05/datafusion:parquet 71402279 / 70438303 / +1.4% 92013107 / 90973348 / +1.1% 0.78 / 0.77 / +0.2%
tpcds_q06/datafusion:parquet 35407614 / 35165927 / +0.7% 51148547 / 50704459 / +0.9% 0.69 / 0.69 / -0.2%
tpcds_q07/datafusion:parquet 45979342 / 46689342 / -1.5% 65376417 / 66217070 / -1.3% 0.70 / 0.71 / -0.3%
tpcds_q08/datafusion:parquet 39936284 / 39169563 / +2.0% 52277212 / 51527564 / +1.5% 0.76 / 0.76 / +0.5%
tpcds_q09/datafusion:parquet 32120856 / 31081165 / +3.3% 44228384 / 39657919 / +11.5% 🔴 0.73 / 0.78 / -7.3%
tpcds_q10/datafusion:parquet 51200741 / 49954590 / +2.5% 61535415 / 61701411 / -0.3% 0.83 / 0.81 / +2.8%
tpcds_q11/datafusion:parquet 94419730 / 92950558 / +1.6% 114346839 / 115753121 / -1.2% 0.83 / 0.80 / +2.8%
tpcds_q12/datafusion:parquet 24206592 / 24301670 / -0.4% 35036769 / 35268626 / -0.7% 0.69 / 0.69 / +0.3%
tpcds_q13/datafusion:parquet 45199456 / 45609725 / -0.9% 66662181 / 67289629 / -0.9% 0.68 / 0.68 / +0.0%
tpcds_q14/datafusion:parquet 144505586 / 137481466 / +5.1% 154222739 / 158689037 / -2.8% 0.94 / 0.87 / +8.2%
tpcds_q15/datafusion:parquet 30788032 / 31333569 / -1.7% 49262852 / 48640508 / +1.3% 0.62 / 0.64 / -3.0%
tpcds_q16/datafusion:parquet 37412711 / 37133820 / +0.8% 55436040 / 54479503 / +1.8% 0.67 / 0.68 / -1.0%
tpcds_q17/datafusion:parquet 73179642 / 74028865 / -1.1% 98775791 / 104354224 / -5.3% 0.74 / 0.71 / +4.4%
tpcds_q18/datafusion:parquet 57898732 / 57396334 / +0.9% 75420043 / 76631451 / -1.6% 0.77 / 0.75 / +2.5%
tpcds_q19/datafusion:parquet 32151258 / 31672409 / +1.5% 49781886 / 51004128 / -2.4% 0.65 / 0.62 / +4.0%
tpcds_q20/datafusion:parquet 25838783 / 25408234 / +1.7% 37675464 / 39443122 / -4.5% 0.69 / 0.64 / +6.5%
tpcds_q21/datafusion:parquet 20378830 / 20331385 / +0.2% 33793549 / 31828759 / +6.2% 0.60 / 0.64 / -5.6%
tpcds_q22/datafusion:parquet 77248055 / 77627236 / -0.5% 90847578 / 91065472 / -0.2% 0.85 / 0.85 / -0.2%
tpcds_q23/datafusion:parquet 116234168 / 113872852 / +2.1% 134466576 / 141354946 / -4.9% 0.86 / 0.81 / +7.3%
tpcds_q24/datafusion:parquet 91662794 / 90147799 / +1.7% 117785458 / 114608644 / +2.8% 0.78 / 0.79 / -1.1%
tpcds_q25/datafusion:parquet 74863819 / 75000082 / -0.2% 96935004 / 98658560 / -1.7% 0.77 / 0.76 / +1.6%
tpcds_q26/datafusion:parquet 43330312 / 42118034 / +2.9% 55975803 / 59811652 / -6.4% 0.77 / 0.70 / +9.9%
tpcds_q27/datafusion:parquet 81354966 / 77145153 / +5.5% 102800378 / 104180522 / -1.3% 0.79 / 0.74 / +6.9%
tpcds_q28/datafusion:parquet 26439616 / 26776391 / -1.3% 44652628 / 43382610 / +2.9% 0.59 / 0.62 / -4.1%
tpcds_q29/datafusion:parquet 76035694 / 75524293 / +0.7% 99002782 / 103239621 / -4.1% 0.77 / 0.73 / +5.0%
tpcds_q30/datafusion:parquet 45572746 / 46442266 / -1.9% 60566132 / 65177385 / -7.1% 0.75 / 0.71 / +5.6%
tpcds_q31/datafusion:parquet 90301656 / 88558954 / +2.0% 101812140 / 104253809 / -2.3% 0.89 / 0.85 / +4.4%
tpcds_q32/datafusion:parquet 25664458 / 25385418 / +1.1% 40261675 / 41003856 / -1.8% 0.64 / 0.62 / +3.0%
tpcds_q33/datafusion:parquet 40479981 / 39069677 / +3.6% 52952151 / 52955369 / -0.0% 0.76 / 0.74 / +3.6%
tpcds_q34/datafusion:parquet 23815200 / 23615276 / +0.8% 38182593 / 36967856 / +3.3% 0.62 / 0.64 / -2.4%
tpcds_q35/datafusion:parquet 53713941 / 55028627 / -2.4% 70709817 / 72267445 / -2.2% 0.76 / 0.76 / -0.2%
tpcds_q36/datafusion:parquet 52215790 / 52045702 / +0.3% 70758246 / 71473567 / -1.0% 0.74 / 0.73 / +1.3%
tpcds_q37/datafusion:parquet 25598746 / 25893606 / -1.1% 39636929 / 39119292 / +1.3% 0.65 / 0.66 / -2.4%
tpcds_q38/datafusion:parquet 45024143 / 44242203 / +1.8% 61908794 / 62938824 / -1.6% 0.73 / 0.70 / +3.5%
tpcds_q39/datafusion:parquet 71259528 / 71874782 / -0.9% 91398561 / 89166621 / +2.5% 0.78 / 0.81 / -3.3%
tpcds_q40/datafusion:parquet 27880544 / 28384260 / -1.8% 50885591 / 49888408 / +2.0% 0.55 / 0.57 / -3.7%
tpcds_q41/datafusion:parquet 20238806 / 20556382 / -1.5% 32753766 / 33096574 / -1.0% 0.62 / 0.62 / -0.5%
tpcds_q42/datafusion:parquet 17968618 / 17957516 / +0.1% 32175270 / 31560733 / +1.9% 0.56 / 0.57 / -1.8%
tpcds_q43/datafusion:parquet 19278878 / 19332442 / -0.3% 33785193 / 33407068 / +1.1% 0.57 / 0.58 / -1.4%
tpcds_q44/datafusion:parquet 33956850 / 33575655 / +1.1% 53051155 / 51068525 / +3.9% 0.64 / 0.66 / -2.6%
tpcds_q45/datafusion:parquet 37502246 / 37993418 / -1.3% 52975705 / 53213741 / -0.4% 0.71 / 0.71 / -0.8%
tpcds_q46/datafusion:parquet 28931089 / 29463263 / -1.8% 46925731 / 49143133 / -4.5% 0.62 / 0.60 / +2.8%
tpcds_q47/datafusion:parquet 98392633 / 98495040 / -0.1% 117550361 / 123088282 / -4.5% 0.84 / 0.80 / +4.6%
tpcds_q48/datafusion:parquet 40912212 / 41949387 / -2.5% 59621121 / 61147874 / -2.5% 0.69 / 0.69 / +0.0%
tpcds_q49/datafusion:parquet 75248794 / 74818625 / +0.6% 98594693 / 95276559 / +3.5% 0.76 / 0.79 / -2.8%
tpcds_q50/datafusion:parquet 47675503 / 47560402 / +0.2% 68482714 / 68632701 / -0.2% 0.70 / 0.69 / +0.5%
tpcds_q51/datafusion:parquet 70654602 / 71157570 / -0.7% 91082789 / 91726861 / -0.7% 0.78 / 0.78 / -0.0%
tpcds_q52/datafusion:parquet 18626518 / 18646448 / -0.1% 32815435 / 32233703 / +1.8% 0.57 / 0.58 / -1.9%
tpcds_q53/datafusion:parquet 22191930 / 22186510 / +0.0% 39315331 / 38955097 / +0.9% 0.56 / 0.57 / -0.9%
tpcds_q54/datafusion:parquet 54821131 / 53822855 / +1.9% 73337473 / 75449886 / -2.8% 0.75 / 0.71 / +4.8%
tpcds_q55/datafusion:parquet 18142884 / 18092693 / +0.3% 32237997 / 31513125 / +2.3% 0.56 / 0.57 / -2.0%
tpcds_q56/datafusion:parquet 46248666 / 44883793 / +3.0% 61526032 / 61183702 / +0.6% 0.75 / 0.73 / +2.5%
tpcds_q57/datafusion:parquet 101401178 / 100059494 / +1.3% 116353399 / 117209076 / -0.7% 0.87 / 0.85 / +2.1%
tpcds_q58/datafusion:parquet 64083206 / 64110570 / -0.0% 82620727 / 83547357 / -1.1% 0.78 / 0.77 / +1.1%
tpcds_q59/datafusion:parquet 45484944 / 47985834 / -5.2% 62936005 / 64963856 / -3.1% 0.72 / 0.74 / -2.2%
tpcds_q60/datafusion:parquet 44761947 / 45757204 / -2.2% 60333271 / 59891797 / +0.7% 0.74 / 0.76 / -2.9%
tpcds_q61/datafusion:parquet 36798144 / 37629775 / -2.2% 55074656 / 60410641 / -8.8% 0.67 / 0.62 / +7.3%
tpcds_q62/datafusion:parquet 25205041 / 24806766 / +1.6% 38520953 / 37956361 / +1.5% 0.65 / 0.65 / +0.1%
tpcds_q63/datafusion:parquet 22051467 / 22381012 / -1.5% 38842535 / 39466968 / -1.6% 0.57 / 0.57 / +0.1%
tpcds_q64/datafusion:parquet 203891426 / 204074782 / -0.1% 233492535 / 234950902 / -0.6% 0.87 / 0.87 / +0.5%
tpcds_q65/datafusion:parquet 36231730 / 37459104 / -3.3% 52826924 / 52403882 / +0.8% 0.69 / 0.71 / -4.1%
tpcds_q66/datafusion:parquet 61917468 / 60835616 / +1.8% 77121096 / 78800200 / -2.1% 0.80 / 0.77 / +4.0%
tpcds_q67/datafusion:parquet 69777195 / 69517751 / +0.4% 93961488 / 94623963 / -0.7% 0.74 / 0.73 / +1.1%
tpcds_q68/datafusion:parquet 29485236 / 29525924 / -0.1% 50188456 / 49916810 / +0.5% 0.59 / 0.59 / -0.7%
tpcds_q69/datafusion:parquet 49599394 / 50366937 / -1.5% 59551770 / 67196559 / -11.4% 🟢 0.83 / 0.75 / +11.1%
tpcds_q70/datafusion:parquet 36951531 / 36924100 / +0.1% 49681002 / 56617582 / -12.3% 🟢 0.74 / 0.65 / +14.0%
tpcds_q71/datafusion:parquet 28162300 / 27149503 / +3.7% 42276937 / 43353198 / -2.5% 0.67 / 0.63 / +6.4%
tpcds_q72/datafusion:parquet 558955394 / 562322333 / -0.6% 583202360 / 589115760 / -1.0% 0.96 / 0.95 / +0.4%
tpcds_q73/datafusion:parquet 22907150 / 22783696 / +0.5% 38564125 / 38087114 / +1.3% 0.59 / 0.60 / -0.7%
tpcds_q74/datafusion:parquet 67370647 / 68922596 / -2.3% 86499724 / 88023625 / -1.7% 0.78 / 0.78 / -0.5%
tpcds_q75/datafusion:parquet 147068499 / 145194639 / +1.3% 171136331 / 169420082 / +1.0% 0.86 / 0.86 / +0.3%
tpcds_q76/datafusion:parquet 54707773 / 53298780 / +2.6% 72128812 / 67406065 / +7.0% 0.76 / 0.79 / -4.1%
tpcds_q77/datafusion:parquet 56746512 / 55127777 / +2.9% 78418876 / 75018143 / +4.5% 0.72 / 0.73 / -1.5%
tpcds_q78/datafusion:parquet 93046760 / 92808430 / +0.3% 121139448 / 119338885 / +1.5% 0.77 / 0.78 / -1.2%
tpcds_q79/datafusion:parquet 25672573 / 25923438 / -1.0% 43653171 / 44064912 / -0.9% 0.59 / 0.59 / -0.0%
tpcds_q80/datafusion:parquet 81285920 / 81979336 / -0.8% 110530282 / 112821458 / -2.0% 0.74 / 0.73 / +1.2%
tpcds_q81/datafusion:parquet 44390697 / 40491206 / +9.6% 63481739 / 61291286 / +3.6% 0.70 / 0.66 / +5.8%
tpcds_q82/datafusion:parquet 25884515 / 26164786 / -1.1% 41557069 / 40038666 / +3.8% 0.62 / 0.65 / -4.7%
tpcds_q83/datafusion:parquet 58296748 / 57467336 / +1.4% 76070522 / 77315143 / -1.6% 0.77 / 0.74 / +3.1%
tpcds_q84/datafusion:parquet 31010926 / 30262945 / +2.5% 44572649 / 43064970 / +3.5% 0.70 / 0.70 / -1.0%
tpcds_q85/datafusion:parquet 83727812 / 82910382 / +1.0% 107575933 / 106993982 / +0.5% 0.78 / 0.77 / +0.4%
tpcds_q86/datafusion:parquet 20235968 / 20274558 / -0.2% 34078094 / 34795681 / -2.1% 0.59 / 0.58 / +1.9%
tpcds_q87/datafusion:parquet 45648868 / 46960876 / -2.8% 62623738 / 64758733 / -3.3% 0.73 / 0.73 / +0.5%
tpcds_q88/datafusion:parquet 49282562 / 46638045 / +5.7% 68598697 / 64994054 / +5.5% 0.72 / 0.72 / +0.1%
tpcds_q89/datafusion:parquet 25470111 / 25541054 / -0.3% 43439189 / 42782698 / +1.5% 0.59 / 0.60 / -1.8%
tpcds_q90/datafusion:parquet 19945529 / 19182770 / +4.0% 33697634 / 32641252 / +3.2% 0.59 / 0.59 / +0.7%
tpcds_q91/datafusion:parquet 36230704 / 36974026 / -2.0% 52378253 / 54805310 / -4.4% 0.69 / 0.67 / +2.5%
tpcds_q92/datafusion:parquet 26169024 / 26069692 / +0.4% 41257725 / 40744090 / +1.3% 0.63 / 0.64 / -0.9%
tpcds_q93/datafusion:parquet 26820673 / 26915638 / -0.4% 48186141 / 47267585 / +1.9% 0.56 / 0.57 / -2.3%
tpcds_q94/datafusion:parquet 34730798 / 34614050 / +0.3% 49339076 / 49328487 / +0.0% 0.70 / 0.70 / +0.3%
tpcds_q95/datafusion:parquet 64655851 / 64861340 / -0.3% 81243017 / 78743039 / +3.2% 0.80 / 0.82 / -3.4%
tpcds_q96/datafusion:parquet 16682008 / 16814866 / -0.8% 31157681 / 30981778 / +0.6% 0.54 / 0.54 / -1.4%
tpcds_q97/datafusion:parquet 35100868 / 35177364 / -0.2% 54017007 / 52915844 / +2.1% 0.65 / 0.66 / -2.3%
tpcds_q98/datafusion:parquet 25092092 / 25111460 / -0.1% 40009992 / 39760706 / +0.6% 0.63 / 0.63 / -0.7%
tpcds_q99/datafusion:parquet 29401488 / 29588132 / -0.6% 43863691 / 42840674 / +2.4% 0.67 / 0.69 / -2.9%
duckdb / vortex-file-compressed / ns (0.978x ➖, 8↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15326495 / 15165242 / +1.1% 22651239 / 26233844 / -13.7% 🟢 0.68 / 0.58 / +17.0%
tpcds_q02/duckdb:vortex-file-compressed 14993737 / 15380758 / -2.5% 19799632 / 20609394 / -3.9% 0.76 / 0.75 / +1.5%
tpcds_q03/duckdb:vortex-file-compressed 12088946 / 12375548 / -2.3% 19162815 / 21174389 / -9.5% 0.63 / 0.58 / +7.9%
tpcds_q04/duckdb:vortex-file-compressed 50665979 / 52315528 / -3.2% 58236460 / 63646408 / -8.5% 0.87 / 0.82 / +5.8%
tpcds_q05/duckdb:vortex-file-compressed 18999324 / 19570788 / -2.9% 26763640 / 28011121 / -4.5% 0.71 / 0.70 / +1.6%
tpcds_q06/duckdb:vortex-file-compressed 26685288 / 27176047 / -1.8% 39695170 / 40037693 / -0.9% 0.67 / 0.68 / -1.0%
tpcds_q07/duckdb:vortex-file-compressed 16291662 / 15632729 / +4.2% 27370705 / 28156092 / -2.8% 0.60 / 0.56 / +7.2%
tpcds_q08/duckdb:vortex-file-compressed 19164088 / 23237125 / -17.5% 🟢 27640681 / 36097109 / -23.4% 🟢 0.69 / 0.64 / +7.7%
tpcds_q09/duckdb:vortex-file-compressed 10879074 / 10740193 / +1.3% 16928268 / 18698725 / -9.5% 0.64 / 0.57 / +11.9%
tpcds_q10/duckdb:vortex-file-compressed 27749162 / 30754948 / -9.8% 44239265 / 43140283 / +2.5% 0.63 / 0.71 / -12.0%
tpcds_q11/duckdb:vortex-file-compressed 40269466 / 41101447 / -2.0% 49030243 / 53516118 / -8.4% 0.82 / 0.77 / +6.9%
tpcds_q12/duckdb:vortex-file-compressed 11153990 / 10641514 / +4.8% 17104677 / 17209536 / -0.6% 0.65 / 0.62 / +5.5%
tpcds_q13/duckdb:vortex-file-compressed 23703519 / 21780657 / +8.8% 37186161 / 37345361 / -0.4% 0.64 / 0.58 / +9.3%
tpcds_q14/duckdb:vortex-file-compressed 57918526 / 59022265 / -1.9% 69045328 / 75869316 / -9.0% 0.84 / 0.78 / +7.8%
tpcds_q15/duckdb:vortex-file-compressed 20570344 / 22397497 / -8.2% 27016634 / 27098405 / -0.3% 0.76 / 0.83 / -7.9%
tpcds_q16/duckdb:vortex-file-compressed 17735804 / 18890372 / -6.1% 26212078 / 27103124 / -3.3% 0.68 / 0.70 / -2.9%
tpcds_q17/duckdb:vortex-file-compressed 29607032 / 30988800 / -4.5% 42120002 / 48230152 / -12.7% 🟢 0.70 / 0.64 / +9.4%
tpcds_q18/duckdb:vortex-file-compressed 28500298 / 29808852 / -4.4% 37503493 / 38855617 / -3.5% 0.76 / 0.77 / -0.9%
tpcds_q19/duckdb:vortex-file-compressed 23541034 / 24446414 / -3.7% 33134697 / 34751061 / -4.7% 0.71 / 0.70 / +1.0%
tpcds_q20/duckdb:vortex-file-compressed 10738174 / 11611942 / -7.5% 15089704 / 15210926 / -0.8% 0.71 / 0.76 / -6.8%
tpcds_q21/duckdb:vortex-file-compressed 10333680 / 9854328 / +4.9% 17361533 / 17856652 / -2.8% 0.60 / 0.55 / +7.9%
tpcds_q22/duckdb:vortex-file-compressed 29481594 / 29383963 / +0.3% 38699807 / 40319727 / -4.0% 0.76 / 0.73 / +4.5%
tpcds_q23/duckdb:vortex-file-compressed 36459432 / 35875252 / +1.6% 47535884 / 47193152 / +0.7% 0.77 / 0.76 / +0.9%
tpcds_q24/duckdb:vortex-file-compressed 28129836 / 28313328 / -0.6% 40698447 / 38808025 / +4.9% 0.69 / 0.73 / -5.3%
tpcds_q25/duckdb:vortex-file-compressed 26566580 / 25999813 / +2.2% 39202867 / 42447158 / -7.6% 0.68 / 0.61 / +10.6%
tpcds_q26/duckdb:vortex-file-compressed 13324126 / 14624563 / -8.9% 20040111 / 20656973 / -3.0% 0.66 / 0.71 / -6.1%
tpcds_q27/duckdb:vortex-file-compressed 17687214 / 17636664 / +0.3% 32496402 / 29510437 / +10.1% 🔴 0.54 / 0.60 / -8.9%
tpcds_q28/duckdb:vortex-file-compressed 8135931 / 8752496 / -7.0% 15485162 / 14268363 / +8.5% 0.53 / 0.61 / -14.3%
tpcds_q29/duckdb:vortex-file-compressed 28594306 / 29923032 / -4.4% 43645506 / 46096715 / -5.3% 0.66 / 0.65 / +0.9%
tpcds_q30/duckdb:vortex-file-compressed 19202086 / 19900722 / -3.5% 28689358 / 27446654 / +4.5% 0.67 / 0.73 / -7.7%
tpcds_q31/duckdb:vortex-file-compressed 19491128 / 19962824 / -2.4% 26578002 / 29638465 / -10.3% 🟢 0.73 / 0.67 / +8.9%
tpcds_q32/duckdb:vortex-file-compressed 10122782 / 10803862 / -6.3% 19843982 / 17064940 / +16.3% 🔴 0.51 / 0.63 / -19.4%
tpcds_q33/duckdb:vortex-file-compressed 16911588 / 17645171 / -4.2% 31619169 / 32182035 / -1.7% 0.53 / 0.55 / -2.5%
tpcds_q34/duckdb:vortex-file-compressed 15493900 / 14180062 / +9.3% 23840706 / 21544364 / +10.7% 🔴 0.65 / 0.66 / -1.3%
tpcds_q35/duckdb:vortex-file-compressed 46177810 / 48609806 / -5.0% 59923185 / 64439810 / -7.0% 0.77 / 0.75 / +2.2%
tpcds_q36/duckdb:vortex-file-compressed 14839214 / 14881830 / -0.3% 26593016 / 32160309 / -17.3% 🟢 0.56 / 0.46 / +20.6%
tpcds_q37/duckdb:vortex-file-compressed 13863032 / 13832222 / +0.2% 23992317 / 22621985 / +6.1% 0.58 / 0.61 / -5.5%
tpcds_q38/duckdb:vortex-file-compressed 22490074 / 22535540 / -0.2% 28333140 / 29407743 / -3.7% 0.79 / 0.77 / +3.6%
tpcds_q39/duckdb:vortex-file-compressed 19649616 / 18413078 / +6.7% 27906863 / 27414060 / +1.8% 0.70 / 0.67 / +4.8%
tpcds_q40/duckdb:vortex-file-compressed 13662854 / 13531731 / +1.0% 18486889 / 22815511 / -19.0% 🟢 0.74 / 0.59 / +24.6%
tpcds_q41/duckdb:vortex-file-compressed 6635836 / 6727019 / -1.4% 9115616 / 12582262 / -27.6% 🟢 0.73 / 0.53 / +36.2%
tpcds_q42/duckdb:vortex-file-compressed 8388529 / 8482072 / -1.1% 16497689 / 18284188 / -9.8% 0.51 / 0.46 / +9.6%
tpcds_q43/duckdb:vortex-file-compressed 10241990 / 10023972 / +2.2% 20398994 / 19252061 / +6.0% 0.50 / 0.52 / -3.6%
tpcds_q44/duckdb:vortex-file-compressed 13908516 / 14204668 / -2.1% 24409458 / 25506623 / -4.3% 0.57 / 0.56 / +2.3%
tpcds_q45/duckdb:vortex-file-compressed 22010430 / 23702717 / -7.1% 29376286 / 30857842 / -4.8% 0.75 / 0.77 / -2.5%
tpcds_q46/duckdb:vortex-file-compressed 18460290 / 17308053 / +6.7% 26383850 / 31114023 / -15.2% 🟢 0.70 / 0.56 / +25.8%
tpcds_q47/duckdb:vortex-file-compressed 30710526 / 30510568 / +0.7% 40632674 / 45439509 / -10.6% 🟢 0.76 / 0.67 / +12.6%
tpcds_q48/duckdb:vortex-file-compressed 19780318 / 19769394 / +0.1% 29994372 / 31919798 / -6.0% 0.66 / 0.62 / +6.5%
tpcds_q49/duckdb:vortex-file-compressed 16737827 / 18630939 / -10.2% 🟢 28470386 / 35498627 / -19.8% 🟢 0.59 / 0.52 / +12.0%
tpcds_q50/duckdb:vortex-file-compressed 16636822 / 16502036 / +0.8% 26614399 / 28572606 / -6.9% 0.63 / 0.58 / +8.2%
tpcds_q51/duckdb:vortex-file-compressed 77074164 / 53010783 / +45.4% 🔴 60250045 / 62348272 / -3.4% 1.28 / 0.85 / +50.5%
tpcds_q52/duckdb:vortex-file-compressed 9622080 / 9033804 / +6.5% 16948734 / 18982877 / -10.7% 🟢 0.57 / 0.48 / +19.3%
tpcds_q53/duckdb:vortex-file-compressed 14779902 / 14342732 / +3.0% 27671763 / 25213691 / +9.7% 0.53 / 0.57 / -6.1%
tpcds_q54/duckdb:vortex-file-compressed 20265171 / 20800618 / -2.6% 27898818 / 32245129 / -13.5% 🟢 0.73 / 0.65 / +12.6%
tpcds_q55/duckdb:vortex-file-compressed 8295058 / 10212706 / -18.8% 🟢 16889895 / 18594866 / -9.2% 0.49 / 0.55 / -10.6%
tpcds_q56/duckdb:vortex-file-compressed 16925299 / 18111580 / -6.5% 26814319 / 32820557 / -18.3% 🟢 0.63 / 0.55 / +14.4%
tpcds_q57/duckdb:vortex-file-compressed 24132658 / 25108599 / -3.9% 30530030 / 35834982 / -14.8% 🟢 0.79 / 0.70 / +12.8%
tpcds_q58/duckdb:vortex-file-compressed 18405734 / 18513169 / -0.6% 26876935 / 28665825 / -6.2% 0.68 / 0.65 / +6.0%
tpcds_q59/duckdb:vortex-file-compressed 18734742 / 20015972 / -6.4% 23865968 / 25928756 / -8.0% 0.78 / 0.77 / +1.7%
tpcds_q60/duckdb:vortex-file-compressed 17582134 / 18855700 / -6.8% 27930316 / 29148999 / -4.2% 0.63 / 0.65 / -2.7%
tpcds_q61/duckdb:vortex-file-compressed 20048802 / 20720300 / -3.2% 31489908 / 34814946 / -9.6% 0.64 / 0.60 / +7.0%
tpcds_q62/duckdb:vortex-file-compressed 11483882 / 10270924 / +11.8% 🔴 16106474 / 17826118 / -9.6% 0.71 / 0.58 / +23.7%
tpcds_q63/duckdb:vortex-file-compressed 14298826 / 13616360 / +5.0% 22281779 / 24539888 / -9.2% 0.64 / 0.55 / +15.7%
tpcds_q64/duckdb:vortex-file-compressed 62670831 / 63573324 / -1.4% 74910034 / 80031672 / -6.4% 0.84 / 0.79 / +5.3%
tpcds_q65/duckdb:vortex-file-compressed 13665785 / 13455796 / +1.6% 23034434 / 21681255 / +6.2% 0.59 / 0.62 / -4.4%
tpcds_q66/duckdb:vortex-file-compressed 21540327 / 23181780 / -7.1% 31747261 / 33871769 / -6.3% 0.68 / 0.68 / -0.9%
tpcds_q67/duckdb:vortex-file-compressed 65662832 / 64484688 / +1.8% 90790261 / 83086018 / +9.3% 0.72 / 0.78 / -6.8%
tpcds_q68/duckdb:vortex-file-compressed 18009076 / 16957851 / +6.2% 31165955 / 32421422 / -3.9% 0.58 / 0.52 / +10.5%
tpcds_q69/duckdb:vortex-file-compressed 29058358 / 31719735 / -8.4% 41451297 / 44483360 / -6.8% 0.70 / 0.71 / -1.7%
tpcds_q70/duckdb:vortex-file-compressed 18624963 / 19042756 / -2.2% 31602645 / 32389702 / -2.4% 0.59 / 0.59 / +0.2%
tpcds_q71/duckdb:vortex-file-compressed 12718136 / 14131276 / -10.0% 🟢 22491138 / 24071208 / -6.6% 0.57 / 0.59 / -3.7%
tpcds_q72/duckdb:vortex-file-compressed 61346262 / 62682323 / -2.1% 76262077 / 74854778 / +1.9% 0.80 / 0.84 / -3.9%
tpcds_q73/duckdb:vortex-file-compressed 14894716 / 13242242 / +12.5% 🔴 20140709 / 25706973 / -21.7% 🟢 0.74 / 0.52 / +43.6%
tpcds_q74/duckdb:vortex-file-compressed 27189493 / 28166638 / -3.5% 34599807 / 40170323 / -13.9% 🟢 0.79 / 0.70 / +12.1%
tpcds_q75/duckdb:vortex-file-compressed 28765742 / 29009972 / -0.8% 40148078 / 39874407 / +0.7% 0.72 / 0.73 / -1.5%
tpcds_q76/duckdb:vortex-file-compressed 12295008 / 14089880 / -12.7% 🟢 25894242 / 26106820 / -0.8% 0.47 / 0.54 / -12.0%
tpcds_q77/duckdb:vortex-file-compressed 15924845 / 17020404 / -6.4% 24279501 / 26399411 / -8.0% 0.66 / 0.64 / +1.7%
tpcds_q78/duckdb:vortex-file-compressed 37357542 / 38684372 / -3.4% 45249829 / 47587014 / -4.9% 0.83 / 0.81 / +1.6%
tpcds_q79/duckdb:vortex-file-compressed 14753741 / 14518179 / +1.6% 27495072 / 25371857 / +8.4% 0.54 / 0.57 / -6.2%
tpcds_q80/duckdb:vortex-file-compressed 27783610 / 29723538 / -6.5% 39395596 / 44790498 / -12.0% 🟢 0.71 / 0.66 / +6.3%
tpcds_q81/duckdb:vortex-file-compressed 24403818 / 22972180 / +6.2% 33023245 / 32818051 / +0.6% 0.74 / 0.70 / +5.6%
tpcds_q82/duckdb:vortex-file-compressed 31874022 / 32324054 / -1.4% 40003989 / 39646854 / +0.9% 0.80 / 0.82 / -2.3%
tpcds_q83/duckdb:vortex-file-compressed 18564988 / 22960004 / -19.1% 🟢 26584745 / 25588492 / +3.9% 0.70 / 0.90 / -22.2%
tpcds_q84/duckdb:vortex-file-compressed 12530240 / 13249312 / -5.4% 21378369 / 23846283 / -10.3% 🟢 0.59 / 0.56 / +5.5%
tpcds_q85/duckdb:vortex-file-compressed 31429088 / 32959830 / -4.6% 40099999 / 42362898 / -5.3% 0.78 / 0.78 / +0.7%
tpcds_q86/duckdb:vortex-file-compressed 11031596 / 10941340 / +0.8% 17160335 / 18946760 / -9.4% 0.64 / 0.58 / +11.3%
tpcds_q87/duckdb:vortex-file-compressed 24354056 / 24686634 / -1.3% 30047416 / 34506594 / -12.9% 🟢 0.81 / 0.72 / +13.3%
tpcds_q88/duckdb:vortex-file-compressed 33467600 / 36242020 / -7.7% 45552889 / 50675671 / -10.1% 🟢 0.73 / 0.72 / +2.7%
tpcds_q89/duckdb:vortex-file-compressed 13884027 / 13743122 / +1.0% 23835842 / 23486341 / +1.5% 0.58 / 0.59 / -0.5%
tpcds_q90/duckdb:vortex-file-compressed 7599774 / 8274548 / -8.2% 12962546 / 14651666 / -11.5% 🟢 0.59 / 0.56 / +3.8%
tpcds_q91/duckdb:vortex-file-compressed 15300086 / 17227874 / -11.2% 🟢 22253292 / 23313664 / -4.5% 0.69 / 0.74 / -7.0%
tpcds_q92/duckdb:vortex-file-compressed 13130264 / 14188566 / -7.5% 21683241 / 22520101 / -3.7% 0.61 / 0.63 / -3.9%
tpcds_q93/duckdb:vortex-file-compressed 17051870 / 16620348 / +2.6% 23832865 / 23501553 / +1.4% 0.72 / 0.71 / +1.2%
tpcds_q94/duckdb:vortex-file-compressed 16615453 / 17431823 / -4.7% 25406026 / 26894164 / -5.5% 0.65 / 0.65 / +0.9%
tpcds_q95/duckdb:vortex-file-compressed 71492053 / 72513978 / -1.4% 84315289 / 80638256 / +4.6% 0.85 / 0.90 / -5.7%
tpcds_q96/duckdb:vortex-file-compressed 7476380 / 8414718 / -11.2% 🟢 19320358 / 17676692 / +9.3% 0.39 / 0.48 / -18.7%
tpcds_q97/duckdb:vortex-file-compressed 22092026 / 23397355 / -5.6% 31905230 / 29658334 / +7.6% 0.69 / 0.79 / -12.2%
tpcds_q98/duckdb:vortex-file-compressed 13356650 / 13708410 / -2.6% 20626608 / 22339151 / -7.7% 0.65 / 0.61 / +5.5%
tpcds_q99/duckdb:vortex-file-compressed 13480508 / 14413710 / -6.5% 19868703 / 21714647 / -8.5% 0.68 / 0.66 / +2.2%
duckdb / parquet / ns (0.998x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24784366 / 23537511 / +5.3% 31813616 / 38081028 / -16.5% 🟢 0.78 / 0.62 / +26.0%
tpcds_q02/duckdb:parquet 15556520 / 15359602 / +1.3% 19911123 / 19943074 / -0.2% 0.78 / 0.77 / +1.4%
tpcds_q03/duckdb:parquet 8779916 / 8708997 / +0.8% 18170938 / 16028585 / +13.4% 🔴 0.48 / 0.54 / -11.1%
tpcds_q04/duckdb:parquet 127067410 / 127421330 / -0.3% 135333136 / 135788728 / -0.3% 0.94 / 0.94 / +0.1%
tpcds_q05/duckdb:parquet 21487804 / 21541148 / -0.2% 28911167 / 28854300 / +0.2% 0.74 / 0.75 / -0.4%
tpcds_q06/duckdb:parquet 26496641 / 26633120 / -0.5% 37775910 / 37833777 / -0.2% 0.70 / 0.70 / -0.4%
tpcds_q07/duckdb:parquet 16743998 / 15275677 / +9.6% 23941961 / 23134088 / +3.5% 0.70 / 0.66 / +5.9%
tpcds_q08/duckdb:parquet 25274404 / 25590490 / -1.2% 33394512 / 33191265 / +0.6% 0.76 / 0.77 / -1.8%
tpcds_q09/duckdb:parquet 18717596 / 19401336 / -3.5% 22611779 / 23141975 / -2.3% 0.83 / 0.84 / -1.3%
tpcds_q10/duckdb:parquet 27635037 / 28850976 / -4.2% 38449345 / 40294395 / -4.6% 0.72 / 0.72 / +0.4%
tpcds_q11/duckdb:parquet 72692188 / 71552302 / +1.6% 78800982 / 78331266 / +0.6% 0.92 / 0.91 / +1.0%
tpcds_q12/duckdb:parquet 12620870 / 12735832 / -0.9% 17523165 / 17284056 / +1.4% 0.72 / 0.74 / -2.3%
tpcds_q13/duckdb:parquet 23847544 / 25262581 / -5.6% 31861853 / 35656437 / -10.6% 🟢 0.75 / 0.71 / +5.6%
tpcds_q14/duckdb:parquet 60629476 / 61065876 / -0.7% 67060733 / 69041030 / -2.9% 0.90 / 0.88 / +2.2%
tpcds_q15/duckdb:parquet 24828011 / 24872174 / -0.2% 31090363 / 33930543 / -8.4% 0.80 / 0.73 / +8.9%
tpcds_q16/duckdb:parquet 19973444 / 22146242 / -9.8% 29082915 / 31481314 / -7.6% 0.69 / 0.70 / -2.4%
tpcds_q17/duckdb:parquet 32287373 / 32384104 / -0.3% 40862298 / 40444880 / +1.0% 0.79 / 0.80 / -1.3%
tpcds_q18/duckdb:parquet 38718481 / 38924276 / -0.5% 50794726 / 52568708 / -3.4% 0.76 / 0.74 / +2.9%
tpcds_q19/duckdb:parquet 24267939 / 24462964 / -0.8% 31940405 / 34911887 / -8.5% 0.76 / 0.70 / +8.4%
tpcds_q20/duckdb:parquet 13486082 / 13518640 / -0.2% 18546191 / 18334133 / +1.2% 0.73 / 0.74 / -1.4%
tpcds_q21/duckdb:parquet 9348034 / 9542860 / -2.0% 13372554 / 14204683 / -5.9% 0.70 / 0.67 / +4.1%
tpcds_q22/duckdb:parquet 36289940 / 35238094 / +3.0% 39777180 / 39103858 / +1.7% 0.91 / 0.90 / +1.2%
tpcds_q23/duckdb:parquet 40389605 / 40255534 / +0.3% 46630885 / 48496960 / -3.8% 0.87 / 0.83 / +4.3%
tpcds_q24/duckdb:parquet 33360720 / 33601052 / -0.7% 44217755 / 44095714 / +0.3% 0.75 / 0.76 / -1.0%
tpcds_q25/duckdb:parquet 30076896 / 30114822 / -0.1% 41046041 / 42815031 / -4.1% 0.73 / 0.70 / +4.2%
tpcds_q26/duckdb:parquet 31026482 / 31110258 / -0.3% 39384454 / 37928331 / +3.8% 0.79 / 0.82 / -4.0%
tpcds_q27/duckdb:parquet 33248727 / 31703888 / +4.9% 40627358 / 41878321 / -3.0% 0.82 / 0.76 / +8.1%
tpcds_q28/duckdb:parquet 17077446 / 17262172 / -1.1% 25737808 / 20784370 / +23.8% 🔴 0.66 / 0.83 / -20.1%
tpcds_q29/duckdb:parquet 30703268 / 30647837 / +0.2% 40138012 / 40126437 / +0.0% 0.76 / 0.76 / +0.2%
tpcds_q30/duckdb:parquet 32530988 / 32546434 / -0.0% 41036030 / 41424338 / -0.9% 0.79 / 0.79 / +0.9%
tpcds_q31/duckdb:parquet 20524995 / 20441950 / +0.4% 28359608 / 25488261 / +11.3% 🔴 0.72 / 0.80 / -9.8%
tpcds_q32/duckdb:parquet 11030072 / 11246518 / -1.9% 17650376 / 16956087 / +4.1% 0.62 / 0.66 / -5.8%
tpcds_q33/duckdb:parquet 15669892 / 15852970 / -1.2% 22816547 / 30093445 / -24.2% 🟢 0.69 / 0.53 / +30.4%
tpcds_q34/duckdb:parquet 17327308 / 16220510 / +6.8% 21990435 / 21889752 / +0.5% 0.79 / 0.74 / +6.3%
tpcds_q35/duckdb:parquet 47842204 / 46801536 / +2.2% 57079705 / 57002438 / +0.1% 0.84 / 0.82 / +2.1%
tpcds_q36/duckdb:parquet 17699574 / 17997894 / -1.7% 25113585 / 29600188 / -15.2% 🟢 0.70 / 0.61 / +15.9%
tpcds_q37/duckdb:parquet 11613362 / 12448540 / -6.7% 17017844 / 18286712 / -6.9% 0.68 / 0.68 / +0.2%
tpcds_q38/duckdb:parquet 26315772 / 26273840 / +0.2% 29985971 / 30333565 / -1.1% 0.88 / 0.87 / +1.3%
tpcds_q39/duckdb:parquet 24381029 / 24595328 / -0.9% 31604749 / 28918262 / +9.3% 0.77 / 0.85 / -9.3%
tpcds_q40/duckdb:parquet 15691154 / 15778760 / -0.6% 21266597 / 21247110 / +0.1% 0.74 / 0.74 / -0.6%
tpcds_q41/duckdb:parquet 10991348 / 7790892 / +41.1% 🔴 13965060 / 12777396 / +9.3% 0.79 / 0.61 / +29.1%
tpcds_q42/duckdb:parquet 8339934 / 8336603 / +0.0% 14951578 / 15230601 / -1.8% 0.56 / 0.55 / +1.9%
tpcds_q43/duckdb:parquet 10643136 / 10603698 / +0.4% 16213815 / 15654287 / +3.6% 0.66 / 0.68 / -3.1%
tpcds_q44/duckdb:parquet 16430084 / 16051312 / +2.4% 22625298 / 22405406 / +1.0% 0.73 / 0.72 / +1.4%
tpcds_q45/duckdb:parquet 22997542 / 23323878 / -1.4% 29164920 / 29694535 / -1.8% 0.79 / 0.79 / +0.4%
tpcds_q46/duckdb:parquet 36300362 / 36200941 / +0.3% 45158300 / 45347423 / -0.4% 0.80 / 0.80 / +0.7%
tpcds_q47/duckdb:parquet 31183838 / 31022757 / +0.5% 36797045 / 40492827 / -9.1% 0.85 / 0.77 / +10.6%
tpcds_q48/duckdb:parquet 20963413 / 21094521 / -0.6% 28782374 / 29283114 / -1.7% 0.73 / 0.72 / +1.1%
tpcds_q49/duckdb:parquet 18690526 / 18867382 / -0.9% 26895650 / 30942434 / -13.1% 🟢 0.69 / 0.61 / +14.0%
tpcds_q50/duckdb:parquet 17478276 / 18039395 / -3.1% 24988993 / 25915744 / -3.6% 0.70 / 0.70 / +0.5%
tpcds_q51/duckdb:parquet 53239670 / 53447238 / -0.4% 59517227 / 60852713 / -2.2% 0.89 / 0.88 / +1.8%
tpcds_q52/duckdb:parquet 8520866 / 9179378 / -7.2% 15591420 / 15531275 / +0.4% 0.55 / 0.59 / -7.5%
tpcds_q53/duckdb:parquet 11657752 / 11768212 / -0.9% 17066447 / 17521887 / -2.6% 0.68 / 0.67 / +1.7%
tpcds_q54/duckdb:parquet 20171843 / 20338449 / -0.8% 29459578 / 29063635 / +1.4% 0.68 / 0.70 / -2.2%
tpcds_q55/duckdb:parquet 8631248 / 8463765 / +2.0% 15500784 / 14719623 / +5.3% 0.56 / 0.57 / -3.2%
tpcds_q56/duckdb:parquet 16471538 / 16221726 / +1.5% 22716039 / 26958597 / -15.7% 🟢 0.73 / 0.60 / +20.5%
tpcds_q57/duckdb:parquet 28870476 / 28988153 / -0.4% 42886651 / 34171239 / +25.5% 🔴 0.67 / 0.85 / -20.6%
tpcds_q58/duckdb:parquet 18076819 / 18336374 / -1.4% 25888056 / 26214325 / -1.2% 0.70 / 0.70 / -0.2%
tpcds_q59/duckdb:parquet 20012684 / 20157281 / -0.7% 25105767 / 25340440 / -0.9% 0.80 / 0.80 / +0.2%
tpcds_q60/duckdb:parquet 16770476 / 16925551 / -0.9% 30193408 / 24901171 / +21.3% 🔴 0.56 / 0.68 / -18.3%
tpcds_q61/duckdb:parquet 21564974 / 21589221 / -0.1% 29034542 / 28688553 / +1.2% 0.74 / 0.75 / -1.3%
tpcds_q62/duckdb:parquet 10721266 / 10833776 / -1.0% 15176316 / 14741398 / +3.0% 0.71 / 0.73 / -3.9%
tpcds_q63/duckdb:parquet 11016058 / 10907022 / +1.0% 16324551 / 16679000 / -2.1% 0.67 / 0.65 / +3.2%
tpcds_q64/duckdb:parquet 54062669 / 52864910 / +2.3% 71273307 / 66387491 / +7.4% 0.76 / 0.80 / -4.7%
tpcds_q65/duckdb:parquet 14416214 / 14488227 / -0.5% 20731296 / 24848081 / -16.6% 🟢 0.70 / 0.58 / +19.3%
tpcds_q66/duckdb:parquet 24622505 / 24992554 / -1.5% 31400240 / 31580132 / -0.6% 0.78 / 0.79 / -0.9%
tpcds_q67/duckdb:parquet 76766584 / 76739389 / +0.0% 84654072 / 84709084 / -0.1% 0.91 / 0.91 / +0.1%
tpcds_q68/duckdb:parquet 29299824 / 29155210 / +0.5% 40514119 / 40973249 / -1.1% 0.72 / 0.71 / +1.6%
tpcds_q69/duckdb:parquet 28795502 / 29871272 / -3.6% 41607056 / 38411480 / +8.3% 0.69 / 0.78 / -11.0%
tpcds_q70/duckdb:parquet 16039686 / 16136040 / -0.6% 24428759 / 26609238 / -8.2% 0.66 / 0.61 / +8.3%
tpcds_q71/duckdb:parquet 14732096 / 14707833 / +0.2% 22558619 / 21545450 / +4.7% 0.65 / 0.68 / -4.3%
tpcds_q72/duckdb:parquet 92061754 / 81392492 / +13.1% 🔴 86836967 / 88991149 / -2.4% 1.06 / 0.91 / +15.9%
tpcds_q73/duckdb:parquet 13387172 / 13404292 / -0.1% 19537343 / 19806885 / -1.4% 0.69 / 0.68 / +1.3%
tpcds_q74/duckdb:parquet 98200592 / 98888963 / -0.7% 105644207 / 107600238 / -1.8% 0.93 / 0.92 / +1.1%
tpcds_q75/duckdb:parquet 40042223 / 41811192 / -4.2% 51287121 / 50641825 / +1.3% 0.78 / 0.83 / -5.4%
tpcds_q76/duckdb:parquet 13637074 / 14172796 / -3.8% 20761520 / 20705767 / +0.3% 0.66 / 0.68 / -4.0%
tpcds_q77/duckdb:parquet 16865859 / 17878730 / -5.7% 25416151 / 25801049 / -1.5% 0.66 / 0.69 / -4.2%
tpcds_q78/duckdb:parquet 48096990 / 48188124 / -0.2% 54303769 / 54491172 / -0.3% 0.89 / 0.88 / +0.2%
tpcds_q79/duckdb:parquet 20474071 / 20494796 / -0.1% 28976514 / 29285962 / -1.1% 0.71 / 0.70 / +1.0%
tpcds_q80/duckdb:parquet 31139382 / 31191693 / -0.2% 39101611 / 44307866 / -11.8% 🟢 0.80 / 0.70 / +13.1%
tpcds_q81/duckdb:parquet 29822787 / 29923510 / -0.3% 39383947 / 39502196 / -0.3% 0.76 / 0.76 / -0.0%
tpcds_q82/duckdb:parquet 12518885 / 14288526 / -12.4% 🟢 20903187 / 21791651 / -4.1% 0.60 / 0.66 / -8.7%
tpcds_q83/duckdb:parquet 15860260 / 15943786 / -0.5% 20614677 / 20625840 / -0.1% 0.77 / 0.77 / -0.5%
tpcds_q84/duckdb:parquet 17342570 / 17539178 / -1.1% 24558062 / 23517059 / +4.4% 0.71 / 0.75 / -5.3%
tpcds_q85/duckdb:parquet 34588952 / 34981826 / -1.1% 48425121 / 45626265 / +6.1% 0.71 / 0.77 / -6.8%
tpcds_q86/duckdb:parquet 11021300 / 10894862 / +1.2% 15815505 / 15593185 / +1.4% 0.70 / 0.70 / -0.3%
tpcds_q87/duckdb:parquet 28842850 / 28332142 / +1.8% 33438225 / 32936536 / +1.5% 0.86 / 0.86 / +0.3%
tpcds_q88/duckdb:parquet 26761322 / 26838252 / -0.3% 31301286 / 30521128 / +2.6% 0.85 / 0.88 / -2.8%
tpcds_q89/duckdb:parquet 12653138 / 12713529 / -0.5% 18357726 / 18600503 / -1.3% 0.69 / 0.68 / +0.8%
tpcds_q90/duckdb:parquet 6852770 / 7102070 / -3.5% 11664979 / 11365245 / +2.6% 0.59 / 0.62 / -6.0%
tpcds_q91/duckdb:parquet 20604468 / 20781674 / -0.9% 33650610 / 28966692 / +16.2% 🔴 0.61 / 0.72 / -14.7%
tpcds_q92/duckdb:parquet 11243837 / 11482088 / -2.1% 17676919 / 18324353 / -3.5% 0.64 / 0.63 / +1.5%
tpcds_q93/duckdb:parquet 21056906 / 21256206 / -0.9% 28668540 / 29354507 / -2.3% 0.73 / 0.72 / +1.4%
tpcds_q94/duckdb:parquet 17641844 / 15871356 / +11.2% 🔴 24468993 / 28122126 / -13.0% 🟢 0.72 / 0.56 / +27.8%
tpcds_q95/duckdb:parquet 90081180 / 89829964 / +0.3% 98440157 / 97501924 / +1.0% 0.92 / 0.92 / -0.7%
tpcds_q96/duckdb:parquet 6848843 / 8210670 / -16.6% 🟢 10595150 / 10520618 / +0.7% 0.65 / 0.78 / -17.2%
tpcds_q97/duckdb:parquet 25884784 / 25768700 / +0.5% 31995244 / 31187503 / +2.6% 0.81 / 0.83 / -2.1%
tpcds_q98/duckdb:parquet 14875246 / 14893963 / -0.1% 22200878 / 22444755 / -1.1% 0.67 / 0.66 / +1.0%
tpcds_q99/duckdb:parquet 17319602 / 17315148 / +0.0% 21699032 / 21347050 / +1.6% 0.80 / 0.81 / -1.6%

File Size Changes (24 files changed, +3.0% overall, 16↑ 8↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 318.13 KB 685.64 KB +367.51 KB +115.5%
date_dim.vortex 1.0 vortex-file-compressed 516.89 KB 1023.04 KB +506.15 KB +97.9%
customer_demographics.vortex 1.0 vortex-file-compressed 1.18 MB 1.48 MB +312.37 KB +25.9%
customer_address.vortex 1.0 vortex-file-compressed 853.22 KB 1008.32 KB +155.10 KB +18.2%
catalog_page.vortex 1.0 vortex-file-compressed 538.30 KB 610.76 KB +72.46 KB +13.5%
customer.vortex 1.0 vortex-file-compressed 4.09 MB 4.50 MB +423.78 KB +10.1%
item.vortex 1.0 vortex-file-compressed 1.60 MB 1.74 MB +147.51 KB +9.0%
store_sales.vortex 1.0 vortex-file-compressed 96.22 MB 100.64 MB +4.42 MB +4.6%
catalog_returns.vortex 1.0 vortex-file-compressed 7.14 MB 7.30 MB +170.37 KB +2.3%
store_returns.vortex 1.0 vortex-file-compressed 10.93 MB 11.12 MB +199.30 KB +1.8%
catalog_sales.vortex 1.0 vortex-file-compressed 68.32 MB 69.36 MB +1.03 MB +1.5%
web_returns.vortex 1.0 vortex-file-compressed 3.44 MB 3.48 MB +42.42 KB +1.2%
promotion.vortex 1.0 vortex-file-compressed 59.29 KB 59.94 KB +664 B +1.1%
web_sales.vortex 1.0 vortex-file-compressed 33.42 MB 33.63 MB +213.76 KB +0.6%
inventory.vortex 1.0 vortex-file-compressed 36.61 MB 36.63 MB +19.97 KB +0.1%
household_demographics.vortex 1.0 vortex-file-compressed 16.20 KB 16.20 KB +8 B +0.0%
web_site.vortex 1.0 vortex-file-compressed 53.94 KB 53.72 KB 224 B -0.4%
call_center.vortex 1.0 vortex-file-compressed 52.61 KB 52.39 KB 224 B -0.4%
store.vortex 1.0 vortex-file-compressed 48.21 KB 47.99 KB 224 B -0.5%
web_page.vortex 1.0 vortex-file-compressed 29.66 KB 29.44 KB 224 B -0.7%
warehouse.vortex 1.0 vortex-file-compressed 23.88 KB 23.66 KB 224 B -0.9%
ship_mode.vortex 1.0 vortex-file-compressed 13.36 KB 13.14 KB 224 B -1.6%
reason.vortex 1.0 vortex-file-compressed 7.71 KB 7.49 KB 224 B -2.8%
income_band.vortex 1.0 vortex-file-compressed 5.57 KB 5.35 KB 224 B -3.9%

Totals:

  • vortex-file-compressed: 265.68 MB → 273.70 MB (+3.0%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 548ac378 vs base 272bf1db
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.987x ➖ · cold 1.073x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95178432 / 95247742 / -0.1% 170955417 / 152560959 / +12.1% 🔴 0.56 / 0.62 / -10.8%
tpch_q02/datafusion:vortex-file-compressed 64895319 / 64198579 / +1.1% 94276468 / 96836681 / -2.6% 0.69 / 0.66 / +3.8%
tpch_q03/datafusion:vortex-file-compressed 64671344 / 65450850 / -1.2% 123979438 / 111887634 / +10.8% 🔴 0.52 / 0.58 / -10.8%
tpch_q04/datafusion:vortex-file-compressed 35102173 / 36510756 / -3.9% 80888254 / 75585272 / +7.0% 0.43 / 0.48 / -10.2%
tpch_q05/datafusion:vortex-file-compressed 117507117 / 117125574 / +0.3% 177847981 / 174946314 / +1.7% 0.66 / 0.67 / -1.3%
tpch_q06/datafusion:vortex-file-compressed 14606987 / 15521752 / -5.9% 77429692 / 69971053 / +10.7% 🔴 0.19 / 0.22 / -15.0%
tpch_q07/datafusion:vortex-file-compressed 139963677 / 141294023 / -0.9% 202206291 / 195227430 / +3.6% 0.69 / 0.72 / -4.4%
tpch_q08/datafusion:vortex-file-compressed 144597216 / 142510669 / +1.5% 212287467 / 198865856 / +6.7% 0.68 / 0.72 / -5.0%
tpch_q09/datafusion:vortex-file-compressed 183368877 / 186185474 / -1.5% 258447610 / 257121057 / +0.5% 0.71 / 0.72 / -2.0%
tpch_q10/datafusion:vortex-file-compressed 72696414 / 74869725 / -2.9% 145128320 / 135762722 / +6.9% 0.50 / 0.55 / -9.2%
tpch_q11/datafusion:vortex-file-compressed 43362784 / 43031510 / +0.8% 70570833 / 69699529 / +1.3% 0.61 / 0.62 / -0.5%
tpch_q12/datafusion:vortex-file-compressed 44543630 / 45880178 / -2.9% 100719035 / 91357218 / +10.2% 🔴 0.44 / 0.50 / -11.9%
tpch_q13/datafusion:vortex-file-compressed 46748749 / 46754909 / -0.0% 83341453 / 78285845 / +6.5% 0.56 / 0.60 / -6.1%
tpch_q14/datafusion:vortex-file-compressed 25439624 / 25368442 / +0.3% 99921205 / 95811973 / +4.3% 0.25 / 0.26 / -3.8%
tpch_q15/datafusion:vortex-file-compressed 37083008 / 36866412 / +0.6% 102209306 / 101336856 / +0.9% 0.36 / 0.36 / -0.3%
tpch_q16/datafusion:vortex-file-compressed 37198039 / 37821851 / -1.6% 67686989 / 66576375 / +1.7% 0.55 / 0.57 / -3.3%
tpch_q17/datafusion:vortex-file-compressed 172322768 / 177762618 / -3.1% 236364883 / 225979492 / +4.6% 0.73 / 0.79 / -7.3%
tpch_q18/datafusion:vortex-file-compressed 206739016 / 203338034 / +1.7% 265006496 / 268639544 / -1.4% 0.78 / 0.76 / +3.1%
tpch_q19/datafusion:vortex-file-compressed 38132665 / 37989476 / +0.4% 98301908 / 96917471 / +1.4% 0.39 / 0.39 / -1.0%
tpch_q20/datafusion:vortex-file-compressed 62924047 / 63141683 / -0.3% 124878436 / 121052849 / +3.2% 0.50 / 0.52 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 180618971 / 184420398 / -2.1% 246973354 / 242789630 / +1.7% 0.73 / 0.76 / -3.7%
tpch_q22/datafusion:vortex-file-compressed 26367511 / 25811594 / +2.2% 56642077 / 55371841 / +2.3% 0.47 / 0.47 / -0.1%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83252522 / 82686843 / +0.7% 131029814 / 136014076 / -3.7% 0.64 / 0.61 / +4.5%
tpch_q02/datafusion:parquet 137909504 / 136445315 / +1.1% 169649522 / 165974000 / +2.2% 0.81 / 0.82 / -1.1%
tpch_q03/datafusion:parquet 126439274 / 125289498 / +0.9% 189860840 / 202374937 / -6.2% 0.67 / 0.62 / +7.6%
tpch_q04/datafusion:parquet 53161054 / 53700726 / -1.0% 103752850 / 103954287 / -0.2% 0.51 / 0.52 / -0.8%
tpch_q05/datafusion:parquet 166046518 / 164357047 / +1.0% 245930407 / 246225224 / -0.1% 0.68 / 0.67 / +1.1%
tpch_q06/datafusion:parquet 32386157 / 32435051 / -0.2% 80697738 / 85609133 / -5.7% 0.40 / 0.38 / +5.9%
tpch_q07/datafusion:parquet 217011432 / 217011054 / +0.0% 287009036 / 296004589 / -3.0% 0.76 / 0.73 / +3.1%
tpch_q08/datafusion:parquet 212267864 / 211066428 / +0.6% 290556307 / 285913355 / +1.6% 0.73 / 0.74 / -1.0%
tpch_q09/datafusion:parquet 281916880 / 278544901 / +1.2% 371309176 / 364339598 / +1.9% 0.76 / 0.76 / -0.7%
tpch_q10/datafusion:parquet 305988048 / 315121905 / -2.9% 380588895 / 387406317 / -1.8% 0.80 / 0.81 / -1.2%
tpch_q11/datafusion:parquet 97508320 / 97305530 / +0.2% 121965843 / 121431418 / +0.4% 0.80 / 0.80 / -0.2%
tpch_q12/datafusion:parquet 79168089 / 78930283 / +0.3% 134295564 / 131589911 / +2.1% 0.59 / 0.60 / -1.7%
tpch_q13/datafusion:parquet 194960113 / 195130429 / -0.1% 227986557 / 231387840 / -1.5% 0.86 / 0.84 / +1.4%
tpch_q14/datafusion:parquet 77151154 / 75854934 / +1.7% 189845702 / 196041642 / -3.2% 0.41 / 0.39 / +5.0%
tpch_q15/datafusion:parquet 78642285 / 79854064 / -1.5% 138441057 / 141931596 / -2.5% 0.57 / 0.56 / +1.0%
tpch_q16/datafusion:parquet 84565270 / 84766270 / -0.2% 112385730 / 111260453 / +1.0% 0.75 / 0.76 / -1.2%
tpch_q17/datafusion:parquet 207035941 / 203524417 / +1.7% 267201853 / 264440890 / +1.0% 0.77 / 0.77 / +0.7%
tpch_q18/datafusion:parquet 269179090 / 264166168 / +1.9% 315258391 / 317398225 / -0.7% 0.85 / 0.83 / +2.6%
tpch_q19/datafusion:parquet 98381944 / 98128100 / +0.3% 172453621 / 172948702 / -0.3% 0.57 / 0.57 / +0.5%
tpch_q20/datafusion:parquet 154104698 / 153990288 / +0.1% 222838973 / 216628358 / +2.9% 0.69 / 0.71 / -2.7%
tpch_q21/datafusion:parquet 233311588 / 235120718 / -0.8% 313757451 / 319805897 / -1.9% 0.74 / 0.74 / +1.1%
tpch_q22/datafusion:parquet 161706964 / 161297954 / +0.3% 186893734 / 187674134 / -0.4% 0.87 / 0.86 / +0.7%
duckdb / vortex-file-compressed / ns (0.983x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54044405 / 54056582 / -0.0% 103523448 / 94107873 / +10.0% 🔴 0.52 / 0.57 / -9.1%
tpch_q02/duckdb:vortex-file-compressed 31683395 / 32823989 / -3.5% 49711255 / 44568270 / +11.5% 🔴 0.64 / 0.74 / -13.5%
tpch_q03/duckdb:vortex-file-compressed 57463723 / 59196540 / -2.9% 118302175 / 98995636 / +19.5% 🔴 0.49 / 0.60 / -18.8%
tpch_q04/duckdb:vortex-file-compressed 80223013 / 80092163 / +0.2% 126347320 / 110397776 / +14.4% 🔴 0.63 / 0.73 / -12.5%
tpch_q05/duckdb:vortex-file-compressed 63644429 / 65939986 / -3.5% 118967777 / 104827111 / +13.5% 🔴 0.53 / 0.63 / -15.0%
tpch_q06/duckdb:vortex-file-compressed 20514442 / 21234736 / -3.4% 70429622 / 57245367 / +23.0% 🔴 0.29 / 0.37 / -21.5%
tpch_q07/duckdb:vortex-file-compressed 60234393 / 64122796 / -6.1% 139978544 / 127903723 / +9.4% 0.43 / 0.50 / -14.2%
tpch_q08/duckdb:vortex-file-compressed 85083529 / 85672952 / -0.7% 153716979 / 141758290 / +8.4% 0.55 / 0.60 / -8.4%
tpch_q09/duckdb:vortex-file-compressed 167386303 / 169391812 / -1.2% 235609318 / 229628796 / +2.6% 0.71 / 0.74 / -3.7%
tpch_q10/duckdb:vortex-file-compressed 111820143 / 116524021 / -4.0% 203595254 / 187186454 / +8.8% 0.55 / 0.62 / -11.8%
tpch_q11/duckdb:vortex-file-compressed 16496143 / 18017750 / -8.4% 31008619 / 32902445 / -5.8% 0.53 / 0.55 / -2.9%
tpch_q12/duckdb:vortex-file-compressed 56010385 / 55094120 / +1.7% 105557530 / 90249910 / +17.0% 🔴 0.53 / 0.61 / -13.1%
tpch_q13/duckdb:vortex-file-compressed 91249439 / 91708193 / -0.5% 143847770 / 127625229 / +12.7% 🔴 0.63 / 0.72 / -11.7%
tpch_q14/duckdb:vortex-file-compressed 31494847 / 30519655 / +3.2% 81169657 / 74303107 / +9.2% 0.39 / 0.41 / -5.5%
tpch_q15/duckdb:vortex-file-compressed 40878585 / 40052289 / +2.1% 106364817 / 93284207 / +14.0% 🔴 0.38 / 0.43 / -10.5%
tpch_q16/duckdb:vortex-file-compressed 41793959 / 43220838 / -3.3% 53660809 / 54348166 / -1.3% 0.78 / 0.80 / -2.1%
tpch_q17/duckdb:vortex-file-compressed 74977173 / 81689424 / -8.2% 160448504 / 163566087 / -1.9% 0.47 / 0.50 / -6.4%
tpch_q18/duckdb:vortex-file-compressed 131557980 / 135063933 / -2.6% 165073957 / 147940933 / +11.6% 🔴 0.80 / 0.91 / -12.7%
tpch_q19/duckdb:vortex-file-compressed 49408722 / 44131250 / +12.0% 🔴 139798206 / 98875789 / +41.4% 🔴 0.35 / 0.45 / -20.8%
tpch_q20/duckdb:vortex-file-compressed 59633697 / 60426881 / -1.3% 128553510 / 113572070 / +13.2% 🔴 0.46 / 0.53 / -12.8%
tpch_q21/duckdb:vortex-file-compressed 241829471 / 249864898 / -3.2% 294954769 / 272582917 / +8.2% 0.82 / 0.92 / -10.6%
tpch_q22/duckdb:vortex-file-compressed 39578940 / 40592231 / -2.5% 55404186 / 56474653 / -1.9% 0.71 / 0.72 / -0.6%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 69865074 / 70514185 / -0.9% 90948400 / 91748096 / -0.9% 0.77 / 0.77 / -0.0%
tpch_q02/duckdb:parquet 70599226 / 71560336 / -1.3% 82491178 / 83717622 / -1.5% 0.86 / 0.85 / +0.1%
tpch_q03/duckdb:parquet 112639165 / 113542506 / -0.8% 148060896 / 149994843 / -1.3% 0.76 / 0.76 / +0.5%
tpch_q04/duckdb:parquet 74778316 / 75341314 / -0.7% 97698637 / 105526311 / -7.4% 0.77 / 0.71 / +7.2%
tpch_q05/duckdb:parquet 124267201 / 126130977 / -1.5% 164711246 / 163133865 / +1.0% 0.75 / 0.77 / -2.4%
tpch_q06/duckdb:parquet 34782340 / 34785635 / -0.0% 56297332 / 49395074 / +14.0% 🔴 0.62 / 0.70 / -12.3%
tpch_q07/duckdb:parquet 89502065 / 90649958 / -1.3% 131717440 / 129874906 / +1.4% 0.68 / 0.70 / -2.6%
tpch_q08/duckdb:parquet 142653545 / 144798165 / -1.5% 185397471 / 186552620 / -0.6% 0.77 / 0.78 / -0.9%
tpch_q09/duckdb:parquet 221642639 / 223551679 / -0.9% 283758647 / 263908794 / +7.5% 0.78 / 0.85 / -7.8%
tpch_q10/duckdb:parquet 468804464 / 474085325 / -1.1% 509004941 / 510857527 / -0.4% 0.92 / 0.93 / -0.8%
tpch_q11/duckdb:parquet 30596832 / 30876043 / -0.9% 38253723 / 38368003 / -0.3% 0.80 / 0.80 / -0.6%
tpch_q12/duckdb:parquet 74845423 / 77212468 / -3.1% 95038313 / 94053495 / +1.0% 0.79 / 0.82 / -4.1%
tpch_q13/duckdb:parquet 316969784 / 317883949 / -0.3% 328427646 / 334753255 / -1.9% 0.97 / 0.95 / +1.6%
tpch_q14/duckdb:parquet 104266422 / 107694805 / -3.2% 136963589 / 158101843 / -13.4% 🟢 0.76 / 0.68 / +11.8%
tpch_q15/duckdb:parquet 43879291 / 44095921 / -0.5% 66367988 / 68309573 / -2.8% 0.66 / 0.65 / +2.4%
tpch_q16/duckdb:parquet 114054366 / 115296793 / -1.1% 128217981 / 126917125 / +1.0% 0.89 / 0.91 / -2.1%
tpch_q17/duckdb:parquet 73197845 / 73881175 / -0.9% 101032810 / 104392097 / -3.2% 0.72 / 0.71 / +2.4%
tpch_q18/duckdb:parquet 199082053 / 187292197 / +6.3% 178361604 / 192642728 / -7.4% 1.12 / 0.97 / +14.8%
tpch_q19/duckdb:parquet 162238095 / 162284043 / -0.0% 191336078 / 193411791 / -1.1% 0.85 / 0.84 / +1.1%
tpch_q20/duckdb:parquet 127904576 / 128798022 / -0.7% 163076305 / 171737430 / -5.0% 0.78 / 0.75 / +4.6%
tpch_q21/duckdb:parquet 267597441 / 278645335 / -4.0% 289054849 / 290148529 / -0.4% 0.93 / 0.96 / -3.6%
tpch_q22/duckdb:parquet 261246390 / 262314360 / -0.4% 274764302 / 272774113 / +0.7% 0.95 / 0.96 / -1.1%

File Size Changes (8 files changed, +17.1% overall, 6↑ 2↓)
File Scale Format Base HEAD Change %
partsupp.vortex 10.0 vortex-file-compressed 238.44 MB 359.86 MB +121.42 MB +50.9%
customer.vortex 10.0 vortex-file-compressed 82.86 MB 104.80 MB +21.95 MB +26.5%
orders.vortex 10.0 vortex-file-compressed 390.34 MB 492.04 MB +101.70 MB +26.1%
supplier.vortex 10.0 vortex-file-compressed 5.40 MB 6.69 MB +1.29 MB +23.8%
part.vortex 10.0 vortex-file-compressed 48.41 MB 54.08 MB +5.67 MB +11.7%
lineitem.vortex 10.0 vortex-file-compressed 1.56 GB 1.71 GB +152.79 MB +9.5%
nation.vortex 10.0 vortex-file-compressed 10.76 KB 10.54 KB 224 B -2.0%
region.vortex 10.0 vortex-file-compressed 6.73 KB 6.52 KB 224 B -3.2%

Totals:

  • vortex-file-compressed: 2.31 GB → 2.71 GB (+17.1%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 548ac378 vs base 272bf1db
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +21.8%
Engines: DataFusion No clear signal (+29.4%, environment too noisy confidence) · DuckDB No clear signal (+14.5%, environment too noisy confidence)
Vortex (geomean): hot 1.199x ➖ · cold 1.252x ➖
Parquet (geomean): hot 0.985x ➖ · cold 1.026x ➖
Shifts: Parquet (control) -1.5% · Median polish +12.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.247x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 53122662 / 37447859 / +41.9% 🔴 125331458 / 100233121 / +25.0% 0.42 / 0.37 / +13.4%
fineweb_q01/datafusion:vortex-file-compressed 487185412 / 393172298 / +23.9% 914515367 / 667199453 / +37.1% 🔴 0.53 / 0.59 / -9.6%
fineweb_q02/datafusion:vortex-file-compressed 501146901 / 367172770 / +36.5% 🔴 669895943 / 543700463 / +23.2% 0.75 / 0.68 / +10.8%
fineweb_q03/datafusion:vortex-file-compressed 574965046 / 486830361 / +18.1% 912200242 / 849868475 / +7.3% 0.63 / 0.57 / +10.0%
fineweb_q04/datafusion:vortex-file-compressed 498327070 / 420644144 / +18.5% 530950093 / 437815947 / +21.3% 0.94 / 0.96 / -2.3%
fineweb_q05/datafusion:vortex-file-compressed 506097620 / 401002158 / +26.2% 529870352 / 434304540 / +22.0% 0.96 / 0.92 / +3.4%
fineweb_q06/datafusion:vortex-file-compressed 818419504 / 720671221 / +13.6% 858657361 / 719905699 / +19.3% 0.95 / 1.00 / -4.8%
fineweb_q07/datafusion:vortex-file-compressed 545991181 / 471972220 / +15.7% 649056517 / 435233056 / +49.1% 🔴 0.84 / 1.08 / -22.4%
fineweb_q08/datafusion:vortex-file-compressed 243973070 / 186563880 / +30.8% 🔴 254806265 / 189525007 / +34.4% 🔴 0.96 / 0.98 / -2.7%
datafusion / parquet / ns (0.963x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 385305032 / 429144767 / -10.2% 981121170 / 934802405 / +5.0% 0.39 / 0.46 / -14.5%
fineweb_q01/datafusion:parquet 831524293 / 674686876 / +23.2% 862755468 / 615598618 / +40.1% 🔴 0.96 / 1.10 / -12.1%
fineweb_q02/datafusion:parquet 867898804 / 777574104 / +11.6% 941290108 / 697030468 / +35.0% 🔴 0.92 / 1.12 / -17.3%
fineweb_q03/datafusion:parquet 811357870 / 835273170 / -2.9% 798635591 / 883294112 / -9.6% 1.02 / 0.95 / +7.4%
fineweb_q04/datafusion:parquet 747663216 / 1083325687 / -31.0% 🟢 906257140 / 1026036996 / -11.7% 0.83 / 1.06 / -21.9%
fineweb_q05/datafusion:parquet 824146603 / 1010821427 / -18.5% 905194920 / 1228258942 / -26.3% 0.91 / 0.82 / +10.6%
fineweb_q06/datafusion:parquet 774052702 / 699231695 / +10.7% 847961495 / 753786125 / +12.5% 0.91 / 0.93 / -1.6%
fineweb_q07/datafusion:parquet 840474744 / 693418354 / +21.2% 741838145 / 720971835 / +2.9% 1.13 / 0.96 / +17.8%
fineweb_q08/datafusion:parquet 792996712 / 1007240951 / -21.3% 815530700 / 1025353046 / -20.5% 0.97 / 0.98 / -1.0%
duckdb / vortex-file-compressed / ns (1.153x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 64023380 / 65381376 / -2.1% 63349580 / 69563167 / -8.9% 1.01 / 0.94 / +7.5%
fineweb_q01/duckdb:vortex-file-compressed 460930255 / 447990568 / +2.9% 460638329 / 477497013 / -3.5% 1.00 / 0.94 / +6.7%
fineweb_q02/duckdb:vortex-file-compressed 683817784 / 681995246 / +0.3% 701897655 / 634594590 / +10.6% 0.97 / 1.07 / -9.3%
fineweb_q03/duckdb:vortex-file-compressed 1214582404 / 965859771 / +25.8% 1461596969 / 1157302668 / +26.3% 0.83 / 0.83 / -0.4%
fineweb_q04/duckdb:vortex-file-compressed 1201310281 / 1013410513 / +18.5% 1356203500 / 1021696285 / +32.7% 🔴 0.89 / 0.99 / -10.7%
fineweb_q05/duckdb:vortex-file-compressed 1274000360 / 981924377 / +29.7% 2007242079 / 1029596337 / +95.0% 🔴 0.63 / 0.95 / -33.4%
fineweb_q06/duckdb:vortex-file-compressed 1345449338 / 1187036676 / +13.3% 1323436108 / 1213149934 / +9.1% 1.02 / 0.98 / +3.9%
fineweb_q07/duckdb:vortex-file-compressed 1073948278 / 903900872 / +18.8% 1315173595 / 957104014 / +37.4% 🔴 0.82 / 0.94 / -13.5%
fineweb_q08/duckdb:vortex-file-compressed 585622057 / 427442875 / +37.0% 🔴 719339986 / 479635904 / +50.0% 🔴 0.81 / 0.89 / -8.6%
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 547048323 / 674245084 / -18.9% 718399078 / 628912977 / +14.2% 0.76 / 1.07 / -29.0%
fineweb_q01/duckdb:parquet 652144225 / 540397414 / +20.7% 560381350 / 597248792 / -6.2% 1.16 / 0.90 / +28.6%
fineweb_q02/duckdb:parquet 613937898 / 567943312 / +8.1% 810125202 / 762256191 / +6.3% 0.76 / 0.75 / +1.7%
fineweb_q03/duckdb:parquet 1419161361 / 1452917682 / -2.3% 1350291148 / 1333720409 / +1.2% 1.05 / 1.09 / -3.5%
fineweb_q04/duckdb:parquet 784896114 / 719735930 / +9.1% 817249997 / 863897210 / -5.4% 0.96 / 0.83 / +15.3%
fineweb_q05/duckdb:parquet 902940830 / 830256068 / +8.8% 927122575 / 856953658 / +8.2% 0.97 / 0.97 / +0.5%
fineweb_q06/duckdb:parquet 1737564175 / 1677886477 / +3.6% 1744423837 / 1504137800 / +16.0% 1.00 / 1.12 / -10.7%
fineweb_q07/duckdb:parquet 1030734646 / 1422043598 / -27.5% 1085903791 / 1157233811 / -6.2% 0.95 / 1.23 / -22.8%
fineweb_q08/duckdb:parquet 577988034 / 500905814 / +15.4% 592393196 / 518394581 / +14.3% 0.98 / 0.97 / +1.0%

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 548ac378 vs base 272bf1db
Verdict: Likely improvement (medium confidence)
Attributed Vortex impact: -15.9%
Engines: DuckDB Likely improvement (-15.9%, medium confidence)
Vortex (geomean): hot 0.860x ✅ · cold 0.908x ➖
Parquet (geomean): hot 1.022x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +2.2% · Median polish -2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.860x ✅, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9030016 / 9108983 / -0.9% 9447995 / 9559674 / -1.2% 0.96 / 0.95 / +0.3%
statpopgen_q01/duckdb:vortex-file-compressed 10247098 / 10571494 / -3.1% 14565433 / 14526125 / +0.3% 0.70 / 0.73 / -3.3%
statpopgen_q02/duckdb:vortex-file-compressed 303281520 / 380465495 / -20.3% 🟢 326033044 / 397591108 / -18.0% 🟢 0.93 / 0.96 / -2.8%
statpopgen_q03/duckdb:vortex-file-compressed 804673350 / 896171963 / -10.2% 🟢 816558107 / 912909817 / -10.6% 🟢 0.99 / 0.98 / +0.4%
statpopgen_q04/duckdb:vortex-file-compressed 817976470 / 903284992 / -9.4% 834412634 / 899256799 / -7.2% 0.98 / 1.00 / -2.4%
statpopgen_q05/duckdb:vortex-file-compressed 318025023 / 423571518 / -24.9% 🟢 339934431 / 439223703 / -22.6% 🟢 0.94 / 0.96 / -3.0%
statpopgen_q06/duckdb:vortex-file-compressed 1139752831 / 1166294920 / -2.3% 1140770836 / 1183933220 / -3.6% 1.00 / 0.99 / +1.4%
statpopgen_q07/duckdb:vortex-file-compressed 125182988 / 182435040 / -31.4% 🟢 185806987 / 193510827 / -4.0% 0.67 / 0.94 / -28.5%
statpopgen_q08/duckdb:vortex-file-compressed 146823964 / 201894408 / -27.3% 🟢 199933520 / 225006166 / -11.1% 🟢 0.73 / 0.90 / -18.2%
statpopgen_q09/duckdb:vortex-file-compressed 613488317 / 710679142 / -13.7% 🟢 625107792 / 752100088 / -16.9% 🟢 0.98 / 0.94 / +3.9%
statpopgen_q10/duckdb:vortex-file-compressed 1950435624 / 2010807878 / -3.0% 1917320444 / 1982424006 / -3.3% 1.02 / 1.01 / +0.3%
duckdb / parquet / ns (1.022x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 246241467 / 248015293 / -0.7% 247510550 / 246739085 / +0.3% 0.99 / 1.01 / -1.0%
statpopgen_q01/duckdb:parquet 302512294 / 304896009 / -0.8% 302018517 / 308048026 / -2.0% 1.00 / 0.99 / +1.2%
statpopgen_q02/duckdb:parquet 567210336 / 538814458 / +5.3% 575787013 / 553921430 / +3.9% 0.99 / 0.97 / +1.3%
statpopgen_q03/duckdb:parquet 869163337 / 826762838 / +5.1% 879545857 / 866848228 / +1.5% 0.99 / 0.95 / +3.6%
statpopgen_q04/duckdb:parquet 838789828 / 783425931 / +7.1% 805136958 / 790982771 / +1.8% 1.04 / 0.99 / +5.2%
statpopgen_q05/duckdb:parquet 587683900 / 578925712 / +1.5% 580007281 / 591508473 / -1.9% 1.01 / 0.98 / +3.5%
statpopgen_q06/duckdb:parquet 686041250 / 679646988 / +0.9% 718424288 / 692744173 / +3.7% 0.95 / 0.98 / -2.7%
statpopgen_q07/duckdb:parquet 606558848 / 614245380 / -1.3% 723764123 / 716652163 / +1.0% 0.84 / 0.86 / -2.2%
statpopgen_q08/duckdb:parquet 622820156 / 625541709 / -0.4% 683208804 / 691479596 / -1.2% 0.91 / 0.90 / +0.8%
statpopgen_q09/duckdb:parquet 825362894 / 788103662 / +4.7% 811394762 / 808752317 / +0.3% 1.02 / 0.97 / +4.4%
statpopgen_q10/duckdb:parquet 1488553631 / 1435347720 / +3.7% 1283929827 / 1244785287 / +3.1% 1.16 / 1.15 / +0.5%

File Size Changes (1 files changed, +16.6% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.55 GB 1.81 GB +264.56 MB +16.7%

Totals:

  • vortex-file-compressed: 1.55 GB → 1.81 GB (+16.6%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 548ac378 vs base 272bf1db
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -7.4%
Engines: DataFusion Likely improvement (-10.4%, low confidence) · DuckDB No clear signal (-4.2%, low confidence)
Vortex (geomean): hot 0.928x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +0.1% · Median polish -2.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.893x ✅, 13↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241657 / 1281186 / -3.1% 20893303 / 21367758 / -2.2% 0.06 / 0.06 / -0.9%
clickbench_q01/datafusion:vortex-file-compressed 5895994 / 6895408 / -14.5% 🟢 33668812 / 35176266 / -4.3% 0.18 / 0.20 / -10.7%
clickbench_q02/datafusion:vortex-file-compressed 10398864 / 13628486 / -23.7% 🟢 38058528 / 38349819 / -0.8% 0.27 / 0.36 / -23.1%
clickbench_q03/datafusion:vortex-file-compressed 11627843 / 13218204 / -12.0% 🟢 53509236 / 50797149 / +5.3% 0.22 / 0.26 / -16.5%
clickbench_q04/datafusion:vortex-file-compressed 55618756 / 57582030 / -3.4% 91595873 / 90933105 / +0.7% 0.61 / 0.63 / -4.1%
clickbench_q05/datafusion:vortex-file-compressed 71831551 / 77000130 / -6.7% 114322054 / 118962654 / -3.9% 0.63 / 0.65 / -2.9%
clickbench_q06/datafusion:vortex-file-compressed 1258906 / 1266573 / -0.6% 20881720 / 21659367 / -3.6% 0.06 / 0.06 / +3.1%
clickbench_q07/datafusion:vortex-file-compressed 9757014 / 13700830 / -28.8% 🟢 34030574 / 37804881 / -10.0% 0.29 / 0.36 / -20.9%
clickbench_q08/datafusion:vortex-file-compressed 78545788 / 79118400 / -0.7% 117417663 / 114482898 / +2.6% 0.67 / 0.69 / -3.2%
clickbench_q09/datafusion:vortex-file-compressed 167450414 / 173905476 / -3.7% 210491324 / 212334918 / -0.9% 0.80 / 0.82 / -2.9%
clickbench_q10/datafusion:vortex-file-compressed 23630904 / 40683106 / -41.9% 🟢 65287179 / 70867982 / -7.9% 0.36 / 0.57 / -36.9%
clickbench_q11/datafusion:vortex-file-compressed 26687208 / 53583242 / -50.2% 🟢 69059871 / 82165658 / -16.0% 🟢 0.39 / 0.65 / -40.7%
clickbench_q12/datafusion:vortex-file-compressed 69189208 / 76407676 / -9.4% 117203026 / 122009841 / -3.9% 0.59 / 0.63 / -5.7%
clickbench_q13/datafusion:vortex-file-compressed 116149499 / 121927419 / -4.7% 177186907 / 177779808 / -0.3% 0.66 / 0.69 / -4.4%
clickbench_q14/datafusion:vortex-file-compressed 72038746 / 85396988 / -15.6% 🟢 121617825 / 119668416 / +1.6% 0.59 / 0.71 / -17.0%
clickbench_q15/datafusion:vortex-file-compressed 62808954 / 64169056 / -2.1% 94435925 / 95883935 / -1.5% 0.67 / 0.67 / -0.6%
clickbench_q16/datafusion:vortex-file-compressed 158619786 / 158445928 / +0.1% 203994490 / 203216421 / +0.4% 0.78 / 0.78 / -0.3%
clickbench_q17/datafusion:vortex-file-compressed 148910426 / 151746004 / -1.9% 208499168 / 211514898 / -1.4% 0.71 / 0.72 / -0.4%
clickbench_q18/datafusion:vortex-file-compressed 298586954 / 302535667 / -1.3% 382430745 / 370272054 / +3.3% 0.78 / 0.82 / -4.4%
clickbench_q19/datafusion:vortex-file-compressed 7983692 / 7838814 / +1.8% 48610563 / 48106193 / +1.0% 0.16 / 0.16 / +0.8%
clickbench_q20/datafusion:vortex-file-compressed 98367034 / 68151496 / +44.3% 🔴 276118865 / 235842705 / +17.1% 🔴 0.36 / 0.29 / +23.3%
clickbench_q21/datafusion:vortex-file-compressed 92807500 / 100239230 / -7.4% 302494906 / 271802836 / +11.3% 🔴 0.31 / 0.37 / -16.8%
clickbench_q22/datafusion:vortex-file-compressed 108611230 / 118363697 / -8.2% 400430222 / 341320259 / +17.3% 🔴 0.27 / 0.35 / -21.8%
clickbench_q23/datafusion:vortex-file-compressed 192168832 / 377113516 / -49.0% 🟢 625807888 / 668703756 / -6.4% 0.31 / 0.56 / -45.5%
clickbench_q24/datafusion:vortex-file-compressed 16400587 / 21355816 / -23.2% 🟢 68855426 / 63856367 / +7.8% 0.24 / 0.33 / -28.8%
clickbench_q25/datafusion:vortex-file-compressed 18677636 / 26434640 / -29.3% 🟢 60715956 / 57371550 / +5.8% 0.31 / 0.46 / -33.2%
clickbench_q26/datafusion:vortex-file-compressed 16226382 / 21405206 / -24.2% 🟢 71064238 / 65825977 / +8.0% 0.23 / 0.33 / -29.8%
clickbench_q27/datafusion:vortex-file-compressed 99049672 / 102931456 / -3.8% 279868222 / 248367565 / +12.7% 🔴 0.35 / 0.41 / -14.6%
clickbench_q28/datafusion:vortex-file-compressed 562995939 / 566784970 / -0.7% 636615754 / 612256256 / +4.0% 0.88 / 0.93 / -4.5%
clickbench_q29/datafusion:vortex-file-compressed 23138622 / 24558274 / -5.8% 49253831 / 53940681 / -8.7% 0.47 / 0.46 / +3.2%
clickbench_q30/datafusion:vortex-file-compressed 61729956 / 85706758 / -28.0% 🟢 108939212 / 121572746 / -10.4% 🟢 0.57 / 0.70 / -19.6%
clickbench_q31/datafusion:vortex-file-compressed 72397636 / 83786623 / -13.6% 🟢 156295561 / 149125514 / +4.8% 0.46 / 0.56 / -17.6%
clickbench_q32/datafusion:vortex-file-compressed 293622464 / 296422464 / -0.9% 379231677 / 368324901 / +3.0% 0.77 / 0.80 / -3.8%
clickbench_q33/datafusion:vortex-file-compressed 329031985 / 341341902 / -3.6% 421972494 / 419745698 / +0.5% 0.78 / 0.81 / -4.1%
clickbench_q34/datafusion:vortex-file-compressed 326437846 / 333632530 / -2.2% 424573230 / 414775651 / +2.4% 0.77 / 0.80 / -4.4%
clickbench_q35/datafusion:vortex-file-compressed 55068116 / 57915747 / -4.9% 86966393 / 88684226 / -1.9% 0.63 / 0.65 / -3.0%
clickbench_q36/datafusion:vortex-file-compressed 37259389 / 37651342 / -1.0% 65902259 / 67981941 / -3.1% 0.57 / 0.55 / +2.1%
clickbench_q37/datafusion:vortex-file-compressed 21856307 / 21948799 / -0.4% 47560912 / 49781701 / -4.5% 0.46 / 0.44 / +4.2%
clickbench_q38/datafusion:vortex-file-compressed 11679430 / 12223284 / -4.4% 38108061 / 40262413 / -5.4% 0.31 / 0.30 / +1.0%
clickbench_q39/datafusion:vortex-file-compressed 78176530 / 80272811 / -2.6% 110825420 / 111792449 / -0.9% 0.71 / 0.72 / -1.8%
clickbench_q40/datafusion:vortex-file-compressed 11058747 / 11549755 / -4.3% 36793187 / 39024172 / -5.7% 0.30 / 0.30 / +1.6%
clickbench_q41/datafusion:vortex-file-compressed 10908928 / 10698338 / +2.0% 35146826 / 37138518 / -5.4% 0.31 / 0.29 / +7.7%
clickbench_q42/datafusion:vortex-file-compressed 10923426 / 11143103 / -2.0% 34693887 / 37718871 / -8.0% 0.31 / 0.30 / +6.6%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1280066 / 1274034 / +0.5% 50118937 / 49450441 / +1.4% 0.03 / 0.03 / -0.9%
clickbench_q01/datafusion:parquet 15812486 / 15626782 / +1.2% 67946231 / 67455281 / +0.7% 0.23 / 0.23 / +0.5%
clickbench_q02/datafusion:parquet 18937880 / 19808997 / -4.4% 82204748 / 82007647 / +0.2% 0.23 / 0.24 / -4.6%
clickbench_q03/datafusion:parquet 17376134 / 16914318 / +2.7% 83678423 / 79672545 / +5.0% 0.21 / 0.21 / -2.2%
clickbench_q04/datafusion:parquet 62542243 / 62450501 / +0.1% 124425505 / 125135466 / -0.6% 0.50 / 0.50 / +0.7%
clickbench_q05/datafusion:parquet 86988840 / 86294616 / +0.8% 156743175 / 155466488 / +0.8% 0.55 / 0.56 / -0.0%
clickbench_q06/datafusion:parquet 1270068 / 1295071 / -1.9% 49317329 / 48477140 / +1.7% 0.03 / 0.03 / -3.6%
clickbench_q07/datafusion:parquet 16948498 / 17021835 / -0.4% 69352121 / 73493266 / -5.6% 0.24 / 0.23 / +5.5%
clickbench_q08/datafusion:parquet 84530415 / 87571226 / -3.5% 162761421 / 158406033 / +2.7% 0.52 / 0.55 / -6.1%
clickbench_q09/datafusion:parquet 184187147 / 183862612 / +0.2% 266214399 / 266627056 / -0.2% 0.69 / 0.69 / +0.3%
clickbench_q10/datafusion:parquet 35892436 / 35079263 / +2.3% 100523825 / 99514321 / +1.0% 0.36 / 0.35 / +1.3%
clickbench_q11/datafusion:parquet 41842192 / 41636619 / +0.5% 111114820 / 110731431 / +0.3% 0.38 / 0.38 / +0.1%
clickbench_q12/datafusion:parquet 93433648 / 94772718 / -1.4% 159721513 / 159218123 / +0.3% 0.58 / 0.60 / -1.7%
clickbench_q13/datafusion:parquet 144114128 / 142191842 / +1.4% 225434053 / 220924663 / +2.0% 0.64 / 0.64 / -0.7%
clickbench_q14/datafusion:parquet 100072726 / 99523319 / +0.6% 175351237 / 170505164 / +2.8% 0.57 / 0.58 / -2.2%
clickbench_q15/datafusion:parquet 69109846 / 69777032 / -1.0% 132672931 / 127749632 / +3.9% 0.52 / 0.55 / -4.6%
clickbench_q16/datafusion:parquet 151759776 / 155311037 / -2.3% 232359329 / 232260983 / +0.0% 0.65 / 0.67 / -2.3%
clickbench_q17/datafusion:parquet 152574649 / 153079388 / -0.3% 232446772 / 230573728 / +0.8% 0.66 / 0.66 / -1.1%
clickbench_q18/datafusion:parquet 311506514 / 311294806 / +0.1% 409525390 / 410415650 / -0.2% 0.76 / 0.76 / +0.3%
clickbench_q19/datafusion:parquet 19234584 / 20054198 / -4.1% 76748885 / 76665599 / +0.1% 0.25 / 0.26 / -4.2%
clickbench_q20/datafusion:parquet 168150796 / 169385451 / -0.7% 279881154 / 281515461 / -0.6% 0.60 / 0.60 / -0.1%
clickbench_q21/datafusion:parquet 163640856 / 161132040 / +1.6% 293570822 / 296843807 / -1.1% 0.56 / 0.54 / +2.7%
clickbench_q22/datafusion:parquet 247495150 / 245911102 / +0.6% 426022777 / 426131677 / -0.0% 0.58 / 0.58 / +0.7%
clickbench_q23/datafusion:parquet 949947749 / 954302522 / -0.5% 1182969921 / 1188610486 / -0.5% 0.80 / 0.80 / +0.0%
clickbench_q24/datafusion:parquet 30390032 / 30205832 / +0.6% 90591058 / 88740561 / +2.1% 0.34 / 0.34 / -1.4%
clickbench_q25/datafusion:parquet 35414508 / 35986322 / -1.6% 100644629 / 102102799 / -1.4% 0.35 / 0.35 / -0.2%
clickbench_q26/datafusion:parquet 30356488 / 30273155 / +0.3% 90937760 / 90023922 / +1.0% 0.33 / 0.34 / -0.7%
clickbench_q27/datafusion:parquet 182909544 / 179406150 / +2.0% 282373664 / 284350084 / -0.7% 0.65 / 0.63 / +2.7%
clickbench_q28/datafusion:parquet 619880824 / 620363384 / -0.1% 701743990 / 699194254 / +0.4% 0.88 / 0.89 / -0.4%
clickbench_q29/datafusion:parquet 28774010 / 28481354 / +1.0% 93279195 / 92053748 / +1.3% 0.31 / 0.31 / -0.3%
clickbench_q30/datafusion:parquet 87795788 / 89913528 / -2.4% 169720987 / 171842482 / -1.2% 0.52 / 0.52 / -1.1%
clickbench_q31/datafusion:parquet 98643618 / 99256964 / -0.6% 199722578 / 197183372 / +1.3% 0.49 / 0.50 / -1.9%
clickbench_q32/datafusion:parquet 312664452 / 319685962 / -2.2% 427863105 / 412121324 / +3.8% 0.73 / 0.78 / -5.8%
clickbench_q33/datafusion:parquet 368781178 / 367924530 / +0.2% 458154878 / 457690894 / +0.1% 0.80 / 0.80 / +0.1%
clickbench_q34/datafusion:parquet 374645508 / 366641101 / +2.2% 455396780 / 456321735 / -0.2% 0.82 / 0.80 / +2.4%
clickbench_q35/datafusion:parquet 62793595 / 66030141 / -4.9% 122833665 / 122880735 / -0.0% 0.51 / 0.54 / -4.9%
clickbench_q36/datafusion:parquet 72436562 / 72397729 / +0.1% 134975320 / 134323291 / +0.5% 0.54 / 0.54 / -0.4%
clickbench_q37/datafusion:parquet 35393414 / 35197004 / +0.6% 91227632 / 91018840 / +0.2% 0.39 / 0.39 / +0.3%
clickbench_q38/datafusion:parquet 46700704 / 47074290 / -0.8% 106870580 / 106604317 / +0.2% 0.44 / 0.44 / -1.0%
clickbench_q39/datafusion:parquet 142148392 / 142230368 / -0.1% 209872474 / 210204471 / -0.2% 0.68 / 0.68 / +0.1%
clickbench_q40/datafusion:parquet 19898076 / 19973192 / -0.4% 77454315 / 75978753 / +1.9% 0.26 / 0.26 / -2.3%
clickbench_q41/datafusion:parquet 18783820 / 18710586 / +0.4% 75254640 / 74912930 / +0.5% 0.25 / 0.25 / -0.1%
clickbench_q42/datafusion:parquet 19027255 / 19074706 / -0.2% 74726297 / 74205641 / +0.7% 0.25 / 0.26 / -0.9%
duckdb / vortex-file-compressed / ns (0.963x ➖, 10↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1871346 / 1535292 / +21.9% 🔴 24154792 / 26978314 / -10.5% 🟢 0.08 / 0.06 / +36.1%
clickbench_q01/duckdb:vortex-file-compressed 14062292 / 11871378 / +18.5% 🔴 31635489 / 27436269 / +15.3% 🔴 0.44 / 0.43 / +2.7%
clickbench_q02/duckdb:vortex-file-compressed 13899850 / 13484589 / +3.1% 33546999 / 34939492 / -4.0% 0.41 / 0.39 / +7.4%
clickbench_q03/duckdb:vortex-file-compressed 17577790 / 17885736 / -1.7% 47604618 / 47535609 / +0.1% 0.37 / 0.38 / -1.9%
clickbench_q04/duckdb:vortex-file-compressed 68962873 / 68918834 / +0.1% 101865856 / 102373030 / -0.5% 0.68 / 0.67 / +0.6%
clickbench_q05/duckdb:vortex-file-compressed 72039823 / 67326509 / +7.0% 91948373 / 92302744 / -0.4% 0.78 / 0.73 / +7.4%
clickbench_q06/duckdb:vortex-file-compressed 2092661 / 1813428 / +15.4% 🔴 28355310 / 28201472 / +0.5% 0.07 / 0.06 / +14.8%
clickbench_q07/duckdb:vortex-file-compressed 14351420 / 15579270 / -7.9% 33188961 / 31947832 / +3.9% 0.43 / 0.49 / -11.3%
clickbench_q08/duckdb:vortex-file-compressed 84354984 / 86155282 / -2.1% 124878374 / 131826876 / -5.3% 0.68 / 0.65 / +3.4%
clickbench_q09/duckdb:vortex-file-compressed 108545570 / 114676230 / -5.3% 150266127 / 154572836 / -2.8% 0.72 / 0.74 / -2.6%
clickbench_q10/duckdb:vortex-file-compressed 33291078 / 43791076 / -24.0% 🟢 70118003 / 77956051 / -10.1% 🟢 0.47 / 0.56 / -15.5%
clickbench_q11/duckdb:vortex-file-compressed 35680944 / 56634250 / -37.0% 🟢 75204474 / 87703116 / -14.3% 🟢 0.47 / 0.65 / -26.5%
clickbench_q12/duckdb:vortex-file-compressed 73809638 / 78602016 / -6.1% 105922786 / 104668035 / +1.2% 0.70 / 0.75 / -7.2%
clickbench_q13/duckdb:vortex-file-compressed 139888341 / 150154120 / -6.8% 183426866 / 193294562 / -5.1% 0.76 / 0.78 / -1.8%
clickbench_q14/duckdb:vortex-file-compressed 78721757 / 83487598 / -5.7% 110165625 / 110691024 / -0.5% 0.71 / 0.75 / -5.3%
clickbench_q15/duckdb:vortex-file-compressed 91842594 / 93144543 / -1.4% 132327957 / 134556787 / -1.7% 0.69 / 0.69 / +0.3%
clickbench_q16/duckdb:vortex-file-compressed 161550328 / 171695643 / -5.9% 215330788 / 217733976 / -1.1% 0.75 / 0.79 / -4.9%
clickbench_q17/duckdb:vortex-file-compressed 166453962 / 169756258 / -1.9% 209781541 / 214797543 / -2.3% 0.79 / 0.79 / +0.4%
clickbench_q18/duckdb:vortex-file-compressed 314359312 / 315535836 / -0.4% 382865180 / 401748529 / -4.7% 0.82 / 0.79 / +4.5%
clickbench_q19/duckdb:vortex-file-compressed 16022369 / 15978438 / +0.3% 40831018 / 42054338 / -2.9% 0.39 / 0.38 / +3.3%
clickbench_q20/duckdb:vortex-file-compressed 131654236 / 125178779 / +5.2% 248698696 / 205421132 / +21.1% 🔴 0.53 / 0.61 / -13.1%
clickbench_q21/duckdb:vortex-file-compressed 158159432 / 183137339 / -13.6% 🟢 340422642 / 325040390 / +4.7% 0.46 / 0.56 / -17.5%
clickbench_q22/duckdb:vortex-file-compressed 237185429 / 289625169 / -18.1% 🟢 509629133 / 552654882 / -7.8% 0.47 / 0.52 / -11.2%
clickbench_q23/duckdb:vortex-file-compressed 58044689 / 69756901 / -16.8% 🟢 106271655 / 111309273 / -4.5% 0.55 / 0.63 / -12.8%
clickbench_q24/duckdb:vortex-file-compressed 27199615 / 27385094 / -0.7% 41942858 / 40775105 / +2.9% 0.65 / 0.67 / -3.4%
clickbench_q25/duckdb:vortex-file-compressed 33597535 / 35762576 / -6.1% 53851219 / 55794610 / -3.5% 0.62 / 0.64 / -2.7%
clickbench_q26/duckdb:vortex-file-compressed 19254080 / 21000833 / -8.3% 35602610 / 34012251 / +4.7% 0.54 / 0.62 / -12.4%
clickbench_q27/duckdb:vortex-file-compressed 141614060 / 169160586 / -16.3% 🟢 282299835 / 280520572 / +0.6% 0.50 / 0.60 / -16.8%
clickbench_q28/duckdb:vortex-file-compressed 1374887427 / 683339128 / +101.2% 🔴 670755360 / 672584524 / -0.3% 2.05 / 1.02 / +101.8%
clickbench_q29/duckdb:vortex-file-compressed 19515330 / 18120069 / +7.7% 40215374 / 42584066 / -5.6% 0.49 / 0.43 / +14.0%
clickbench_q30/duckdb:vortex-file-compressed 67408646 / 94351760 / -28.6% 🟢 118698866 / 131747563 / -9.9% 0.57 / 0.72 / -20.7%
clickbench_q31/duckdb:vortex-file-compressed 124853690 / 141307470 / -11.6% 🟢 211689750 / 238289731 / -11.2% 🟢 0.59 / 0.59 / -0.5%
clickbench_q32/duckdb:vortex-file-compressed 444162571 / 429490706 / +3.4% 489875505 / 489534260 / +0.1% 0.91 / 0.88 / +3.3%
clickbench_q33/duckdb:vortex-file-compressed 397143421 / 402802770 / -1.4% 517136679 / 519299255 / -0.4% 0.77 / 0.78 / -1.0%
clickbench_q34/duckdb:vortex-file-compressed 413410753 / 433311320 / -4.6% 538377898 / 554935437 / -3.0% 0.77 / 0.78 / -1.7%
clickbench_q35/duckdb:vortex-file-compressed 103328920 / 103173802 / +0.2% 135200760 / 138291546 / -2.2% 0.76 / 0.75 / +2.4%
clickbench_q36/duckdb:vortex-file-compressed 16057685 / 17350672 / -7.5% 32453142 / 32467467 / -0.0% 0.49 / 0.53 / -7.4%
clickbench_q37/duckdb:vortex-file-compressed 12442789 / 13434747 / -7.4% 28226783 / 25173119 / +12.1% 🔴 0.44 / 0.53 / -17.4%
clickbench_q38/duckdb:vortex-file-compressed 12902743 / 15297498 / -15.7% 🟢 30561047 / 29160457 / +4.8% 0.42 / 0.52 / -19.5%
clickbench_q39/duckdb:vortex-file-compressed 23419701 / 26074824 / -10.2% 🟢 40317937 / 47446143 / -15.0% 🟢 0.58 / 0.55 / +5.7%
clickbench_q40/duckdb:vortex-file-compressed 11473802 / 11517290 / -0.4% 27577429 / 27029004 / +2.0% 0.42 / 0.43 / -2.4%
clickbench_q41/duckdb:vortex-file-compressed 13784347 / 13866026 / -0.6% 27109934 / 26358049 / +2.9% 0.51 / 0.53 / -3.3%
clickbench_q42/duckdb:vortex-file-compressed 12062036 / 12709127 / -5.1% 30047634 / 28076972 / +7.0% 0.40 / 0.45 / -11.3%
duckdb / parquet / ns (1.006x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 7867233 / 8992378 / -12.5% 🟢 21728092 / 17676928 / +22.9% 🔴 0.36 / 0.51 / -28.8%
clickbench_q01/duckdb:parquet 10566251 / 10641474 / -0.7% 22397563 / 20612480 / +8.7% 0.47 / 0.52 / -8.6%
clickbench_q02/duckdb:parquet 15751606 / 15627308 / +0.8% 34760242 / 36551357 / -4.9% 0.45 / 0.43 / +6.0%
clickbench_q03/duckdb:parquet 16388008 / 15553440 / +5.4% 55567329 / 53574206 / +3.7% 0.29 / 0.29 / +1.6%
clickbench_q04/duckdb:parquet 72856036 / 69856888 / +4.3% 91371443 / 91890449 / -0.6% 0.80 / 0.76 / +4.9%
clickbench_q05/duckdb:parquet 81244770 / 79998478 / +1.6% 116647384 / 120679307 / -3.3% 0.70 / 0.66 / +5.1%
clickbench_q06/duckdb:parquet 14969034 / 15516946 / -3.5% 24120003 / 27508974 / -12.3% 🟢 0.62 / 0.56 / +10.0%
clickbench_q07/duckdb:parquet 11877086 / 11100332 / +7.0% 22918568 / 21912583 / +4.6% 0.52 / 0.51 / +2.3%
clickbench_q08/duckdb:parquet 87287976 / 87311330 / -0.0% 129211237 / 132203826 / -2.3% 0.68 / 0.66 / +2.3%
clickbench_q09/duckdb:parquet 115624689 / 115081943 / +0.5% 173675506 / 156461465 / +11.0% 🔴 0.67 / 0.74 / -9.5%
clickbench_q10/duckdb:parquet 33019540 / 33994714 / -2.9% 66934018 / 67992340 / -1.6% 0.49 / 0.50 / -1.3%
clickbench_q11/duckdb:parquet 36625138 / 41030599 / -10.7% 🟢 78168089 / 76967405 / +1.6% 0.47 / 0.53 / -12.1%
clickbench_q12/duckdb:parquet 91637880 / 90345714 / +1.4% 131589115 / 127933996 / +2.9% 0.70 / 0.71 / -1.4%
clickbench_q13/duckdb:parquet 145635586 / 154816986 / -5.9% 208755169 / 212782855 / -1.9% 0.70 / 0.73 / -4.1%
clickbench_q14/duckdb:parquet 98869530 / 95721511 / +3.3% 156811660 / 144909350 / +8.2% 0.63 / 0.66 / -4.6%
clickbench_q15/duckdb:parquet 92144353 / 94043984 / -2.0% 121420325 / 123593027 / -1.8% 0.76 / 0.76 / -0.3%
clickbench_q16/duckdb:parquet 175955708 / 170116024 / +3.4% 242959337 / 252458219 / -3.8% 0.72 / 0.67 / +7.5%
clickbench_q17/duckdb:parquet 178615732 / 176428674 / +1.2% 236252970 / 231214891 / +2.2% 0.76 / 0.76 / -0.9%
clickbench_q18/duckdb:parquet 329012668 / 323843055 / +1.6% 409474732 / 404666396 / +1.2% 0.80 / 0.80 / +0.4%
clickbench_q19/duckdb:parquet 13270858 / 13285374 / -0.1% 41550976 / 45321907 / -8.3% 0.32 / 0.29 / +9.0%
clickbench_q20/duckdb:parquet 134570610 / 136608031 / -1.5% 239868013 / 243522117 / -1.5% 0.56 / 0.56 / +0.0%
clickbench_q21/duckdb:parquet 184327453 / 179925408 / +2.4% 317597582 / 322968671 / -1.7% 0.58 / 0.56 / +4.2%
clickbench_q22/duckdb:parquet 247217124 / 235755120 / +4.9% 412711925 / 414837067 / -0.5% 0.60 / 0.57 / +5.4%
clickbench_q23/duckdb:parquet 147617374 / 145441271 / +1.5% 170432287 / 168073500 / +1.4% 0.87 / 0.87 / +0.1%
clickbench_q24/duckdb:parquet 43578321 / 41511338 / +5.0% 62886976 / 63952005 / -1.7% 0.69 / 0.65 / +6.8%
clickbench_q25/duckdb:parquet 40550551 / 39944448 / +1.5% 93773650 / 89626228 / +4.6% 0.43 / 0.45 / -3.0%
clickbench_q26/duckdb:parquet 30121784 / 30821604 / -2.3% 47633545 / 46660769 / +2.1% 0.63 / 0.66 / -4.3%
clickbench_q27/duckdb:parquet 150847379 / 146012554 / +3.3% 259684353 / 257485424 / +0.9% 0.58 / 0.57 / +2.4%
clickbench_q28/duckdb:parquet 901037958 / 904802829 / -0.4% 1028721664 / 1009969463 / +1.9% 0.88 / 0.90 / -2.2%
clickbench_q29/duckdb:parquet 17901774 / 17344505 / +3.2% 32270749 / 33563229 / -3.9% 0.55 / 0.52 / +7.3%
clickbench_q30/duckdb:parquet 94535921 / 98075932 / -3.6% 177396287 / 173401616 / +2.3% 0.53 / 0.57 / -5.8%
clickbench_q31/duckdb:parquet 147553515 / 142728950 / +3.4% 291892331 / 298296032 / -2.1% 0.51 / 0.48 / +5.6%
clickbench_q32/duckdb:parquet 466571786 / 440291976 / +6.0% 514024886 / 483588606 / +6.3% 0.91 / 0.91 / -0.3%
clickbench_q33/duckdb:parquet 453702925 / 450889778 / +0.6% 489884361 / 463186739 / +5.8% 0.93 / 0.97 / -4.9%
clickbench_q34/duckdb:parquet 457122332 / 457332550 / -0.0% 503207823 / 487564712 / +3.2% 0.91 / 0.94 / -3.2%
clickbench_q35/duckdb:parquet 104217495 / 104263384 / -0.0% 129509098 / 118821620 / +9.0% 0.80 / 0.88 / -8.3%
clickbench_q36/duckdb:parquet 31269244 / 31190158 / +0.3% 41105552 / 41806480 / -1.7% 0.76 / 0.75 / +2.0%
clickbench_q37/duckdb:parquet 23059821 / 23210853 / -0.7% 32038606 / 32719093 / -2.1% 0.72 / 0.71 / +1.5%
clickbench_q38/duckdb:parquet 24543046 / 23815278 / +3.1% 33781724 / 32542156 / +3.8% 0.73 / 0.73 / -0.7%
clickbench_q39/duckdb:parquet 56971070 / 56763192 / +0.4% 68596673 / 68037754 / +0.8% 0.83 / 0.83 / -0.5%
clickbench_q40/duckdb:parquet 12702372 / 12684087 / +0.1% 22774589 / 21532477 / +5.8% 0.56 / 0.59 / -5.3%
clickbench_q41/duckdb:parquet 13477962 / 12909928 / +4.4% 22787037 / 21922846 / +3.9% 0.59 / 0.59 / +0.4%
clickbench_q42/duckdb:parquet 14812919 / 14228644 / +4.1% 24632074 / 24879406 / -1.0% 0.60 / 0.57 / +5.2%

File Size Changes (100 files changed, +29.3% overall, 100↑ 0↓)
File Scale Format Base HEAD Change %
hits_54.vortex 1.0 vortex-file-compressed 221.18 MB 361.51 MB +140.33 MB +63.4%
hits_51.vortex 1.0 vortex-file-compressed 279.37 MB 427.95 MB +148.58 MB +53.2%
hits_55.vortex 1.0 vortex-file-compressed 168.11 MB 252.90 MB +84.79 MB +50.4%
hits_78.vortex 1.0 vortex-file-compressed 163.88 MB 238.85 MB +74.96 MB +45.7%
hits_90.vortex 1.0 vortex-file-compressed 141.48 MB 205.08 MB +63.59 MB +44.9%
hits_67.vortex 1.0 vortex-file-compressed 183.95 MB 266.62 MB +82.67 MB +44.9%
hits_89.vortex 1.0 vortex-file-compressed 184.80 MB 266.28 MB +81.48 MB +44.1%
hits_50.vortex 1.0 vortex-file-compressed 178.87 MB 256.16 MB +77.29 MB +43.2%
hits_79.vortex 1.0 vortex-file-compressed 143.47 MB 205.02 MB +61.55 MB +42.9%
hits_68.vortex 1.0 vortex-file-compressed 121.95 MB 174.21 MB +52.27 MB +42.9%
hits_27.vortex 1.0 vortex-file-compressed 121.54 MB 172.37 MB +50.84 MB +41.8%
hits_28.vortex 1.0 vortex-file-compressed 118.35 MB 165.97 MB +47.61 MB +40.2%
hits_3.vortex 1.0 vortex-file-compressed 141.49 MB 194.91 MB +53.42 MB +37.8%
hits_96.vortex 1.0 vortex-file-compressed 135.00 MB 184.51 MB +49.51 MB +36.7%
hits_92.vortex 1.0 vortex-file-compressed 146.58 MB 199.76 MB +53.19 MB +36.3%
hits_94.vortex 1.0 vortex-file-compressed 137.84 MB 187.57 MB +49.73 MB +36.1%
hits_56.vortex 1.0 vortex-file-compressed 122.41 MB 165.08 MB +42.67 MB +34.9%
hits_5.vortex 1.0 vortex-file-compressed 91.45 MB 122.13 MB +30.68 MB +33.5%
hits_8.vortex 1.0 vortex-file-compressed 91.74 MB 122.44 MB +30.70 MB +33.5%
hits_7.vortex 1.0 vortex-file-compressed 92.45 MB 123.38 MB +30.93 MB +33.5%
hits_43.vortex 1.0 vortex-file-compressed 227.63 MB 303.74 MB +76.11 MB +33.4%
hits_6.vortex 1.0 vortex-file-compressed 91.88 MB 122.48 MB +30.60 MB +33.3%
hits_41.vortex 1.0 vortex-file-compressed 223.98 MB 298.48 MB +74.50 MB +33.3%
hits_42.vortex 1.0 vortex-file-compressed 223.02 MB 296.83 MB +73.81 MB +33.1%
hits_1.vortex 1.0 vortex-file-compressed 137.87 MB 182.89 MB +45.03 MB +32.7%
hits_26.vortex 1.0 vortex-file-compressed 108.66 MB 143.55 MB +34.89 MB +32.1%
hits_99.vortex 1.0 vortex-file-compressed 122.33 MB 161.57 MB +39.25 MB +32.1%
hits_44.vortex 1.0 vortex-file-compressed 187.12 MB 243.37 MB +56.25 MB +30.1%
hits_77.vortex 1.0 vortex-file-compressed 168.86 MB 219.04 MB +50.18 MB +29.7%
hits_4.vortex 1.0 vortex-file-compressed 107.60 MB 139.56 MB +31.96 MB +29.7%
hits_2.vortex 1.0 vortex-file-compressed 186.82 MB 242.22 MB +55.39 MB +29.6%
hits_62.vortex 1.0 vortex-file-compressed 116.56 MB 151.03 MB +34.47 MB +29.6%
hits_98.vortex 1.0 vortex-file-compressed 117.63 MB 151.79 MB +34.15 MB +29.0%
hits_74.vortex 1.0 vortex-file-compressed 118.88 MB 152.93 MB +34.05 MB +28.6%
hits_81.vortex 1.0 vortex-file-compressed 99.37 MB 127.72 MB +28.34 MB +28.5%
hits_87.vortex 1.0 vortex-file-compressed 172.75 MB 221.88 MB +49.14 MB +28.4%
hits_58.vortex 1.0 vortex-file-compressed 88.97 MB 114.11 MB +25.14 MB +28.3%
hits_65.vortex 1.0 vortex-file-compressed 184.24 MB 235.48 MB +51.25 MB +27.8%
hits_0.vortex 1.0 vortex-file-compressed 87.76 MB 111.87 MB +24.11 MB +27.5%
hits_9.vortex 1.0 vortex-file-compressed 98.22 MB 125.08 MB +26.86 MB +27.4%
hits_71.vortex 1.0 vortex-file-compressed 100.96 MB 128.56 MB +27.61 MB +27.3%
hits_12.vortex 1.0 vortex-file-compressed 99.10 MB 126.15 MB +27.04 MB +27.3%
hits_13.vortex 1.0 vortex-file-compressed 96.97 MB 122.71 MB +25.74 MB +26.5%
hits_70.vortex 1.0 vortex-file-compressed 92.23 MB 116.70 MB +24.47 MB +26.5%
hits_82.vortex 1.0 vortex-file-compressed 97.92 MB 123.32 MB +25.40 MB +25.9%
hits_97.vortex 1.0 vortex-file-compressed 106.36 MB 133.66 MB +27.30 MB +25.7%
hits_11.vortex 1.0 vortex-file-compressed 78.50 MB 98.52 MB +20.02 MB +25.5%
hits_84.vortex 1.0 vortex-file-compressed 116.44 MB 146.05 MB +29.61 MB +25.4%
hits_88.vortex 1.0 vortex-file-compressed 109.95 MB 137.72 MB +27.77 MB +25.3%
hits_18.vortex 1.0 vortex-file-compressed 103.45 MB 129.54 MB +26.09 MB +25.2%
hits_57.vortex 1.0 vortex-file-compressed 127.67 MB 159.78 MB +32.10 MB +25.1%
hits_91.vortex 1.0 vortex-file-compressed 95.92 MB 119.72 MB +23.80 MB +24.8%
hits_76.vortex 1.0 vortex-file-compressed 112.83 MB 140.52 MB +27.68 MB +24.5%
hits_30.vortex 1.0 vortex-file-compressed 85.22 MB 105.85 MB +20.63 MB +24.2%
hits_93.vortex 1.0 vortex-file-compressed 89.67 MB 111.08 MB +21.41 MB +23.9%
hits_35.vortex 1.0 vortex-file-compressed 113.91 MB 141.11 MB +27.20 MB +23.9%
hits_17.vortex 1.0 vortex-file-compressed 86.30 MB 106.82 MB +20.52 MB +23.8%
hits_14.vortex 1.0 vortex-file-compressed 109.62 MB 135.29 MB +25.67 MB +23.4%
hits_25.vortex 1.0 vortex-file-compressed 112.14 MB 138.25 MB +26.11 MB +23.3%
hits_38.vortex 1.0 vortex-file-compressed 97.80 MB 120.55 MB +22.75 MB +23.3%
hits_59.vortex 1.0 vortex-file-compressed 100.65 MB 123.89 MB +23.24 MB +23.1%
hits_95.vortex 1.0 vortex-file-compressed 95.35 MB 117.07 MB +21.72 MB +22.8%
hits_40.vortex 1.0 vortex-file-compressed 116.81 MB 143.02 MB +26.20 MB +22.4%
hits_10.vortex 1.0 vortex-file-compressed 67.91 MB 83.06 MB +15.15 MB +22.3%
hits_60.vortex 1.0 vortex-file-compressed 102.40 MB 125.21 MB +22.82 MB +22.3%
hits_86.vortex 1.0 vortex-file-compressed 67.09 MB 81.86 MB +14.77 MB +22.0%
hits_73.vortex 1.0 vortex-file-compressed 108.93 MB 132.74 MB +23.81 MB +21.9%
hits_39.vortex 1.0 vortex-file-compressed 78.11 MB 94.80 MB +16.69 MB +21.4%
hits_36.vortex 1.0 vortex-file-compressed 66.37 MB 80.51 MB +14.14 MB +21.3%
hits_64.vortex 1.0 vortex-file-compressed 79.27 MB 96.09 MB +16.82 MB +21.2%
hits_63.vortex 1.0 vortex-file-compressed 67.27 MB 81.48 MB +14.21 MB +21.1%
hits_80.vortex 1.0 vortex-file-compressed 104.26 MB 126.06 MB +21.79 MB +20.9%
hits_69.vortex 1.0 vortex-file-compressed 122.65 MB 148.29 MB +25.64 MB +20.9%
hits_49.vortex 1.0 vortex-file-compressed 74.57 MB 90.03 MB +15.46 MB +20.7%
hits_46.vortex 1.0 vortex-file-compressed 67.63 MB 81.51 MB +13.89 MB +20.5%
hits_75.vortex 1.0 vortex-file-compressed 61.68 MB 74.35 MB +12.66 MB +20.5%
hits_83.vortex 1.0 vortex-file-compressed 88.41 MB 106.46 MB +18.05 MB +20.4%
hits_66.vortex 1.0 vortex-file-compressed 89.15 MB 107.20 MB +18.06 MB +20.3%
hits_85.vortex 1.0 vortex-file-compressed 90.94 MB 108.61 MB +17.67 MB +19.4%
hits_32.vortex 1.0 vortex-file-compressed 65.46 MB 78.17 MB +12.71 MB +19.4%
hits_31.vortex 1.0 vortex-file-compressed 88.41 MB 105.44 MB +17.03 MB +19.3%
hits_45.vortex 1.0 vortex-file-compressed 121.13 MB 144.46 MB +23.32 MB +19.3%
hits_72.vortex 1.0 vortex-file-compressed 83.47 MB 98.99 MB +15.53 MB +18.6%
hits_37.vortex 1.0 vortex-file-compressed 84.35 MB 99.69 MB +15.34 MB +18.2%
hits_52.vortex 1.0 vortex-file-compressed 102.95 MB 121.65 MB +18.70 MB +18.2%
hits_34.vortex 1.0 vortex-file-compressed 96.61 MB 113.82 MB +17.20 MB +17.8%
hits_19.vortex 1.0 vortex-file-compressed 72.19 MB 84.18 MB +11.99 MB +16.6%
hits_29.vortex 1.0 vortex-file-compressed 57.83 MB 67.10 MB +9.27 MB +16.0%
hits_53.vortex 1.0 vortex-file-compressed 84.98 MB 98.04 MB +13.06 MB +15.4%
hits_61.vortex 1.0 vortex-file-compressed 100.54 MB 115.86 MB +15.32 MB +15.2%
hits_33.vortex 1.0 vortex-file-compressed 55.84 MB 63.95 MB +8.11 MB +14.5%
hits_20.vortex 1.0 vortex-file-compressed 61.26 MB 68.34 MB +7.09 MB +11.6%
hits_16.vortex 1.0 vortex-file-compressed 78.74 MB 87.69 MB +8.94 MB +11.4%
hits_15.vortex 1.0 vortex-file-compressed 88.29 MB 98.32 MB +10.02 MB +11.4%
hits_21.vortex 1.0 vortex-file-compressed 92.38 MB 102.54 MB +10.17 MB +11.0%
hits_48.vortex 1.0 vortex-file-compressed 26.53 MB 29.19 MB +2.66 MB +10.0%
hits_47.vortex 1.0 vortex-file-compressed 39.89 MB 42.43 MB +2.54 MB +6.4%
hits_23.vortex 1.0 vortex-file-compressed 75.17 MB 79.25 MB +4.09 MB +5.4%
hits_24.vortex 1.0 vortex-file-compressed 74.68 MB 78.61 MB +3.93 MB +5.3%
hits_22.vortex 1.0 vortex-file-compressed 75.82 MB 79.76 MB +3.95 MB +5.2%

Totals:

  • vortex-file-compressed: 10.90 GB → 14.10 GB (+29.3%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 548ac378 vs base d6037bc2
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.2%
Engines: DataFusion No clear signal (+10.1%, environment too noisy confidence) · DuckDB No clear signal (+6.2%, environment too noisy confidence)
Vortex (geomean): hot 1.222x ➖ · cold 1.183x ➖
Parquet (geomean): hot 1.129x ➖ · cold 1.086x ➖
Shifts: Parquet (control) +12.9% · Median polish +12.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.272x ➖, 0↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 218290709 / 207143042 / +5.4% 850833616 / 913065787 / -6.8% 0.26 / 0.23 / +13.1%
tpch_q02/datafusion:vortex-file-compressed 363317239 / 317909180 / +14.3% 983058202 / 664588260 / +47.9% 🔴 0.37 / 0.48 / -22.7%
tpch_q03/datafusion:vortex-file-compressed 366042314 / 356415045 / +2.7% 1291237151 / 1399335323 / -7.7% 0.28 / 0.25 / +11.3%
tpch_q04/datafusion:vortex-file-compressed 249940684 / 153802726 / +62.5% 🔴 405839537 / 414587960 / -2.1% 0.62 / 0.37 / +66.0%
tpch_q05/datafusion:vortex-file-compressed 401699320 / 324046059 / +24.0% 675793069 / 584974299 / +15.5% 0.59 / 0.55 / +7.3%
tpch_q06/datafusion:vortex-file-compressed 325874983 / 259185406 / +25.7% 471805261 / 340997885 / +38.4% 🔴 0.69 / 0.76 / -9.1%
tpch_q07/datafusion:vortex-file-compressed 459106546 / 387323406 / +18.5% 885477747 / 459465780 / +92.7% 🔴 0.52 / 0.84 / -38.5%
tpch_q08/datafusion:vortex-file-compressed 640005921 / 539478309 / +18.6% 795886739 / 1896702733 / -58.0% 🟢 0.80 / 0.28 / +182.7%
tpch_q09/datafusion:vortex-file-compressed 454351709 / 440719735 / +3.1% 633012380 / 470999806 / +34.4% 🔴 0.72 / 0.94 / -23.3%
tpch_q10/datafusion:vortex-file-compressed 439629089 / 311756758 / +41.0% 🔴 759568245 / 516730904 / +47.0% 🔴 0.58 / 0.60 / -4.1%
tpch_q11/datafusion:vortex-file-compressed 455377168 / 280476665 / +62.4% 🔴 461814432 / 394239031 / +17.1% 0.99 / 0.71 / +38.6%
tpch_q12/datafusion:vortex-file-compressed 374885111 / 309803776 / +21.0% 806354925 / 462426832 / +74.4% 🔴 0.46 / 0.67 / -30.6%
tpch_q13/datafusion:vortex-file-compressed 217228404 / 168874291 / +28.6% 473238397 / 619432757 / -23.6% 0.46 / 0.27 / +68.4%
tpch_q14/datafusion:vortex-file-compressed 212426056 / 189825256 / +11.9% 417499625 / 246153497 / +69.6% 🔴 0.51 / 0.77 / -34.0%
tpch_q15/datafusion:vortex-file-compressed 324106593 / 284119267 / +14.1% 516372166 / 457805766 / +12.8% 0.63 / 0.62 / +1.1%
tpch_q16/datafusion:vortex-file-compressed 185183407 / 155645137 / +19.0% 330224632 / 274594428 / +20.3% 0.56 / 0.57 / -1.1%
tpch_q17/datafusion:vortex-file-compressed 374211839 / 267226212 / +40.0% 🔴 531496051 / 396920142 / +33.9% 🔴 0.70 / 0.67 / +4.6%
tpch_q18/datafusion:vortex-file-compressed 469680102 / 243498485 / +92.9% 🔴 578623529 / 386464050 / +49.7% 🔴 0.81 / 0.63 / +28.8%
tpch_q19/datafusion:vortex-file-compressed 423002691 / 335779542 / +26.0% 572402328 / 473211497 / +21.0% 0.74 / 0.71 / +4.1%
tpch_q20/datafusion:vortex-file-compressed 334317079 / 280549644 / +19.2% 550634561 / 401779029 / +37.0% 🔴 0.61 / 0.70 / -13.0%
tpch_q21/datafusion:vortex-file-compressed 671814171 / 437618747 / +53.5% 🔴 718591592 / 1058894433 / -32.1% 🟢 0.93 / 0.41 / +126.2%
tpch_q22/datafusion:vortex-file-compressed 186560764 / 143397448 / +30.1% 🔴 344400692 / 315384274 / +9.2% 0.54 / 0.45 / +19.1%
datafusion / parquet / ns (1.155x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 210586244 / 163825082 / +28.5% 667655902 / 491688601 / +35.8% 🔴 0.32 / 0.33 / -5.3%
tpch_q02/datafusion:parquet 365576706 / 257490466 / +42.0% 🔴 919302294 / 478392308 / +92.2% 🔴 0.40 / 0.54 / -26.1%
tpch_q03/datafusion:parquet 266131851 / 274554876 / -3.1% 695546965 / 765931664 / -9.2% 0.38 / 0.36 / +6.7%
tpch_q04/datafusion:parquet 216434670 / 155436663 / +39.2% 🔴 461257700 / 391624546 / +17.8% 0.47 / 0.40 / +18.2%
tpch_q05/datafusion:parquet 687409212 / 333895706 / +105.9% 🔴 582655067 / 459088752 / +26.9% 1.18 / 0.73 / +62.2%
tpch_q06/datafusion:parquet 126816483 / 131533293 / -3.6% 228387174 / 522033260 / -56.3% 🟢 0.56 / 0.25 / +120.4%
tpch_q07/datafusion:parquet 373587513 / 329094010 / +13.5% 478004492 / 449879914 / +6.3% 0.78 / 0.73 / +6.8%
tpch_q08/datafusion:parquet 460156014 / 424503998 / +8.4% 542721677 / 545899479 / -0.6% 0.85 / 0.78 / +9.0%
tpch_q09/datafusion:parquet 475848335 / 444902667 / +7.0% 582616986 / 608132277 / -4.2% 0.82 / 0.73 / +11.6%
tpch_q10/datafusion:parquet 396298164 / 370647159 / +6.9% 541805215 / 512294289 / +5.8% 0.73 / 0.72 / +1.1%
tpch_q11/datafusion:parquet 366825384 / 260848473 / +40.6% 🔴 455601621 / 432218249 / +5.4% 0.81 / 0.60 / +33.4%
tpch_q12/datafusion:parquet 202322784 / 178959295 / +13.1% 417038054 / 423607484 / -1.6% 0.49 / 0.42 / +14.8%
tpch_q13/datafusion:parquet 393764750 / 396777926 / -0.8% 558769009 / 627558838 / -11.0% 0.70 / 0.63 / +11.5%
tpch_q14/datafusion:parquet 162295931 / 164627528 / -1.4% 519603136 / 256617409 / +102.5% 🔴 0.31 / 0.64 / -51.3%
tpch_q15/datafusion:parquet 313503368 / 258319898 / +21.4% 513330629 / 630115998 / -18.5% 0.61 / 0.41 / +49.0%
tpch_q16/datafusion:parquet 125632852 / 110831990 / +13.4% 254216001 / 262914351 / -3.3% 0.49 / 0.42 / +17.2%
tpch_q17/datafusion:parquet 288204473 / 304554345 / -5.4% 464485882 / 405643523 / +14.5% 0.62 / 0.75 / -17.4%
tpch_q18/datafusion:parquet 438296561 / 406101315 / +7.9% 566158065 / 531893943 / +6.4% 0.77 / 0.76 / +1.4%
tpch_q19/datafusion:parquet 233800867 / 160224569 / +45.9% 🔴 309867307 / 277640805 / +11.6% 0.75 / 0.58 / +30.7%
tpch_q20/datafusion:parquet 270015122 / 249308954 / +8.3% 425776149 / 417183224 / +2.1% 0.63 / 0.60 / +6.1%
tpch_q21/datafusion:parquet 345101350 / 328063891 / +5.2% 634665329 / 425502619 / +49.2% 🔴 0.54 / 0.77 / -29.5%
tpch_q22/datafusion:parquet 158511009 / 166803204 / -5.0% 332437113 / 307132423 / +8.2% 0.48 / 0.54 / -12.2%
duckdb / vortex-file-compressed / ns (1.173x ➖, 0↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 192460919 / 199570873 / -3.6% 250848042 / 277427962 / -9.6% 0.77 / 0.72 / +6.7%
tpch_q02/duckdb:vortex-file-compressed 426173565 / 376751760 / +13.1% 392853422 / 453930097 / -13.5% 1.08 / 0.83 / +30.7%
tpch_q03/duckdb:vortex-file-compressed 614260439 / 389603964 / +57.7% 🔴 598605984 / 483655670 / +23.8% 1.03 / 0.81 / +27.4%
tpch_q04/duckdb:vortex-file-compressed 307191027 / 240863723 / +27.5% 450233495 / 244722048 / +84.0% 🔴 0.68 / 0.98 / -30.7%
tpch_q05/duckdb:vortex-file-compressed 512201316 / 360022076 / +42.3% 🔴 465196683 / 410736828 / +13.3% 1.10 / 0.88 / +25.6%
tpch_q06/duckdb:vortex-file-compressed 287945936 / 268817264 / +7.1% 289074107 / 296875702 / -2.6% 1.00 / 0.91 / +10.0%
tpch_q07/duckdb:vortex-file-compressed 516836611 / 471972291 / +9.5% 581375418 / 469567036 / +23.8% 0.89 / 1.01 / -11.6%
tpch_q08/duckdb:vortex-file-compressed 687385655 / 548807006 / +25.3% 873888006 / 634332512 / +37.8% 🔴 0.79 / 0.87 / -9.1%
tpch_q09/duckdb:vortex-file-compressed 444199858 / 496324655 / -10.5% 490278948 / 563758998 / -13.0% 0.91 / 0.88 / +2.9%
tpch_q10/duckdb:vortex-file-compressed 521872646 / 465526827 / +12.1% 583416105 / 475761593 / +22.6% 0.89 / 0.98 / -8.6%
tpch_q11/duckdb:vortex-file-compressed 142620460 / 148428059 / -3.9% 169856971 / 164590606 / +3.2% 0.84 / 0.90 / -6.9%
tpch_q12/duckdb:vortex-file-compressed 609205423 / 449077631 / +35.7% 🔴 675511790 / 404233864 / +67.1% 🔴 0.90 / 1.11 / -18.8%
tpch_q13/duckdb:vortex-file-compressed 425342560 / 280815219 / +51.5% 🔴 373675555 / 384444785 / -2.8% 1.14 / 0.73 / +55.8%
tpch_q14/duckdb:vortex-file-compressed 324303491 / 233794953 / +38.7% 🔴 476880482 / 270010692 / +76.6% 🔴 0.68 / 0.87 / -21.5%
tpch_q15/duckdb:vortex-file-compressed 183540888 / 144862740 / +26.7% 278777986 / 217073232 / +28.4% 0.66 / 0.67 / -1.3%
tpch_q16/duckdb:vortex-file-compressed 193761258 / 187152383 / +3.5% 223008360 / 224832643 / -0.8% 0.87 / 0.83 / +4.4%
tpch_q17/duckdb:vortex-file-compressed 617408053 / 362587252 / +70.3% 🔴 1072522936 / 410022478 / +161.6% 🔴 0.58 / 0.88 / -34.9%
tpch_q18/duckdb:vortex-file-compressed 353540923 / 295169073 / +19.8% 536172629 / 346712832 / +54.6% 🔴 0.66 / 0.85 / -22.5%
tpch_q19/duckdb:vortex-file-compressed 312200073 / 325075439 / -4.0% 387905147 / 405975882 / -4.5% 0.80 / 0.80 / +0.5%
tpch_q20/duckdb:vortex-file-compressed 398391762 / 400508991 / -0.5% 493193852 / 480323384 / +2.7% 0.81 / 0.83 / -3.1%
tpch_q21/duckdb:vortex-file-compressed 691419851 / 560974020 / +23.3% 869979752 / 792134454 / +9.8% 0.79 / 0.71 / +12.2%
tpch_q22/duckdb:vortex-file-compressed 123610172 / 145847360 / -15.2% 141918753 / 144263647 / -1.6% 0.87 / 1.01 / -13.8%
duckdb / parquet / ns (1.105x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 329459627 / 270638367 / +21.7% 321612822 / 295169389 / +9.0% 1.02 / 0.92 / +11.7%
tpch_q02/duckdb:parquet 698684173 / 607114514 / +15.1% 613846864 / 625696037 / -1.9% 1.14 / 0.97 / +17.3%
tpch_q03/duckdb:parquet 758372650 / 661548586 / +14.6% 908521215 / 750016072 / +21.1% 0.83 / 0.88 / -5.4%
tpch_q04/duckdb:parquet 487987415 / 417059830 / +17.0% 478624547 / 521821433 / -8.3% 1.02 / 0.80 / +27.6%
tpch_q05/duckdb:parquet 936441380 / 896260507 / +4.5% 1042058526 / 945269782 / +10.2% 0.90 / 0.95 / -5.2%
tpch_q06/duckdb:parquet 327641702 / 277460978 / +18.1% 402524134 / 287345652 / +40.1% 🔴 0.81 / 0.97 / -15.7%
tpch_q07/duckdb:parquet 823283813 / 770786433 / +6.8% 905326603 / 758097030 / +19.4% 0.91 / 1.02 / -10.6%
tpch_q08/duckdb:parquet 1041428391 / 980352635 / +6.2% 1103929650 / 1098549562 / +0.5% 0.94 / 0.89 / +5.7%
tpch_q09/duckdb:parquet 1012934667 / 1042730652 / -2.9% 994370890 / 918367817 / +8.3% 1.02 / 1.14 / -10.3%
tpch_q10/duckdb:parquet 964261637 / 930763568 / +3.6% 1022869129 / 890047802 / +14.9% 0.94 / 1.05 / -9.9%
tpch_q11/duckdb:parquet 457799549 / 408822789 / +12.0% 666280894 / 501668326 / +32.8% 🔴 0.69 / 0.81 / -15.7%
tpch_q12/duckdb:parquet 519257314 / 477905323 / +8.7% 607592105 / 526415094 / +15.4% 0.85 / 0.91 / -5.9%
tpch_q13/duckdb:parquet 774354631 / 741449424 / +4.4% 846040811 / 922592118 / -8.3% 0.92 / 0.80 / +13.9%
tpch_q14/duckdb:parquet 504007736 / 465782907 / +8.2% 552582934 / 449509365 / +22.9% 0.91 / 1.04 / -12.0%
tpch_q15/duckdb:parquet 390659406 / 336985458 / +15.9% 388917603 / 334973082 / +16.1% 1.00 / 1.01 / -0.2%
tpch_q16/duckdb:parquet 496012568 / 451875398 / +9.8% 460825423 / 470619457 / -2.1% 1.08 / 0.96 / +12.1%
tpch_q17/duckdb:parquet 487907027 / 418483681 / +16.6% 492200236 / 552764622 / -11.0% 0.99 / 0.76 / +30.9%
tpch_q18/duckdb:parquet 638378131 / 613672101 / +4.0% 611595458 / 567957810 / +7.7% 1.04 / 1.08 / -3.4%
tpch_q19/duckdb:parquet 609985676 / 527947103 / +15.5% 696797859 / 563714109 / +23.6% 0.88 / 0.94 / -6.5%
tpch_q20/duckdb:parquet 825132800 / 762132637 / +8.3% 916587817 / 773693762 / +18.5% 0.90 / 0.99 / -8.6%
tpch_q21/duckdb:parquet 713922130 / 621714649 / +14.8% 642784381 / 682530580 / -5.8% 1.11 / 0.91 / +21.9%
tpch_q22/duckdb:parquet 430972138 / 390135585 / +10.5% 384954176 / 390203214 / -1.3% 1.12 / 1.00 / +12.0%

@robert3005 robert3005 changed the title Convert trivial filters into slices during reduction, MaskValues::last uses BitBuffer:last_set_index Convert trivial filters into slices during reduction, MaskValues::last uses BitBuffer::last_set_index Sep 10, 2026
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 10, 2026
@robert3005
robert3005 requested a review from gatesn September 10, 2026 21:06
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 10, 2026
…t uses BitBuffer:last_set_index

Signed-off-by: Robert Kruszewski <github@robertk.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant