Skip to content

perf: batch fragmented CASE branch execution - #9820

Open
gatesn wants to merge 1 commit into
developfrom
ngates/batched-case-execution
Open

perf: batch fragmented CASE branch execution#9820
gatesn wants to merge 1 commit into
developfrom
ngates/batched-case-execution

Conversation

@gatesn

@gatesn gatesn commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Why

Fragmented CASE selections can repeatedly execute lazy branch expressions for tiny runs or individual rows. Batch those selections so branch evaluation stays columnar, while keeping the existing low-overhead approach for coarse runs.

Changes

  • Evaluate later WHEN conditions only on unmatched rows; evaluate THEN/ELSE values only where selected. Preserve first-match semantics, nullability, and errors from selected rows.
  • Compact fragmented branch results and restore row positions with a bulk take. Assemble coarse runs directly. Builders and the permutation buffer use the execution context's allocator.
  • Push filters through all scalar-function arguments and reduce contiguous filters to slices. These shared rules are not CASE-specific.
  • Add focused semantic tests and extend the existing CASE benchmark with decimal products and string branches across run lengths.

Validation

  • cargo nextest run -p vortex-array: 3,453 passed, one skipped (including 55 CASE tests).
  • cargo clippy -p vortex-array --all-targets --all-features -- -D warnings: passed.
  • cargo +nightly fmt --all and git diff --check: passed.
  • cargo bench -p vortex-array --bench expr_case_when -- --sample-count 30: completed, including simple, n-ary, early-exit, fragmented, and coarse-run controls.

On this revision, 65,536-row alternating decimal-product and string cases have medians of 165.5 µs and 157.1 µs. These are candidate-only measurements, not a fresh comparison against develop. Earlier paired experiments motivated the change, but also found small n-ary regressions; this is not a claim of uniform improvement.

Review considerations

The 128-rows-per-run heuristic is empirical. Compact assembly adds temporary output/permutation storage; no memory-saving claim is made. The shared scalar-function filter rule broadens selection pushdown, so its contract and deeply nested expression behavior deserve particular review.

Ported and validated with Codex. No dependency changes or unrelated Vortex experiments are included.

…ution

Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@codspeed-hq

codspeed-hq Bot commented Sep 9, 2026

Copy link
Copy Markdown

Merging this PR will regress 19 benchmarks

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 27 improved benchmarks
❌ 19 regressed benchmarks
✅ 2147 untouched benchmarks
🆕 12 new benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation case_when_nary_10_conditions[1000] 285 µs 404.6 µs -29.55%
Simulation random_i8[0.5] 67.9 µs 93.3 µs -27.25%
Simulation take_filter_primitive_nullable_slice_mask_random_indices[4096, 1000] 100.9 µs 131 µs -22.99%
Simulation case_when_nary_equality_lookup[1000] 246.4 µs 317.3 µs -22.34%
Simulation filter_list_primitive_short[Sparse] 132.2 µs 168.9 µs -21.74%
Simulation filter_list_primitive_wide[Sparse] 133.3 µs 169.2 µs -21.23%
Simulation take_filter_primitive_nullable_slice_mask_random_indices[16384, 1000] 119.5 µs 150.9 µs -20.85%
Simulation filter_list_primitive_short[Clustered] 134.2 µs 168.6 µs -20.4%
Simulation case_when_nary_3_conditions[1000] 174.9 µs 219.2 µs -20.23%
Simulation case_when_nary_early_dominant[1000] 174.8 µs 216.1 µs -19.1%
Simulation filter_list_primitive_short[Prefix] 137.8 µs 169.8 µs -18.87%
Simulation filter_list_primitive_wide[Clustered] 137.6 µs 169.4 µs -18.79%
Simulation case_when_nary_equality_lookup[10000] 390.2 µs 480 µs -18.71%
Simulation filter_list_primitive_wide[Prefix] 138 µs 169.3 µs -18.48%
Simulation filter_powerlaw_by_random[10000] 32.3 µs 37.9 µs -14.66%
Simulation take_filter_primitive_slice_mask_sequential_indices[16384, 1000] 53.7 µs 61.5 µs -12.69%
Simulation filter_ultra_sparse[250000] 74.3 µs 84.7 µs -12.3%
WallTime mul_u32_nonnull_avx512 5.6 µs 6.3 µs -12.13%
Simulation case_when_without_else[10000] 211.7 µs 237.8 µs -10.99%
Simulation density_sweep_single_slice[0.9999] 84.2 µs 27.3 µs ×3.1
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ngates/batched-case-execution (2ae4de6) with develop (9d1b103)

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2ae4de6 statpopgen 2 Explore Profiling Data
🟢 Done 2ae4de6 clickbench-sorted-nvme 2 Explore Profiling Data
🟢 Done 2ae4de6 fineweb-s3 2 Explore Profiling Data
🟢 Done 2ae4de6 clickbench-nvme 2 Explore Profiling Data
🟢 Done 2ae4de6 tpcds-nvme 2 Explore Profiling Data
🟢 Done 2ae4de6 tpch-nvme 2 Explore Profiling Data
🟢 Done 2ae4de6 polarsignals 2 Explore Profiling Data
🟢 Done 2ae4de6 tpch-s3 2 Explore Profiling Data
🟢 Done 2ae4de6 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 2ae4de6 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Engines: DataFusion No clear signal (+2.5%, low confidence) · DuckDB No clear signal (+3.4%, low confidence)
Vortex (geomean): hot 1.036x ➖ · cold 1.070x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.019x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6946672 / 6888695 / +0.8% 21870166 / 19587014 / +11.7% 🔴 0.32 / 0.35 / -9.7%
fineweb_q01/datafusion:vortex-file-compressed 13335538 / 13272356 / +0.5% 51444651 / 46805451 / +9.9% 0.26 / 0.28 / -8.6%
fineweb_q02/datafusion:vortex-file-compressed 14145206 / 12796946 / +10.5% 🔴 55883774 / 46784292 / +19.4% 🔴 0.25 / 0.27 / -7.5%
fineweb_q03/datafusion:vortex-file-compressed 20284130 / 19519313 / +3.9% 103711194 / 98783180 / +5.0% 0.20 / 0.20 / -1.0%
fineweb_q04/datafusion:vortex-file-compressed 74073788 / 72994740 / +1.5% 152825791 / 149080432 / +2.5% 0.48 / 0.49 / -1.0%
fineweb_q05/datafusion:vortex-file-compressed 57166764 / 56957685 / +0.4% 139198825 / 130101651 / +7.0% 0.41 / 0.44 / -6.2%
fineweb_q06/datafusion:vortex-file-compressed 19309142 / 19817142 / -2.6% 111458590 / 103366559 / +7.8% 0.17 / 0.19 / -9.6%
fineweb_q07/datafusion:vortex-file-compressed 16973796 / 16763064 / +1.3% 101610559 / 97869430 / +3.8% 0.17 / 0.17 / -2.5%
fineweb_q08/datafusion:vortex-file-compressed 9489662 / 8951423 / +6.0% 56787861 / 54203761 / +4.8% 0.17 / 0.17 / +1.2%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9399697 / 9349039 / +0.5% 33049672 / 35235506 / -6.2% 0.28 / 0.27 / +7.2%
fineweb_q01/datafusion:parquet 70720460 / 70407270 / +0.4% 152822871 / 152032996 / +0.5% 0.46 / 0.46 / -0.1%
fineweb_q02/datafusion:parquet 69868826 / 70885974 / -1.4% 157604126 / 148080797 / +6.4% 0.44 / 0.48 / -7.4%
fineweb_q03/datafusion:parquet 71759132 / 68548796 / +4.7% 148738499 / 143957999 / +3.3% 0.48 / 0.48 / +1.3%
fineweb_q04/datafusion:parquet 76023168 / 76884414 / -1.1% 154190039 / 143444811 / +7.5% 0.49 / 0.54 / -8.0%
fineweb_q05/datafusion:parquet 74612008 / 75149258 / -0.7% 150118832 / 144295607 / +4.0% 0.50 / 0.52 / -4.6%
fineweb_q06/datafusion:parquet 69679448 / 70538917 / -1.2% 160070487 / 150918395 / +6.1% 0.44 / 0.47 / -6.9%
fineweb_q07/datafusion:parquet 69658890 / 69316142 / +0.5% 158559392 / 148662043 / +6.7% 0.44 / 0.47 / -5.8%
fineweb_q08/datafusion:parquet 68535737 / 70063122 / -2.2% 148654432 / 146251398 / +1.6% 0.46 / 0.48 / -3.8%
duckdb / vortex-file-compressed / ns (1.047x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2960226 / 2193588 / +34.9% 🔴 5767273 / 5943765 / -3.0% 0.51 / 0.37 / +39.1%
fineweb_q01/duckdb:vortex-file-compressed 18008022 / 16617896 / +8.4% 58804087 / 48803387 / +20.5% 🔴 0.31 / 0.34 / -10.1%
fineweb_q02/duckdb:vortex-file-compressed 18537750 / 18242824 / +1.6% 45016058 / 47826713 / -5.9% 0.41 / 0.38 / +8.0%
fineweb_q03/duckdb:vortex-file-compressed 23902302 / 23044736 / +3.7% 102292784 / 93091431 / +9.9% 0.23 / 0.25 / -5.6%
fineweb_q04/duckdb:vortex-file-compressed 80066072 / 78026092 / +2.6% 148426808 / 143110664 / +3.7% 0.54 / 0.55 / -1.1%
fineweb_q05/duckdb:vortex-file-compressed 63348690 / 62050370 / +2.1% 115208387 / 112078071 / +2.8% 0.55 / 0.55 / -0.7%
fineweb_q06/duckdb:vortex-file-compressed 24701688 / 26456222 / -6.6% 108636641 / 100364119 / +8.2% 0.23 / 0.26 / -13.7%
fineweb_q07/duckdb:vortex-file-compressed 24147420 / 22911755 / +5.4% 97589333 / 87760243 / +11.2% 🔴 0.25 / 0.26 / -5.2%
fineweb_q08/duckdb:vortex-file-compressed 10385846 / 10894854 / -4.7% 51076249 / 46495651 / +9.9% 0.20 / 0.23 / -13.2%
duckdb / parquet / ns (1.013x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24385918 / 21574539 / +13.0% 🔴 24099224 / 23100648 / +4.3% 1.01 / 0.93 / +8.3%
fineweb_q01/duckdb:parquet 44386257 / 45659412 / -2.8% 54782832 / 55516100 / -1.3% 0.81 / 0.82 / -1.5%
fineweb_q02/duckdb:parquet 43710182 / 43929453 / -0.5% 52783216 / 53353200 / -1.1% 0.83 / 0.82 / +0.6%
fineweb_q03/duckdb:parquet 94818946 / 94803362 / +0.0% 186122729 / 190525839 / -2.3% 0.51 / 0.50 / +2.4%
fineweb_q04/duckdb:parquet 151823144 / 151928025 / -0.1% 196196512 / 193455139 / +1.4% 0.77 / 0.79 / -1.5%
fineweb_q05/duckdb:parquet 142986654 / 143209609 / -0.2% 195824751 / 188079533 / +4.1% 0.73 / 0.76 / -4.1%
fineweb_q06/duckdb:parquet 70981622 / 71290520 / -0.4% 127866998 / 124451945 / +2.7% 0.56 / 0.57 / -3.1%
fineweb_q07/duckdb:parquet 72526714 / 72149606 / +0.5% 157471582 / 162716743 / -3.2% 0.46 / 0.44 / +3.9%
fineweb_q08/duckdb:parquet 22879247 / 22241276 / +2.9% 24283951 / 24071858 / +0.9% 0.94 / 0.92 / +2.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 2ae4de65 vs base 5c92e4e4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-1.5%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.019x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 96813962 / 91262916 / +6.1% 169328659 / 150453623 / +12.5% 🔴 0.57 / 0.61 / -5.7%
tpch_q02/datafusion:vortex-file-compressed 64707228 / 65769787 / -1.6% 95754330 / 92198430 / +3.9% 0.68 / 0.71 / -5.3%
tpch_q03/datafusion:vortex-file-compressed 65540383 / 66293551 / -1.1% 111239576 / 110281387 / +0.9% 0.59 / 0.60 / -2.0%
tpch_q04/datafusion:vortex-file-compressed 35633197 / 36098316 / -1.3% 72372314 / 71264140 / +1.6% 0.49 / 0.51 / -2.8%
tpch_q05/datafusion:vortex-file-compressed 117421667 / 118118849 / -0.6% 179707089 / 169162601 / +6.2% 0.65 / 0.70 / -6.4%
tpch_q06/datafusion:vortex-file-compressed 14690824 / 14575812 / +0.8% 68192404 / 70701986 / -3.5% 0.22 / 0.21 / +4.5%
tpch_q07/datafusion:vortex-file-compressed 139030099 / 140292185 / -0.9% 187031215 / 190093742 / -1.6% 0.74 / 0.74 / +0.7%
tpch_q08/datafusion:vortex-file-compressed 143208592 / 145092225 / -1.3% 233150816 / 196599438 / +18.6% 🔴 0.61 / 0.74 / -16.8%
tpch_q09/datafusion:vortex-file-compressed 183794541 / 185995820 / -1.2% 247589560 / 252774369 / -2.1% 0.74 / 0.74 / +0.9%
tpch_q10/datafusion:vortex-file-compressed 74676938 / 75632737 / -1.3% 129927698 / 123170811 / +5.5% 0.57 / 0.61 / -6.4%
tpch_q11/datafusion:vortex-file-compressed 42554178 / 43579171 / -2.4% 67033539 / 64732508 / +3.6% 0.63 / 0.67 / -5.7%
tpch_q12/datafusion:vortex-file-compressed 46526215 / 47052408 / -1.1% 88942045 / 91545346 / -2.8% 0.52 / 0.51 / +1.8%
tpch_q13/datafusion:vortex-file-compressed 47140485 / 47580420 / -0.9% 79661325 / 77122744 / +3.3% 0.59 / 0.62 / -4.1%
tpch_q14/datafusion:vortex-file-compressed 25656204 / 24866740 / +3.2% 95135140 / 93523107 / +1.7% 0.27 / 0.27 / +1.4%
tpch_q15/datafusion:vortex-file-compressed 36700425 / 37951467 / -3.3% 100288404 / 98987665 / +1.3% 0.37 / 0.38 / -4.6%
tpch_q16/datafusion:vortex-file-compressed 37136010 / 37845761 / -1.9% 65011299 / 62474713 / +4.1% 0.57 / 0.61 / -5.7%
tpch_q17/datafusion:vortex-file-compressed 172662488 / 180261710 / -4.2% 225035626 / 228934982 / -1.7% 0.77 / 0.79 / -2.6%
tpch_q18/datafusion:vortex-file-compressed 201067520 / 203147401 / -1.0% 259516323 / 260978647 / -0.6% 0.77 / 0.78 / -0.5%
tpch_q19/datafusion:vortex-file-compressed 35004584 / 39045894 / -10.4% 🟢 93706807 / 88557457 / +5.8% 0.37 / 0.44 / -15.3%
tpch_q20/datafusion:vortex-file-compressed 63526468 / 63417615 / +0.2% 116912353 / 123192542 / -5.1% 0.54 / 0.51 / +5.6%
tpch_q21/datafusion:vortex-file-compressed 182668100 / 181763481 / +0.5% 236005466 / 231341137 / +2.0% 0.77 / 0.79 / -1.5%
tpch_q22/datafusion:vortex-file-compressed 25157586 / 25561532 / -1.6% 53584516 / 53362546 / +0.4% 0.47 / 0.48 / -2.0%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83588609 / 82924546 / +0.8% 128758358 / 132375140 / -2.7% 0.65 / 0.63 / +3.6%
tpch_q02/datafusion:parquet 134344204 / 133904580 / +0.3% 162794059 / 160968317 / +1.1% 0.83 / 0.83 / -0.8%
tpch_q03/datafusion:parquet 125796898 / 123951078 / +1.5% 189814915 / 208381137 / -8.9% 0.66 / 0.59 / +11.4%
tpch_q04/datafusion:parquet 53929550 / 53859085 / +0.1% 96814331 / 103400128 / -6.4% 0.56 / 0.52 / +6.9%
tpch_q05/datafusion:parquet 164783162 / 164445164 / +0.2% 236862169 / 236261684 / +0.3% 0.70 / 0.70 / -0.0%
tpch_q06/datafusion:parquet 32484174 / 32086449 / +1.2% 79699890 / 87597578 / -9.0% 0.41 / 0.37 / +11.3%
tpch_q07/datafusion:parquet 216742409 / 217352710 / -0.3% 295020210 / 296985091 / -0.7% 0.73 / 0.73 / +0.4%
tpch_q08/datafusion:parquet 212208966 / 211849191 / +0.2% 284433442 / 285189406 / -0.3% 0.75 / 0.74 / +0.4%
tpch_q09/datafusion:parquet 284735277 / 280880083 / +1.4% 355929140 / 354196499 / +0.5% 0.80 / 0.79 / +0.9%
tpch_q10/datafusion:parquet 306450189 / 310253139 / -1.2% 370773968 / 365735393 / +1.4% 0.83 / 0.85 / -2.6%
tpch_q11/datafusion:parquet 96673929 / 96937512 / -0.3% 119033570 / 116223150 / +2.4% 0.81 / 0.83 / -2.6%
tpch_q12/datafusion:parquet 79572669 / 78503862 / +1.4% 127875276 / 129132247 / -1.0% 0.62 / 0.61 / +2.4%
tpch_q13/datafusion:parquet 194857448 / 195306864 / -0.2% 226934298 / 225867304 / +0.5% 0.86 / 0.86 / -0.7%
tpch_q14/datafusion:parquet 74044003 / 75849454 / -2.4% 187313803 / 174475078 / +7.4% 0.40 / 0.43 / -9.1%
tpch_q15/datafusion:parquet 77745084 / 77886325 / -0.2% 138213417 / 138206172 / +0.0% 0.56 / 0.56 / -0.2%
tpch_q16/datafusion:parquet 83683841 / 85302573 / -1.9% 108532752 / 107942897 / +0.5% 0.77 / 0.79 / -2.4%
tpch_q17/datafusion:parquet 204129093 / 202312865 / +0.9% 265998079 / 262905386 / +1.2% 0.77 / 0.77 / -0.3%
tpch_q18/datafusion:parquet 270267918 / 261594839 / +3.3% 312629638 / 312116022 / +0.2% 0.86 / 0.84 / +3.1%
tpch_q19/datafusion:parquet 97620474 / 97555929 / +0.1% 168910747 / 171595748 / -1.6% 0.58 / 0.57 / +1.7%
tpch_q20/datafusion:parquet 154132739 / 152752771 / +0.9% 219160765 / 219546837 / -0.2% 0.70 / 0.70 / +1.1%
tpch_q21/datafusion:parquet 232814487 / 229864395 / +1.3% 323841636 / 305203310 / +6.1% 0.72 / 0.75 / -4.5%
tpch_q22/datafusion:parquet 162164477 / 160567876 / +1.0% 185119718 / 181503146 / +2.0% 0.88 / 0.88 / -1.0%
duckdb / vortex-file-compressed / ns (1.020x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55241397 / 53665664 / +2.9% 91278015 / 92463685 / -1.3% 0.61 / 0.58 / +4.3%
tpch_q02/duckdb:vortex-file-compressed 32853499 / 32984992 / -0.4% 48229286 / 45071708 / +7.0% 0.68 / 0.73 / -6.9%
tpch_q03/duckdb:vortex-file-compressed 59464114 / 58090482 / +2.4% 97870561 / 100556988 / -2.7% 0.61 / 0.58 / +5.2%
tpch_q04/duckdb:vortex-file-compressed 79746672 / 80611162 / -1.1% 112077170 / 110333737 / +1.6% 0.71 / 0.73 / -2.6%
tpch_q05/duckdb:vortex-file-compressed 65077532 / 63979977 / +1.7% 107643447 / 107859853 / -0.2% 0.60 / 0.59 / +1.9%
tpch_q06/duckdb:vortex-file-compressed 21003392 / 21258294 / -1.2% 57752259 / 58162286 / -0.7% 0.36 / 0.37 / -0.5%
tpch_q07/duckdb:vortex-file-compressed 62394473 / 63316792 / -1.5% 127811376 / 118000805 / +8.3% 0.49 / 0.54 / -9.0%
tpch_q08/duckdb:vortex-file-compressed 83795609 / 86053824 / -2.6% 138058172 / 136378810 / +1.2% 0.61 / 0.63 / -3.8%
tpch_q09/duckdb:vortex-file-compressed 169829188 / 174104051 / -2.5% 230646204 / 224676718 / +2.7% 0.74 / 0.77 / -5.0%
tpch_q10/duckdb:vortex-file-compressed 117068863 / 115768927 / +1.1% 170920516 / 192912522 / -11.4% 🟢 0.68 / 0.60 / +14.1%
tpch_q11/duckdb:vortex-file-compressed 17328961 / 16981247 / +2.0% 35575348 / 30409453 / +17.0% 🔴 0.49 / 0.56 / -12.8%
tpch_q12/duckdb:vortex-file-compressed 56360181 / 53703995 / +4.9% 91794136 / 89003906 / +3.1% 0.61 / 0.60 / +1.8%
tpch_q13/duckdb:vortex-file-compressed 92794425 / 90064196 / +3.0% 134822653 / 131162014 / +2.8% 0.69 / 0.69 / +0.2%
tpch_q14/duckdb:vortex-file-compressed 31401858 / 30453176 / +3.1% 75009598 / 75823361 / -1.1% 0.42 / 0.40 / +4.2%
tpch_q15/duckdb:vortex-file-compressed 39581362 / 37838822 / +4.6% 88094645 / 84749803 / +3.9% 0.45 / 0.45 / +0.6%
tpch_q16/duckdb:vortex-file-compressed 43328950 / 42392016 / +2.2% 54321308 / 56422652 / -3.7% 0.80 / 0.75 / +6.2%
tpch_q17/duckdb:vortex-file-compressed 78445318 / 59983363 / +30.8% 🔴 156323108 / 139414750 / +12.1% 🔴 0.50 / 0.43 / +16.6%
tpch_q18/duckdb:vortex-file-compressed 134801881 / 139622399 / -3.5% 151669068 / 151715264 / -0.0% 0.89 / 0.92 / -3.4%
tpch_q19/duckdb:vortex-file-compressed 44855104 / 43371403 / +3.4% 112010765 / 102477295 / +9.3% 0.40 / 0.42 / -5.4%
tpch_q20/duckdb:vortex-file-compressed 59747823 / 60216827 / -0.8% 110176172 / 120608887 / -8.7% 0.54 / 0.50 / +8.6%
tpch_q21/duckdb:vortex-file-compressed 245338929 / 244373947 / +0.4% 279879343 / 279884592 / -0.0% 0.88 / 0.87 / +0.4%
tpch_q22/duckdb:vortex-file-compressed 40610768 / 41297137 / -1.7% 58455025 / 59928153 / -2.5% 0.69 / 0.69 / +0.8%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70769054 / 69756587 / +1.5% 127045180 / 85935919 / +47.8% 🔴 0.56 / 0.81 / -31.4%
tpch_q02/duckdb:parquet 71558609 / 71120566 / +0.6% 81180348 / 81383225 / -0.2% 0.88 / 0.87 / +0.9%
tpch_q03/duckdb:parquet 113745018 / 114722653 / -0.9% 161621584 / 158460632 / +2.0% 0.70 / 0.72 / -2.8%
tpch_q04/duckdb:parquet 75123553 / 75265332 / -0.2% 100696715 / 105325244 / -4.4% 0.75 / 0.71 / +4.4%
tpch_q05/duckdb:parquet 126810198 / 124092898 / +2.2% 160848151 / 162610120 / -1.1% 0.79 / 0.76 / +3.3%
tpch_q06/duckdb:parquet 35808850 / 33933313 / +5.5% 50170831 / 48992464 / +2.4% 0.71 / 0.69 / +3.0%
tpch_q07/duckdb:parquet 90770153 / 89764533 / +1.1% 131733526 / 127972881 / +2.9% 0.69 / 0.70 / -1.8%
tpch_q08/duckdb:parquet 144704056 / 143479846 / +0.9% 201204440 / 186213067 / +8.1% 0.72 / 0.77 / -6.7%
tpch_q09/duckdb:parquet 224570049 / 225397694 / -0.4% 263159527 / 263724930 / -0.2% 0.85 / 0.85 / -0.2%
tpch_q10/duckdb:parquet 472958429 / 471538652 / +0.3% 509413165 / 509586465 / -0.0% 0.93 / 0.93 / +0.3%
tpch_q11/duckdb:parquet 31023105 / 30561446 / +1.5% 37566522 / 37121458 / +1.2% 0.83 / 0.82 / +0.3%
tpch_q12/duckdb:parquet 76591203 / 75712202 / +1.2% 94017978 / 93707048 / +0.3% 0.81 / 0.81 / +0.8%
tpch_q13/duckdb:parquet 315276752 / 313099847 / +0.7% 330331323 / 327438666 / +0.9% 0.95 / 0.96 / -0.2%
tpch_q14/duckdb:parquet 107465686 / 105791549 / +1.6% 137384068 / 144050653 / -4.6% 0.78 / 0.73 / +6.5%
tpch_q15/duckdb:parquet 44756958 / 43778987 / +2.2% 66881752 / 68759365 / -2.7% 0.67 / 0.64 / +5.1%
tpch_q16/duckdb:parquet 114171490 / 113277695 / +0.8% 127128148 / 123577102 / +2.9% 0.90 / 0.92 / -2.0%
tpch_q17/duckdb:parquet 74146922 / 73659778 / +0.7% 104222255 / 104123126 / +0.1% 0.71 / 0.71 / +0.6%
tpch_q18/duckdb:parquet 193260701 / 203024169 / -4.8% 168094390 / 166118944 / +1.2% 1.15 / 1.22 / -5.9%
tpch_q19/duckdb:parquet 162300263 / 162939866 / -0.4% 195333368 / 190832090 / +2.4% 0.83 / 0.85 / -2.7%
tpch_q20/duckdb:parquet 129072061 / 128858824 / +0.2% 165210175 / 160320589 / +3.0% 0.78 / 0.80 / -2.8%
tpch_q21/duckdb:parquet 261692359 / 272280748 / -3.9% 298729179 / 295849051 / +1.0% 0.88 / 0.92 / -4.8%
tpch_q22/duckdb:parquet 263970724 / 261896745 / +0.8% 273975709 / 270735802 / +1.2% 0.96 / 0.97 / -0.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.026x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 262837724 / 249498942 / +5.3% 742176305 / 515990911 / +43.8% 🔴 0.35 / 0.48 / -26.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed 13070741 / 13884355 / -5.9% 49587073 / 51784935 / -4.2% 0.26 / 0.27 / -1.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed 14178795 / 14334882 / -1.1% 47682534 / 48783451 / -2.3% 0.30 / 0.29 / +1.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 29952384 / 29985038 / -0.1% 64795838 / 67330879 / -3.8% 0.46 / 0.45 / +3.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed 25245966 / 24145302 / +4.6% 55901989 / 57688786 / -3.1% 0.45 / 0.42 / +7.9%
clickbench-sorted_q38/datafusion:vortex-file-compressed 35835241 / 36641794 / -2.2% 68733788 / 75604819 / -9.1% 0.52 / 0.48 / +7.6%
clickbench-sorted_q39/datafusion:vortex-file-compressed 89389638 / 91906712 / -2.7% 116190442 / 119643054 / -2.9% 0.77 / 0.77 / +0.2%
clickbench-sorted_q40/datafusion:vortex-file-compressed 16279766 / 16181415 / +0.6% 44965951 / 44027903 / +2.1% 0.36 / 0.37 / -1.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 15461532 / 15369861 / +0.6% 45972488 / 43136040 / +6.6% 0.34 / 0.36 / -5.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed 14041986 / 13493904 / +4.1% 38586956 / 37780443 / +2.1% 0.36 / 0.36 / +1.9%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 756825852 / 761990374 / -0.7% 951032885 / 969886246 / -1.9% 0.80 / 0.79 / +1.3%
clickbench-sorted_q24/datafusion:parquet 8547198 / 8907641 / -4.0% 72033658 / 70856288 / +1.7% 0.12 / 0.13 / -5.6%
clickbench-sorted_q26/datafusion:parquet 8785247 / 9348132 / -6.0% 72527499 / 71242467 / +1.8% 0.12 / 0.13 / -7.7%
clickbench-sorted_q36/datafusion:parquet 94489912 / 94134458 / +0.4% 167473641 / 167352243 / +0.1% 0.56 / 0.56 / +0.3%
clickbench-sorted_q37/datafusion:parquet 65050695 / 64475246 / +0.9% 131125430 / 130056495 / +0.8% 0.50 / 0.50 / +0.1%
clickbench-sorted_q38/datafusion:parquet 88246485 / 87461466 / +0.9% 159515364 / 158106256 / +0.9% 0.55 / 0.55 / +0.0%
clickbench-sorted_q39/datafusion:parquet 160036722 / 160330758 / -0.2% 235515537 / 233976032 / +0.7% 0.68 / 0.69 / -0.8%
clickbench-sorted_q40/datafusion:parquet 44803779 / 43995372 / +1.8% 109159652 / 109620597 / -0.4% 0.41 / 0.40 / +2.3%
clickbench-sorted_q41/datafusion:parquet 42626754 / 42205100 / +1.0% 108345645 / 109321187 / -0.9% 0.39 / 0.39 / +1.9%
clickbench-sorted_q42/datafusion:parquet 26218612 / 26250616 / -0.1% 86462471 / 87353613 / -1.0% 0.30 / 0.30 / +0.9%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 69218148 / 67643839 / +2.3% 99272518 / 85743339 / +15.8% 🔴 0.70 / 0.79 / -11.6%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18685426 / 20433666 / -8.6% 30450235 / 32011270 / -4.9% 0.61 / 0.64 / -3.9%
clickbench-sorted_q26/duckdb:vortex-file-compressed 17666872 / 16424112 / +7.6% 26667535 / 27420330 / -2.7% 0.66 / 0.60 / +10.6%
clickbench-sorted_q36/duckdb:vortex-file-compressed 45578841 / 45765086 / -0.4% 78547618 / 73338353 / +7.1% 0.58 / 0.62 / -7.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 37525691 / 38052044 / -1.4% 62037095 / 61262652 / +1.3% 0.60 / 0.62 / -2.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 52498157 / 47973684 / +9.4% 78201277 / 76535332 / +2.2% 0.67 / 0.63 / +7.1%
clickbench-sorted_q39/duckdb:vortex-file-compressed 111146693 / 116500514 / -4.6% 146507642 / 146528570 / -0.0% 0.76 / 0.80 / -4.6%
clickbench-sorted_q40/duckdb:vortex-file-compressed 21597415 / 21302020 / +1.4% 42161148 / 39804172 / +5.9% 0.51 / 0.54 / -4.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21244148 / 21257965 / -0.1% 44381268 / 40789430 / +8.8% 0.48 / 0.52 / -8.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed 19099182 / 18668936 / +2.3% 33953892 / 34362327 / -1.2% 0.56 / 0.54 / +3.5%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 126633010 / 126962143 / -0.3% 142502225 / 154210535 / -7.6% 0.89 / 0.82 / +7.9%
clickbench-sorted_q24/duckdb:parquet 18349462 / 18822656 / -2.5% 28391839 / 25805314 / +10.0% 🔴 0.65 / 0.73 / -11.4%
clickbench-sorted_q26/duckdb:parquet 12076948 / 12771545 / -5.4% 23501542 / 23946939 / -1.9% 0.51 / 0.53 / -3.6%
clickbench-sorted_q36/duckdb:parquet 44017843 / 42629350 / +3.3% 60458257 / 59103779 / +2.3% 0.73 / 0.72 / +0.9%
clickbench-sorted_q37/duckdb:parquet 30985968 / 31341916 / -1.1% 46194737 / 47869397 / -3.5% 0.67 / 0.65 / +2.4%
clickbench-sorted_q38/duckdb:parquet 38752022 / 38713509 / +0.1% 56180738 / 55725147 / +0.8% 0.69 / 0.69 / -0.7%
clickbench-sorted_q39/duckdb:parquet 74543194 / 72032032 / +3.5% 86514736 / 87443673 / -1.1% 0.86 / 0.82 / +4.6%
clickbench-sorted_q40/duckdb:parquet 17266264 / 16600297 / +4.0% 35021084 / 36698950 / -4.6% 0.49 / 0.45 / +9.0%
clickbench-sorted_q41/duckdb:parquet 17372282 / 17035162 / +2.0% 35992274 / 34886237 / +3.2% 0.48 / 0.49 / -1.2%
clickbench-sorted_q42/duckdb:parquet 10996580 / 11507854 / -4.4% 23581351 / 26312566 / -10.4% 🟢 0.47 / 0.44 / +6.6%

File Size Changes (100 files changed, -0.0% overall, 44↑ 56↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 190.42 MB 192.44 MB +2.02 MB +1.1%
hits_033.vortex 1.0 vortex-file-compressed 198.57 MB 200.05 MB +1.49 MB +0.7%
hits_081.vortex 1.0 vortex-file-compressed 198.19 MB 199.55 MB +1.36 MB +0.7%
hits_044.vortex 1.0 vortex-file-compressed 198.08 MB 199.31 MB +1.23 MB +0.6%
hits_074.vortex 1.0 vortex-file-compressed 197.56 MB 198.63 MB +1.06 MB +0.5%
hits_007.vortex 1.0 vortex-file-compressed 198.55 MB 199.49 MB +969.07 KB +0.5%
hits_049.vortex 1.0 vortex-file-compressed 190.55 MB 191.36 MB +832.66 KB +0.4%
hits_085.vortex 1.0 vortex-file-compressed 198.24 MB 199.02 MB +795.89 KB +0.4%
hits_058.vortex 1.0 vortex-file-compressed 154.10 MB 154.58 MB +488.46 KB +0.3%
hits_067.vortex 1.0 vortex-file-compressed 130.77 MB 131.16 MB +394.33 KB +0.3%
hits_024.vortex 1.0 vortex-file-compressed 159.63 MB 160.09 MB +470.16 KB +0.3%
hits_014.vortex 1.0 vortex-file-compressed 171.53 MB 172.00 MB +486.78 KB +0.3%
hits_088.vortex 1.0 vortex-file-compressed 171.40 MB 171.86 MB +467.69 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 158.53 MB 158.89 MB +369.84 KB +0.2%
hits_046.vortex 1.0 vortex-file-compressed 100.51 MB 100.67 MB +169.70 KB +0.2%
hits_092.vortex 1.0 vortex-file-compressed 199.09 MB 199.35 MB +270.65 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 145.75 MB 145.94 MB +191.85 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 189.81 MB 190.03 MB +228.15 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.74 MB 191.95 MB +211.15 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.50 MB 130.63 MB +134.51 KB +0.1%
hits_070.vortex 1.0 vortex-file-compressed 199.67 MB 199.85 MB +184.70 KB +0.1%
hits_022.vortex 1.0 vortex-file-compressed 198.44 MB 198.60 MB +157.86 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 134.46 MB 134.55 MB +92.95 KB +0.1%
hits_098.vortex 1.0 vortex-file-compressed 136.68 MB 136.77 MB +90.01 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 189.77 MB 189.89 MB +123.58 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.03 MB 199.14 MB +112.25 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.91 MB 101.95 MB +48.68 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.87 MB 159.94 MB +74.88 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.25 MB 130.30 MB +52.46 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.09 MB 192.16 MB +75.37 KB +0.0%
hits_019.vortex 1.0 vortex-file-compressed 139.61 MB 139.66 MB +41.44 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 188.80 MB 188.85 MB +53.89 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.05 MB 131.08 MB +33.27 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.02 MB 130.04 MB +29.32 KB +0.0%
hits_066.vortex 1.0 vortex-file-compressed 162.36 MB 162.40 MB +33.27 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.24 MB 102.26 MB +18.52 KB +0.0%
hits_071.vortex 1.0 vortex-file-compressed 139.25 MB 139.27 MB +24.38 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 182.84 MB 182.87 MB +30.92 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.39 MB 153.41 MB +25.28 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.19 MB 160.21 MB +18.22 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 159.96 MB 159.97 MB +15.02 KB +0.0%
hits_045.vortex 1.0 vortex-file-compressed 138.64 MB 138.65 MB +11.15 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 150.82 MB 150.83 MB +11.55 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.69 MB 135.70 MB +7.70 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.65 MB 125.65 MB 1.42 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 200.46 MB 200.45 MB 7.78 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.40 MB 176.39 MB 16.45 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.56 MB 153.54 MB 14.95 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 198.83 MB 198.81 MB 19.91 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.23 MB 130.22 MB 13.63 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.83 MB 130.81 MB 15.88 KB -0.0%
hits_062.vortex 1.0 vortex-file-compressed 170.05 MB 170.02 MB 35.88 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 138.66 MB 138.62 MB 45.16 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.66 MB 141.61 MB 52.15 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 171.23 MB 171.17 MB 63.59 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.52 MB 130.48 MB 48.70 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.16 MB 191.09 MB 73.99 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 146.13 MB 146.07 MB 61.18 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.02 MB 129.96 MB 56.29 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.84 MB 153.77 MB 69.59 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.24 MB 126.17 MB 67.19 KB -0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.23 MB 159.15 MB 86.11 KB -0.1%
hits_011.vortex 1.0 vortex-file-compressed 198.69 MB 198.58 MB 112.49 KB -0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.44 MB 194.33 MB 120.65 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.60 MB 130.52 MB 83.93 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.73 MB 100.67 MB 67.70 KB -0.1%
hits_043.vortex 1.0 vortex-file-compressed 125.90 MB 125.82 MB 88.30 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.17 MB 156.05 MB 113.57 KB -0.1%
hits_039.vortex 1.0 vortex-file-compressed 160.13 MB 160.01 MB 118.98 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 159.49 MB 159.37 MB 125.27 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.70 MB 153.58 MB 124.19 KB -0.1%
hits_053.vortex 1.0 vortex-file-compressed 188.95 MB 188.79 MB 159.46 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.75 MB 130.64 MB 113.85 KB -0.1%
hits_038.vortex 1.0 vortex-file-compressed 189.05 MB 188.89 MB 165.28 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 160.19 MB 160.05 MB 145.75 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 171.66 MB 171.49 MB 168.23 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 188.68 MB 188.50 MB 188.02 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.01 MB 179.82 MB 200.33 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 170.93 MB 170.73 MB 201.45 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.03 MB 171.83 MB 206.32 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.25 MB 168.00 MB 254.85 KB -0.1%
hits_050.vortex 1.0 vortex-file-compressed 160.19 MB 159.94 MB 256.99 KB -0.2%
hits_005.vortex 1.0 vortex-file-compressed 166.73 MB 166.45 MB 278.48 KB -0.2%
hits_099.vortex 1.0 vortex-file-compressed 170.89 MB 170.61 MB 291.12 KB -0.2%
hits_008.vortex 1.0 vortex-file-compressed 139.04 MB 138.80 MB 248.24 KB -0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.87 MB 130.64 MB 235.08 KB -0.2%
hits_091.vortex 1.0 vortex-file-compressed 146.44 MB 146.11 MB 338.87 KB -0.2%
hits_020.vortex 1.0 vortex-file-compressed 159.54 MB 159.14 MB 409.09 KB -0.3%
hits_094.vortex 1.0 vortex-file-compressed 157.79 MB 157.36 MB 438.05 KB -0.3%
hits_095.vortex 1.0 vortex-file-compressed 153.84 MB 153.38 MB 472.19 KB -0.3%
hits_016.vortex 1.0 vortex-file-compressed 180.04 MB 179.47 MB 576.50 KB -0.3%
hits_029.vortex 1.0 vortex-file-compressed 198.95 MB 198.31 MB 655.98 KB -0.3%
hits_065.vortex 1.0 vortex-file-compressed 160.72 MB 160.16 MB 579.41 KB -0.4%
hits_059.vortex 1.0 vortex-file-compressed 198.29 MB 197.38 MB 930.18 KB -0.5%
hits_090.vortex 1.0 vortex-file-compressed 194.37 MB 193.36 MB 1.01 MB -0.5%
hits_096.vortex 1.0 vortex-file-compressed 198.77 MB 197.61 MB 1.16 MB -0.6%
hits_040.vortex 1.0 vortex-file-compressed 143.02 MB 142.13 MB 915.45 KB -0.6%
hits_055.vortex 1.0 vortex-file-compressed 199.03 MB 197.63 MB 1.41 MB -0.7%
hits_051.vortex 1.0 vortex-file-compressed 172.98 MB 171.71 MB 1.27 MB -0.7%
hits_076.vortex 1.0 vortex-file-compressed 159.95 MB 158.59 MB 1.36 MB -0.9%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.88 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: Likely regression (low confidence)
Attributed Vortex impact: +20.2%
Engines: DuckDB Likely regression (+20.2%, low confidence)
Vortex (geomean): hot 1.212x ❌ · cold 1.204x ❌
Parquet (geomean): hot 1.009x ➖ · cold 1.020x ➖
Shifts: Parquet (control) +0.9% · Median polish +1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.212x ❌, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 8998948 / 8975234 / +0.3% 9519789 / 9441941 / +0.8% 0.95 / 0.95 / -0.6%
statpopgen_q01/duckdb:vortex-file-compressed 10547808 / 10360788 / +1.8% 16545001 / 16073639 / +2.9% 0.64 / 0.64 / -1.1%
statpopgen_q02/duckdb:vortex-file-compressed 381083881 / 378367276 / +0.7% 400340951 / 392775972 / +1.9% 0.95 / 0.96 / -1.2%
statpopgen_q03/duckdb:vortex-file-compressed 892453588 / 896984627 / -0.5% 896643751 / 904291836 / -0.8% 1.00 / 0.99 / +0.3%
statpopgen_q04/duckdb:vortex-file-compressed 898667570 / 892750499 / +0.7% 910649319 / 891043166 / +2.2% 0.99 / 1.00 / -1.5%
statpopgen_q05/duckdb:vortex-file-compressed 423293071 / 423819106 / -0.1% 439299641 / 436046273 / +0.7% 0.96 / 0.97 / -0.9%
statpopgen_q06/duckdb:vortex-file-compressed 1169977146 / 1172577476 / -0.2% 1174878742 / 1169346814 / +0.5% 1.00 / 1.00 / -0.7%
statpopgen_q07/duckdb:vortex-file-compressed 547579302 / 184397934 / +197.0% 🔴 563179975 / 200793956 / +180.5% 🔴 0.97 / 0.92 / +5.9%
statpopgen_q08/duckdb:vortex-file-compressed 559483685 / 203515113 / +174.9% 🔴 598565152 / 241982650 / +147.4% 🔴 0.93 / 0.84 / +11.1%
statpopgen_q09/duckdb:vortex-file-compressed 708141132 / 711248740 / -0.4% 752328276 / 732523098 / +2.7% 0.94 / 0.97 / -3.1%
statpopgen_q10/duckdb:vortex-file-compressed 1998367746 / 2010496259 / -0.6% 1975576223 / 1976905747 / -0.1% 1.01 / 1.02 / -0.5%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245925802 / 247047211 / -0.5% 246275024 / 248521027 / -0.9% 1.00 / 0.99 / +0.5%
statpopgen_q01/duckdb:parquet 301324478 / 307038943 / -1.9% 304651754 / 307529089 / -0.9% 0.99 / 1.00 / -0.9%
statpopgen_q02/duckdb:parquet 566783640 / 528424200 / +7.3% 573459532 / 552660500 / +3.8% 0.99 / 0.96 / +3.4%
statpopgen_q03/duckdb:parquet 835283120 / 845032199 / -1.2% 875083847 / 852801130 / +2.6% 0.95 / 0.99 / -3.7%
statpopgen_q04/duckdb:parquet 882821248 / 817311144 / +8.0% 894550252 / 829362038 / +7.9% 0.99 / 0.99 / +0.1%
statpopgen_q05/duckdb:parquet 580303118 / 587778152 / -1.3% 581639202 / 589297522 / -1.3% 1.00 / 1.00 / +0.0%
statpopgen_q06/duckdb:parquet 742170804 / 720766509 / +3.0% 747125630 / 716917039 / +4.2% 0.99 / 1.01 / -1.2%
statpopgen_q07/duckdb:parquet 611268436 / 621871870 / -1.7% 699743446 / 663361652 / +5.5% 0.87 / 0.94 / -6.8%
statpopgen_q08/duckdb:parquet 617598018 / 624055728 / -1.0% 722094212 / 700821413 / +3.0% 0.86 / 0.89 / -4.0%
statpopgen_q09/duckdb:parquet 807681974 / 774726169 / +4.3% 832459809 / 819230006 / +1.6% 0.97 / 0.95 / +2.6%
statpopgen_q10/duckdb:parquet 1523110542 / 1596718321 / -4.6% 1288294338 / 1329428363 / -3.1% 1.18 / 1.20 / -1.6%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 2ae4de65 vs base 5c92e4e4
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.987x ➖ · cold 0.977x ➖
Parquet (geomean): hot 0.989x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -1.1% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1228999 / 1218021 / +0.9% 20753352 / 22018306 / -5.7% 0.06 / 0.06 / +7.1%
clickbench_q01/datafusion:vortex-file-compressed 7097808 / 7340138 / -3.3% 34496328 / 34873794 / -1.1% 0.21 / 0.21 / -2.2%
clickbench_q02/datafusion:vortex-file-compressed 13146650 / 13391398 / -1.8% 37698260 / 42421669 / -11.1% 🟢 0.35 / 0.32 / +10.5%
clickbench_q03/datafusion:vortex-file-compressed 13002572 / 12732138 / +2.1% 47145616 / 53231096 / -11.4% 🟢 0.28 / 0.24 / +15.3%
clickbench_q04/datafusion:vortex-file-compressed 58005355 / 58690499 / -1.2% 93716617 / 93454602 / +0.3% 0.62 / 0.63 / -1.4%
clickbench_q05/datafusion:vortex-file-compressed 77381198 / 77275886 / +0.1% 113677967 / 126361230 / -10.0% 🟢 0.68 / 0.61 / +11.3%
clickbench_q06/datafusion:vortex-file-compressed 1232152 / 1248190 / -1.3% 21027907 / 21861547 / -3.8% 0.06 / 0.06 / +2.6%
clickbench_q07/datafusion:vortex-file-compressed 13515162 / 14019480 / -3.6% 37778479 / 37579548 / +0.5% 0.36 / 0.37 / -4.1%
clickbench_q08/datafusion:vortex-file-compressed 83124078 / 78649724 / +5.7% 118344321 / 118572288 / -0.2% 0.70 / 0.66 / +5.9%
clickbench_q09/datafusion:vortex-file-compressed 175860480 / 175922052 / -0.0% 209437394 / 215207595 / -2.7% 0.84 / 0.82 / +2.7%
clickbench_q10/datafusion:vortex-file-compressed 41204188 / 40655686 / +1.3% 73761409 / 74670329 / -1.2% 0.56 / 0.54 / +2.6%
clickbench_q11/datafusion:vortex-file-compressed 55864279 / 54623468 / +2.3% 82851004 / 85567904 / -3.2% 0.67 / 0.64 / +5.6%
clickbench_q12/datafusion:vortex-file-compressed 79298181 / 76030924 / +4.3% 114682647 / 119465154 / -4.0% 0.69 / 0.64 / +8.6%
clickbench_q13/datafusion:vortex-file-compressed 123484166 / 123885584 / -0.3% 173301541 / 179778873 / -3.6% 0.71 / 0.69 / +3.4%
clickbench_q14/datafusion:vortex-file-compressed 88247993 / 84930028 / +3.9% 120645736 / 122118966 / -1.2% 0.73 / 0.70 / +5.2%
clickbench_q15/datafusion:vortex-file-compressed 63237950 / 63999492 / -1.2% 95802415 / 94370249 / +1.5% 0.66 / 0.68 / -2.7%
clickbench_q16/datafusion:vortex-file-compressed 154080962 / 158358862 / -2.7% 203139709 / 204559400 / -0.7% 0.76 / 0.77 / -2.0%
clickbench_q17/datafusion:vortex-file-compressed 153371758 / 154149420 / -0.5% 207696855 / 205987246 / +0.8% 0.74 / 0.75 / -1.3%
clickbench_q18/datafusion:vortex-file-compressed 303818143 / 305537612 / -0.6% 364479270 / 362163751 / +0.6% 0.83 / 0.84 / -1.2%
clickbench_q19/datafusion:vortex-file-compressed 8094650 / 8510568 / -4.9% 46177741 / 46551197 / -0.8% 0.18 / 0.18 / -4.1%
clickbench_q20/datafusion:vortex-file-compressed 67665724 / 68567856 / -1.3% 231205638 / 226322588 / +2.2% 0.29 / 0.30 / -3.4%
clickbench_q21/datafusion:vortex-file-compressed 100831444 / 99817287 / +1.0% 270240930 / 270394361 / -0.1% 0.37 / 0.37 / +1.1%
clickbench_q22/datafusion:vortex-file-compressed 122048660 / 123020844 / -0.8% 343238270 / 345262976 / -0.6% 0.36 / 0.36 / -0.2%
clickbench_q23/datafusion:vortex-file-compressed 380397492 / 394959974 / -3.7% 662823616 / 628863668 / +5.4% 0.57 / 0.63 / -8.6%
clickbench_q24/datafusion:vortex-file-compressed 21436490 / 21299214 / +0.6% 63296977 / 71294164 / -11.2% 🟢 0.34 / 0.30 / +13.4%
clickbench_q25/datafusion:vortex-file-compressed 25444981 / 26730708 / -4.8% 60116659 / 67318271 / -10.7% 🟢 0.42 / 0.40 / +6.6%
clickbench_q26/datafusion:vortex-file-compressed 21052776 / 22255780 / -5.4% 68109269 / 68298308 / -0.3% 0.31 / 0.33 / -5.1%
clickbench_q27/datafusion:vortex-file-compressed 101102543 / 102773338 / -1.6% 244647157 / 249335788 / -1.9% 0.41 / 0.41 / +0.3%
clickbench_q28/datafusion:vortex-file-compressed 569386460 / 564485101 / +0.9% 625778126 / 609919644 / +2.6% 0.91 / 0.93 / -1.7%
clickbench_q29/datafusion:vortex-file-compressed 25106014 / 25075045 / +0.1% 51588115 / 50077171 / +3.0% 0.49 / 0.50 / -2.8%
clickbench_q30/datafusion:vortex-file-compressed 88933362 / 82537868 / +7.7% 126412439 / 124769835 / +1.3% 0.70 / 0.66 / +6.3%
clickbench_q31/datafusion:vortex-file-compressed 86633617 / 82333044 / +5.2% 150566632 / 151267181 / -0.5% 0.58 / 0.54 / +5.7%
clickbench_q32/datafusion:vortex-file-compressed 297700558 / 294957276 / +0.9% 366684545 / 369346489 / -0.7% 0.81 / 0.80 / +1.7%
clickbench_q33/datafusion:vortex-file-compressed 339546637 / 331116728 / +2.5% 416447362 / 412323844 / +1.0% 0.82 / 0.80 / +1.5%
clickbench_q34/datafusion:vortex-file-compressed 333815194 / 337780490 / -1.2% 421033711 / 415233262 / +1.4% 0.79 / 0.81 / -2.5%
clickbench_q35/datafusion:vortex-file-compressed 57561004 / 58593426 / -1.8% 87401367 / 88645910 / -1.4% 0.66 / 0.66 / -0.4%
clickbench_q36/datafusion:vortex-file-compressed 37650412 / 37510208 / +0.4% 65870574 / 67678536 / -2.7% 0.57 / 0.55 / +3.1%
clickbench_q37/datafusion:vortex-file-compressed 22130968 / 22027512 / +0.5% 47101848 / 48224617 / -2.3% 0.47 / 0.46 / +2.9%
clickbench_q38/datafusion:vortex-file-compressed 11994896 / 12181274 / -1.5% 39208073 / 40381871 / -2.9% 0.31 / 0.30 / +1.4%
clickbench_q39/datafusion:vortex-file-compressed 79154737 / 79341182 / -0.2% 110271495 / 111162921 / -0.8% 0.72 / 0.71 / +0.6%
clickbench_q40/datafusion:vortex-file-compressed 11531951 / 11316265 / +1.9% 37444992 / 36879879 / +1.5% 0.31 / 0.31 / +0.4%
clickbench_q41/datafusion:vortex-file-compressed 10899041 / 11156384 / -2.3% 36493056 / 36332490 / +0.4% 0.30 / 0.31 / -2.7%
clickbench_q42/datafusion:vortex-file-compressed 11268924 / 11194950 / +0.7% 37025198 / 36182592 / +2.3% 0.30 / 0.31 / -1.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1271229 / 1237738 / +2.7% 52208525 / 50066410 / +4.3% 0.02 / 0.02 / -1.5%
clickbench_q01/datafusion:parquet 16331172 / 16048642 / +1.8% 75381457 / 70911657 / +6.3% 0.22 / 0.23 / -4.3%
clickbench_q02/datafusion:parquet 18412350 / 19014514 / -3.2% 83261327 / 85165728 / -2.2% 0.22 / 0.22 / -1.0%
clickbench_q03/datafusion:parquet 16935068 / 17143454 / -1.2% 81110943 / 82928754 / -2.2% 0.21 / 0.21 / +1.0%
clickbench_q04/datafusion:parquet 61155495 / 62805216 / -2.6% 126111341 / 130583735 / -3.4% 0.48 / 0.48 / +0.8%
clickbench_q05/datafusion:parquet 86774358 / 87456812 / -0.8% 156486624 / 158358336 / -1.2% 0.55 / 0.55 / +0.4%
clickbench_q06/datafusion:parquet 1264196 / 1268411 / -0.3% 49970362 / 50586779 / -1.2% 0.03 / 0.03 / +0.9%
clickbench_q07/datafusion:parquet 16809862 / 16777890 / +0.2% 69796087 / 69508477 / +0.4% 0.24 / 0.24 / -0.2%
clickbench_q08/datafusion:parquet 84978902 / 85995098 / -1.2% 163629881 / 164551120 / -0.6% 0.52 / 0.52 / -0.6%
clickbench_q09/datafusion:parquet 182356130 / 188787184 / -3.4% 265709399 / 270692969 / -1.8% 0.69 / 0.70 / -1.6%
clickbench_q10/datafusion:parquet 35581050 / 35245248 / +1.0% 104505307 / 103440121 / +1.0% 0.34 / 0.34 / -0.1%
clickbench_q11/datafusion:parquet 41819146 / 41408454 / +1.0% 110342711 / 109921373 / +0.4% 0.38 / 0.38 / +0.6%
clickbench_q12/datafusion:parquet 94500808 / 94565258 / -0.1% 159440400 / 160108953 / -0.4% 0.59 / 0.59 / +0.4%
clickbench_q13/datafusion:parquet 146094000 / 142678324 / +2.4% 220625373 / 224724824 / -1.8% 0.66 / 0.63 / +4.3%
clickbench_q14/datafusion:parquet 99673974 / 100240658 / -0.6% 170525047 / 175214667 / -2.7% 0.58 / 0.57 / +2.2%
clickbench_q15/datafusion:parquet 68827098 / 69690138 / -1.2% 130043778 / 128057985 / +1.6% 0.53 / 0.54 / -2.7%
clickbench_q16/datafusion:parquet 153268504 / 154356606 / -0.7% 231225518 / 234153190 / -1.3% 0.66 / 0.66 / +0.6%
clickbench_q17/datafusion:parquet 153868028 / 153804412 / +0.0% 229919040 / 229361711 / +0.2% 0.67 / 0.67 / -0.2%
clickbench_q18/datafusion:parquet 311981180 / 311475987 / +0.2% 409036261 / 415720575 / -1.6% 0.76 / 0.75 / +1.8%
clickbench_q19/datafusion:parquet 18806119 / 19507748 / -3.6% 71552317 / 78473881 / -8.8% 0.26 / 0.25 / +5.7%
clickbench_q20/datafusion:parquet 168138717 / 168091732 / +0.0% 275907540 / 293271967 / -5.9% 0.61 / 0.57 / +6.3%
clickbench_q21/datafusion:parquet 164504991 / 163434606 / +0.7% 287722256 / 310015567 / -7.2% 0.57 / 0.53 / +8.5%
clickbench_q22/datafusion:parquet 245964604 / 248575404 / -1.1% 411887981 / 453601963 / -9.2% 0.60 / 0.55 / +9.0%
clickbench_q23/datafusion:parquet 956765320 / 959507990 / -0.3% 1160689062 / 1195602114 / -2.9% 0.82 / 0.80 / +2.7%
clickbench_q24/datafusion:parquet 29783578 / 30010349 / -0.8% 87982810 / 91876396 / -4.2% 0.34 / 0.33 / +3.6%
clickbench_q25/datafusion:parquet 34951970 / 36790808 / -5.0% 98689044 / 104309504 / -5.4% 0.35 / 0.35 / +0.4%
clickbench_q26/datafusion:parquet 30469684 / 30376590 / +0.3% 86996900 / 92356202 / -5.8% 0.35 / 0.33 / +6.5%
clickbench_q27/datafusion:parquet 181525182 / 182228598 / -0.4% 272218260 / 302729072 / -10.1% 🟢 0.67 / 0.60 / +10.8%
clickbench_q28/datafusion:parquet 622299874 / 620489448 / +0.3% 693391869 / 707182868 / -2.0% 0.90 / 0.88 / +2.3%
clickbench_q29/datafusion:parquet 29416810 / 29250489 / +0.6% 93277207 / 92107546 / +1.3% 0.32 / 0.32 / -0.7%
clickbench_q30/datafusion:parquet 89088666 / 88120842 / +1.1% 164501876 / 174227485 / -5.6% 0.54 / 0.51 / +7.1%
clickbench_q31/datafusion:parquet 98742730 / 99780802 / -1.0% 190505926 / 199710850 / -4.6% 0.52 / 0.50 / +3.7%
clickbench_q32/datafusion:parquet 309791028 / 312654968 / -0.9% 414729374 / 418793156 / -1.0% 0.75 / 0.75 / +0.1%
clickbench_q33/datafusion:parquet 369759917 / 371774079 / -0.5% 453133056 / 458687507 / -1.2% 0.82 / 0.81 / +0.7%
clickbench_q34/datafusion:parquet 369368912 / 367695820 / +0.5% 455573748 / 460901756 / -1.2% 0.81 / 0.80 / +1.6%
clickbench_q35/datafusion:parquet 63297256 / 64431616 / -1.8% 125440772 / 125278253 / +0.1% 0.50 / 0.51 / -1.9%
clickbench_q36/datafusion:parquet 72930786 / 72594466 / +0.5% 134208788 / 134539639 / -0.2% 0.54 / 0.54 / +0.7%
clickbench_q37/datafusion:parquet 35223810 / 35396824 / -0.5% 92707807 / 89722286 / +3.3% 0.38 / 0.39 / -3.7%
clickbench_q38/datafusion:parquet 46881982 / 46987560 / -0.2% 104801665 / 106629290 / -1.7% 0.45 / 0.44 / +1.5%
clickbench_q39/datafusion:parquet 143140429 / 143108565 / +0.0% 206580474 / 208385377 / -0.9% 0.69 / 0.69 / +0.9%
clickbench_q40/datafusion:parquet 19728706 / 19730684 / -0.0% 75932022 / 78242117 / -3.0% 0.26 / 0.25 / +3.0%
clickbench_q41/datafusion:parquet 18731969 / 18644536 / +0.5% 76944499 / 75726475 / +1.6% 0.24 / 0.25 / -1.1%
clickbench_q42/datafusion:parquet 19166506 / 18988360 / +0.9% 76099184 / 75640632 / +0.6% 0.25 / 0.25 / +0.3%
duckdb / vortex-file-compressed / ns (0.975x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1553703 / 1730624 / -10.2% 🟢 23428432 / 26568566 / -11.8% 🟢 0.07 / 0.07 / +1.8%
clickbench_q01/duckdb:vortex-file-compressed 13469306 / 12388508 / +8.7% 32419105 / 31527695 / +2.8% 0.42 / 0.39 / +5.7%
clickbench_q02/duckdb:vortex-file-compressed 13549914 / 13861884 / -2.3% 33832363 / 31884270 / +6.1% 0.40 / 0.43 / -7.9%
clickbench_q03/duckdb:vortex-file-compressed 17428864 / 18678240 / -6.7% 42663205 / 48196897 / -11.5% 🟢 0.41 / 0.39 / +5.4%
clickbench_q04/duckdb:vortex-file-compressed 68584048 / 71798453 / -4.5% 101748832 / 107659387 / -5.5% 0.67 / 0.67 / +1.1%
clickbench_q05/duckdb:vortex-file-compressed 74252078 / 69490048 / +6.9% 90409864 / 92113192 / -1.8% 0.82 / 0.75 / +8.9%
clickbench_q06/duckdb:vortex-file-compressed 1818698 / 2009422 / -9.5% 33913177 / 28691336 / +18.2% 🔴 0.05 / 0.07 / -23.4%
clickbench_q07/duckdb:vortex-file-compressed 14232182 / 14036506 / +1.4% 34671598 / 31606820 / +9.7% 0.41 / 0.44 / -7.6%
clickbench_q08/duckdb:vortex-file-compressed 84547610 / 85416692 / -1.0% 124890169 / 130585828 / -4.4% 0.68 / 0.65 / +3.5%
clickbench_q09/duckdb:vortex-file-compressed 110335968 / 112369520 / -1.8% 152818579 / 153400356 / -0.4% 0.72 / 0.73 / -1.4%
clickbench_q10/duckdb:vortex-file-compressed 43760826 / 43806708 / -0.1% 74421168 / 77431949 / -3.9% 0.59 / 0.57 / +3.9%
clickbench_q11/duckdb:vortex-file-compressed 56131512 / 57469116 / -2.3% 84544205 / 89245721 / -5.3% 0.66 / 0.64 / +3.1%
clickbench_q12/duckdb:vortex-file-compressed 75316211 / 78142492 / -3.6% 104728787 / 112867928 / -7.2% 0.72 / 0.69 / +3.9%
clickbench_q13/duckdb:vortex-file-compressed 138921097 / 140947251 / -1.4% 176597994 / 183108767 / -3.6% 0.79 / 0.77 / +2.2%
clickbench_q14/duckdb:vortex-file-compressed 86323624 / 85240659 / +1.3% 117508204 / 119461189 / -1.6% 0.73 / 0.71 / +3.0%
clickbench_q15/duckdb:vortex-file-compressed 92393903 / 92383782 / +0.0% 127404837 / 130526167 / -2.4% 0.73 / 0.71 / +2.5%
clickbench_q16/duckdb:vortex-file-compressed 161935192 / 165904424 / -2.4% 206944949 / 211504350 / -2.2% 0.78 / 0.78 / -0.2%
clickbench_q17/duckdb:vortex-file-compressed 166523842 / 167533208 / -0.6% 209701256 / 219271729 / -4.4% 0.79 / 0.76 / +3.9%
clickbench_q18/duckdb:vortex-file-compressed 318583872 / 337744430 / -5.7% 380417247 / 411495403 / -7.6% 0.84 / 0.82 / +2.0%
clickbench_q19/duckdb:vortex-file-compressed 16407782 / 17832669 / -8.0% 39559556 / 41170952 / -3.9% 0.41 / 0.43 / -4.2%
clickbench_q20/duckdb:vortex-file-compressed 127226836 / 127379428 / -0.1% 201568399 / 209882180 / -4.0% 0.63 / 0.61 / +4.0%
clickbench_q21/duckdb:vortex-file-compressed 179736296 / 184775554 / -2.7% 293244939 / 324678113 / -9.7% 0.61 / 0.57 / +7.7%
clickbench_q22/duckdb:vortex-file-compressed 284217464 / 284616572 / -0.1% 469895064 / 549140266 / -14.4% 🟢 0.60 / 0.52 / +16.7%
clickbench_q23/duckdb:vortex-file-compressed 70513926 / 70597266 / -0.1% 110258994 / 116216546 / -5.1% 0.64 / 0.61 / +5.3%
clickbench_q24/duckdb:vortex-file-compressed 26360692 / 28855272 / -8.6% 41877174 / 45563504 / -8.1% 0.63 / 0.63 / -0.6%
clickbench_q25/duckdb:vortex-file-compressed 37447686 / 36455224 / +2.7% 50653166 / 53059102 / -4.5% 0.74 / 0.69 / +7.6%
clickbench_q26/duckdb:vortex-file-compressed 20910925 / 22415868 / -6.7% 34410734 / 34334950 / +0.2% 0.61 / 0.65 / -6.9%
clickbench_q27/duckdb:vortex-file-compressed 171832114 / 176362511 / -2.6% 266442364 / 279125507 / -4.5% 0.64 / 0.63 / +2.1%
clickbench_q28/duckdb:vortex-file-compressed 673722496 / 717415611 / -6.1% 670274697 / 706103783 / -5.1% 1.01 / 1.02 / -1.1%
clickbench_q29/duckdb:vortex-file-compressed 20587468 / 18431418 / +11.7% 🔴 41927750 / 39899381 / +5.1% 0.49 / 0.46 / +6.3%
clickbench_q30/duckdb:vortex-file-compressed 92991898 / 91928840 / +1.2% 125261904 / 132262041 / -5.3% 0.74 / 0.70 / +6.8%
clickbench_q31/duckdb:vortex-file-compressed 143408088 / 144704918 / -0.9% 215189652 / 228418269 / -5.8% 0.67 / 0.63 / +5.2%
clickbench_q32/duckdb:vortex-file-compressed 442254116 / 442013049 / +0.1% 490210990 / 487153528 / +0.6% 0.90 / 0.91 / -0.6%
clickbench_q33/duckdb:vortex-file-compressed 399743774 / 412589115 / -3.1% 513380197 / 523570369 / -1.9% 0.78 / 0.79 / -1.2%
clickbench_q34/duckdb:vortex-file-compressed 423816812 / 432275336 / -2.0% 546733843 / 552553265 / -1.1% 0.78 / 0.78 / -0.9%
clickbench_q35/duckdb:vortex-file-compressed 102700704 / 104722912 / -1.9% 138480148 / 138447242 / +0.0% 0.74 / 0.76 / -2.0%
clickbench_q36/duckdb:vortex-file-compressed 17328105 / 18351165 / -5.6% 32449433 / 34422976 / -5.7% 0.53 / 0.53 / +0.2%
clickbench_q37/duckdb:vortex-file-compressed 12440691 / 13250703 / -6.1% 27948950 / 28043268 / -0.3% 0.45 / 0.47 / -5.8%
clickbench_q38/duckdb:vortex-file-compressed 14156364 / 17496348 / -19.1% 🟢 30774605 / 29738916 / +3.5% 0.46 / 0.59 / -21.8%
clickbench_q39/duckdb:vortex-file-compressed 26394534 / 28306221 / -6.8% 42348259 / 45250721 / -6.4% 0.62 / 0.63 / -0.4%
clickbench_q40/duckdb:vortex-file-compressed 12434594 / 12400226 / +0.3% 30178630 / 27127851 / +11.2% 🔴 0.41 / 0.46 / -9.9%
clickbench_q41/duckdb:vortex-file-compressed 12366050 / 12384519 / -0.1% 27789066 / 28216796 / -1.5% 0.44 / 0.44 / +1.4%
clickbench_q42/duckdb:vortex-file-compressed 13126431 / 13630060 / -3.7% 28448198 / 30868419 / -7.8% 0.46 / 0.44 / +4.5%
duckdb / parquet / ns (0.983x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9794479 / 10604390 / -7.6% 25020117 / 18759263 / +33.4% 🔴 0.39 / 0.57 / -30.7%
clickbench_q01/duckdb:parquet 11073420 / 10044696 / +10.2% 🔴 18921395 / 21993473 / -14.0% 🟢 0.59 / 0.46 / +28.1%
clickbench_q02/duckdb:parquet 14985914 / 15479410 / -3.2% 32270207 / 34343246 / -6.0% 0.46 / 0.45 / +3.0%
clickbench_q03/duckdb:parquet 15644556 / 16571364 / -5.6% 52267105 / 55855029 / -6.4% 0.30 / 0.30 / +0.9%
clickbench_q04/duckdb:parquet 68706182 / 71981016 / -4.5% 86970924 / 99975474 / -13.0% 🟢 0.79 / 0.72 / +9.7%
clickbench_q05/duckdb:parquet 79013304 / 81787912 / -3.4% 113494185 / 122749918 / -7.5% 0.70 / 0.67 / +4.5%
clickbench_q06/duckdb:parquet 16119083 / 14780178 / +9.1% 25929348 / 26923644 / -3.7% 0.62 / 0.55 / +13.2%
clickbench_q07/duckdb:parquet 11369024 / 11574254 / -1.8% 23483948 / 22264086 / +5.5% 0.48 / 0.52 / -6.9%
clickbench_q08/duckdb:parquet 83273612 / 85327198 / -2.4% 121624848 / 128028069 / -5.0% 0.68 / 0.67 / +2.7%
clickbench_q09/duckdb:parquet 114288921 / 118989900 / -4.0% 158502427 / 160433023 / -1.2% 0.72 / 0.74 / -2.8%
clickbench_q10/duckdb:parquet 32477286 / 32800402 / -1.0% 67359539 / 70997170 / -5.1% 0.48 / 0.46 / +4.4%
clickbench_q11/duckdb:parquet 40339268 / 37820853 / +6.7% 75859444 / 78557469 / -3.4% 0.53 / 0.48 / +10.5%
clickbench_q12/duckdb:parquet 91468011 / 91108658 / +0.4% 125650853 / 134117571 / -6.3% 0.73 / 0.68 / +7.2%
clickbench_q13/duckdb:parquet 147457515 / 144689770 / +1.9% 208429457 / 213199056 / -2.2% 0.71 / 0.68 / +4.2%
clickbench_q14/duckdb:parquet 99907966 / 98733641 / +1.2% 140054473 / 138643042 / +1.0% 0.71 / 0.71 / +0.2%
clickbench_q15/duckdb:parquet 91925940 / 93407025 / -1.6% 122828357 / 123703827 / -0.7% 0.75 / 0.76 / -0.9%
clickbench_q16/duckdb:parquet 174361684 / 170860278 / +2.0% 222170260 / 229727127 / -3.3% 0.78 / 0.74 / +5.5%
clickbench_q17/duckdb:parquet 178293841 / 181764932 / -1.9% 227877048 / 234581639 / -2.9% 0.78 / 0.77 / +1.0%
clickbench_q18/duckdb:parquet 317969097 / 328366158 / -3.2% 440658111 / 403774248 / +9.1% 0.72 / 0.81 / -11.3%
clickbench_q19/duckdb:parquet 13258825 / 13973304 / -5.1% 40694047 / 46402152 / -12.3% 🟢 0.33 / 0.30 / +8.2%
clickbench_q20/duckdb:parquet 133018976 / 137234592 / -3.1% 249267511 / 243733678 / +2.3% 0.53 / 0.56 / -5.2%
clickbench_q21/duckdb:parquet 180264220 / 182993882 / -1.5% 324232687 / 323239311 / +0.3% 0.56 / 0.57 / -1.8%
clickbench_q22/duckdb:parquet 244765326 / 240923884 / +1.6% 418006182 / 407051242 / +2.7% 0.59 / 0.59 / -1.1%
clickbench_q23/duckdb:parquet 145459784 / 146231971 / -0.5% 167715655 / 166495724 / +0.7% 0.87 / 0.88 / -1.3%
clickbench_q24/duckdb:parquet 42904078 / 43052030 / -0.3% 60626220 / 62021657 / -2.2% 0.71 / 0.69 / +2.0%
clickbench_q25/duckdb:parquet 39257275 / 42221612 / -7.0% 88390363 / 92290121 / -4.2% 0.44 / 0.46 / -2.9%
clickbench_q26/duckdb:parquet 29818688 / 32329889 / -7.8% 46433915 / 47054070 / -1.3% 0.64 / 0.69 / -6.5%
clickbench_q27/duckdb:parquet 142379831 / 146016620 / -2.5% 261481734 / 254503422 / +2.7% 0.54 / 0.57 / -5.1%
clickbench_q28/duckdb:parquet 907919680 / 905283895 / +0.3% 1001474207 / 1014209865 / -1.3% 0.91 / 0.89 / +1.6%
clickbench_q29/duckdb:parquet 16376564 / 18046576 / -9.3% 30688234 / 32937033 / -6.8% 0.53 / 0.55 / -2.6%
clickbench_q30/duckdb:parquet 90309723 / 92958926 / -2.8% 178635497 / 174419567 / +2.4% 0.51 / 0.53 / -5.1%
clickbench_q31/duckdb:parquet 144250204 / 145235688 / -0.7% 290339857 / 290813468 / -0.2% 0.50 / 0.50 / -0.5%
clickbench_q32/duckdb:parquet 451043162 / 446543480 / +1.0% 544063869 / 501884481 / +8.4% 0.83 / 0.89 / -6.8%
clickbench_q33/duckdb:parquet 448428215 / 458509128 / -2.2% 485810445 / 480555650 / +1.1% 0.92 / 0.95 / -3.3%
clickbench_q34/duckdb:parquet 442797206 / 452407642 / -2.1% 483043871 / 476752226 / +1.3% 0.92 / 0.95 / -3.4%
clickbench_q35/duckdb:parquet 100578352 / 100982952 / -0.4% 116806384 / 118806747 / -1.7% 0.86 / 0.85 / +1.3%
clickbench_q36/duckdb:parquet 31120036 / 31427408 / -1.0% 43881807 / 42623297 / +3.0% 0.71 / 0.74 / -3.8%
clickbench_q37/duckdb:parquet 22372482 / 23071798 / -3.0% 31366808 / 31663305 / -0.9% 0.71 / 0.73 / -2.1%
clickbench_q38/duckdb:parquet 24485927 / 24571836 / -0.3% 35819426 / 35371628 / +1.3% 0.68 / 0.69 / -1.6%
clickbench_q39/duckdb:parquet 56063104 / 57174824 / -1.9% 66365406 / 66538442 / -0.3% 0.84 / 0.86 / -1.7%
clickbench_q40/duckdb:parquet 12869560 / 13444204 / -4.3% 22283379 / 21616297 / +3.1% 0.58 / 0.62 / -7.1%
clickbench_q41/duckdb:parquet 12337484 / 13519153 / -8.7% 21696187 / 23540174 / -7.8% 0.57 / 0.57 / -1.0%
clickbench_q42/duckdb:parquet 14356098 / 14492118 / -0.9% 25534403 / 24418092 / +4.6% 0.56 / 0.59 / -5.3%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.8%
Engines: DataFusion No clear signal (-6.6%, environment too noisy confidence) · DuckDB No clear signal (+19.9%, environment too noisy confidence)
Vortex (geomean): hot 1.063x ➖ · cold 1.132x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.023x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.942x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 52717770 / 57651351 / -8.6% 203771758 / 130316290 / +56.4% 🔴 0.26 / 0.44 / -41.5%
fineweb_q01/datafusion:vortex-file-compressed 379684766 / 388897790 / -2.4% 630748951 / 728350131 / -13.4% 0.60 / 0.53 / +12.7%
fineweb_q02/datafusion:vortex-file-compressed 380462118 / 393955692 / -3.4% 610137448 / 571668181 / +6.7% 0.62 / 0.69 / -9.5%
fineweb_q03/datafusion:vortex-file-compressed 499616651 / 523751784 / -4.6% 945156818 / 1086577602 / -13.0% 0.53 / 0.48 / +9.7%
fineweb_q04/datafusion:vortex-file-compressed 438294404 / 655187228 / -33.1% 🟢 459193490 / 499662182 / -8.1% 0.95 / 1.31 / -27.2%
fineweb_q05/datafusion:vortex-file-compressed 539615864 / 598380320 / -9.8% 1294559407 / 632487010 / +104.7% 🔴 0.42 / 0.95 / -55.9%
fineweb_q06/datafusion:vortex-file-compressed 836983954 / 732409192 / +14.3% 799860269 / 694670620 / +15.1% 1.05 / 1.05 / -0.8%
fineweb_q07/datafusion:vortex-file-compressed 454348914 / 493647857 / -8.0% 460326811 / 458522260 / +0.4% 0.99 / 1.08 / -8.3%
fineweb_q08/datafusion:vortex-file-compressed 198339651 / 176754571 / +12.2% 244876849 / 206735558 / +18.4% 0.81 / 0.85 / -5.3%
datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 537186119 / 496010417 / +8.3% 869810987 / 738025355 / +17.9% 0.62 / 0.67 / -8.1%
fineweb_q01/datafusion:parquet 936947473 / 789262210 / +18.7% 844851551 / 751202949 / +12.5% 1.11 / 1.05 / +5.6%
fineweb_q02/datafusion:parquet 736493122 / 768704039 / -4.2% 704385708 / 863087003 / -18.4% 1.05 / 0.89 / +17.4%
fineweb_q03/datafusion:parquet 886597359 / 835029594 / +6.2% 1082845083 / 877757460 / +23.4% 0.82 / 0.95 / -13.9%
fineweb_q04/datafusion:parquet 726277220 / 782264563 / -7.2% 709352905 / 760561941 / -6.7% 1.02 / 1.03 / -0.5%
fineweb_q05/datafusion:parquet 831423565 / 741129776 / +12.2% 1398375332 / 779298688 / +79.4% 🔴 0.59 / 0.95 / -37.5%
fineweb_q06/datafusion:parquet 742148232 / 781198476 / -5.0% 599819738 / 790697996 / -24.1% 1.24 / 0.99 / +25.2%
fineweb_q07/datafusion:parquet 707772852 / 798645210 / -11.4% 659520767 / 800838893 / -17.6% 1.07 / 1.00 / +7.6%
fineweb_q08/datafusion:parquet 729169392 / 772525348 / -5.6% 646129607 / 924129730 / -30.1% 🟢 1.13 / 0.84 / +35.0%
duckdb / vortex-file-compressed / ns (1.200x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 74287112 / 49681347 / +49.5% 🔴 65681202 / 103367157 / -36.5% 🟢 1.13 / 0.48 / +135.3%
fineweb_q01/duckdb:vortex-file-compressed 489906252 / 408362198 / +20.0% 599573902 / 429351740 / +39.6% 🔴 0.82 / 0.95 / -14.1%
fineweb_q02/duckdb:vortex-file-compressed 735712966 / 569162411 / +29.3% 669187079 / 600167207 / +11.5% 1.10 / 0.95 / +15.9%
fineweb_q03/duckdb:vortex-file-compressed 2203706100 / 943601460 / +133.5% 🔴 2122782581 / 1073978171 / +97.7% 🔴 1.04 / 0.88 / +18.2%
fineweb_q04/duckdb:vortex-file-compressed 971661882 / 941085170 / +3.2% 957433855 / 943297888 / +1.5% 1.01 / 1.00 / +1.7%
fineweb_q05/duckdb:vortex-file-compressed 974100746 / 885138505 / +10.1% 1396034420 / 993551717 / +40.5% 🔴 0.70 / 0.89 / -21.7%
fineweb_q06/duckdb:vortex-file-compressed 1217089034 / 1147442254 / +6.1% 1317587298 / 1177992433 / +11.9% 0.92 / 0.97 / -5.2%
fineweb_q07/duckdb:vortex-file-compressed 985071822 / 961160437 / +2.5% 999560191 / 984675849 / +1.5% 0.99 / 0.98 / +1.0%
fineweb_q08/duckdb:vortex-file-compressed 382889117 / 496262677 / -22.8% 484854152 / 533924425 / -9.2% 0.79 / 0.93 / -15.0%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 535323789 / 498965111 / +7.3% 689920100 / 510877839 / +35.0% 🔴 0.78 / 0.98 / -20.6%
fineweb_q01/duckdb:parquet 694530612 / 577296244 / +20.3% 804397369 / 552359869 / +45.6% 🔴 0.86 / 1.05 / -17.4%
fineweb_q02/duckdb:parquet 595671603 / 548350210 / +8.6% 585079428 / 562065291 / +4.1% 1.02 / 0.98 / +4.4%
fineweb_q03/duckdb:parquet 1391530938 / 1409886794 / -1.3% 1298562754 / 1652539191 / -21.4% 1.07 / 0.85 / +25.6%
fineweb_q04/duckdb:parquet 718925195 / 761604591 / -5.6% 848916056 / 779616871 / +8.9% 0.85 / 0.98 / -13.3%
fineweb_q05/duckdb:parquet 880039242 / 898241544 / -2.0% 968644706 / 802049591 / +20.8% 0.91 / 1.12 / -18.9%
fineweb_q06/duckdb:parquet 1595129817 / 1829217174 / -12.8% 1592471870 / 1756686653 / -9.3% 1.00 / 1.04 / -3.8%
fineweb_q07/duckdb:parquet 1020393584 / 1143542220 / -10.8% 980815437 / 1195319605 / -17.9% 1.04 / 0.96 / +8.7%
fineweb_q08/duckdb:parquet 496007876 / 491173509 / +1.0% 501485528 / 509509296 / -1.6% 0.99 / 0.96 / +2.6%

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-2.4%, low confidence)
Vortex (geomean): hot 0.990x ➖ · cold 1.056x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.018x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16145083 / 16549011 / -2.4% 48411570 / 43116065 / +12.3% 🔴 0.33 / 0.38 / -13.1%
tpch_q02/datafusion:vortex-file-compressed 17667873 / 17422420 / +1.4% 38654892 / 36016718 / +7.3% 0.46 / 0.48 / -5.5%
tpch_q03/datafusion:vortex-file-compressed 19653014 / 19476259 / +0.9% 48813329 / 45977890 / +6.2% 0.40 / 0.42 / -5.0%
tpch_q04/datafusion:vortex-file-compressed 10532956 / 10252702 / +2.7% 33797068 / 30217367 / +11.8% 🔴 0.31 / 0.34 / -8.1%
tpch_q05/datafusion:vortex-file-compressed 37254807 / 37238058 / +0.0% 64426430 / 61511473 / +4.7% 0.58 / 0.61 / -4.5%
tpch_q06/datafusion:vortex-file-compressed 6364958 / 6197040 / +2.7% 30897733 / 27367737 / +12.9% 🔴 0.21 / 0.23 / -9.0%
tpch_q07/datafusion:vortex-file-compressed 52084269 / 52314898 / -0.4% 83854636 / 79559073 / +5.4% 0.62 / 0.66 / -5.5%
tpch_q08/datafusion:vortex-file-compressed 52058266 / 52382008 / -0.6% 81982418 / 74507204 / +10.0% 🔴 0.63 / 0.70 / -9.7%
tpch_q09/datafusion:vortex-file-compressed 49472371 / 49663685 / -0.4% 78794263 / 74243182 / +6.1% 0.63 / 0.67 / -6.1%
tpch_q10/datafusion:vortex-file-compressed 17455096 / 17040096 / +2.4% 51122906 / 47196792 / +8.3% 0.34 / 0.36 / -5.4%
tpch_q11/datafusion:vortex-file-compressed 14991230 / 15123450 / -0.9% 33404003 / 33094584 / +0.9% 0.45 / 0.46 / -1.8%
tpch_q12/datafusion:vortex-file-compressed 22787115 / 23073467 / -1.2% 49484545 / 45159106 / +9.6% 0.46 / 0.51 / -9.9%
tpch_q13/datafusion:vortex-file-compressed 20235825 / 20173548 / +0.3% 40071481 / 37682120 / +6.3% 0.50 / 0.54 / -5.7%
tpch_q14/datafusion:vortex-file-compressed 15205895 / 14986251 / +1.5% 40397778 / 38609842 / +4.6% 0.38 / 0.39 / -3.0%
tpch_q15/datafusion:vortex-file-compressed 18659048 / 18583904 / +0.4% 45995372 / 45154334 / +1.9% 0.41 / 0.41 / -1.4%
tpch_q16/datafusion:vortex-file-compressed 18749583 / 18702463 / +0.3% 38148758 / 37256099 / +2.4% 0.49 / 0.50 / -2.1%
tpch_q17/datafusion:vortex-file-compressed 28739700 / 27856153 / +3.2% 60051332 / 57467100 / +4.5% 0.48 / 0.48 / -1.3%
tpch_q18/datafusion:vortex-file-compressed 37704879 / 36981369 / +2.0% 58773690 / 58181770 / +1.0% 0.64 / 0.64 / +0.9%
tpch_q19/datafusion:vortex-file-compressed 13354825 / 13774433 / -3.0% 38765235 / 36886155 / +5.1% 0.34 / 0.37 / -7.7%
tpch_q20/datafusion:vortex-file-compressed 21428207 / 21052321 / +1.8% 45183253 / 43953924 / +2.8% 0.47 / 0.48 / -1.0%
tpch_q21/datafusion:vortex-file-compressed 38915964 / 39715088 / -2.0% 67582833 / 63094607 / +7.1% 0.58 / 0.63 / -8.5%
tpch_q22/datafusion:vortex-file-compressed 11047586 / 11344546 / -2.6% 32625410 / 30750469 / +6.1% 0.34 / 0.37 / -8.2%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 66921509 / 66711267 / +0.3% 87098477 / 82741569 / +5.3% 0.77 / 0.81 / -4.7%
tpch_q02/datafusion:parquet 52765765 / 52705066 / +0.1% 72068914 / 70008505 / +2.9% 0.73 / 0.75 / -2.7%
tpch_q03/datafusion:parquet 72336812 / 71966536 / +0.5% 97329925 / 95176590 / +2.3% 0.74 / 0.76 / -1.7%
tpch_q04/datafusion:parquet 39998534 / 39468365 / +1.3% 61789382 / 59476333 / +3.9% 0.65 / 0.66 / -2.5%
tpch_q05/datafusion:parquet 88041507 / 87344107 / +0.8% 119458088 / 116969920 / +2.1% 0.74 / 0.75 / -1.3%
tpch_q06/datafusion:parquet 28246525 / 27812454 / +1.6% 47627155 / 45375536 / +5.0% 0.59 / 0.61 / -3.2%
tpch_q07/datafusion:parquet 94363463 / 93030014 / +1.4% 129264286 / 118175773 / +9.4% 0.73 / 0.79 / -7.3%
tpch_q08/datafusion:parquet 98021337 / 96996788 / +1.1% 129915907 / 120632298 / +7.7% 0.75 / 0.80 / -6.2%
tpch_q09/datafusion:parquet 114145115 / 113666368 / +0.4% 146272289 / 142002319 / +3.0% 0.78 / 0.80 / -2.5%
tpch_q10/datafusion:parquet 79941444 / 79652451 / +0.4% 110932241 / 106782355 / +3.9% 0.72 / 0.75 / -3.4%
tpch_q11/datafusion:parquet 38673209 / 38664102 / +0.0% 62254695 / 60389770 / +3.1% 0.62 / 0.64 / -3.0%
tpch_q12/datafusion:parquet 61955797 / 62287771 / -0.5% 88041272 / 84019570 / +4.8% 0.70 / 0.74 / -5.1%
tpch_q13/datafusion:parquet 160173490 / 159539363 / +0.4% 185155871 / 180384390 / +2.6% 0.87 / 0.88 / -2.2%
tpch_q14/datafusion:parquet 39770243 / 39533320 / +0.6% 66045818 / 63675218 / +3.7% 0.60 / 0.62 / -3.0%
tpch_q15/datafusion:parquet 47933494 / 46066198 / +4.1% 67226584 / 68550728 / -1.9% 0.71 / 0.67 / +6.1%
tpch_q16/datafusion:parquet 38353388 / 38359643 / -0.0% 57058802 / 57626436 / -1.0% 0.67 / 0.67 / +1.0%
tpch_q17/datafusion:parquet 117188390 / 116829712 / +0.3% 142629201 / 142038870 / +0.4% 0.82 / 0.82 / -0.1%
tpch_q18/datafusion:parquet 115669794 / 115882464 / -0.2% 139711875 / 135938278 / +2.8% 0.83 / 0.85 / -2.9%
tpch_q19/datafusion:parquet 49484729 / 50541412 / -2.1% 78627398 / 75383890 / +4.3% 0.63 / 0.67 / -6.1%
tpch_q20/datafusion:parquet 57246998 / 58076802 / -1.4% 84058988 / 79516804 / +5.7% 0.68 / 0.73 / -6.8%
tpch_q21/datafusion:parquet 99232218 / 98411425 / +0.8% 122629280 / 120791590 / +1.5% 0.81 / 0.81 / -0.7%
tpch_q22/datafusion:parquet 41265000 / 41274325 / -0.0% 59588049 / 57874544 / +3.0% 0.69 / 0.71 / -2.9%
duckdb / vortex-file-compressed / ns (0.978x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9910714 / 12098257 / -18.1% 🟢 22017021 / 22977426 / -4.2% 0.45 / 0.53 / -14.5%
tpch_q02/duckdb:vortex-file-compressed 17709551 / 17602606 / +0.6% 26250585 / 25931953 / +1.2% 0.67 / 0.68 / -0.6%
tpch_q03/duckdb:vortex-file-compressed 18638961 / 18222222 / +2.3% 37375597 / 34502786 / +8.3% 0.50 / 0.53 / -5.6%
tpch_q04/duckdb:vortex-file-compressed 16993338 / 16965695 / +0.2% 29443173 / 28010358 / +5.1% 0.58 / 0.61 / -4.7%
tpch_q05/duckdb:vortex-file-compressed 22466524 / 22289539 / +0.8% 38071925 / 32681938 / +16.5% 🔴 0.59 / 0.68 / -13.5%
tpch_q06/duckdb:vortex-file-compressed 5636951 / 5607100 / +0.5% 14518470 / 13571405 / +7.0% 0.39 / 0.41 / -6.0%
tpch_q07/duckdb:vortex-file-compressed 21128531 / 20822010 / +1.5% 40190715 / 35733711 / +12.5% 🔴 0.53 / 0.58 / -9.8%
tpch_q08/duckdb:vortex-file-compressed 24433235 / 23534660 / +3.8% 41841562 / 39586926 / +5.7% 0.58 / 0.59 / -1.8%
tpch_q09/duckdb:vortex-file-compressed 29677743 / 29497637 / +0.6% 49534059 / 47895892 / +3.4% 0.60 / 0.62 / -2.7%
tpch_q10/duckdb:vortex-file-compressed 28566806 / 28853724 / -1.0% 47508349 / 42918671 / +10.7% 🔴 0.60 / 0.67 / -10.6%
tpch_q11/duckdb:vortex-file-compressed 8143831 / 11041618 / -26.2% 🟢 19296934 / 15922313 / +21.2% 🔴 0.42 / 0.69 / -39.1%
tpch_q12/duckdb:vortex-file-compressed 15732279 / 15681600 / +0.3% 30164165 / 29848417 / +1.1% 0.52 / 0.53 / -0.7%
tpch_q13/duckdb:vortex-file-compressed 22439670 / 23541297 / -4.7% 42653622 / 37067753 / +15.1% 🔴 0.53 / 0.64 / -17.2%
tpch_q14/duckdb:vortex-file-compressed 13225572 / 13408818 / -1.4% 26772409 / 28323166 / -5.5% 0.49 / 0.47 / +4.3%
tpch_q15/duckdb:vortex-file-compressed 9173166 / 9555793 / -4.0% 19707794 / 21621544 / -8.9% 0.47 / 0.44 / +5.3%
tpch_q16/duckdb:vortex-file-compressed 18784045 / 18471986 / +1.7% 23471290 / 23526645 / -0.2% 0.80 / 0.79 / +1.9%
tpch_q17/duckdb:vortex-file-compressed 15681101 / 15625470 / +0.4% 32083883 / 31034362 / +3.4% 0.49 / 0.50 / -2.9%
tpch_q18/duckdb:vortex-file-compressed 25061812 / 24835877 / +0.9% 37457136 / 38047625 / -1.6% 0.67 / 0.65 / +2.5%
tpch_q19/duckdb:vortex-file-compressed 23191461 / 24348748 / -4.8% 34951786 / 39660191 / -11.9% 🟢 0.66 / 0.61 / +8.1%
tpch_q20/duckdb:vortex-file-compressed 17562918 / 17487185 / +0.4% 43097196 / 32434439 / +32.9% 🔴 0.41 / 0.54 / -24.4%
tpch_q21/duckdb:vortex-file-compressed 66290488 / 65845152 / +0.7% 81873987 / 79489924 / +3.0% 0.81 / 0.83 / -2.3%
tpch_q22/duckdb:vortex-file-compressed 12564562 / 12248242 / +2.6% 21256045 / 20092588 / +5.8% 0.59 / 0.61 / -3.0%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60148596 / 60054003 / +0.2% 66901344 / 68564348 / -2.4% 0.90 / 0.88 / +2.6%
tpch_q02/duckdb:parquet 35163465 / 34782088 / +1.1% 43288313 / 46884317 / -7.7% 0.81 / 0.74 / +9.5%
tpch_q03/duckdb:parquet 62837886 / 61881781 / +1.5% 74885392 / 73876771 / +1.4% 0.84 / 0.84 / +0.2%
tpch_q04/duckdb:parquet 43449969 / 46045410 / -5.6% 53875661 / 55762997 / -3.4% 0.81 / 0.83 / -2.3%
tpch_q05/duckdb:parquet 60948224 / 60775878 / +0.3% 73798697 / 71592631 / +3.1% 0.83 / 0.85 / -2.7%
tpch_q06/duckdb:parquet 20066220 / 20344914 / -1.4% 25021230 / 24529249 / +2.0% 0.80 / 0.83 / -3.3%
tpch_q07/duckdb:parquet 61056178 / 60969819 / +0.1% 72480312 / 73461438 / -1.3% 0.84 / 0.83 / +1.5%
tpch_q08/duckdb:parquet 73302534 / 73669000 / -0.5% 87048087 / 86020890 / +1.2% 0.84 / 0.86 / -1.7%
tpch_q09/duckdb:parquet 114280854 / 113305325 / +0.9% 128315588 / 126249088 / +1.6% 0.89 / 0.90 / -0.8%
tpch_q10/duckdb:parquet 108742310 / 107958692 / +0.7% 122706289 / 120062171 / +2.2% 0.89 / 0.90 / -1.4%
tpch_q11/duckdb:parquet 20422400 / 19922394 / +2.5% 23806747 / 23855452 / -0.2% 0.86 / 0.84 / +2.7%
tpch_q12/duckdb:parquet 41573507 / 41342224 / +0.6% 49011068 / 49149113 / -0.3% 0.85 / 0.84 / +0.8%
tpch_q13/duckdb:parquet 239830834 / 238387422 / +0.6% 253669305 / 247782240 / +2.4% 0.95 / 0.96 / -1.7%
tpch_q14/duckdb:parquet 43703474 / 43363154 / +0.8% 53047419 / 52031486 / +2.0% 0.82 / 0.83 / -1.1%
tpch_q15/duckdb:parquet 24965363 / 24616952 / +1.4% 31502009 / 30587783 / +3.0% 0.79 / 0.80 / -1.5%
tpch_q16/duckdb:parquet 50447463 / 51383534 / -1.8% 57023863 / 58394140 / -2.3% 0.88 / 0.88 / +0.5%
tpch_q17/duckdb:parquet 44844880 / 44294920 / +1.2% 54462090 / 54122685 / +0.6% 0.82 / 0.82 / +0.6%
tpch_q18/duckdb:parquet 90090873 / 89496035 / +0.7% 104027754 / 102569932 / +1.4% 0.87 / 0.87 / -0.7%
tpch_q19/duckdb:parquet 61501549 / 61257605 / +0.4% 71313997 / 71016074 / +0.4% 0.86 / 0.86 / -0.0%
tpch_q20/duckdb:parquet 58971185 / 58645927 / +0.6% 71486572 / 70802777 / +1.0% 0.82 / 0.83 / -0.4%
tpch_q21/duckdb:parquet 137772055 / 136404780 / +1.0% 150101475 / 147244763 / +1.9% 0.92 / 0.93 / -0.9%
tpch_q22/duckdb:parquet 50520015 / 50446098 / +0.1% 58888086 / 57639738 / +2.2% 0.86 / 0.88 / -2.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Vortex (geomean): hot 1.016x ➖ · cold 0.945x ➖


datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45512966 / 45903880 / -0.9% 86025190 / 96392153 / -10.8% 🟢 0.53 / 0.48 / +11.1%
polarsignals_q01/datafusion:vortex-file-compressed 51035242 / 51422508 / -0.8% 108395054 / 117477178 / -7.7% 0.47 / 0.44 / +7.6%
polarsignals_q02/datafusion:vortex-file-compressed 44764436 / 35601370 / +25.7% 🔴 82440377 / 87178588 / -5.4% 0.54 / 0.41 / +33.0%
polarsignals_q03/datafusion:vortex-file-compressed 53783346 / 53971618 / -0.3% 110562575 / 118680106 / -6.8% 0.49 / 0.45 / +7.0%
polarsignals_q04/datafusion:vortex-file-compressed 9609223 / 9685757 / -0.8% 49899126 / 53993777 / -7.6% 0.19 / 0.18 / +7.4%
polarsignals_q05/datafusion:vortex-file-compressed 11725228 / 11441748 / +2.5% 51919930 / 57696198 / -10.0% 🟢 0.23 / 0.20 / +13.9%
polarsignals_q06/datafusion:vortex-file-compressed 22037226 / 22114922 / -0.4% 63153328 / 63540424 / -0.6% 0.35 / 0.35 / +0.3%
polarsignals_q07/datafusion:vortex-file-compressed 11187288 / 11157884 / +0.3% 56595409 / 55990954 / +1.1% 0.20 / 0.20 / -0.8%
polarsignals_q08/datafusion:vortex-file-compressed 99944428 / 101044464 / -1.1% 164337042 / 168225464 / -2.3% 0.61 / 0.60 / +1.3%
polarsignals_q09/datafusion:vortex-file-compressed 9702426 / 10233082 / -5.2% 48820117 / 50919298 / -4.1% 0.20 / 0.20 / -1.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-1.0%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, environment too noisy confidence)
Vortex (geomean): hot 1.035x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.049x ➖ · cold 1.060x ➖
Shifts: Parquet (control) +4.9% · Median polish +3.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.046x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 211107462 / 231873226 / -9.0% 616484570 / 609573932 / +1.1% 0.34 / 0.38 / -10.0%
tpch_q02/datafusion:vortex-file-compressed 321510322 / 333628999 / -3.6% 645488611 / 666272426 / -3.1% 0.50 / 0.50 / -0.5%
tpch_q03/datafusion:vortex-file-compressed 378652437 / 346649563 / +9.2% 926468264 / 974455951 / -4.9% 0.41 / 0.36 / +14.9%
tpch_q04/datafusion:vortex-file-compressed 183660657 / 166895998 / +10.0% 474183688 / 422849343 / +12.1% 0.39 / 0.39 / -1.9%
tpch_q05/datafusion:vortex-file-compressed 635780154 / 438510948 / +45.0% 🔴 710028272 / 703233655 / +1.0% 0.90 / 0.62 / +43.6%
tpch_q06/datafusion:vortex-file-compressed 405856718 / 243863053 / +66.4% 🔴 484202890 / 348896194 / +38.8% 🔴 0.84 / 0.70 / +19.9%
tpch_q07/datafusion:vortex-file-compressed 380140835 / 719121717 / -47.1% 🟢 520254337 / 731462157 / -28.9% 0.73 / 0.98 / -25.7%
tpch_q08/datafusion:vortex-file-compressed 479039971 / 386136795 / +24.1% 693368333 / 656627701 / +5.6% 0.69 / 0.59 / +17.5%
tpch_q09/datafusion:vortex-file-compressed 501473876 / 334929944 / +49.7% 🔴 578745829 / 406730006 / +42.3% 🔴 0.87 / 0.82 / +5.2%
tpch_q10/datafusion:vortex-file-compressed 296728094 / 348794160 / -14.9% 497837524 / 468280991 / +6.3% 0.60 / 0.74 / -20.0%
tpch_q11/datafusion:vortex-file-compressed 321760305 / 282689704 / +13.8% 443219497 / 397430500 / +11.5% 0.73 / 0.71 / +2.1%
tpch_q12/datafusion:vortex-file-compressed 363912000 / 340997897 / +6.7% 521842164 / 903409326 / -42.2% 🟢 0.70 / 0.38 / +84.8%
tpch_q13/datafusion:vortex-file-compressed 127152501 / 115383967 / +10.2% 398752780 / 364162724 / +9.5% 0.32 / 0.32 / +0.6%
tpch_q14/datafusion:vortex-file-compressed 175720918 / 169165606 / +3.9% 704202360 / 312019682 / +125.7% 🔴 0.25 / 0.54 / -54.0%
tpch_q15/datafusion:vortex-file-compressed 281966355 / 290801712 / -3.0% 436589741 / 523884281 / -16.7% 0.65 / 0.56 / +16.3%
tpch_q16/datafusion:vortex-file-compressed 172325430 / 169068808 / +1.9% 332126295 / 287942485 / +15.3% 0.52 / 0.59 / -11.6%
tpch_q17/datafusion:vortex-file-compressed 244019618 / 282958731 / -13.8% 434147315 / 490011295 / -11.4% 0.56 / 0.58 / -2.7%
tpch_q18/datafusion:vortex-file-compressed 227018799 / 230032883 / -1.3% 394253381 / 371521915 / +6.1% 0.58 / 0.62 / -7.0%
tpch_q19/datafusion:vortex-file-compressed 328675975 / 345406023 / -4.8% 493461722 / 469807909 / +5.0% 0.67 / 0.74 / -9.4%
tpch_q20/datafusion:vortex-file-compressed 308621938 / 298125937 / +3.5% 437471996 / 445572346 / -1.8% 0.71 / 0.67 / +5.4%
tpch_q21/datafusion:vortex-file-compressed 456878555 / 481097639 / -5.0% 624361826 / 569160594 / +9.7% 0.73 / 0.85 / -13.4%
tpch_q22/datafusion:vortex-file-compressed 189766969 / 163808448 / +15.8% 356531328 / 313523824 / +13.7% 0.53 / 0.52 / +1.9%
datafusion / parquet / ns (1.057x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164767746 / 165248503 / -0.3% 442384408 / 603091579 / -26.6% 0.37 / 0.27 / +35.9%
tpch_q02/datafusion:parquet 308811626 / 296439518 / +4.2% 506124381 / 643350139 / -21.3% 0.61 / 0.46 / +32.4%
tpch_q03/datafusion:parquet 323795875 / 283652289 / +14.2% 1112417287 / 694359298 / +60.2% 🔴 0.29 / 0.41 / -28.7%
tpch_q04/datafusion:parquet 132739827 / 170896144 / -22.3% 458277335 / 370377098 / +23.7% 0.29 / 0.46 / -37.2%
tpch_q05/datafusion:parquet 420337779 / 348476274 / +20.6% 591427181 / 430897917 / +37.3% 🔴 0.71 / 0.81 / -12.1%
tpch_q06/datafusion:parquet 127491606 / 140542814 / -9.3% 241593023 / 282713339 / -14.5% 0.53 / 0.50 / +6.2%
tpch_q07/datafusion:parquet 462718886 / 345586826 / +33.9% 🔴 600709415 / 640624293 / -6.2% 0.77 / 0.54 / +42.8%
tpch_q08/datafusion:parquet 494945419 / 604206540 / -18.1% 586790279 / 784398758 / -25.2% 0.84 / 0.77 / +9.5%
tpch_q09/datafusion:parquet 441845166 / 429341566 / +2.9% 592858743 / 636782619 / -6.9% 0.75 / 0.67 / +10.5%
tpch_q10/datafusion:parquet 388534709 / 377112675 / +3.0% 611860875 / 507416514 / +20.6% 0.64 / 0.74 / -14.6%
tpch_q11/datafusion:parquet 257380031 / 265730520 / -3.1% 417650468 / 448534917 / -6.9% 0.62 / 0.59 / +4.0%
tpch_q12/datafusion:parquet 202349845 / 193487578 / +4.6% 421969173 / 402565890 / +4.8% 0.48 / 0.48 / -0.2%
tpch_q13/datafusion:parquet 445039678 / 395526626 / +12.5% 621604309 / 570311582 / +9.0% 0.72 / 0.69 / +3.2%
tpch_q14/datafusion:parquet 194522245 / 174505046 / +11.5% 373132769 / 283274297 / +31.7% 🔴 0.52 / 0.62 / -15.4%
tpch_q15/datafusion:parquet 305647242 / 279386327 / +9.4% 509942837 / 445532081 / +14.5% 0.60 / 0.63 / -4.4%
tpch_q16/datafusion:parquet 113098143 / 104295914 / +8.4% 283158214 / 278307848 / +1.7% 0.40 / 0.37 / +6.6%
tpch_q17/datafusion:parquet 299732492 / 291133686 / +3.0% 433075478 / 393453305 / +10.1% 0.69 / 0.74 / -6.5%
tpch_q18/datafusion:parquet 474866505 / 415224074 / +14.4% 730143826 / 509813397 / +43.2% 🔴 0.65 / 0.81 / -20.1%
tpch_q19/datafusion:parquet 218687896 / 224207459 / -2.5% 329292713 / 507133931 / -35.1% 🟢 0.66 / 0.44 / +50.2%
tpch_q20/datafusion:parquet 261633460 / 290615306 / -10.0% 419922319 / 463408365 / -9.4% 0.62 / 0.63 / -0.6%
tpch_q21/datafusion:parquet 459122629 / 512881091 / -10.5% 532177193 / 521993606 / +2.0% 0.86 / 0.98 / -12.2%
tpch_q22/datafusion:parquet 328600436 / 158168345 / +107.8% 🔴 573716074 / 319737593 / +79.4% 🔴 0.57 / 0.49 / +15.8%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 201274371 / 197837223 / +1.7% 292179076 / 425323520 / -31.3% 🟢 0.69 / 0.47 / +48.1%
tpch_q02/duckdb:vortex-file-compressed 383881966 / 431631313 / -11.1% 370978230 / 451908052 / -17.9% 1.03 / 0.96 / +8.3%
tpch_q03/duckdb:vortex-file-compressed 460553387 / 435000961 / +5.9% 568249840 / 418031978 / +35.9% 🔴 0.81 / 1.04 / -22.1%
tpch_q04/duckdb:vortex-file-compressed 253468727 / 229762452 / +10.3% 240900272 / 288172385 / -16.4% 1.05 / 0.80 / +32.0%
tpch_q05/duckdb:vortex-file-compressed 384962377 / 370054546 / +4.0% 409211757 / 425547752 / -3.8% 0.94 / 0.87 / +8.2%
tpch_q06/duckdb:vortex-file-compressed 320662004 / 249455180 / +28.5% 292282204 / 264485626 / +10.5% 1.10 / 0.94 / +16.3%
tpch_q07/duckdb:vortex-file-compressed 412291577 / 455081085 / -9.4% 448532584 / 594335639 / -24.5% 0.92 / 0.77 / +20.0%
tpch_q08/duckdb:vortex-file-compressed 527808673 / 525593489 / +0.4% 587316938 / 596868757 / -1.6% 0.90 / 0.88 / +2.1%
tpch_q09/duckdb:vortex-file-compressed 427345652 / 447579395 / -4.5% 459915874 / 443939599 / +3.6% 0.93 / 1.01 / -7.8%
tpch_q10/duckdb:vortex-file-compressed 466050504 / 413111266 / +12.8% 490312866 / 474866313 / +3.3% 0.95 / 0.87 / +9.3%
tpch_q11/duckdb:vortex-file-compressed 147983219 / 137724584 / +7.4% 190955617 / 246953340 / -22.7% 0.77 / 0.56 / +39.0%
tpch_q12/duckdb:vortex-file-compressed 361283015 / 432229263 / -16.4% 431047625 / 764232790 / -43.6% 🟢 0.84 / 0.57 / +48.2%
tpch_q13/duckdb:vortex-file-compressed 281810258 / 269660997 / +4.5% 261784198 / 300033161 / -12.7% 1.08 / 0.90 / +19.8%
tpch_q14/duckdb:vortex-file-compressed 240394983 / 228932240 / +5.0% 266829425 / 276358651 / -3.4% 0.90 / 0.83 / +8.8%
tpch_q15/duckdb:vortex-file-compressed 142226464 / 149332718 / -4.8% 200372933 / 201916485 / -0.8% 0.71 / 0.74 / -4.0%
tpch_q16/duckdb:vortex-file-compressed 178971558 / 165365561 / +8.2% 212487365 / 207395918 / +2.5% 0.84 / 0.80 / +5.6%
tpch_q17/duckdb:vortex-file-compressed 395431556 / 430368866 / -8.1% 450660412 / 451512132 / -0.2% 0.88 / 0.95 / -7.9%
tpch_q18/duckdb:vortex-file-compressed 334201274 / 291740789 / +14.6% 323852722 / 332076382 / -2.5% 1.03 / 0.88 / +17.5%
tpch_q19/duckdb:vortex-file-compressed 315862761 / 346430712 / -8.8% 373062822 / 371243840 / +0.5% 0.85 / 0.93 / -9.3%
tpch_q20/duckdb:vortex-file-compressed 457781347 / 405996104 / +12.8% 466461306 / 447064467 / +4.3% 0.98 / 0.91 / +8.1%
tpch_q21/duckdb:vortex-file-compressed 676494420 / 605176198 / +11.8% 916671870 / 750751866 / +22.1% 0.74 / 0.81 / -8.4%
tpch_q22/duckdb:vortex-file-compressed 109200603 / 111374904 / -2.0% 134670987 / 148672363 / -9.4% 0.81 / 0.75 / +8.2%
duckdb / parquet / ns (1.041x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 274830469 / 289479362 / -5.1% 304530747 / 307440520 / -0.9% 0.90 / 0.94 / -4.2%
tpch_q02/duckdb:parquet 634043867 / 632147479 / +0.3% 577242060 / 774299894 / -25.4% 1.10 / 0.82 / +34.5%
tpch_q03/duckdb:parquet 757485606 / 754011818 / +0.5% 829042734 / 836770072 / -0.9% 0.91 / 0.90 / +1.4%
tpch_q04/duckdb:parquet 453079821 / 453049391 / +0.0% 599770799 / 611716982 / -2.0% 0.76 / 0.74 / +2.0%
tpch_q05/duckdb:parquet 904855048 / 879836835 / +2.8% 1073957029 / 834211700 / +28.7% 0.84 / 1.05 / -20.1%
tpch_q06/duckdb:parquet 307478159 / 306981301 / +0.2% 313042199 / 276136673 / +13.4% 0.98 / 1.11 / -11.6%
tpch_q07/duckdb:parquet 821674305 / 810185920 / +1.4% 844073906 / 771826839 / +9.4% 0.97 / 1.05 / -7.3%
tpch_q08/duckdb:parquet 1115290111 / 1034000458 / +7.9% 1162760923 / 1019443761 / +14.1% 0.96 / 1.01 / -5.4%
tpch_q09/duckdb:parquet 975247091 / 959672971 / +1.6% 1019127626 / 1070556091 / -4.8% 0.96 / 0.90 / +6.8%
tpch_q10/duckdb:parquet 1080924385 / 936330949 / +15.4% 1346534661 / 1034456396 / +30.2% 🔴 0.80 / 0.91 / -11.3%
tpch_q11/duckdb:parquet 441441750 / 411581978 / +7.3% 436109085 / 393547225 / +10.8% 1.01 / 1.05 / -3.2%
tpch_q12/duckdb:parquet 474379246 / 535771239 / -11.5% 552594867 / 716895230 / -22.9% 0.86 / 0.75 / +14.9%
tpch_q13/duckdb:parquet 802561096 / 761461395 / +5.4% 851185271 / 791747429 / +7.5% 0.94 / 0.96 / -2.0%
tpch_q14/duckdb:parquet 558944644 / 489740654 / +14.1% 618414157 / 455222367 / +35.8% 🔴 0.90 / 1.08 / -16.0%
tpch_q15/duckdb:parquet 363073084 / 357765727 / +1.5% 370328438 / 393800145 / -6.0% 0.98 / 0.91 / +7.9%
tpch_q16/duckdb:parquet 467176765 / 471689520 / -1.0% 468343993 / 431427754 / +8.6% 1.00 / 1.09 / -8.8%
tpch_q17/duckdb:parquet 420951196 / 448265065 / -6.1% 511208833 / 435819117 / +17.3% 0.82 / 1.03 / -19.9%
tpch_q18/duckdb:parquet 623242807 / 594667982 / +4.8% 742147609 / 670434965 / +10.7% 0.84 / 0.89 / -5.3%
tpch_q19/duckdb:parquet 605180120 / 545843260 / +10.9% 626046149 / 595838209 / +5.1% 0.97 / 0.92 / +5.5%
tpch_q20/duckdb:parquet 767100926 / 774932554 / -1.0% 783780529 / 817123914 / -4.1% 0.98 / 0.95 / +3.2%
tpch_q21/duckdb:parquet 725097095 / 653659069 / +10.9% 624058594 / 733690330 / -14.9% 1.16 / 0.89 / +30.4%
tpch_q22/duckdb:parquet 562717949 / 408140707 / +37.9% 🔴 611820088 / 322750636 / +89.6% 🔴 0.92 / 1.26 / -27.3%

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.017x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24271978 / 23548262 / +3.1% 41709424 / 43742059 / -4.6% 0.58 / 0.54 / +8.1%
tpcds_q02/datafusion:vortex-file-compressed 45632098 / 45485108 / +0.3% 61384755 / 61782828 / -0.6% 0.74 / 0.74 / +1.0%
tpcds_q03/datafusion:vortex-file-compressed 11565927 / 11391022 / +1.5% 29365068 / 28370295 / +3.5% 0.39 / 0.40 / -1.9%
tpcds_q04/datafusion:vortex-file-compressed 112693496 / 115449272 / -2.4% 143396044 / 140422011 / +2.1% 0.79 / 0.82 / -4.4%
tpcds_q05/datafusion:vortex-file-compressed 60237604 / 59165699 / +1.8% 81686259 / 79958705 / +2.2% 0.74 / 0.74 / -0.3%
tpcds_q06/datafusion:vortex-file-compressed 23313220 / 23387760 / -0.3% 43494289 / 46793284 / -7.1% 0.54 / 0.50 / +7.2%
tpcds_q07/datafusion:vortex-file-compressed 31696978 / 32155836 / -1.4% 56633357 / 54247714 / +4.4% 0.56 / 0.59 / -5.6%
tpcds_q08/datafusion:vortex-file-compressed 26567311 / 26291546 / +1.0% 44046487 / 44418546 / -0.8% 0.60 / 0.59 / +1.9%
tpcds_q09/datafusion:vortex-file-compressed 16890244 / 17970720 / -6.0% 34357978 / 33904269 / +1.3% 0.49 / 0.53 / -7.3%
tpcds_q10/datafusion:vortex-file-compressed 28725280 / 29318182 / -2.0% 48347295 / 51379000 / -5.9% 0.59 / 0.57 / +4.1%
tpcds_q11/datafusion:vortex-file-compressed 60675972 / 59806509 / +1.5% 86498839 / 84719304 / +2.1% 0.70 / 0.71 / -0.6%
tpcds_q12/datafusion:vortex-file-compressed 16395207 / 16666016 / -1.6% 32625607 / 31587314 / +3.3% 0.50 / 0.53 / -4.8%
tpcds_q13/datafusion:vortex-file-compressed 37362028 / 37793209 / -1.1% 61139108 / 60158736 / +1.6% 0.61 / 0.63 / -2.7%
tpcds_q14/datafusion:vortex-file-compressed 90427802 / 91801422 / -1.5% 116605689 / 118401990 / -1.5% 0.78 / 0.78 / +0.0%
tpcds_q15/datafusion:vortex-file-compressed 25200066 / 24977606 / +0.9% 44792451 / 46394780 / -3.5% 0.56 / 0.54 / +4.5%
tpcds_q16/datafusion:vortex-file-compressed 20595948 / 20559536 / +0.2% 41372769 / 40188287 / +2.9% 0.50 / 0.51 / -2.7%
tpcds_q17/datafusion:vortex-file-compressed 60863316 / 54000817 / +12.7% 🔴 77295894 / 76021512 / +1.7% 0.79 / 0.71 / +10.8%
tpcds_q18/datafusion:vortex-file-compressed 68218008 / 68527304 / -0.5% 92892414 / 93995461 / -1.2% 0.73 / 0.73 / +0.7%
tpcds_q19/datafusion:vortex-file-compressed 18138796 / 18684774 / -2.9% 41343737 / 39079576 / +5.8% 0.44 / 0.48 / -8.2%
tpcds_q20/datafusion:vortex-file-compressed 17434654 / 17946658 / -2.9% 33865023 / 34590552 / -2.1% 0.51 / 0.52 / -0.8%
tpcds_q21/datafusion:vortex-file-compressed 17406028 / 16723786 / +4.1% 39437162 / 40779159 / -3.3% 0.44 / 0.41 / +7.6%
tpcds_q22/datafusion:vortex-file-compressed 50128588 / 49554777 / +1.2% 71250203 / 70278568 / +1.4% 0.70 / 0.71 / -0.2%
tpcds_q23/datafusion:vortex-file-compressed 71926892 / 70694124 / +1.7% 98351418 / 98111754 / +0.2% 0.73 / 0.72 / +1.5%
tpcds_q24/datafusion:vortex-file-compressed 69872404 / 69783955 / +0.1% 96570172 / 93565891 / +3.2% 0.72 / 0.75 / -3.0%
tpcds_q25/datafusion:vortex-file-compressed 47588784 / 51288488 / -7.2% 72898772 / 79971247 / -8.8% 0.65 / 0.64 / +1.8%
tpcds_q26/datafusion:vortex-file-compressed 30477339 / 30398854 / +0.3% 51601879 / 51340929 / +0.5% 0.59 / 0.59 / -0.2%
tpcds_q27/datafusion:vortex-file-compressed 62673833 / 61353454 / +2.2% 90148322 / 89789674 / +0.4% 0.70 / 0.68 / +1.7%
tpcds_q28/datafusion:vortex-file-compressed 17886866 / 18409536 / -2.8% 38165366 / 37581681 / +1.6% 0.47 / 0.49 / -4.3%
tpcds_q29/datafusion:vortex-file-compressed 60239217 / 60118950 / +0.2% 82923096 / 82272092 / +0.8% 0.73 / 0.73 / -0.6%
tpcds_q30/datafusion:vortex-file-compressed 28011228 / 28008698 / +0.0% 44191866 / 45442570 / -2.8% 0.63 / 0.62 / +2.8%
tpcds_q31/datafusion:vortex-file-compressed 64334412 / 64031584 / +0.5% 92393287 / 90466111 / +2.1% 0.70 / 0.71 / -1.6%
tpcds_q32/datafusion:vortex-file-compressed 14077730 / 13927760 / +1.1% 32374458 / 31291107 / +3.5% 0.43 / 0.45 / -2.3%
tpcds_q33/datafusion:vortex-file-compressed 26755076 / 26873198 / -0.4% 46941686 / 47693846 / -1.6% 0.57 / 0.56 / +1.2%
tpcds_q34/datafusion:vortex-file-compressed 18453857 / 18444198 / +0.1% 36989208 / 37116541 / -0.3% 0.50 / 0.50 / +0.4%
tpcds_q35/datafusion:vortex-file-compressed 35242882 / 34732954 / +1.5% 58030296 / 58107655 / -0.1% 0.61 / 0.60 / +1.6%
tpcds_q36/datafusion:vortex-file-compressed 47539749 / 47738029 / -0.4% 72553981 / 68229677 / +6.3% 0.66 / 0.70 / -6.4%
tpcds_q37/datafusion:vortex-file-compressed 12704842 / 13241730 / -4.1% 35933144 / 34740339 / +3.4% 0.35 / 0.38 / -7.2%
tpcds_q38/datafusion:vortex-file-compressed 30173784 / 29852702 / +1.1% 50704452 / 49954519 / +1.5% 0.60 / 0.60 / -0.4%
tpcds_q39/datafusion:vortex-file-compressed 65790030 / 65114700 / +1.0% 91789354 / 88369633 / +3.9% 0.72 / 0.74 / -2.7%
tpcds_q40/datafusion:vortex-file-compressed 25579466 / 25750760 / -0.7% 45828706 / 44791701 / +2.3% 0.56 / 0.57 / -2.9%
tpcds_q41/datafusion:vortex-file-compressed 16540002 / 16427570 / +0.7% 30808613 / 31531152 / -2.3% 0.54 / 0.52 / +3.0%
tpcds_q42/datafusion:vortex-file-compressed 11088519 / 11181024 / -0.8% 28096248 / 29454193 / -4.6% 0.39 / 0.38 / +4.0%
tpcds_q43/datafusion:vortex-file-compressed 12784662 / 12617876 / +1.3% 32070848 / 31802641 / +0.8% 0.40 / 0.40 / +0.5%
tpcds_q44/datafusion:vortex-file-compressed 26257786 / 26210318 / +0.2% 48725667 / 49261625 / -1.1% 0.54 / 0.53 / +1.3%
tpcds_q45/datafusion:vortex-file-compressed 28193510 / 28700980 / -1.8% 49596720 / 48402891 / +2.5% 0.57 / 0.59 / -4.1%
tpcds_q46/datafusion:vortex-file-compressed 24349257 / 24060342 / +1.2% 46269474 / 47381905 / -2.3% 0.53 / 0.51 / +3.6%
tpcds_q47/datafusion:vortex-file-compressed 77517092 / 77028552 / +0.6% 103761606 / 104816704 / -1.0% 0.75 / 0.73 / +1.7%
tpcds_q48/datafusion:vortex-file-compressed 31899196 / 32124686 / -0.7% 54474123 / 52751433 / +3.3% 0.59 / 0.61 / -3.8%
tpcds_q49/datafusion:vortex-file-compressed 59691862 / 59677788 / +0.0% 84550002 / 83642060 / +1.1% 0.71 / 0.71 / -1.1%
tpcds_q50/datafusion:vortex-file-compressed 32992764 / 33308935 / -0.9% 52847004 / 54046228 / -2.2% 0.62 / 0.62 / +1.3%
tpcds_q51/datafusion:vortex-file-compressed 61171204 / 61281714 / -0.2% 83139655 / 83561345 / -0.5% 0.74 / 0.73 / +0.3%
tpcds_q52/datafusion:vortex-file-compressed 11528085 / 11434360 / +0.8% 28703986 / 28440683 / +0.9% 0.40 / 0.40 / -0.1%
tpcds_q53/datafusion:vortex-file-compressed 18326584 / 18301942 / +0.1% 38655799 / 37169673 / +4.0% 0.47 / 0.49 / -3.7%
tpcds_q54/datafusion:vortex-file-compressed 34228308 / 34304352 / -0.2% 59042909 / 57114707 / +3.4% 0.58 / 0.60 / -3.5%
tpcds_q55/datafusion:vortex-file-compressed 11292506 / 11099030 / +1.7% 27229244 / 28048173 / -2.9% 0.41 / 0.40 / +4.8%
tpcds_q56/datafusion:vortex-file-compressed 26659312 / 26264958 / +1.5% 47494307 / 46638327 / +1.8% 0.56 / 0.56 / -0.3%
tpcds_q57/datafusion:vortex-file-compressed 74159950 / 73921206 / +0.3% 98474810 / 97483939 / +1.0% 0.75 / 0.76 / -0.7%
tpcds_q58/datafusion:vortex-file-compressed 40663526 / 40991558 / -0.8% 67405932 / 66554305 / +1.3% 0.60 / 0.62 / -2.1%
tpcds_q59/datafusion:vortex-file-compressed 30911493 / 30774784 / +0.4% 51809306 / 51680028 / +0.3% 0.60 / 0.60 / +0.2%
tpcds_q60/datafusion:vortex-file-compressed 25898136 / 26022704 / -0.5% 46457160 / 47258346 / -1.7% 0.56 / 0.55 / +1.2%
tpcds_q61/datafusion:vortex-file-compressed 23279746 / 24158250 / -3.6% 49554971 / 46804386 / +5.9% 0.47 / 0.52 / -9.0%
tpcds_q62/datafusion:vortex-file-compressed 17715896 / 17226468 / +2.8% 35437237 / 34957325 / +1.4% 0.50 / 0.49 / +1.4%
tpcds_q63/datafusion:vortex-file-compressed 18515233 / 18379517 / +0.7% 38745252 / 37565985 / +3.1% 0.48 / 0.49 / -2.3%
tpcds_q64/datafusion:vortex-file-compressed 331635672 / 331052912 / +0.2% 351467764 / 356669802 / -1.5% 0.94 / 0.93 / +1.7%
tpcds_q65/datafusion:vortex-file-compressed 73848212 / 75981689 / -2.8% 99136480 / 93930157 / +5.5% 0.74 / 0.81 / -7.9%
tpcds_q66/datafusion:vortex-file-compressed 53257740 / 52917163 / +0.6% 75849569 / 75141935 / +0.9% 0.70 / 0.70 / -0.3%
tpcds_q67/datafusion:vortex-file-compressed 55891998 / 54775679 / +2.0% 83450216 / 83288780 / +0.2% 0.67 / 0.66 / +1.8%
tpcds_q68/datafusion:vortex-file-compressed 23578062 / 23483486 / +0.4% 47487522 / 47179652 / +0.7% 0.50 / 0.50 / -0.2%
tpcds_q69/datafusion:vortex-file-compressed 28672264 / 28444720 / +0.8% 48530663 / 48983784 / -0.9% 0.59 / 0.58 / +1.7%
tpcds_q70/datafusion:vortex-file-compressed 69408306 / 70669108 / -1.8% 91079519 / 89648705 / +1.6% 0.76 / 0.79 / -3.3%
tpcds_q71/datafusion:vortex-file-compressed 19239688 / 19106968 / +0.7% 39927470 / 40413781 / -1.2% 0.48 / 0.47 / +1.9%
tpcds_q72/datafusion:vortex-file-compressed 463178160 / 467926649 / -1.0% 466051895 / 472859126 / -1.4% 0.99 / 0.99 / +0.4%
tpcds_q73/datafusion:vortex-file-compressed 17055372 / 16746288 / +1.8% 36570703 / 37263112 / -1.9% 0.47 / 0.45 / +3.8%
tpcds_q74/datafusion:vortex-file-compressed 45086390 / 44364302 / +1.6% 69275537 / 67947614 / +2.0% 0.65 / 0.65 / -0.3%
tpcds_q75/datafusion:vortex-file-compressed 133013696 / 133036839 / -0.0% 152815753 / 160147159 / -4.6% 0.87 / 0.83 / +4.8%
tpcds_q76/datafusion:vortex-file-compressed 44171673 / 42025898 / +5.1% 63553823 / 61943676 / +2.6% 0.70 / 0.68 / +2.4%
tpcds_q77/datafusion:vortex-file-compressed 35249589 / 34220287 / +3.0% 57166336 / 55554443 / +2.9% 0.62 / 0.62 / +0.1%
tpcds_q78/datafusion:vortex-file-compressed 79437564 / 79709960 / -0.3% 106788231 / 105718253 / +1.0% 0.74 / 0.75 / -1.3%
tpcds_q79/datafusion:vortex-file-compressed 20241892 / 21513154 / -5.9% 42168249 / 41471326 / +1.7% 0.48 / 0.52 / -7.5%
tpcds_q80/datafusion:vortex-file-compressed 77670466 / 78046878 / -0.5% 106365731 / 109695681 / -3.0% 0.73 / 0.71 / +2.6%
tpcds_q81/datafusion:vortex-file-compressed 28305657 / 28744104 / -1.5% 44289906 / 44640274 / -0.8% 0.64 / 0.64 / -0.7%
tpcds_q82/datafusion:vortex-file-compressed 13967890 / 13786378 / +1.3% 36000676 / 35475353 / +1.5% 0.39 / 0.39 / -0.2%
tpcds_q83/datafusion:vortex-file-compressed 35874702 / 36578524 / -1.9% 56078676 / 57414273 / -2.3% 0.64 / 0.64 / +0.4%
tpcds_q84/datafusion:vortex-file-compressed 12335457 / 12544050 / -1.7% 28331383 / 28813287 / -1.7% 0.44 / 0.44 / +0.0%
tpcds_q85/datafusion:vortex-file-compressed 62022316 / 62451050 / -0.7% 85423086 / 85180827 / +0.3% 0.73 / 0.73 / -1.0%
tpcds_q86/datafusion:vortex-file-compressed 16548999 / 16263454 / +1.8% 32857258 / 33573967 / -2.1% 0.50 / 0.48 / +4.0%
tpcds_q87/datafusion:vortex-file-compressed 29951249 / 30083356 / -0.4% 51130997 / 49362800 / +3.6% 0.59 / 0.61 / -3.9%
tpcds_q88/datafusion:vortex-file-compressed 32551152 / 32211072 / +1.1% 60634374 / 61020787 / -0.6% 0.54 / 0.53 / +1.7%
tpcds_q89/datafusion:vortex-file-compressed 20698798 / 21057602 / -1.7% 40647715 / 41909330 / -3.0% 0.51 / 0.50 / +1.3%
tpcds_q90/datafusion:vortex-file-compressed 10334135 / 10667353 / -3.1% 27072866 / 27480883 / -1.5% 0.38 / 0.39 / -1.7%
tpcds_q91/datafusion:vortex-file-compressed 17850130 / 17561136 / +1.6% 37640345 / 38388063 / -1.9% 0.47 / 0.46 / +3.7%
tpcds_q92/datafusion:vortex-file-compressed 13981707 / 14101794 / -0.9% 31615237 / 31728126 / -0.4% 0.44 / 0.44 / -0.5%
tpcds_q93/datafusion:vortex-file-compressed 22556892 / 22663637 / -0.5% 43328624 / 46271345 / -6.4% 0.52 / 0.49 / +6.3%
tpcds_q94/datafusion:vortex-file-compressed 20218239 / 19731544 / +2.5% 40531284 / 39273599 / +3.2% 0.50 / 0.50 / -0.7%
tpcds_q95/datafusion:vortex-file-compressed 46228390 / 46481515 / -0.5% 67373823 / 67793887 / -0.6% 0.69 / 0.69 / +0.1%
tpcds_q96/datafusion:vortex-file-compressed 8457578 / 8054866 / +5.0% 23386570 / 24097920 / -3.0% 0.36 / 0.33 / +8.2%
tpcds_q97/datafusion:vortex-file-compressed 20902169 / 21155784 / -1.2% 41396693 / 42108590 / -1.7% 0.50 / 0.50 / +0.5%
tpcds_q98/datafusion:vortex-file-compressed 16780439 / 16880764 / -0.6% 34461425 / 35555885 / -3.1% 0.49 / 0.47 / +2.6%
tpcds_q99/datafusion:vortex-file-compressed 19737174 / 19710231 / +0.1% 38212962 / 39055084 / -2.2% 0.52 / 0.50 / +2.3%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30110970 / 29311694 / +2.7% 44985051 / 49861605 / -9.8% 0.67 / 0.59 / +13.9%
tpcds_q02/datafusion:parquet 45466101 / 46346454 / -1.9% 62632436 / 60940617 / +2.8% 0.73 / 0.76 / -4.5%
tpcds_q03/datafusion:parquet 18826092 / 18874352 / -0.3% 31360826 / 34004902 / -7.8% 0.60 / 0.56 / +8.2%
tpcds_q04/datafusion:parquet 194900749 / 191778322 / +1.6% 222582551 / 220243339 / +1.1% 0.88 / 0.87 / +0.6%
tpcds_q05/datafusion:parquet 73018044 / 72245002 / +1.1% 94930586 / 92599467 / +2.5% 0.77 / 0.78 / -1.4%
tpcds_q06/datafusion:parquet 34723840 / 34709618 / +0.0% 51267866 / 50913996 / +0.7% 0.68 / 0.68 / -0.6%
tpcds_q07/datafusion:parquet 46468497 / 46098580 / +0.8% 68529880 / 65668841 / +4.4% 0.68 / 0.70 / -3.4%
tpcds_q08/datafusion:parquet 39083248 / 39139024 / -0.1% 56531329 / 51451772 / +9.9% 0.69 / 0.76 / -9.1%
tpcds_q09/datafusion:parquet 32824692 / 31875896 / +3.0% 44643914 / 38430026 / +16.2% 🔴 0.74 / 0.83 / -11.4%
tpcds_q10/datafusion:parquet 50696338 / 50546228 / +0.3% 66163455 / 66886081 / -1.1% 0.77 / 0.76 / +1.4%
tpcds_q11/datafusion:parquet 92851374 / 94377138 / -1.6% 117436516 / 115492378 / +1.7% 0.79 / 0.82 / -3.2%
tpcds_q12/datafusion:parquet 24270204 / 24159942 / +0.5% 34924761 / 34817392 / +0.3% 0.69 / 0.69 / +0.1%
tpcds_q13/datafusion:parquet 45968874 / 44340153 / +3.7% 70827932 / 68965861 / +2.7% 0.65 / 0.64 / +0.9%
tpcds_q14/datafusion:parquet 138802010 / 138441302 / +0.3% 155273300 / 158121306 / -1.8% 0.89 / 0.88 / +2.1%
tpcds_q15/datafusion:parquet 31052992 / 30922437 / +0.4% 49079935 / 48345646 / +1.5% 0.63 / 0.64 / -1.1%
tpcds_q16/datafusion:parquet 37587274 / 37241130 / +0.9% 56991018 / 57321206 / -0.6% 0.66 / 0.65 / +1.5%
tpcds_q17/datafusion:parquet 74444954 / 74246150 / +0.3% 100738790 / 99381056 / +1.4% 0.74 / 0.75 / -1.1%
tpcds_q18/datafusion:parquet 56984081 / 58460311 / -2.5% 78731551 / 76856363 / +2.4% 0.72 / 0.76 / -4.8%
tpcds_q19/datafusion:parquet 32151426 / 31815106 / +1.1% 51846830 / 50600958 / +2.5% 0.62 / 0.63 / -1.4%
tpcds_q20/datafusion:parquet 25220012 / 25331064 / -0.4% 38035470 / 35819147 / +6.2% 0.66 / 0.71 / -6.2%
tpcds_q21/datafusion:parquet 20332450 / 20118392 / +1.1% 34436698 / 33103088 / +4.0% 0.59 / 0.61 / -2.8%
tpcds_q22/datafusion:parquet 77706872 / 77443960 / +0.3% 93006407 / 91384091 / +1.8% 0.84 / 0.85 / -1.4%
tpcds_q23/datafusion:parquet 114787310 / 119462771 / -3.9% 141266140 / 138550565 / +2.0% 0.81 / 0.86 / -5.8%
tpcds_q24/datafusion:parquet 92045644 / 89976682 / +2.3% 119077375 / 117442581 / +1.4% 0.77 / 0.77 / +0.9%
tpcds_q25/datafusion:parquet 74662770 / 77561322 / -3.7% 99619999 / 101920869 / -2.3% 0.75 / 0.76 / -1.5%
tpcds_q26/datafusion:parquet 42482470 / 41396136 / +2.6% 58543851 / 60742750 / -3.6% 0.73 / 0.68 / +6.5%
tpcds_q27/datafusion:parquet 79532520 / 79732998 / -0.3% 101109620 / 102747547 / -1.6% 0.79 / 0.78 / +1.4%
tpcds_q28/datafusion:parquet 26511892 / 26532718 / -0.1% 45707313 / 44208172 / +3.4% 0.58 / 0.60 / -3.4%
tpcds_q29/datafusion:parquet 75949641 / 74895342 / +1.4% 105528192 / 99678863 / +5.9% 0.72 / 0.75 / -4.2%
tpcds_q30/datafusion:parquet 45417523 / 44357967 / +2.4% 66129867 / 60817969 / +8.7% 0.69 / 0.73 / -5.8%
tpcds_q31/datafusion:parquet 91633792 / 88616348 / +3.4% 109812976 / 103587466 / +6.0% 0.83 / 0.86 / -2.5%
tpcds_q32/datafusion:parquet 25984156 / 25366826 / +2.4% 40617719 / 41535761 / -2.2% 0.64 / 0.61 / +4.7%
tpcds_q33/datafusion:parquet 39540294 / 39481818 / +0.1% 56587961 / 54585024 / +3.7% 0.70 / 0.72 / -3.4%
tpcds_q34/datafusion:parquet 23916766 / 23520164 / +1.7% 38398780 / 37202924 / +3.2% 0.62 / 0.63 / -1.5%
tpcds_q35/datafusion:parquet 53810188 / 54078724 / -0.5% 73871971 / 67325167 / +9.7% 0.73 / 0.80 / -9.3%
tpcds_q36/datafusion:parquet 50457442 / 52449130 / -3.8% 70302854 / 71667991 / -1.9% 0.72 / 0.73 / -1.9%
tpcds_q37/datafusion:parquet 25852554 / 26079767 / -0.9% 38274429 / 40462218 / -5.4% 0.68 / 0.64 / +4.8%
tpcds_q38/datafusion:parquet 44094168 / 44640444 / -1.2% 64465852 / 63413801 / +1.7% 0.68 / 0.70 / -2.8%
tpcds_q39/datafusion:parquet 72089148 / 71265954 / +1.2% 91799121 / 89045235 / +3.1% 0.79 / 0.80 / -1.9%
tpcds_q40/datafusion:parquet 28234506 / 28275378 / -0.1% 49724610 / 49699609 / +0.1% 0.57 / 0.57 / -0.2%
tpcds_q41/datafusion:parquet 19880468 / 20090756 / -1.0% 32034973 / 34089769 / -6.0% 0.62 / 0.59 / +5.3%
tpcds_q42/datafusion:parquet 17939332 / 18278368 / -1.9% 32993592 / 30123836 / +9.5% 0.54 / 0.61 / -10.4%
tpcds_q43/datafusion:parquet 19382665 / 19458399 / -0.4% 32441405 / 34275583 / -5.4% 0.60 / 0.57 / +5.2%
tpcds_q44/datafusion:parquet 34814768 / 34004068 / +2.4% 51549468 / 51410052 / +0.3% 0.68 / 0.66 / +2.1%
tpcds_q45/datafusion:parquet 38293175 / 38149314 / +0.4% 55534221 / 53221645 / +4.3% 0.69 / 0.72 / -3.8%
tpcds_q46/datafusion:parquet 29069666 / 29449374 / -1.3% 48887145 / 49158174 / -0.6% 0.59 / 0.60 / -0.7%
tpcds_q47/datafusion:parquet 98008571 / 99460215 / -1.5% 123147660 / 121856781 / +1.1% 0.80 / 0.82 / -2.5%
tpcds_q48/datafusion:parquet 41429004 / 40466170 / +2.4% 61915098 / 59458144 / +4.1% 0.67 / 0.68 / -1.7%
tpcds_q49/datafusion:parquet 74155940 / 71636376 / +3.5% 101494796 / 96381836 / +5.3% 0.73 / 0.74 / -1.7%
tpcds_q50/datafusion:parquet 47092542 / 47421174 / -0.7% 69230911 / 68206548 / +1.5% 0.68 / 0.70 / -2.2%
tpcds_q51/datafusion:parquet 71740937 / 71383906 / +0.5% 87518200 / 90113861 / -2.9% 0.82 / 0.79 / +3.5%
tpcds_q52/datafusion:parquet 18544120 / 18627918 / -0.4% 32848498 / 29841961 / +10.1% 🔴 0.56 / 0.62 / -9.6%
tpcds_q53/datafusion:parquet 22541306 / 23239096 / -3.0% 41290583 / 39827263 / +3.7% 0.55 / 0.58 / -6.4%
tpcds_q54/datafusion:parquet 55299266 / 54301902 / +1.8% 75402508 / 76225824 / -1.1% 0.73 / 0.71 / +2.9%
tpcds_q55/datafusion:parquet 17946812 / 18029108 / -0.5% 31110972 / 31250834 / -0.4% 0.58 / 0.58 / -0.0%
tpcds_q56/datafusion:parquet 45658511 / 45706911 / -0.1% 60330215 / 60766701 / -0.7% 0.76 / 0.75 / +0.6%
tpcds_q57/datafusion:parquet 101933368 / 101487139 / +0.4% 117332829 / 122805320 / -4.5% 0.87 / 0.83 / +5.1%
tpcds_q58/datafusion:parquet 64025550 / 64673532 / -1.0% 83062781 / 80937854 / +2.6% 0.77 / 0.80 / -3.5%
tpcds_q59/datafusion:parquet 45664485 / 47113804 / -3.1% 63395673 / 63117587 / +0.4% 0.72 / 0.75 / -3.5%
tpcds_q60/datafusion:parquet 44917435 / 45303984 / -0.9% 60599372 / 60769079 / -0.3% 0.74 / 0.75 / -0.6%
tpcds_q61/datafusion:parquet 37060102 / 38121061 / -2.8% 59354479 / 58597446 / +1.3% 0.62 / 0.65 / -4.0%
tpcds_q62/datafusion:parquet 25014524 / 24908460 / +0.4% 39297974 / 38737568 / +1.4% 0.64 / 0.64 / -1.0%
tpcds_q63/datafusion:parquet 22203545 / 22280834 / -0.3% 39260575 / 39346218 / -0.2% 0.57 / 0.57 / -0.1%
tpcds_q64/datafusion:parquet 205626371 / 203488104 / +1.1% 242282570 / 242173044 / +0.0% 0.85 / 0.84 / +1.0%
tpcds_q65/datafusion:parquet 37875200 / 37787899 / +0.2% 56537795 / 55537511 / +1.8% 0.67 / 0.68 / -1.5%
tpcds_q66/datafusion:parquet 62108678 / 61433462 / +1.1% 79932528 / 76573505 / +4.4% 0.78 / 0.80 / -3.1%
tpcds_q67/datafusion:parquet 69487028 / 69991573 / -0.7% 95016746 / 94558147 / +0.5% 0.73 / 0.74 / -1.2%
tpcds_q68/datafusion:parquet 29144492 / 28970258 / +0.6% 49136074 / 48808977 / +0.7% 0.59 / 0.59 / -0.1%
tpcds_q69/datafusion:parquet 50173661 / 49839155 / +0.7% 69055417 / 64832894 / +6.5% 0.73 / 0.77 / -5.5%
tpcds_q70/datafusion:parquet 36304744 / 37122610 / -2.2% 54606274 / 57270975 / -4.7% 0.66 / 0.65 / +2.6%
tpcds_q71/datafusion:parquet 28880676 / 28492106 / +1.4% 43256004 / 42415007 / +2.0% 0.67 / 0.67 / -0.6%
tpcds_q72/datafusion:parquet 550410452 / 550353359 / +0.0% 576396431 / 583360839 / -1.2% 0.95 / 0.94 / +1.2%
tpcds_q73/datafusion:parquet 22883939 / 22969930 / -0.4% 38931350 / 37437095 / +4.0% 0.59 / 0.61 / -4.2%
tpcds_q74/datafusion:parquet 68782106 / 66154949 / +4.0% 84132121 / 87437061 / -3.8% 0.82 / 0.76 / +8.1%
tpcds_q75/datafusion:parquet 145802113 / 145750089 / +0.0% 174354447 / 169272277 / +3.0% 0.84 / 0.86 / -2.9%
tpcds_q76/datafusion:parquet 51572640 / 53278614 / -3.2% 75014010 / 70263280 / +6.8% 0.69 / 0.76 / -9.3%
tpcds_q77/datafusion:parquet 56298940 / 54050789 / +4.2% 75732183 / 73296796 / +3.3% 0.74 / 0.74 / +0.8%
tpcds_q78/datafusion:parquet 93785368 / 87658706 / +7.0% 121425010 / 121878261 / -0.4% 0.77 / 0.72 / +7.4%
tpcds_q79/datafusion:parquet 26171836 / 26205420 / -0.1% 44236362 / 44215739 / +0.0% 0.59 / 0.59 / -0.2%
tpcds_q80/datafusion:parquet 80303090 / 80066651 / +0.3% 110980770 / 109800825 / +1.1% 0.72 / 0.73 / -0.8%
tpcds_q81/datafusion:parquet 41760860 / 42040819 / -0.7% 60618960 / 56932349 / +6.5% 0.69 / 0.74 / -6.7%
tpcds_q82/datafusion:parquet 26495796 / 26621994 / -0.5% 41284620 / 42110166 / -2.0% 0.64 / 0.63 / +1.5%
tpcds_q83/datafusion:parquet 57359564 / 57423462 / -0.1% 73126384 / 75790772 / -3.5% 0.78 / 0.76 / +3.5%
tpcds_q84/datafusion:parquet 30505000 / 31732804 / -3.9% 45984594 / 43340852 / +6.1% 0.66 / 0.73 / -9.4%
tpcds_q85/datafusion:parquet 82976598 / 82735490 / +0.3% 105988059 / 105320942 / +0.6% 0.78 / 0.79 / -0.3%
tpcds_q86/datafusion:parquet 20216206 / 20280661 / -0.3% 34781638 / 35025429 / -0.7% 0.58 / 0.58 / +0.4%
tpcds_q87/datafusion:parquet 48511822 / 46146145 / +5.1% 61374559 / 62937911 / -2.5% 0.79 / 0.73 / +7.8%
tpcds_q88/datafusion:parquet 49503880 / 49335890 / +0.3% 67884985 / 59318423 / +14.4% 🔴 0.73 / 0.83 / -12.3%
tpcds_q89/datafusion:parquet 25578434 / 25982370 / -1.6% 43032122 / 43792097 / -1.7% 0.59 / 0.59 / +0.2%
tpcds_q90/datafusion:parquet 20105849 / 19724808 / +1.9% 33688936 / 33720190 / -0.1% 0.60 / 0.58 / +2.0%
tpcds_q91/datafusion:parquet 37457338 / 37194014 / +0.7% 51449038 / 55766737 / -7.7% 0.73 / 0.67 / +9.2%
tpcds_q92/datafusion:parquet 26103737 / 25767627 / +1.3% 41549009 / 43937885 / -5.4% 0.63 / 0.59 / +7.1%
tpcds_q93/datafusion:parquet 26951696 / 26282576 / +2.5% 47762290 / 48488461 / -1.5% 0.56 / 0.54 / +4.1%
tpcds_q94/datafusion:parquet 34750656 / 34397863 / +1.0% 50272768 / 49830018 / +0.9% 0.69 / 0.69 / +0.1%
tpcds_q95/datafusion:parquet 64125918 / 63593985 / +0.8% 79339540 / 79515453 / -0.2% 0.81 / 0.80 / +1.1%
tpcds_q96/datafusion:parquet 16525667 / 16508468 / +0.1% 29083384 / 29101426 / -0.1% 0.57 / 0.57 / +0.2%
tpcds_q97/datafusion:parquet 35971384 / 35693857 / +0.8% 52872116 / 54315874 / -2.7% 0.68 / 0.66 / +3.5%
tpcds_q98/datafusion:parquet 25620152 / 25041278 / +2.3% 39424300 / 39424472 / -0.0% 0.65 / 0.64 / +2.3%
tpcds_q99/datafusion:parquet 29365002 / 29322859 / +0.1% 42973306 / 42333003 / +1.5% 0.68 / 0.69 / -1.3%
duckdb / vortex-file-compressed / ns (1.001x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15622236 / 15321799 / +2.0% 27171277 / 22293273 / +21.9% 🔴 0.57 / 0.69 / -16.3%
tpcds_q02/duckdb:vortex-file-compressed 15110332 / 15697260 / -3.7% 21313239 / 23034616 / -7.5% 0.71 / 0.68 / +4.0%
tpcds_q03/duckdb:vortex-file-compressed 13311372 / 14455734 / -7.9% 20697940 / 21791618 / -5.0% 0.64 / 0.66 / -3.1%
tpcds_q04/duckdb:vortex-file-compressed 51750294 / 51881031 / -0.3% 62121882 / 61340766 / +1.3% 0.83 / 0.85 / -1.5%
tpcds_q05/duckdb:vortex-file-compressed 19578346 / 19607930 / -0.2% 27755414 / 26920046 / +3.1% 0.71 / 0.73 / -3.2%
tpcds_q06/duckdb:vortex-file-compressed 27419280 / 27976980 / -2.0% 41437865 / 40680488 / +1.9% 0.66 / 0.69 / -3.8%
tpcds_q07/duckdb:vortex-file-compressed 16237338 / 16446270 / -1.3% 28236344 / 27518887 / +2.6% 0.58 / 0.60 / -3.8%
tpcds_q08/duckdb:vortex-file-compressed 23665953 / 23371557 / +1.3% 34057479 / 31340994 / +8.7% 0.69 / 0.75 / -6.8%
tpcds_q09/duckdb:vortex-file-compressed 10645294 / 10750366 / -1.0% 19914881 / 17519964 / +13.7% 🔴 0.53 / 0.61 / -12.9%
tpcds_q10/duckdb:vortex-file-compressed 30989396 / 30904294 / +0.3% 43176830 / 44989822 / -4.0% 0.72 / 0.69 / +4.5%
tpcds_q11/duckdb:vortex-file-compressed 41501676 / 41344528 / +0.4% 53453328 / 52531767 / +1.8% 0.78 / 0.79 / -1.4%
tpcds_q12/duckdb:vortex-file-compressed 10950024 / 11002952 / -0.5% 18234232 / 16896570 / +7.9% 0.60 / 0.65 / -7.8%
tpcds_q13/duckdb:vortex-file-compressed 22299726 / 21785742 / +2.4% 35462451 / 34029957 / +4.2% 0.63 / 0.64 / -1.8%
tpcds_q14/duckdb:vortex-file-compressed 58517373 / 58760736 / -0.4% 70170631 / 69532904 / +0.9% 0.83 / 0.85 / -1.3%
tpcds_q15/duckdb:vortex-file-compressed 22366160 / 22460707 / -0.4% 27913548 / 29341261 / -4.9% 0.80 / 0.77 / +4.7%
tpcds_q16/duckdb:vortex-file-compressed 19109475 / 19414564 / -1.6% 30301065 / 27239304 / +11.2% 🔴 0.63 / 0.71 / -11.5%
tpcds_q17/duckdb:vortex-file-compressed 31660436 / 31955060 / -0.9% 46773158 / 44899811 / +4.2% 0.68 / 0.71 / -4.9%
tpcds_q18/duckdb:vortex-file-compressed 29750260 / 29829207 / -0.3% 41951924 / 39437215 / +6.4% 0.71 / 0.76 / -6.2%
tpcds_q19/duckdb:vortex-file-compressed 24970216 / 25285628 / -1.2% 36246835 / 35845268 / +1.1% 0.69 / 0.71 / -2.3%
tpcds_q20/duckdb:vortex-file-compressed 11298234 / 11083564 / +1.9% 17131823 / 16537404 / +3.6% 0.66 / 0.67 / -1.6%
tpcds_q21/duckdb:vortex-file-compressed 10909826 / 10660524 / +2.3% 26072101 / 20168878 / +29.3% 🔴 0.42 / 0.53 / -20.8%
tpcds_q22/duckdb:vortex-file-compressed 29714755 / 30062020 / -1.2% 42214493 / 40627745 / +3.9% 0.70 / 0.74 / -4.9%
tpcds_q23/duckdb:vortex-file-compressed 37673098 / 36499842 / +3.2% 49462908 / 49070300 / +0.8% 0.76 / 0.74 / +2.4%
tpcds_q24/duckdb:vortex-file-compressed 28306352 / 28830101 / -1.8% 39066482 / 39015175 / +0.1% 0.72 / 0.74 / -1.9%
tpcds_q25/duckdb:vortex-file-compressed 27123950 / 27505894 / -1.4% 41181965 / 36988126 / +11.3% 🔴 0.66 / 0.74 / -11.4%
tpcds_q26/duckdb:vortex-file-compressed 15058459 / 14846964 / +1.4% 20842877 / 21008896 / -0.8% 0.72 / 0.71 / +2.2%
tpcds_q27/duckdb:vortex-file-compressed 17254740 / 17332355 / -0.4% 28671873 / 27508998 / +4.2% 0.60 / 0.63 / -4.5%
tpcds_q28/duckdb:vortex-file-compressed 8063571 / 8196998 / -1.6% 12424806 / 11854550 / +4.8% 0.65 / 0.69 / -6.1%
tpcds_q29/duckdb:vortex-file-compressed 30285984 / 31066230 / -2.5% 46330731 / 43833124 / +5.7% 0.65 / 0.71 / -7.8%
tpcds_q30/duckdb:vortex-file-compressed 20274617 / 20227538 / +0.2% 29427409 / 30319720 / -2.9% 0.69 / 0.67 / +3.3%
tpcds_q31/duckdb:vortex-file-compressed 20113551 / 20113006 / +0.0% 28973760 / 27789465 / +4.3% 0.69 / 0.72 / -4.1%
tpcds_q32/duckdb:vortex-file-compressed 11092758 / 11231834 / -1.2% 21414478 / 18186079 / +17.8% 🔴 0.52 / 0.62 / -16.1%
tpcds_q33/duckdb:vortex-file-compressed 17312072 / 17344998 / -0.2% 31734597 / 29314488 / +8.3% 0.55 / 0.59 / -7.8%
tpcds_q34/duckdb:vortex-file-compressed 13778661 / 13706212 / +0.5% 20225930 / 21232033 / -4.7% 0.68 / 0.65 / +5.5%
tpcds_q35/duckdb:vortex-file-compressed 49069524 / 48936341 / +0.3% 62449308 / 61679176 / +1.2% 0.79 / 0.79 / -1.0%
tpcds_q36/duckdb:vortex-file-compressed 15450100 / 17953920 / -13.9% 🟢 30122421 / 26990779 / +11.6% 🔴 0.51 / 0.67 / -22.9%
tpcds_q37/duckdb:vortex-file-compressed 14224558 / 14058203 / +1.2% 22181845 / 22872037 / -3.0% 0.64 / 0.61 / +4.3%
tpcds_q38/duckdb:vortex-file-compressed 22217978 / 22258543 / -0.2% 29734833 / 29583425 / +0.5% 0.75 / 0.75 / -0.7%
tpcds_q39/duckdb:vortex-file-compressed 22534230 / 19169468 / +17.6% 🔴 29420960 / 30584027 / -3.8% 0.77 / 0.63 / +22.2%
tpcds_q40/duckdb:vortex-file-compressed 14290128 / 14456086 / -1.1% 19014088 / 19962104 / -4.7% 0.75 / 0.72 / +3.8%
tpcds_q41/duckdb:vortex-file-compressed 6589978 / 6667994 / -1.2% 10762593 / 9308828 / +15.6% 🔴 0.61 / 0.72 / -14.5%
tpcds_q42/duckdb:vortex-file-compressed 9170002 / 9075926 / +1.0% 18404824 / 17002196 / +8.2% 0.50 / 0.53 / -6.7%
tpcds_q43/duckdb:vortex-file-compressed 12557948 / 10548104 / +19.1% 🔴 18982616 / 17995819 / +5.5% 0.66 / 0.59 / +12.9%
tpcds_q44/duckdb:vortex-file-compressed 14485790 / 13993228 / +3.5% 25035623 / 23822022 / +5.1% 0.58 / 0.59 / -1.5%
tpcds_q45/duckdb:vortex-file-compressed 23856562 / 23912638 / -0.2% 30442905 / 29871135 / +1.9% 0.78 / 0.80 / -2.1%
tpcds_q46/duckdb:vortex-file-compressed 17036186 / 17196942 / -0.9% 31130692 / 27307794 / +14.0% 🔴 0.55 / 0.63 / -13.1%
tpcds_q47/duckdb:vortex-file-compressed 30990703 / 30929772 / +0.2% 42772448 / 43122349 / -0.8% 0.72 / 0.72 / +1.0%
tpcds_q48/duckdb:vortex-file-compressed 19457716 / 20090792 / -3.2% 35558166 / 33095468 / +7.4% 0.55 / 0.61 / -9.9%
tpcds_q49/duckdb:vortex-file-compressed 18778280 / 17957289 / +4.6% 34765435 / 30548250 / +13.8% 🔴 0.54 / 0.59 / -8.1%
tpcds_q50/duckdb:vortex-file-compressed 17353446 / 17101164 / +1.5% 29426780 / 28595529 / +2.9% 0.59 / 0.60 / -1.4%
tpcds_q51/duckdb:vortex-file-compressed 52987312 / 52818186 / +0.3% 88431148 / 63658761 / +38.9% 🔴 0.60 / 0.83 / -27.8%
tpcds_q52/duckdb:vortex-file-compressed 9014640 / 8950864 / +0.7% 18773597 / 18201658 / +3.1% 0.48 / 0.49 / -2.4%
tpcds_q53/duckdb:vortex-file-compressed 14646639 / 14679844 / -0.2% 25017185 / 27876284 / -10.3% 🟢 0.59 / 0.53 / +11.2%
tpcds_q54/duckdb:vortex-file-compressed 21044517 / 21332988 / -1.4% 33171433 / 35624703 / -6.9% 0.63 / 0.60 / +5.9%
tpcds_q55/duckdb:vortex-file-compressed 8886124 / 8884540 / +0.0% 18867719 / 17448419 / +8.1% 0.47 / 0.51 / -7.5%
tpcds_q56/duckdb:vortex-file-compressed 17789036 / 17753370 / +0.2% 32953330 / 30731345 / +7.2% 0.54 / 0.58 / -6.6%
tpcds_q57/duckdb:vortex-file-compressed 24869639 / 25004508 / -0.5% 31525864 / 32748609 / -3.7% 0.79 / 0.76 / +3.3%
tpcds_q58/duckdb:vortex-file-compressed 18399838 / 18534816 / -0.7% 28235316 / 30406171 / -7.1% 0.65 / 0.61 / +6.9%
tpcds_q59/duckdb:vortex-file-compressed 18608942 / 18729794 / -0.6% 26222483 / 24413998 / +7.4% 0.71 / 0.77 / -7.5%
tpcds_q60/duckdb:vortex-file-compressed 17522034 / 18493680 / -5.3% 29843200 / 28633163 / +4.2% 0.59 / 0.65 / -9.1%
tpcds_q61/duckdb:vortex-file-compressed 20758318 / 21762688 / -4.6% 31945341 / 31993711 / -0.2% 0.65 / 0.68 / -4.5%
tpcds_q62/duckdb:vortex-file-compressed 10607201 / 10737640 / -1.2% 19223330 / 18762060 / +2.5% 0.55 / 0.57 / -3.6%
tpcds_q63/duckdb:vortex-file-compressed 13522304 / 13916298 / -2.8% 23421279 / 22747052 / +3.0% 0.58 / 0.61 / -5.6%
tpcds_q64/duckdb:vortex-file-compressed 66477560 / 63380566 / +4.9% 79067466 / 77241389 / +2.4% 0.84 / 0.82 / +2.5%
tpcds_q65/duckdb:vortex-file-compressed 13245330 / 13282943 / -0.3% 23100876 / 21046783 / +9.8% 0.57 / 0.63 / -9.1%
tpcds_q66/duckdb:vortex-file-compressed 23961404 / 23278272 / +2.9% 30802447 / 31160761 / -1.1% 0.78 / 0.75 / +4.1%
tpcds_q67/duckdb:vortex-file-compressed 65875130 / 66426438 / -0.8% 87701748 / 84050573 / +4.3% 0.75 / 0.79 / -5.0%
tpcds_q68/duckdb:vortex-file-compressed 16779561 / 16585358 / +1.2% 28589830 / 32963609 / -13.3% 🟢 0.59 / 0.50 / +16.6%
tpcds_q69/duckdb:vortex-file-compressed 31740456 / 32336998 / -1.8% 43953040 / 47324454 / -7.1% 0.72 / 0.68 / +5.7%
tpcds_q70/duckdb:vortex-file-compressed 19180942 / 18773496 / +2.2% 28836429 / 29252013 / -1.4% 0.67 / 0.64 / +3.6%
tpcds_q71/duckdb:vortex-file-compressed 13864726 / 13552313 / +2.3% 25385282 / 23261666 / +9.1% 0.55 / 0.58 / -6.3%
tpcds_q72/duckdb:vortex-file-compressed 63706370 / 64108512 / -0.6% 83264037 / 78902008 / +5.5% 0.77 / 0.81 / -5.8%
tpcds_q73/duckdb:vortex-file-compressed 13115789 / 13332300 / -1.6% 21156053 / 20360102 / +3.9% 0.62 / 0.65 / -5.3%
tpcds_q74/duckdb:vortex-file-compressed 28301532 / 28095708 / +0.7% 38703499 / 37968380 / +1.9% 0.73 / 0.74 / -1.2%
tpcds_q75/duckdb:vortex-file-compressed 29271830 / 28403618 / +3.1% 44200451 / 40993645 / +7.8% 0.66 / 0.69 / -4.4%
tpcds_q76/duckdb:vortex-file-compressed 13449426 / 13959821 / -3.7% 25730947 / 26902592 / -4.4% 0.52 / 0.52 / +0.7%
tpcds_q77/duckdb:vortex-file-compressed 16427226 / 16102002 / +2.0% 24885750 / 26899658 / -7.5% 0.66 / 0.60 / +10.3%
tpcds_q78/duckdb:vortex-file-compressed 38290089 / 38464146 / -0.5% 47698968 / 49997187 / -4.6% 0.80 / 0.77 / +4.3%
tpcds_q79/duckdb:vortex-file-compressed 14997576 / 14697442 / +2.0% 26394274 / 23558306 / +12.0% 🔴 0.57 / 0.62 / -8.9%
tpcds_q80/duckdb:vortex-file-compressed 28900768 / 28143300 / +2.7% 43034554 / 41877033 / +2.8% 0.67 / 0.67 / -0.1%
tpcds_q81/duckdb:vortex-file-compressed 23415938 / 23357980 / +0.2% 32469249 / 33908116 / -4.2% 0.72 / 0.69 / +4.7%
tpcds_q82/duckdb:vortex-file-compressed 32163296 / 32124326 / +0.1% 41138307 / 39509814 / +4.1% 0.78 / 0.81 / -3.8%
tpcds_q83/duckdb:vortex-file-compressed 21196474 / 21315382 / -0.6% 25351380 / 25142505 / +0.8% 0.84 / 0.85 / -1.4%
tpcds_q84/duckdb:vortex-file-compressed 16425980 / 13987042 / +17.4% 🔴 23077848 / 21634338 / +6.7% 0.71 / 0.65 / +10.1%
tpcds_q85/duckdb:vortex-file-compressed 33339353 / 33283634 / +0.2% 44091589 / 42160464 / +4.6% 0.76 / 0.79 / -4.2%
tpcds_q86/duckdb:vortex-file-compressed 11260840 / 11300994 / -0.4% 20656050 / 18553894 / +11.3% 🔴 0.55 / 0.61 / -10.5%
tpcds_q87/duckdb:vortex-file-compressed 24165736 / 23919050 / +1.0% 30386479 / 30633803 / -0.8% 0.80 / 0.78 / +1.9%
tpcds_q88/duckdb:vortex-file-compressed 37071009 / 36109228 / +2.7% 47526536 / 48178571 / -1.4% 0.78 / 0.75 / +4.1%
tpcds_q89/duckdb:vortex-file-compressed 13999494 / 14161859 / -1.1% 24670030 / 22727057 / +8.5% 0.57 / 0.62 / -8.9%
tpcds_q90/duckdb:vortex-file-compressed 8407194 / 8628838 / -2.6% 13853887 / 14089789 / -1.7% 0.61 / 0.61 / -0.9%
tpcds_q91/duckdb:vortex-file-compressed 17475870 / 17430668 / +0.3% 25874783 / 22955101 / +12.7% 🔴 0.68 / 0.76 / -11.1%
tpcds_q92/duckdb:vortex-file-compressed 14421366 / 14370342 / +0.4% 26126723 / 22278088 / +17.3% 🔴 0.55 / 0.65 / -14.4%
tpcds_q93/duckdb:vortex-file-compressed 17414711 / 17695142 / -1.6% 23482758 / 24605193 / -4.6% 0.74 / 0.72 / +3.1%
tpcds_q94/duckdb:vortex-file-compressed 17401935 / 17653988 / -1.4% 27043343 / 26764051 / +1.0% 0.64 / 0.66 / -2.4%
tpcds_q95/duckdb:vortex-file-compressed 72105672 / 71411691 / +1.0% 80548390 / 77749719 / +3.6% 0.90 / 0.92 / -2.5%
tpcds_q96/duckdb:vortex-file-compressed 8514347 / 9215672 / -7.6% 17525136 / 16678736 / +5.1% 0.49 / 0.55 / -12.1%
tpcds_q97/duckdb:vortex-file-compressed 23619044 / 23290306 / +1.4% 31396838 / 31285572 / +0.4% 0.75 / 0.74 / +1.1%
tpcds_q98/duckdb:vortex-file-compressed 13883264 / 13854372 / +0.2% 23583746 / 21994890 / +7.2% 0.59 / 0.63 / -6.5%
tpcds_q99/duckdb:vortex-file-compressed 14558540 / 14668058 / -0.7% 21607555 / 23819457 / -9.3% 0.67 / 0.62 / +9.4%
duckdb / parquet / ns (1.008x ➖, 1↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23574776 / 23452190 / +0.5% 31337401 / 31719914 / -1.2% 0.75 / 0.74 / +1.7%
tpcds_q02/duckdb:parquet 15592430 / 15398088 / +1.3% 20074517 / 20196249 / -0.6% 0.78 / 0.76 / +1.9%
tpcds_q03/duckdb:parquet 8885934 / 8984010 / -1.1% 15329496 / 16050061 / -4.5% 0.58 / 0.56 / +3.6%
tpcds_q04/duckdb:parquet 127461604 / 127786552 / -0.3% 133454269 / 132934661 / +0.4% 0.96 / 0.96 / -0.6%
tpcds_q05/duckdb:parquet 21397837 / 21431162 / -0.2% 25961819 / 25684070 / +1.1% 0.82 / 0.83 / -1.2%
tpcds_q06/duckdb:parquet 26821984 / 26839832 / -0.1% 39216661 / 38423652 / +2.1% 0.68 / 0.70 / -2.1%
tpcds_q07/duckdb:parquet 15348268 / 15338757 / +0.1% 23647820 / 22915569 / +3.2% 0.65 / 0.67 / -3.0%
tpcds_q08/duckdb:parquet 28760396 / 25860730 / +11.2% 🔴 36457748 / 33922346 / +7.5% 0.79 / 0.76 / +3.5%
tpcds_q09/duckdb:parquet 18693630 / 20511287 / -8.9% 22355029 / 25194389 / -11.3% 🟢 0.84 / 0.81 / +2.7%
tpcds_q10/duckdb:parquet 27757981 / 28515553 / -2.7% 41469435 / 38725836 / +7.1% 0.67 / 0.74 / -9.1%
tpcds_q11/duckdb:parquet 71592716 / 73978912 / -3.2% 76062281 / 77872671 / -2.3% 0.94 / 0.95 / -0.9%
tpcds_q12/duckdb:parquet 13041710 / 13049208 / -0.1% 17812530 / 17339047 / +2.7% 0.73 / 0.75 / -2.7%
tpcds_q13/duckdb:parquet 23752426 / 24084998 / -1.4% 32561537 / 31653205 / +2.9% 0.73 / 0.76 / -4.1%
tpcds_q14/duckdb:parquet 61243390 / 60981058 / +0.4% 66797434 / 68208078 / -2.1% 0.92 / 0.89 / +2.6%
tpcds_q15/duckdb:parquet 24864864 / 24953807 / -0.4% 30766324 / 34373003 / -10.5% 🟢 0.81 / 0.73 / +11.3%
tpcds_q16/duckdb:parquet 20204562 / 20142488 / +0.3% 29204614 / 29046183 / +0.5% 0.69 / 0.69 / -0.2%
tpcds_q17/duckdb:parquet 32865854 / 32541009 / +1.0% 40562978 / 40916753 / -0.9% 0.81 / 0.80 / +1.9%
tpcds_q18/duckdb:parquet 39501182 / 39278109 / +0.6% 49367533 / 53867929 / -8.4% 0.80 / 0.73 / +9.7%
tpcds_q19/duckdb:parquet 24384902 / 24388336 / -0.0% 36128201 / 33637782 / +7.4% 0.67 / 0.73 / -6.9%
tpcds_q20/duckdb:parquet 13497632 / 13889332 / -2.8% 18670528 / 18686339 / -0.1% 0.72 / 0.74 / -2.7%
tpcds_q21/duckdb:parquet 9524938 / 9536779 / -0.1% 13124010 / 12604712 / +4.1% 0.73 / 0.76 / -4.1%
tpcds_q22/duckdb:parquet 35349860 / 35628424 / -0.8% 39852964 / 40001869 / -0.4% 0.89 / 0.89 / -0.4%
tpcds_q23/duckdb:parquet 40880634 / 40817172 / +0.2% 47678510 / 52885712 / -9.8% 0.86 / 0.77 / +11.1%
tpcds_q24/duckdb:parquet 33150846 / 33145605 / +0.0% 45187231 / 43831841 / +3.1% 0.73 / 0.76 / -3.0%
tpcds_q25/duckdb:parquet 30068419 / 30347292 / -0.9% 40660246 / 40758329 / -0.2% 0.74 / 0.74 / -0.7%
tpcds_q26/duckdb:parquet 31177505 / 30881478 / +1.0% 38426859 / 39247832 / -2.1% 0.81 / 0.79 / +3.1%
tpcds_q27/duckdb:parquet 31946870 / 32017734 / -0.2% 43761633 / 43679068 / +0.2% 0.73 / 0.73 / -0.4%
tpcds_q28/duckdb:parquet 17073382 / 17183374 / -0.6% 22243033 / 19955292 / +11.5% 🔴 0.77 / 0.86 / -10.9%
tpcds_q29/duckdb:parquet 30807256 / 31149133 / -1.1% 40262895 / 39657642 / +1.5% 0.77 / 0.79 / -2.6%
tpcds_q30/duckdb:parquet 32568004 / 34135998 / -4.6% 42289724 / 41275843 / +2.5% 0.77 / 0.83 / -6.9%
tpcds_q31/duckdb:parquet 21550232 / 20418129 / +5.5% 25940434 / 25800254 / +0.5% 0.83 / 0.79 / +5.0%
tpcds_q32/duckdb:parquet 11133924 / 11234272 / -0.9% 17290674 / 17763938 / -2.7% 0.64 / 0.63 / +1.8%
tpcds_q33/duckdb:parquet 15883853 / 15868778 / +0.1% 23327135 / 23425318 / -0.4% 0.68 / 0.68 / +0.5%
tpcds_q34/duckdb:parquet 18756276 / 16228229 / +15.6% 🔴 22537284 / 22200229 / +1.5% 0.83 / 0.73 / +13.8%
tpcds_q35/duckdb:parquet 47146976 / 47357416 / -0.4% 57225425 / 56859963 / +0.6% 0.82 / 0.83 / -1.1%
tpcds_q36/duckdb:parquet 15248978 / 15205704 / +0.3% 22867152 / 23015026 / -0.6% 0.67 / 0.66 / +0.9%
tpcds_q37/duckdb:parquet 12601676 / 11572074 / +8.9% 16578676 / 20023455 / -17.2% 🟢 0.76 / 0.58 / +31.5%
tpcds_q38/duckdb:parquet 26271394 / 26591826 / -1.2% 30857363 / 30244485 / +2.0% 0.85 / 0.88 / -3.2%
tpcds_q39/duckdb:parquet 24856412 / 24755072 / +0.4% 28015169 / 29227083 / -4.1% 0.89 / 0.85 / +4.8%
tpcds_q40/duckdb:parquet 15967636 / 16118286 / -0.9% 20883464 / 21547355 / -3.1% 0.76 / 0.75 / +2.2%
tpcds_q41/duckdb:parquet 7893958 / 9005206 / -12.3% 🟢 13150748 / 17376620 / -24.3% 🟢 0.60 / 0.52 / +15.8%
tpcds_q42/duckdb:parquet 8422422 / 8512522 / -1.1% 19229852 / 14938854 / +28.7% 🔴 0.44 / 0.57 / -23.1%
tpcds_q43/duckdb:parquet 10716670 / 10743440 / -0.2% 15458993 / 18858565 / -18.0% 🟢 0.69 / 0.57 / +21.7%
tpcds_q44/duckdb:parquet 16300428 / 16280694 / +0.1% 22293335 / 25260507 / -11.7% 🟢 0.73 / 0.64 / +13.4%
tpcds_q45/duckdb:parquet 23139466 / 23248414 / -0.5% 29894560 / 29155594 / +2.5% 0.77 / 0.80 / -2.9%
tpcds_q46/duckdb:parquet 36105796 / 37192040 / -2.9% 46211958 / 44467293 / +3.9% 0.78 / 0.84 / -6.6%
tpcds_q47/duckdb:parquet 33125485 / 31363272 / +5.6% 40619952 / 37387804 / +8.6% 0.82 / 0.84 / -2.8%
tpcds_q48/duckdb:parquet 21209008 / 21213027 / -0.0% 29434898 / 28263398 / +4.1% 0.72 / 0.75 / -4.0%
tpcds_q49/duckdb:parquet 18721246 / 19227554 / -2.6% 27969685 / 35194044 / -20.5% 🟢 0.67 / 0.55 / +22.5%
tpcds_q50/duckdb:parquet 17625419 / 17501848 / +0.7% 25828026 / 24753730 / +4.3% 0.68 / 0.71 / -3.5%
tpcds_q51/duckdb:parquet 53617151 / 53817210 / -0.4% 60714356 / 63362513 / -4.2% 0.88 / 0.85 / +4.0%
tpcds_q52/duckdb:parquet 8602984 / 8781552 / -2.0% 15016934 / 15193812 / -1.2% 0.57 / 0.58 / -0.9%
tpcds_q53/duckdb:parquet 11592945 / 11644089 / -0.4% 17232445 / 17170269 / +0.4% 0.67 / 0.68 / -0.8%
tpcds_q54/duckdb:parquet 20654060 / 20935442 / -1.3% 29911222 / 31948001 / -6.4% 0.69 / 0.66 / +5.4%
tpcds_q55/duckdb:parquet 8692652 / 8664058 / +0.3% 15141459 / 14948727 / +1.3% 0.57 / 0.58 / -0.9%
tpcds_q56/duckdb:parquet 16549210 / 16338488 / +1.3% 24341031 / 23444429 / +3.8% 0.68 / 0.70 / -2.4%
tpcds_q57/duckdb:parquet 29111840 / 29207196 / -0.3% 39041395 / 34943535 / +11.7% 🔴 0.75 / 0.84 / -10.8%
tpcds_q58/duckdb:parquet 18410028 / 18045469 / +2.0% 25917025 / 25871934 / +0.2% 0.71 / 0.70 / +1.8%
tpcds_q59/duckdb:parquet 20273430 / 20118750 / +0.8% 25239874 / 24957337 / +1.1% 0.80 / 0.81 / -0.4%
tpcds_q60/duckdb:parquet 16626974 / 16933512 / -1.8% 26080913 / 25115351 / +3.8% 0.64 / 0.67 / -5.4%
tpcds_q61/duckdb:parquet 21428454 / 21610435 / -0.8% 29983463 / 28899294 / +3.8% 0.71 / 0.75 / -4.4%
tpcds_q62/duckdb:parquet 10908312 / 10728302 / +1.7% 14925832 / 15054146 / -0.9% 0.73 / 0.71 / +2.6%
tpcds_q63/duckdb:parquet 11047716 / 11077888 / -0.3% 17126931 / 16659603 / +2.8% 0.65 / 0.66 / -3.0%
tpcds_q64/duckdb:parquet 53140443 / 53322446 / -0.3% 67186126 / 72268700 / -7.0% 0.79 / 0.74 / +7.2%
tpcds_q65/duckdb:parquet 17746910 / 16263784 / +9.1% 24179774 / 20507481 / +17.9% 🔴 0.73 / 0.79 / -7.5%
tpcds_q66/duckdb:parquet 25178432 / 25347893 / -0.7% 31954494 / 30998382 / +3.1% 0.79 / 0.82 / -3.6%
tpcds_q67/duckdb:parquet 78184406 / 79356994 / -1.5% 90600108 / 86503426 / +4.7% 0.86 / 0.92 / -5.9%
tpcds_q68/duckdb:parquet 29359832 / 29387317 / -0.1% 41155445 / 41399696 / -0.6% 0.71 / 0.71 / +0.5%
tpcds_q69/duckdb:parquet 29051950 / 28969076 / +0.3% 39872187 / 42345129 / -5.8% 0.73 / 0.68 / +6.5%
tpcds_q70/duckdb:parquet 16412095 / 16089713 / +2.0% 26998986 / 24445770 / +10.4% 🔴 0.61 / 0.66 / -7.6%
tpcds_q71/duckdb:parquet 14844827 / 14768177 / +0.5% 20861095 / 20988022 / -0.6% 0.71 / 0.70 / +1.1%
tpcds_q72/duckdb:parquet 93386490 / 82286831 / +13.5% 🔴 86594898 / 86972242 / -0.4% 1.08 / 0.95 / +14.0%
tpcds_q73/duckdb:parquet 13561057 / 13587976 / -0.2% 19829306 / 23266200 / -14.8% 🟢 0.68 / 0.58 / +17.1%
tpcds_q74/duckdb:parquet 100416043 / 99468774 / +1.0% 107140088 / 107375616 / -0.2% 0.94 / 0.93 / +1.2%
tpcds_q75/duckdb:parquet 41977360 / 40496084 / +3.7% 55409302 / 51300946 / +8.0% 0.76 / 0.79 / -4.0%
tpcds_q76/duckdb:parquet 13631020 / 13767701 / -1.0% 20883545 / 21386762 / -2.4% 0.65 / 0.64 / +1.4%
tpcds_q77/duckdb:parquet 17272027 / 17094990 / +1.0% 29066807 / 24293736 / +19.6% 🔴 0.59 / 0.70 / -15.6%
tpcds_q78/duckdb:parquet 48139097 / 48222778 / -0.2% 54366018 / 53868247 / +0.9% 0.89 / 0.90 / -1.1%
tpcds_q79/duckdb:parquet 22021172 / 20520957 / +7.3% 31193829 / 29031660 / +7.4% 0.71 / 0.71 / -0.1%
tpcds_q80/duckdb:parquet 31293011 / 31483549 / -0.6% 40364274 / 38755783 / +4.2% 0.78 / 0.81 / -4.6%
tpcds_q81/duckdb:parquet 30172255 / 30174692 / -0.0% 40461645 / 38913632 / +4.0% 0.75 / 0.78 / -3.8%
tpcds_q82/duckdb:parquet 13025994 / 12664088 / +2.9% 18450726 / 20468748 / -9.9% 0.71 / 0.62 / +14.1%
tpcds_q83/duckdb:parquet 15823265 / 16122229 / -1.9% 24374772 / 20762780 / +17.4% 🔴 0.65 / 0.78 / -16.4%
tpcds_q84/duckdb:parquet 17335669 / 17314944 / +0.1% 23669149 / 23815885 / -0.6% 0.73 / 0.73 / +0.7%
tpcds_q85/duckdb:parquet 34703598 / 35180526 / -1.4% 45568779 / 48545597 / -6.1% 0.76 / 0.72 / +5.1%
tpcds_q86/duckdb:parquet 12333348 / 11030179 / +11.8% 🔴 15876661 / 15735930 / +0.9% 0.78 / 0.70 / +10.8%
tpcds_q87/duckdb:parquet 28337682 / 28461196 / -0.4% 32957491 / 33676228 / -2.1% 0.86 / 0.85 / +1.7%
tpcds_q88/duckdb:parquet 27800156 / 26837562 / +3.6% 30768861 / 30853267 / -0.3% 0.90 / 0.87 / +3.9%
tpcds_q89/duckdb:parquet 12873341 / 12841204 / +0.3% 18647055 / 18945039 / -1.6% 0.69 / 0.68 / +1.9%
tpcds_q90/duckdb:parquet 8333008 / 6893303 / +20.9% 🔴 10984711 / 11346700 / -3.2% 0.76 / 0.61 / +24.9%
tpcds_q91/duckdb:parquet 20488272 / 20694878 / -1.0% 28468508 / 30840537 / -7.7% 0.72 / 0.67 / +7.3%
tpcds_q92/duckdb:parquet 11606689 / 11554066 / +0.5% 18569693 / 17846917 / +4.0% 0.63 / 0.65 / -3.5%
tpcds_q93/duckdb:parquet 22694654 / 21518600 / +5.5% 29356925 / 28298706 / +3.7% 0.77 / 0.76 / +1.7%
tpcds_q94/duckdb:parquet 17780749 / 15948577 / +11.5% 🔴 27116870 / 25083758 / +8.1% 0.66 / 0.64 / +3.1%
tpcds_q95/duckdb:parquet 89761394 / 89849552 / -0.1% 97777445 / 98386343 / -0.6% 0.92 / 0.91 / +0.5%
tpcds_q96/duckdb:parquet 6923848 / 6961389 / -0.5% 10850845 / 10661402 / +1.8% 0.64 / 0.65 / -2.3%
tpcds_q97/duckdb:parquet 25970179 / 26104618 / -0.5% 31910444 / 31859514 / +0.2% 0.81 / 0.82 / -0.7%
tpcds_q98/duckdb:parquet 15125970 / 15154052 / -0.2% 25203548 / 22085366 / +14.1% 🔴 0.60 / 0.69 / -12.5%
tpcds_q99/duckdb:parquet 17459055 / 17404464 / +0.3% 22530273 / 21758936 / +3.5% 0.77 / 0.80 / -3.1%

No file size changes detected.

@gatesn
gatesn marked this pull request as ready for review September 9, 2026 20:26
Mask::AllTrue(_) => Ok(Some(array.child().clone())),
Mask::AllFalse(_) => Ok(Some(Canonical::empty(array.dtype()).into_array())),
Mask::Values(_) => Ok(None),
mask @ Mask::Values(_) => {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you make this a separate pr, also while you're at it fix MaskValues::last to use BitBuffer::last_set_index

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

actually you can leverage contiguous_values_range here

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


#[derive(Debug)]
struct ScalarFnUnaryFilterPushDownRule;
struct ScalarFnFilterPushDownRule;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can this be a separate pr?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


return Ok(Some(new_array));
}
.map(|c| match c.as_opt::<Constant>() {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change this to call prepare_mask_for_reuse if nchildren > 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants