Skip to content

Pushdown filter through scalar function regardless of number of children - #9830

Merged
robert3005 merged 1 commit into
developfrom
rk/scalarfilterpushdown
Sep 11, 2026
Merged

Pushdown filter through scalar function regardless of number of children#9830
robert3005 merged 1 commit into
developfrom
rk/scalarfilterpushdown

Conversation

@robert3005

Copy link
Copy Markdown
Contributor

Now that we have more filter machinery this can be safe

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added the changelog/performance A performance improvement label Sep 10, 2026
@robert3005
robert3005 enabled auto-merge (squash) September 10, 2026 15:53
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 10, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 10, 2026
@codspeed-hq

codspeed-hq Bot commented Sep 10, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 10.38%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
❌ 8 regressed benchmarks
✅ 2185 untouched benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 12.2 µs 20.5 µs -40.27%
WallTime dict_canonicalize_gt_u8_avx2[16000000] 6.8 ms 11.1 ms -39.14%
Simulation decompress[u64, (4000, 1024)] 70.8 µs 87.2 µs -18.77%
WallTime filtered_owned_i64_avx2[OneNullInEight] 21.9 µs 26 µs -15.97%
Simulation compact_sliced[(1024, 90)] 1.3 µs 1.5 µs -11.23%
Simulation compact[(1024, 90)] 1.4 µs 1.5 µs -10.83%
Simulation compact_sliced[(2048, 90)] 1.4 µs 1.5 µs -10.8%
Simulation compact[(2048, 90)] 1.4 µs 1.6 µs -10.43%
WallTime filtered_owned_i64_avx512[OneNullInEight] 26.3 µs 22.3 µs +17.8%
WallTime dict_canonicalize_gt_u8_neon[1000000] 559.7 µs 487.1 µs +14.89%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%
WallTime dict_canonicalize_gt_u8_neon[16000000] 9.4 ms 8.4 ms +11.38%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing rk/scalarfilterpushdown (dfcb8c8) with develop (272bf1d)2

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on develop (d6037bc) during the generation of this report, so 272bf1d was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done dfcb8c8 statpopgen 2 Explore Profiling Data
🟢 Done dfcb8c8 clickbench-sorted-nvme 2 Explore Profiling Data
🟢 Done dfcb8c8 tpch-nvme-10 2 Explore Profiling Data
🟢 Done dfcb8c8 fineweb 2 Explore Profiling Data
🟢 Done dfcb8c8 tpcds-nvme 2 Explore Profiling Data
🟢 Done dfcb8c8 fineweb-s3 1 Explore Profiling Data
🟢 Done dfcb8c8 clickbench-nvme 1 Explore Profiling Data
🟢 Done dfcb8c8 tpch-nvme 1 Explore Profiling Data
🟢 Done dfcb8c8 polarsignals 1 Explore Profiling Data
🟢 Done dfcb8c8 tpch-s3 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done dfcb8c8 fineweb 1 Explore Profiling Data
🟢 Done dfcb8c8 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR dfcb8c8e vs base d6037bc2
Vortex (geomean): hot 1.004x ➖ · cold 0.910x ➖


datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45954129 / 45207531 / +1.7% 90417191 / 100423818 / -10.0% 0.51 / 0.45 / +12.9%
polarsignals_q01/datafusion:vortex-file-compressed 51162671 / 51548402 / -0.7% 110922781 / 126772034 / -12.5% 🟢 0.46 / 0.41 / +13.4%
polarsignals_q02/datafusion:vortex-file-compressed 37285671 / 35555650 / +4.9% 83971742 / 93231970 / -9.9% 0.44 / 0.38 / +16.4%
polarsignals_q03/datafusion:vortex-file-compressed 53297942 / 53810724 / -1.0% 114687075 / 124982753 / -8.2% 0.46 / 0.43 / +7.9%
polarsignals_q04/datafusion:vortex-file-compressed 9373710 / 9487734 / -1.2% 49149963 / 56409474 / -12.9% 🟢 0.19 / 0.17 / +13.4%
polarsignals_q05/datafusion:vortex-file-compressed 11441072 / 11400775 / +0.4% 55188655 / 60489634 / -8.8% 0.21 / 0.19 / +10.0%
polarsignals_q06/datafusion:vortex-file-compressed 21228100 / 20963290 / +1.3% 64649639 / 70100996 / -7.8% 0.33 / 0.30 / +9.8%
polarsignals_q07/datafusion:vortex-file-compressed 11114066 / 11389236 / -2.4% 55676019 / 60009510 / -7.2% 0.20 / 0.19 / +5.2%
polarsignals_q08/datafusion:vortex-file-compressed 99952888 / 100751864 / -0.8% 166979412 / 174097497 / -4.1% 0.60 / 0.58 / +3.4%
polarsignals_q09/datafusion:vortex-file-compressed 10099765 / 9901679 / +2.0% 51556633 / 56250509 / -8.3% 0.20 / 0.18 / +11.3%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR dfcb8c8e vs base 272bf1db
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Engines: DuckDB No clear signal (-2.5%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.990x ➖
Parquet (geomean): hot 1.017x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +1.7% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 8999014 / 9108983 / -1.2% 10564461 / 9559674 / +10.5% 🔴 0.85 / 0.95 / -10.6%
statpopgen_q01/duckdb:vortex-file-compressed 10261157 / 10571494 / -2.9% 14079628 / 14526125 / -3.1% 0.73 / 0.73 / +0.1%
statpopgen_q02/duckdb:vortex-file-compressed 379579414 / 380465495 / -0.2% 402984626 / 397591108 / +1.4% 0.94 / 0.96 / -1.6%
statpopgen_q03/duckdb:vortex-file-compressed 891586326 / 896171963 / -0.5% 892247337 / 912909817 / -2.3% 1.00 / 0.98 / +1.8%
statpopgen_q04/duckdb:vortex-file-compressed 895301549 / 903284992 / -0.9% 892485781 / 899256799 / -0.8% 1.00 / 1.00 / -0.1%
statpopgen_q05/duckdb:vortex-file-compressed 424502074 / 423571518 / +0.2% 432386864 / 439223703 / -1.6% 0.98 / 0.96 / +1.8%
statpopgen_q06/duckdb:vortex-file-compressed 1164977601 / 1166294920 / -0.1% 1174875548 / 1183933220 / -0.8% 0.99 / 0.99 / +0.7%
statpopgen_q07/duckdb:vortex-file-compressed 180029820 / 182435040 / -1.3% 188349804 / 193510827 / -2.7% 0.96 / 0.94 / +1.4%
statpopgen_q08/duckdb:vortex-file-compressed 194430194 / 201894408 / -3.7% 203139470 / 225006166 / -9.7% 0.96 / 0.90 / +6.7%
statpopgen_q09/duckdb:vortex-file-compressed 710531415 / 710679142 / -0.0% 746842662 / 752100088 / -0.7% 0.95 / 0.94 / +0.7%
statpopgen_q10/duckdb:vortex-file-compressed 2021576680 / 2010807878 / +0.5% 1976537210 / 1982424006 / -0.3% 1.02 / 1.01 / +0.8%
duckdb / parquet / ns (1.017x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 246549158 / 248015293 / -0.6% 246969956 / 246739085 / +0.1% 1.00 / 1.01 / -0.7%
statpopgen_q01/duckdb:parquet 301784168 / 304896009 / -1.0% 304294034 / 308048026 / -1.2% 0.99 / 0.99 / +0.2%
statpopgen_q02/duckdb:parquet 551877090 / 538814458 / +2.4% 555989366 / 553921430 / +0.4% 0.99 / 0.97 / +2.0%
statpopgen_q03/duckdb:parquet 881395696 / 826762838 / +6.6% 865520740 / 866848228 / -0.2% 1.02 / 0.95 / +6.8%
statpopgen_q04/duckdb:parquet 823066408 / 783425931 / +5.1% 819377874 / 790982771 / +3.6% 1.00 / 0.99 / +1.4%
statpopgen_q05/duckdb:parquet 595739220 / 578925712 / +2.9% 586891486 / 591508473 / -0.8% 1.02 / 0.98 / +3.7%
statpopgen_q06/duckdb:parquet 710106634 / 679646988 / +4.5% 725441043 / 692744173 / +4.7% 0.98 / 0.98 / -0.2%
statpopgen_q07/duckdb:parquet 606367381 / 614245380 / -1.3% 705579921 / 716652163 / -1.5% 0.86 / 0.86 / +0.3%
statpopgen_q08/duckdb:parquet 620037091 / 625541709 / -0.9% 692270502 / 691479596 / +0.1% 0.90 / 0.90 / -1.0%
statpopgen_q09/duckdb:parquet 800660692 / 788103662 / +1.6% 843597747 / 808752317 / +4.3% 0.95 / 0.97 / -2.6%
statpopgen_q10/duckdb:parquet 1425636640 / 1435347720 / -0.7% 1269515770 / 1244785287 / +2.0% 1.12 / 1.15 / -2.6%

File Size Changes (1 files changed, -0.1% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.55 GB 1.55 GB 815.36 KB -0.1%

Totals:

  • vortex-file-compressed: 1.55 GB → 1.55 GB (-0.1%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR dfcb8c8e vs base 272bf1db
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 0.990x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.982x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91989946 / 95247742 / -3.4% 167732727 / 152560959 / +9.9% 0.55 / 0.62 / -12.2%
tpch_q02/datafusion:vortex-file-compressed 64931453 / 64198579 / +1.1% 93422392 / 96836681 / -3.5% 0.70 / 0.66 / +4.8%
tpch_q03/datafusion:vortex-file-compressed 66884707 / 65450850 / +2.2% 111055074 / 111887634 / -0.7% 0.60 / 0.58 / +3.0%
tpch_q04/datafusion:vortex-file-compressed 36113999 / 36510756 / -1.1% 75115420 / 75585272 / -0.6% 0.48 / 0.48 / -0.5%
tpch_q05/datafusion:vortex-file-compressed 118480953 / 117125574 / +1.2% 175508655 / 174946314 / +0.3% 0.68 / 0.67 / +0.8%
tpch_q06/datafusion:vortex-file-compressed 14520146 / 15521752 / -6.5% 69984508 / 69971053 / +0.0% 0.21 / 0.22 / -6.5%
tpch_q07/datafusion:vortex-file-compressed 140040925 / 141294023 / -0.9% 182571755 / 195227430 / -6.5% 0.77 / 0.72 / +6.0%
tpch_q08/datafusion:vortex-file-compressed 145132354 / 142510669 / +1.8% 211458078 / 198865856 / +6.3% 0.69 / 0.72 / -4.2%
tpch_q09/datafusion:vortex-file-compressed 187779328 / 186185474 / +0.9% 264312872 / 257121057 / +2.8% 0.71 / 0.72 / -1.9%
tpch_q10/datafusion:vortex-file-compressed 74789244 / 74869725 / -0.1% 129448258 / 135762722 / -4.7% 0.58 / 0.55 / +4.8%
tpch_q11/datafusion:vortex-file-compressed 44121449 / 43031510 / +2.5% 69799241 / 69699529 / +0.1% 0.63 / 0.62 / +2.4%
tpch_q12/datafusion:vortex-file-compressed 46557015 / 45880178 / +1.5% 90825809 / 91357218 / -0.6% 0.51 / 0.50 / +2.1%
tpch_q13/datafusion:vortex-file-compressed 47572891 / 46754909 / +1.7% 79308652 / 78285845 / +1.3% 0.60 / 0.60 / +0.4%
tpch_q14/datafusion:vortex-file-compressed 25329077 / 25368442 / -0.2% 98093420 / 95811973 / +2.4% 0.26 / 0.26 / -2.5%
tpch_q15/datafusion:vortex-file-compressed 37316179 / 36866412 / +1.2% 101507881 / 101336856 / +0.2% 0.37 / 0.36 / +1.0%
tpch_q16/datafusion:vortex-file-compressed 37231218 / 37821851 / -1.6% 67278719 / 66576375 / +1.1% 0.55 / 0.57 / -2.6%
tpch_q17/datafusion:vortex-file-compressed 176662017 / 177762618 / -0.6% 228785833 / 225979492 / +1.2% 0.77 / 0.79 / -1.8%
tpch_q18/datafusion:vortex-file-compressed 200917933 / 203338034 / -1.2% 255959910 / 268639544 / -4.7% 0.78 / 0.76 / +3.7%
tpch_q19/datafusion:vortex-file-compressed 34807954 / 37989476 / -8.4% 97934316 / 96917471 / +1.0% 0.36 / 0.39 / -9.3%
tpch_q20/datafusion:vortex-file-compressed 63240263 / 63141683 / +0.2% 123393775 / 121052849 / +1.9% 0.51 / 0.52 / -1.7%
tpch_q21/datafusion:vortex-file-compressed 182613335 / 184420398 / -1.0% 235919916 / 242789630 / -2.8% 0.77 / 0.76 / +1.9%
tpch_q22/datafusion:vortex-file-compressed 25638752 / 25811594 / -0.7% 57562145 / 55371841 / +4.0% 0.45 / 0.47 / -4.4%
datafusion / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83197818 / 82686843 / +0.6% 129611554 / 136014076 / -4.7% 0.64 / 0.61 / +5.6%
tpch_q02/datafusion:parquet 135711245 / 136445315 / -0.5% 163736332 / 165974000 / -1.3% 0.83 / 0.82 / +0.8%
tpch_q03/datafusion:parquet 123292091 / 125289498 / -1.6% 188726654 / 202374937 / -6.7% 0.65 / 0.62 / +5.5%
tpch_q04/datafusion:parquet 53243214 / 53700726 / -0.9% 104634606 / 103954287 / +0.7% 0.51 / 0.52 / -1.5%
tpch_q05/datafusion:parquet 164130302 / 164357047 / -0.1% 242400049 / 246225224 / -1.6% 0.68 / 0.67 / +1.4%
tpch_q06/datafusion:parquet 32052204 / 32435051 / -1.2% 79617924 / 85609133 / -7.0% 0.40 / 0.38 / +6.3%
tpch_q07/datafusion:parquet 213384584 / 217011054 / -1.7% 276182519 / 296004589 / -6.7% 0.77 / 0.73 / +5.4%
tpch_q08/datafusion:parquet 210371765 / 211066428 / -0.3% 284167614 / 285913355 / -0.6% 0.74 / 0.74 / +0.3%
tpch_q09/datafusion:parquet 282366376 / 278544901 / +1.4% 357954124 / 364339598 / -1.8% 0.79 / 0.76 / +3.2%
tpch_q10/datafusion:parquet 305499071 / 315121905 / -3.1% 370576971 / 387406317 / -4.3% 0.82 / 0.81 / +1.3%
tpch_q11/datafusion:parquet 96667980 / 97305530 / -0.7% 122706857 / 121431418 / +1.1% 0.79 / 0.80 / -1.7%
tpch_q12/datafusion:parquet 77897304 / 78930283 / -1.3% 128693320 / 131589911 / -2.2% 0.61 / 0.60 / +0.9%
tpch_q13/datafusion:parquet 195896243 / 195130429 / +0.4% 228063745 / 231387840 / -1.4% 0.86 / 0.84 / +1.9%
tpch_q14/datafusion:parquet 74787210 / 75854934 / -1.4% 173759580 / 196041642 / -11.4% 🟢 0.43 / 0.39 / +11.2%
tpch_q15/datafusion:parquet 76561040 / 79854064 / -4.1% 136339661 / 141931596 / -3.9% 0.56 / 0.56 / -0.2%
tpch_q16/datafusion:parquet 83705576 / 84766270 / -1.3% 112136524 / 111260453 / +0.8% 0.75 / 0.76 / -2.0%
tpch_q17/datafusion:parquet 201207023 / 203524417 / -1.1% 260381504 / 264440890 / -1.5% 0.77 / 0.77 / +0.4%
tpch_q18/datafusion:parquet 262532112 / 264166168 / -0.6% 316872364 / 317398225 / -0.2% 0.83 / 0.83 / -0.5%
tpch_q19/datafusion:parquet 97719611 / 98128100 / -0.4% 171989172 / 172948702 / -0.6% 0.57 / 0.57 / +0.1%
tpch_q20/datafusion:parquet 152011865 / 153990288 / -1.3% 215482918 / 216628358 / -0.5% 0.71 / 0.71 / -0.8%
tpch_q21/datafusion:parquet 227548519 / 235120718 / -3.2% 302814936 / 319805897 / -5.3% 0.75 / 0.74 / +2.2%
tpch_q22/datafusion:parquet 159827163 / 161297954 / -0.9% 185515074 / 187674134 / -1.2% 0.86 / 0.86 / +0.2%
duckdb / vortex-file-compressed / ns (0.985x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54825205 / 54056582 / +1.4% 110660261 / 94107873 / +17.6% 🔴 0.50 / 0.57 / -13.7%
tpch_q02/duckdb:vortex-file-compressed 31931398 / 32823989 / -2.7% 47025097 / 44568270 / +5.5% 0.68 / 0.74 / -7.8%
tpch_q03/duckdb:vortex-file-compressed 59068150 / 59196540 / -0.2% 104306977 / 98995636 / +5.4% 0.57 / 0.60 / -5.3%
tpch_q04/duckdb:vortex-file-compressed 80712210 / 80092163 / +0.8% 119423053 / 110397776 / +8.2% 0.68 / 0.73 / -6.8%
tpch_q05/duckdb:vortex-file-compressed 64995945 / 65939986 / -1.4% 121424850 / 104827111 / +15.8% 🔴 0.54 / 0.63 / -14.9%
tpch_q06/duckdb:vortex-file-compressed 20571389 / 21234736 / -3.1% 68458048 / 57245367 / +19.6% 🔴 0.30 / 0.37 / -19.0%
tpch_q07/duckdb:vortex-file-compressed 59576904 / 64122796 / -7.1% 128749208 / 127903723 / +0.7% 0.46 / 0.50 / -7.7%
tpch_q08/duckdb:vortex-file-compressed 83888369 / 85672952 / -2.1% 150806645 / 141758290 / +6.4% 0.56 / 0.60 / -8.0%
tpch_q09/duckdb:vortex-file-compressed 167826976 / 169391812 / -0.9% 232850023 / 229628796 / +1.4% 0.72 / 0.74 / -2.3%
tpch_q10/duckdb:vortex-file-compressed 115097391 / 116524021 / -1.2% 192392157 / 187186454 / +2.8% 0.60 / 0.62 / -3.9%
tpch_q11/duckdb:vortex-file-compressed 16714986 / 18017750 / -7.2% 32771041 / 32902445 / -0.4% 0.51 / 0.55 / -6.9%
tpch_q12/duckdb:vortex-file-compressed 54092641 / 55094120 / -1.8% 101507321 / 90249910 / +12.5% 🔴 0.53 / 0.61 / -12.7%
tpch_q13/duckdb:vortex-file-compressed 89297016 / 91708193 / -2.6% 138832766 / 127625229 / +8.8% 0.64 / 0.72 / -10.5%
tpch_q14/duckdb:vortex-file-compressed 30127964 / 30519655 / -1.3% 76168178 / 74303107 / +2.5% 0.40 / 0.41 / -3.7%
tpch_q15/duckdb:vortex-file-compressed 40496314 / 40052289 / +1.1% 95379824 / 93284207 / +2.2% 0.42 / 0.43 / -1.1%
tpch_q16/duckdb:vortex-file-compressed 42322816 / 43220838 / -2.1% 55526844 / 54348166 / +2.2% 0.76 / 0.80 / -4.2%
tpch_q17/duckdb:vortex-file-compressed 74770898 / 81689424 / -8.5% 162421974 / 163566087 / -0.7% 0.46 / 0.50 / -7.8%
tpch_q18/duckdb:vortex-file-compressed 134497892 / 135063933 / -0.4% 164465085 / 147940933 / +11.2% 🔴 0.82 / 0.91 / -10.4%
tpch_q19/duckdb:vortex-file-compressed 50586462 / 44131250 / +14.6% 🔴 125381453 / 98875789 / +26.8% 🔴 0.40 / 0.45 / -9.6%
tpch_q20/duckdb:vortex-file-compressed 59365642 / 60426881 / -1.8% 127732029 / 113572070 / +12.5% 🔴 0.46 / 0.53 / -12.6%
tpch_q21/duckdb:vortex-file-compressed 243291080 / 249864898 / -2.6% 293873495 / 272582917 / +7.8% 0.83 / 0.92 / -9.7%
tpch_q22/duckdb:vortex-file-compressed 39804233 / 40592231 / -1.9% 61317055 / 56474653 / +8.6% 0.65 / 0.72 / -9.7%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 69912537 / 70514185 / -0.9% 86842977 / 91748096 / -5.3% 0.81 / 0.77 / +4.7%
tpch_q02/duckdb:parquet 70745666 / 71560336 / -1.1% 82873656 / 83717622 / -1.0% 0.85 / 0.85 / -0.1%
tpch_q03/duckdb:parquet 115978134 / 113542506 / +2.1% 152793970 / 149994843 / +1.9% 0.76 / 0.76 / +0.3%
tpch_q04/duckdb:parquet 74113890 / 75341314 / -1.6% 105182307 / 105526311 / -0.3% 0.70 / 0.71 / -1.3%
tpch_q05/duckdb:parquet 123777817 / 126130977 / -1.9% 161668348 / 163133865 / -0.9% 0.77 / 0.77 / -1.0%
tpch_q06/duckdb:parquet 34379387 / 34785635 / -1.2% 48302057 / 49395074 / -2.2% 0.71 / 0.70 / +1.1%
tpch_q07/duckdb:parquet 89531330 / 90649958 / -1.2% 132674281 / 129874906 / +2.2% 0.67 / 0.70 / -3.3%
tpch_q08/duckdb:parquet 142277674 / 144798165 / -1.7% 193447874 / 186552620 / +3.7% 0.74 / 0.78 / -5.2%
tpch_q09/duckdb:parquet 222581991 / 223551679 / -0.4% 268885652 / 263908794 / +1.9% 0.83 / 0.85 / -2.3%
tpch_q10/duckdb:parquet 470965003 / 474085325 / -0.7% 527056776 / 510857527 / +3.2% 0.89 / 0.93 / -3.7%
tpch_q11/duckdb:parquet 30850505 / 30876043 / -0.1% 38747362 / 38368003 / +1.0% 0.80 / 0.80 / -1.1%
tpch_q12/duckdb:parquet 75809087 / 77212468 / -1.8% 92510528 / 94053495 / -1.6% 0.82 / 0.82 / -0.2%
tpch_q13/duckdb:parquet 314706896 / 317883949 / -1.0% 332744881 / 334753255 / -0.6% 0.95 / 0.95 / -0.4%
tpch_q14/duckdb:parquet 103785275 / 107694805 / -3.6% 137392684 / 158101843 / -13.1% 🟢 0.76 / 0.68 / +10.9%
tpch_q15/duckdb:parquet 43735495 / 44095921 / -0.8% 71059377 / 68309573 / +4.0% 0.62 / 0.65 / -4.7%
tpch_q16/duckdb:parquet 114095944 / 115296793 / -1.0% 127151107 / 126917125 / +0.2% 0.90 / 0.91 / -1.2%
tpch_q17/duckdb:parquet 73398023 / 73881175 / -0.7% 103343047 / 104392097 / -1.0% 0.71 / 0.71 / +0.4%
tpch_q18/duckdb:parquet 205240756 / 187292197 / +9.6% 177207714 / 192642728 / -8.0% 1.16 / 0.97 / +19.1%
tpch_q19/duckdb:parquet 178296674 / 162284043 / +9.9% 199458148 / 193411791 / +3.1% 0.89 / 0.84 / +6.5%
tpch_q20/duckdb:parquet 127987518 / 128798022 / -0.6% 163837909 / 171737430 / -4.6% 0.78 / 0.75 / +4.2%
tpch_q21/duckdb:parquet 274893917 / 278645335 / -1.3% 300445369 / 290148529 / +3.5% 0.91 / 0.96 / -4.7%
tpch_q22/duckdb:parquet 262744187 / 262314360 / +0.2% 273813369 / 272774113 / +0.4% 0.96 / 0.96 / -0.2%

File Size Changes (6 files changed, -0.0% overall, 2↑ 4↓)
File Scale Format Base HEAD Change %
partsupp.vortex 10.0 vortex-file-compressed 238.44 MB 238.47 MB +28.50 KB +0.0%
lineitem.vortex 10.0 vortex-file-compressed 1.56 GB 1.56 GB +208 B +0.0%
orders.vortex 10.0 vortex-file-compressed 390.34 MB 390.32 MB 22.45 KB -0.0%
part.vortex 10.0 vortex-file-compressed 48.41 MB 48.41 MB 3.38 KB -0.0%
customer.vortex 10.0 vortex-file-compressed 82.86 MB 82.66 MB 206.48 KB -0.2%
supplier.vortex 10.0 vortex-file-compressed 5.40 MB 5.36 MB 41.91 KB -0.8%

Totals:

  • vortex-file-compressed: 2.31 GB → 2.31 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR dfcb8c8e vs base 272bf1db
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+2.3%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 1.012x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.027x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 260985599 / 219584210 / +18.9% 🔴 715186062 / 590885641 / +21.0% 🔴 0.36 / 0.37 / -1.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed 13722998 / 13498680 / +1.7% 45710833 / 50361598 / -9.2% 0.30 / 0.27 / +12.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 14298773 / 13477430 / +6.1% 50951604 / 49010130 / +4.0% 0.28 / 0.27 / +2.1%
clickbench-sorted_q36/datafusion:vortex-file-compressed 29295410 / 29520992 / -0.8% 67606047 / 63159255 / +7.0% 0.43 / 0.47 / -7.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed 24667798 / 24729754 / -0.3% 56803739 / 55740851 / +1.9% 0.43 / 0.44 / -2.1%
clickbench-sorted_q38/datafusion:vortex-file-compressed 35761010 / 34714520 / +3.0% 66879918 / 71321347 / -6.2% 0.53 / 0.49 / +9.9%
clickbench-sorted_q39/datafusion:vortex-file-compressed 87657808 / 87864098 / -0.2% 114013316 / 118703929 / -4.0% 0.77 / 0.74 / +3.9%
clickbench-sorted_q40/datafusion:vortex-file-compressed 15826114 / 16312598 / -3.0% 43129483 / 45585077 / -5.4% 0.37 / 0.36 / +2.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed 16139595 / 15897434 / +1.5% 41821570 / 42552903 / -1.7% 0.39 / 0.37 / +3.3%
clickbench-sorted_q42/datafusion:vortex-file-compressed 13559914 / 13366455 / +1.4% 36760333 / 38000409 / -3.3% 0.37 / 0.35 / +4.9%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 767029644 / 760818838 / +0.8% 946948156 / 948162986 / -0.1% 0.81 / 0.80 / +0.9%
clickbench-sorted_q24/datafusion:parquet 9050329 / 9211303 / -1.7% 69359823 / 70997014 / -2.3% 0.13 / 0.13 / +0.6%
clickbench-sorted_q26/datafusion:parquet 9321438 / 9180556 / +1.5% 71087350 / 70795423 / +0.4% 0.13 / 0.13 / +1.1%
clickbench-sorted_q36/datafusion:parquet 93575022 / 93314808 / +0.3% 168788077 / 168520785 / +0.2% 0.55 / 0.55 / +0.1%
clickbench-sorted_q37/datafusion:parquet 64155664 / 63834879 / +0.5% 129334564 / 130788676 / -1.1% 0.50 / 0.49 / +1.6%
clickbench-sorted_q38/datafusion:parquet 87619302 / 86723018 / +1.0% 159358884 / 161375058 / -1.2% 0.55 / 0.54 / +2.3%
clickbench-sorted_q39/datafusion:parquet 159578280 / 158751336 / +0.5% 232737597 / 234238944 / -0.6% 0.69 / 0.68 / +1.2%
clickbench-sorted_q40/datafusion:parquet 44451535 / 44237028 / +0.5% 112652721 / 110975183 / +1.5% 0.39 / 0.40 / -1.0%
clickbench-sorted_q41/datafusion:parquet 42272628 / 41958540 / +0.7% 108301462 / 109162261 / -0.8% 0.39 / 0.38 / +1.5%
clickbench-sorted_q42/datafusion:parquet 26135016 / 26207860 / -0.3% 88135065 / 86841358 / +1.5% 0.30 / 0.30 / -1.7%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 65958420 / 66202433 / -0.4% 93022654 / 86066799 / +8.1% 0.71 / 0.77 / -7.8%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21218599 / 20269334 / +4.7% 34204312 / 29411347 / +16.3% 🔴 0.62 / 0.69 / -10.0%
clickbench-sorted_q26/duckdb:vortex-file-compressed 18448138 / 16572420 / +11.3% 🔴 24969365 / 30209476 / -17.3% 🟢 0.74 / 0.55 / +34.7%
clickbench-sorted_q36/duckdb:vortex-file-compressed 42533028 / 45163340 / -5.8% 71360245 / 76283807 / -6.5% 0.60 / 0.59 / +0.7%
clickbench-sorted_q37/duckdb:vortex-file-compressed 37146817 / 37147750 / -0.0% 60692826 / 62662096 / -3.1% 0.61 / 0.59 / +3.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed 48017598 / 47648364 / +0.8% 74081233 / 74848067 / -1.0% 0.65 / 0.64 / +1.8%
clickbench-sorted_q39/duckdb:vortex-file-compressed 114894098 / 118469542 / -3.0% 135795985 / 144989856 / -6.3% 0.85 / 0.82 / +3.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed 20718483 / 20697158 / +0.1% 41990680 / 38913856 / +7.9% 0.49 / 0.53 / -7.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed 20960260 / 21546378 / -2.7% 42753340 / 40480758 / +5.6% 0.49 / 0.53 / -7.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed 18293641 / 19541864 / -6.4% 37420089 / 38730091 / -3.4% 0.49 / 0.50 / -3.1%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 123851028 / 124536020 / -0.6% 143529233 / 141340556 / +1.5% 0.86 / 0.88 / -2.1%
clickbench-sorted_q24/duckdb:parquet 17471010 / 18368558 / -4.9% 27234900 / 29951977 / -9.1% 0.64 / 0.61 / +4.6%
clickbench-sorted_q26/duckdb:parquet 14263552 / 14716861 / -3.1% 21964837 / 21136090 / +3.9% 0.65 / 0.70 / -6.7%
clickbench-sorted_q36/duckdb:parquet 44041791 / 44272747 / -0.5% 70325973 / 60824810 / +15.6% 🔴 0.63 / 0.73 / -14.0%
clickbench-sorted_q37/duckdb:parquet 31141108 / 29913068 / +4.1% 47244527 / 46395451 / +1.8% 0.66 / 0.64 / +2.2%
clickbench-sorted_q38/duckdb:parquet 39803464 / 39321416 / +1.2% 56720543 / 54888740 / +3.3% 0.70 / 0.72 / -2.0%
clickbench-sorted_q39/duckdb:parquet 73784602 / 74105479 / -0.4% 89137694 / 86885994 / +2.6% 0.83 / 0.85 / -2.9%
clickbench-sorted_q40/duckdb:parquet 16815339 / 17036562 / -1.3% 34819161 / 35258336 / -1.2% 0.48 / 0.48 / -0.1%
clickbench-sorted_q41/duckdb:parquet 16738870 / 17001125 / -1.5% 37055704 / 36791090 / +0.7% 0.45 / 0.46 / -2.2%
clickbench-sorted_q42/duckdb:parquet 10973185 / 11186195 / -1.9% 26263334 / 22979239 / +14.3% 🔴 0.42 / 0.49 / -14.2%

File Size Changes (100 files changed, +0.0% overall, 46↑ 54↓)
File Scale Format Base HEAD Change %
hits_049.vortex 1.0 vortex-file-compressed 190.45 MB 193.50 MB +3.04 MB +1.6%
hits_053.vortex 1.0 vortex-file-compressed 188.99 MB 191.15 MB +2.16 MB +1.1%
hits_038.vortex 1.0 vortex-file-compressed 189.23 MB 190.99 MB +1.76 MB +0.9%
hits_090.vortex 1.0 vortex-file-compressed 191.50 MB 193.26 MB +1.77 MB +0.9%
hits_070.vortex 1.0 vortex-file-compressed 197.93 MB 199.24 MB +1.31 MB +0.7%
hits_033.vortex 1.0 vortex-file-compressed 198.03 MB 199.30 MB +1.26 MB +0.6%
hits_022.vortex 1.0 vortex-file-compressed 197.46 MB 198.36 MB +922.07 KB +0.5%
hits_027.vortex 1.0 vortex-file-compressed 190.34 MB 191.09 MB +768.55 KB +0.4%
hits_035.vortex 1.0 vortex-file-compressed 102.21 MB 102.58 MB +374.44 KB +0.4%
hits_061.vortex 1.0 vortex-file-compressed 159.90 MB 160.39 MB +494.16 KB +0.3%
hits_084.vortex 1.0 vortex-file-compressed 153.70 MB 154.15 MB +452.06 KB +0.3%
hits_037.vortex 1.0 vortex-file-compressed 176.25 MB 176.65 MB +408.27 KB +0.2%
hits_040.vortex 1.0 vortex-file-compressed 142.18 MB 142.46 MB +291.02 KB +0.2%
hits_042.vortex 1.0 vortex-file-compressed 200.60 MB 200.95 MB +356.52 KB +0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.38 MB 130.60 MB +222.41 KB +0.2%
hits_098.vortex 1.0 vortex-file-compressed 136.59 MB 136.81 MB +232.35 KB +0.2%
hits_026.vortex 1.0 vortex-file-compressed 130.36 MB 130.56 MB +205.51 KB +0.2%
hits_055.vortex 1.0 vortex-file-compressed 199.19 MB 199.44 MB +258.09 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 190.06 MB 190.28 MB +234.51 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.11 MB 126.24 MB +132.83 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 171.82 MB 172.00 MB +177.15 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 159.90 MB 160.06 MB +159.81 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 129.97 MB 130.09 MB +125.86 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.56 MB 100.65 MB +95.25 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 138.61 MB 138.72 MB +112.07 KB +0.1%
hits_031.vortex 1.0 vortex-file-compressed 158.43 MB 158.55 MB +121.68 KB +0.1%
hits_092.vortex 1.0 vortex-file-compressed 198.83 MB 198.97 MB +137.81 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 160.25 MB 160.34 MB +98.48 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.73 MB 130.81 MB +77.68 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 171.67 MB 171.76 MB +86.26 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.60 MB 141.66 MB +60.09 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 198.57 MB 198.64 MB +68.48 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 171.36 MB 171.42 MB +57.20 KB +0.0%
hits_068.vortex 1.0 vortex-file-compressed 159.53 MB 159.58 MB +49.84 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 134.47 MB 134.51 MB +40.30 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 159.94 MB 159.99 MB +45.92 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 166.58 MB 166.62 MB +33.72 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 138.64 MB 138.66 MB +24.45 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 160.01 MB 160.04 MB +24.48 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.73 MB 135.75 MB +19.57 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 160.00 MB 160.01 MB +14.38 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.71 MB 153.72 MB +13.18 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 150.62 MB 150.63 MB +12.27 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.84 MB 145.84 MB +3.12 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 170.63 MB 170.63 MB +3.58 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 171.32 MB 171.32 MB +1.78 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 170.50 MB 170.49 MB 12.13 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.09 MB 156.08 MB 11.61 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 171.66 MB 171.65 MB 16.73 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.08 MB 199.05 MB 29.88 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 160.14 MB 160.10 MB 34.39 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.62 MB 125.59 MB 32.01 KB -0.0%
hits_096.vortex 1.0 vortex-file-compressed 198.80 MB 198.74 MB 56.75 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.36 MB 153.31 MB 46.40 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 130.94 MB 130.90 MB 39.95 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.12 MB 168.06 MB 58.96 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.15 MB 130.10 MB 46.20 KB -0.0%
hits_059.vortex 1.0 vortex-file-compressed 198.44 MB 198.37 MB 71.78 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.14 MB 146.08 MB 56.16 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.81 MB 125.76 MB 50.13 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.21 MB 160.15 MB 63.88 KB -0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.17 MB 190.09 MB 76.29 KB -0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.76 MB 130.71 MB 57.29 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.26 MB 194.18 MB 87.45 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.75 MB 130.69 MB 59.10 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.57 MB 153.50 MB 72.39 KB -0.0%
hits_081.vortex 1.0 vortex-file-compressed 199.40 MB 199.31 MB 95.65 KB -0.0%
hits_094.vortex 1.0 vortex-file-compressed 157.91 MB 157.84 MB 78.05 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.43 MB 180.34 MB 96.34 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.33 MB 154.23 MB 107.98 KB -0.1%
hits_066.vortex 1.0 vortex-file-compressed 162.39 MB 162.28 MB 114.37 KB -0.1%
hits_071.vortex 1.0 vortex-file-compressed 138.80 MB 138.70 MB 101.88 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.50 MB 153.38 MB 122.13 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.64 MB 100.56 MB 83.70 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 188.51 MB 188.34 MB 166.15 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.80 MB 130.68 MB 124.02 KB -0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.21 MB 199.00 MB 213.38 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.17 MB 130.04 MB 140.59 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.70 MB 130.56 MB 147.69 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 180.89 MB 180.68 MB 214.02 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 199.39 MB 199.15 MB 241.70 KB -0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.06 MB 158.86 MB 197.99 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.77 MB 101.65 MB 128.40 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.81 MB 199.52 MB 300.97 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.38 MB 171.12 MB 265.63 KB -0.2%
hits_097.vortex 1.0 vortex-file-compressed 192.18 MB 191.84 MB 349.05 KB -0.2%
hits_060.vortex 1.0 vortex-file-compressed 192.50 MB 191.99 MB 526.99 KB -0.3%
hits_018.vortex 1.0 vortex-file-compressed 199.44 MB 198.85 MB 597.64 KB -0.3%
hits_054.vortex 1.0 vortex-file-compressed 146.50 MB 145.93 MB 578.97 KB -0.4%
hits_062.vortex 1.0 vortex-file-compressed 170.62 MB 169.92 MB 716.18 KB -0.4%
hits_024.vortex 1.0 vortex-file-compressed 160.16 MB 159.43 MB 741.12 KB -0.5%
hits_041.vortex 1.0 vortex-file-compressed 130.86 MB 130.27 MB 606.92 KB -0.5%
hits_019.vortex 1.0 vortex-file-compressed 140.33 MB 139.68 MB 664.73 KB -0.5%
hits_020.vortex 1.0 vortex-file-compressed 160.06 MB 159.31 MB 762.33 KB -0.5%
hits_045.vortex 1.0 vortex-file-compressed 139.41 MB 138.68 MB 741.91 KB -0.5%
hits_011.vortex 1.0 vortex-file-compressed 198.87 MB 197.83 MB 1.05 MB -0.5%
hits_016.vortex 1.0 vortex-file-compressed 180.96 MB 179.87 MB 1.09 MB -0.6%
hits_048.vortex 1.0 vortex-file-compressed 198.91 MB 197.68 MB 1.22 MB -0.6%
hits_086.vortex 1.0 vortex-file-compressed 193.23 MB 191.12 MB 2.11 MB -1.1%
hits_001.vortex 1.0 vortex-file-compressed 190.50 MB 188.03 MB 2.48 MB -1.3%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.88 GB (+0.0%)

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR dfcb8c8e vs base d6037bc2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.4%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.975x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24142100 / 24399548 / -1.1% 41568131 / 44103278 / -5.7% 0.58 / 0.55 / +5.0%
tpcds_q02/datafusion:vortex-file-compressed 45521018 / 45177461 / +0.8% 61622590 / 62618339 / -1.6% 0.74 / 0.72 / +2.4%
tpcds_q03/datafusion:vortex-file-compressed 11337552 / 11511708 / -1.5% 27955050 / 29458322 / -5.1% 0.41 / 0.39 / +3.8%
tpcds_q04/datafusion:vortex-file-compressed 113729752 / 112552974 / +1.0% 141685097 / 136974279 / +3.4% 0.80 / 0.82 / -2.3%
tpcds_q05/datafusion:vortex-file-compressed 59749154 / 60036244 / -0.5% 80318449 / 81707752 / -1.7% 0.74 / 0.73 / +1.2%
tpcds_q06/datafusion:vortex-file-compressed 22848058 / 23332818 / -2.1% 43378501 / 43998517 / -1.4% 0.53 / 0.53 / -0.7%
tpcds_q07/datafusion:vortex-file-compressed 31522413 / 31941078 / -1.3% 53576477 / 56589683 / -5.3% 0.59 / 0.56 / +4.2%
tpcds_q08/datafusion:vortex-file-compressed 26305702 / 26194690 / +0.4% 43702855 / 46309352 / -5.6% 0.60 / 0.57 / +6.4%
tpcds_q09/datafusion:vortex-file-compressed 17729648 / 17924829 / -1.1% 35058131 / 34615991 / +1.3% 0.51 / 0.52 / -2.3%
tpcds_q10/datafusion:vortex-file-compressed 29699250 / 29324514 / +1.3% 48441925 / 50782440 / -4.6% 0.61 / 0.58 / +6.2%
tpcds_q11/datafusion:vortex-file-compressed 59910128 / 59746112 / +0.3% 85377010 / 83821746 / +1.9% 0.70 / 0.71 / -1.6%
tpcds_q12/datafusion:vortex-file-compressed 16384440 / 16495472 / -0.7% 30211145 / 31847169 / -5.1% 0.54 / 0.52 / +4.7%
tpcds_q13/datafusion:vortex-file-compressed 38149666 / 36972470 / +3.2% 56335373 / 60241114 / -6.5% 0.68 / 0.61 / +10.3%
tpcds_q14/datafusion:vortex-file-compressed 92229728 / 92344486 / -0.1% 116060089 / 117818236 / -1.5% 0.79 / 0.78 / +1.4%
tpcds_q15/datafusion:vortex-file-compressed 24753255 / 25082732 / -1.3% 43552741 / 44495113 / -2.1% 0.57 / 0.56 / +0.8%
tpcds_q16/datafusion:vortex-file-compressed 21007364 / 20836804 / +0.8% 40863817 / 42961518 / -4.9% 0.51 / 0.49 / +6.0%
tpcds_q17/datafusion:vortex-file-compressed 58291264 / 54241355 / +7.5% 80331740 / 83371551 / -3.6% 0.73 / 0.65 / +11.5%
tpcds_q18/datafusion:vortex-file-compressed 68759524 / 68552398 / +0.3% 89856365 / 93339309 / -3.7% 0.77 / 0.73 / +4.2%
tpcds_q19/datafusion:vortex-file-compressed 18578260 / 17676118 / +5.1% 40446753 / 41327664 / -2.1% 0.46 / 0.43 / +7.4%
tpcds_q20/datafusion:vortex-file-compressed 17901632 / 17832842 / +0.4% 32804429 / 34785755 / -5.7% 0.55 / 0.51 / +6.4%
tpcds_q21/datafusion:vortex-file-compressed 16546986 / 16489099 / +0.4% 38616675 / 40133680 / -3.8% 0.43 / 0.41 / +4.3%
tpcds_q22/datafusion:vortex-file-compressed 49060072 / 49342713 / -0.6% 70295615 / 69968489 / +0.5% 0.70 / 0.71 / -1.0%
tpcds_q23/datafusion:vortex-file-compressed 71796307 / 72504390 / -1.0% 95381145 / 95097012 / +0.3% 0.75 / 0.76 / -1.3%
tpcds_q24/datafusion:vortex-file-compressed 69820860 / 69632965 / +0.3% 92616956 / 95980549 / -3.5% 0.75 / 0.73 / +3.9%
tpcds_q25/datafusion:vortex-file-compressed 55570650 / 54421348 / +2.1% 73244185 / 81402706 / -10.0% 🟢 0.76 / 0.67 / +13.5%
tpcds_q26/datafusion:vortex-file-compressed 30483816 / 31081816 / -1.9% 50034955 / 50538958 / -1.0% 0.61 / 0.62 / -0.9%
tpcds_q27/datafusion:vortex-file-compressed 65696872 / 63439988 / +3.6% 84802178 / 91245649 / -7.1% 0.77 / 0.70 / +11.4%
tpcds_q28/datafusion:vortex-file-compressed 17867410 / 18672442 / -4.3% 36218640 / 38660012 / -6.3% 0.49 / 0.48 / +2.1%
tpcds_q29/datafusion:vortex-file-compressed 61433602 / 60995323 / +0.7% 83997353 / 83991078 / +0.0% 0.73 / 0.73 / +0.7%
tpcds_q30/datafusion:vortex-file-compressed 27418958 / 27737518 / -1.1% 43599289 / 44451317 / -1.9% 0.63 / 0.62 / +0.8%
tpcds_q31/datafusion:vortex-file-compressed 64772632 / 63951297 / +1.3% 88406171 / 89423378 / -1.1% 0.73 / 0.72 / +2.4%
tpcds_q32/datafusion:vortex-file-compressed 13843900 / 14095239 / -1.8% 30722736 / 30960856 / -0.8% 0.45 / 0.46 / -1.0%
tpcds_q33/datafusion:vortex-file-compressed 27078412 / 26822922 / +1.0% 46011844 / 48579532 / -5.3% 0.59 / 0.55 / +6.6%
tpcds_q34/datafusion:vortex-file-compressed 18226954 / 18001266 / +1.3% 35404422 / 37959622 / -6.7% 0.51 / 0.47 / +8.6%
tpcds_q35/datafusion:vortex-file-compressed 34933888 / 34866800 / +0.2% 53707086 / 56816537 / -5.5% 0.65 / 0.61 / +6.0%
tpcds_q36/datafusion:vortex-file-compressed 47124466 / 48026406 / -1.9% 68071369 / 69208423 / -1.6% 0.69 / 0.69 / -0.2%
tpcds_q37/datafusion:vortex-file-compressed 13391312 / 13092668 / +2.3% 32503050 / 35964204 / -9.6% 0.41 / 0.36 / +13.2%
tpcds_q38/datafusion:vortex-file-compressed 29691126 / 30197609 / -1.7% 50202531 / 51154218 / -1.9% 0.59 / 0.59 / +0.2%
tpcds_q39/datafusion:vortex-file-compressed 64481208 / 65054536 / -0.9% 89887532 / 90974119 / -1.2% 0.72 / 0.72 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 25173584 / 25493856 / -1.3% 44330801 / 43534774 / +1.8% 0.57 / 0.59 / -3.0%
tpcds_q41/datafusion:vortex-file-compressed 16555626 / 16620438 / -0.4% 29905502 / 30588224 / -2.2% 0.55 / 0.54 / +1.9%
tpcds_q42/datafusion:vortex-file-compressed 11173442 / 11162966 / +0.1% 27067826 / 28553133 / -5.2% 0.41 / 0.39 / +5.6%
tpcds_q43/datafusion:vortex-file-compressed 12628126 / 12963074 / -2.6% 30709775 / 31578469 / -2.8% 0.41 / 0.41 / +0.2%
tpcds_q44/datafusion:vortex-file-compressed 26348678 / 26279076 / +0.3% 47577884 / 49252953 / -3.4% 0.55 / 0.53 / +3.8%
tpcds_q45/datafusion:vortex-file-compressed 28145264 / 28354808 / -0.7% 46946698 / 51738236 / -9.3% 0.60 / 0.55 / +9.4%
tpcds_q46/datafusion:vortex-file-compressed 24130454 / 23446816 / +2.9% 46993813 / 47621698 / -1.3% 0.51 / 0.49 / +4.3%
tpcds_q47/datafusion:vortex-file-compressed 77254410 / 76726424 / +0.7% 104215161 / 105021620 / -0.8% 0.74 / 0.73 / +1.5%
tpcds_q48/datafusion:vortex-file-compressed 31971927 / 31815548 / +0.5% 51285578 / 52795720 / -2.9% 0.62 / 0.60 / +3.5%
tpcds_q49/datafusion:vortex-file-compressed 60511444 / 60309459 / +0.3% 84137979 / 84454692 / -0.4% 0.72 / 0.71 / +0.7%
tpcds_q50/datafusion:vortex-file-compressed 33620294 / 33506198 / +0.3% 54379283 / 52761911 / +3.1% 0.62 / 0.64 / -2.6%
tpcds_q51/datafusion:vortex-file-compressed 60896066 / 61149042 / -0.4% 82250314 / 82554279 / -0.4% 0.74 / 0.74 / -0.0%
tpcds_q52/datafusion:vortex-file-compressed 11573853 / 11615596 / -0.4% 26739027 / 28440405 / -6.0% 0.43 / 0.41 / +6.0%
tpcds_q53/datafusion:vortex-file-compressed 18296956 / 18249028 / +0.3% 36143764 / 38827685 / -6.9% 0.51 / 0.47 / +7.7%
tpcds_q54/datafusion:vortex-file-compressed 33639854 / 33329752 / +0.9% 56547388 / 58540645 / -3.4% 0.59 / 0.57 / +4.5%
tpcds_q55/datafusion:vortex-file-compressed 11146444 / 10980938 / +1.5% 27327478 / 27876283 / -2.0% 0.41 / 0.39 / +3.5%
tpcds_q56/datafusion:vortex-file-compressed 26340358 / 26699310 / -1.3% 46464278 / 47490051 / -2.2% 0.57 / 0.56 / +0.8%
tpcds_q57/datafusion:vortex-file-compressed 74402560 / 73711550 / +0.9% 95055094 / 96034992 / -1.0% 0.78 / 0.77 / +2.0%
tpcds_q58/datafusion:vortex-file-compressed 41004037 / 40934770 / +0.2% 65721601 / 65408875 / +0.5% 0.62 / 0.63 / -0.3%
tpcds_q59/datafusion:vortex-file-compressed 31013206 / 31288470 / -0.9% 49892872 / 51993241 / -4.0% 0.62 / 0.60 / +3.3%
tpcds_q60/datafusion:vortex-file-compressed 25685352 / 25927618 / -0.9% 45988092 / 46499183 / -1.1% 0.56 / 0.56 / +0.2%
tpcds_q61/datafusion:vortex-file-compressed 23022350 / 24278832 / -5.2% 44457981 / 45578954 / -2.5% 0.52 / 0.53 / -2.8%
tpcds_q62/datafusion:vortex-file-compressed 17487388 / 17505090 / -0.1% 34243068 / 35250183 / -2.9% 0.51 / 0.50 / +2.8%
tpcds_q63/datafusion:vortex-file-compressed 18521270 / 18416131 / +0.6% 37875814 / 39121241 / -3.2% 0.49 / 0.47 / +3.9%
tpcds_q64/datafusion:vortex-file-compressed 333460492 / 332041250 / +0.4% 364195087 / 352918264 / +3.2% 0.92 / 0.94 / -2.7%
tpcds_q65/datafusion:vortex-file-compressed 76224004 / 74936724 / +1.7% 96010267 / 93152613 / +3.1% 0.79 / 0.80 / -1.3%
tpcds_q66/datafusion:vortex-file-compressed 53322115 / 52791760 / +1.0% 74386148 / 74775894 / -0.5% 0.72 / 0.71 / +1.5%
tpcds_q67/datafusion:vortex-file-compressed 55557386 / 55078896 / +0.9% 80930102 / 82617975 / -2.0% 0.69 / 0.67 / +3.0%
tpcds_q68/datafusion:vortex-file-compressed 23344830 / 22878631 / +2.0% 45046979 / 48249366 / -6.6% 0.52 / 0.47 / +9.3%
tpcds_q69/datafusion:vortex-file-compressed 27981014 / 27948594 / +0.1% 46917159 / 48384769 / -3.0% 0.60 / 0.58 / +3.2%
tpcds_q70/datafusion:vortex-file-compressed 69628368 / 69692778 / -0.1% 90435518 / 90381576 / +0.1% 0.77 / 0.77 / -0.2%
tpcds_q71/datafusion:vortex-file-compressed 19975908 / 19923009 / +0.3% 41097787 / 40134753 / +2.4% 0.49 / 0.50 / -2.1%
tpcds_q72/datafusion:vortex-file-compressed 462217600 / 450468334 / +2.6% 501095736 / 483761378 / +3.6% 0.92 / 0.93 / -0.9%
tpcds_q73/datafusion:vortex-file-compressed 16741128 / 17066094 / -1.9% 35474412 / 35528831 / -0.2% 0.47 / 0.48 / -1.8%
tpcds_q74/datafusion:vortex-file-compressed 44913428 / 44700060 / +0.5% 66987350 / 67851244 / -1.3% 0.67 / 0.66 / +1.8%
tpcds_q75/datafusion:vortex-file-compressed 130811712 / 129753166 / +0.8% 158638017 / 156069041 / +1.6% 0.82 / 0.83 / -0.8%
tpcds_q76/datafusion:vortex-file-compressed 41642104 / 44094140 / -5.6% 60626528 / 60885950 / -0.4% 0.69 / 0.72 / -5.2%
tpcds_q77/datafusion:vortex-file-compressed 34146426 / 34852496 / -2.0% 54465643 / 58703883 / -7.2% 0.63 / 0.59 / +5.6%
tpcds_q78/datafusion:vortex-file-compressed 79965228 / 79415490 / +0.7% 105727495 / 106936337 / -1.1% 0.76 / 0.74 / +1.8%
tpcds_q79/datafusion:vortex-file-compressed 20889452 / 20339480 / +2.7% 38404589 / 41377578 / -7.2% 0.54 / 0.49 / +10.7%
tpcds_q80/datafusion:vortex-file-compressed 77943400 / 77063866 / +1.1% 107056469 / 105898205 / +1.1% 0.73 / 0.73 / +0.0%
tpcds_q81/datafusion:vortex-file-compressed 28154691 / 27938698 / +0.8% 43331311 / 44751360 / -3.2% 0.65 / 0.62 / +4.1%
tpcds_q82/datafusion:vortex-file-compressed 13825916 / 14249769 / -3.0% 33824127 / 37112275 / -8.9% 0.41 / 0.38 / +6.5%
tpcds_q83/datafusion:vortex-file-compressed 36509492 / 36104518 / +1.1% 55217529 / 53516558 / +3.2% 0.66 / 0.67 / -2.0%
tpcds_q84/datafusion:vortex-file-compressed 12601777 / 12296723 / +2.5% 27163196 / 28733536 / -5.5% 0.46 / 0.43 / +8.4%
tpcds_q85/datafusion:vortex-file-compressed 63166812 / 62334178 / +1.3% 83316372 / 85420667 / -2.5% 0.76 / 0.73 / +3.9%
tpcds_q86/datafusion:vortex-file-compressed 16443194 / 16389846 / +0.3% 31711065 / 33143624 / -4.3% 0.52 / 0.49 / +4.9%
tpcds_q87/datafusion:vortex-file-compressed 29600647 / 29573240 / +0.1% 49350085 / 49882658 / -1.1% 0.60 / 0.59 / +1.2%
tpcds_q88/datafusion:vortex-file-compressed 32319772 / 31718280 / +1.9% 58668147 / 59794400 / -1.9% 0.55 / 0.53 / +3.9%
tpcds_q89/datafusion:vortex-file-compressed 21117866 / 20785700 / +1.6% 39560190 / 41913608 / -5.6% 0.53 / 0.50 / +7.6%
tpcds_q90/datafusion:vortex-file-compressed 10705314 / 10497372 / +2.0% 26335493 / 26902312 / -2.1% 0.41 / 0.39 / +4.2%
tpcds_q91/datafusion:vortex-file-compressed 17461642 / 17096558 / +2.1% 36289027 / 36788079 / -1.4% 0.48 / 0.46 / +3.5%
tpcds_q92/datafusion:vortex-file-compressed 13899808 / 13837458 / +0.5% 30276220 / 31308089 / -3.3% 0.46 / 0.44 / +3.9%
tpcds_q93/datafusion:vortex-file-compressed 22723908 / 23263329 / -2.3% 43978241 / 46687812 / -5.8% 0.52 / 0.50 / +3.7%
tpcds_q94/datafusion:vortex-file-compressed 20130561 / 19958160 / +0.9% 39136017 / 38633890 / +1.3% 0.51 / 0.52 / -0.4%
tpcds_q95/datafusion:vortex-file-compressed 46265060 / 46424406 / -0.3% 66062206 / 69437859 / -4.9% 0.70 / 0.67 / +4.7%
tpcds_q96/datafusion:vortex-file-compressed 8208986 / 8344972 / -1.6% 24089986 / 23843438 / +1.0% 0.34 / 0.35 / -2.6%
tpcds_q97/datafusion:vortex-file-compressed 20543405 / 20970473 / -2.0% 42450065 / 42548881 / -0.2% 0.48 / 0.49 / -1.8%
tpcds_q98/datafusion:vortex-file-compressed 17199690 / 16908055 / +1.7% 34414550 / 35230679 / -2.3% 0.50 / 0.48 / +4.1%
tpcds_q99/datafusion:vortex-file-compressed 20196654 / 20293213 / -0.5% 38713827 / 38754807 / -0.1% 0.52 / 0.52 / -0.4%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29403315 / 30935998 / -5.0% 49112508 / 50562502 / -2.9% 0.60 / 0.61 / -2.1%
tpcds_q02/datafusion:parquet 45292194 / 45200922 / +0.2% 61395942 / 59041692 / +4.0% 0.74 / 0.77 / -3.6%
tpcds_q03/datafusion:parquet 18547792 / 18926213 / -2.0% 30585866 / 31509095 / -2.9% 0.61 / 0.60 / +1.0%
tpcds_q04/datafusion:parquet 194079762 / 194939764 / -0.4% 219432852 / 223126562 / -1.7% 0.88 / 0.87 / +1.2%
tpcds_q05/datafusion:parquet 72726105 / 70438303 / +3.2% 90720938 / 90973348 / -0.3% 0.80 / 0.77 / +3.5%
tpcds_q06/datafusion:parquet 34406144 / 35165927 / -2.2% 49438872 / 50704459 / -2.5% 0.70 / 0.69 / +0.3%
tpcds_q07/datafusion:parquet 45464640 / 46689342 / -2.6% 63877996 / 66217070 / -3.5% 0.71 / 0.71 / +0.9%
tpcds_q08/datafusion:parquet 39514670 / 39169563 / +0.9% 52995743 / 51527564 / +2.8% 0.75 / 0.76 / -1.9%
tpcds_q09/datafusion:parquet 28458150 / 31081165 / -8.4% 36913326 / 39657919 / -6.9% 0.77 / 0.78 / -1.6%
tpcds_q10/datafusion:parquet 49970304 / 49954590 / +0.0% 63904645 / 61701411 / +3.6% 0.78 / 0.81 / -3.4%
tpcds_q11/datafusion:parquet 94658759 / 92950558 / +1.8% 113990724 / 115753121 / -1.5% 0.83 / 0.80 / +3.4%
tpcds_q12/datafusion:parquet 24341426 / 24301670 / +0.2% 35409275 / 35268626 / +0.4% 0.69 / 0.69 / -0.2%
tpcds_q13/datafusion:parquet 43846256 / 45609725 / -3.9% 68496271 / 67289629 / +1.8% 0.64 / 0.68 / -5.6%
tpcds_q14/datafusion:parquet 140050739 / 137481466 / +1.9% 154214350 / 158689037 / -2.8% 0.91 / 0.87 / +4.8%
tpcds_q15/datafusion:parquet 30996971 / 31333569 / -1.1% 48341430 / 48640508 / -0.6% 0.64 / 0.64 / -0.5%
tpcds_q16/datafusion:parquet 37241046 / 37133820 / +0.3% 56678593 / 54479503 / +4.0% 0.66 / 0.68 / -3.6%
tpcds_q17/datafusion:parquet 74296675 / 74028865 / +0.4% 100363188 / 104354224 / -3.8% 0.74 / 0.71 / +4.4%
tpcds_q18/datafusion:parquet 58583283 / 57396334 / +2.1% 82221317 / 76631451 / +7.3% 0.71 / 0.75 / -4.9%
tpcds_q19/datafusion:parquet 31695300 / 31672409 / +0.1% 49431869 / 51004128 / -3.1% 0.64 / 0.62 / +3.3%
tpcds_q20/datafusion:parquet 25436264 / 25408234 / +0.1% 34936178 / 39443122 / -11.4% 🟢 0.73 / 0.64 / +13.0%
tpcds_q21/datafusion:parquet 20366872 / 20331385 / +0.2% 34159341 / 31828759 / +7.3% 0.60 / 0.64 / -6.7%
tpcds_q22/datafusion:parquet 77081646 / 77627236 / -0.7% 91467611 / 91065472 / +0.4% 0.84 / 0.85 / -1.1%
tpcds_q23/datafusion:parquet 117871104 / 113872852 / +3.5% 142608902 / 141354946 / +0.9% 0.83 / 0.81 / +2.6%
tpcds_q24/datafusion:parquet 91101098 / 90147799 / +1.1% 116974328 / 114608644 / +2.1% 0.78 / 0.79 / -1.0%
tpcds_q25/datafusion:parquet 75237080 / 75000082 / +0.3% 99960810 / 98658560 / +1.3% 0.75 / 0.76 / -1.0%
tpcds_q26/datafusion:parquet 41819962 / 42118034 / -0.7% 58788905 / 59811652 / -1.7% 0.71 / 0.70 / +1.0%
tpcds_q27/datafusion:parquet 77104246 / 77145153 / -0.1% 102753677 / 104180522 / -1.4% 0.75 / 0.74 / +1.3%
tpcds_q28/datafusion:parquet 26785630 / 26776391 / +0.0% 44318415 / 43382610 / +2.2% 0.60 / 0.62 / -2.1%
tpcds_q29/datafusion:parquet 76095236 / 75524293 / +0.8% 102142710 / 103239621 / -1.1% 0.74 / 0.73 / +1.8%
tpcds_q30/datafusion:parquet 44872902 / 46442266 / -3.4% 63907855 / 65177385 / -1.9% 0.70 / 0.71 / -1.5%
tpcds_q31/datafusion:parquet 89374937 / 88558954 / +0.9% 107977148 / 104253809 / +3.6% 0.83 / 0.85 / -2.6%
tpcds_q32/datafusion:parquet 25762058 / 25385418 / +1.5% 40417805 / 41003856 / -1.4% 0.64 / 0.62 / +3.0%
tpcds_q33/datafusion:parquet 40199222 / 39069677 / +2.9% 52788495 / 52955369 / -0.3% 0.76 / 0.74 / +3.2%
tpcds_q34/datafusion:parquet 23786058 / 23615276 / +0.7% 36119211 / 36967856 / -2.3% 0.66 / 0.64 / +3.1%
tpcds_q35/datafusion:parquet 54546192 / 55028627 / -0.9% 72014328 / 72267445 / -0.4% 0.76 / 0.76 / -0.5%
tpcds_q36/datafusion:parquet 50641779 / 52045702 / -2.7% 70983882 / 71473567 / -0.7% 0.71 / 0.73 / -2.0%
tpcds_q37/datafusion:parquet 25215450 / 25893606 / -2.6% 41080956 / 39119292 / +5.0% 0.61 / 0.66 / -7.3%
tpcds_q38/datafusion:parquet 44929726 / 44242203 / +1.6% 60957940 / 62938824 / -3.1% 0.74 / 0.70 / +4.9%
tpcds_q39/datafusion:parquet 71697416 / 71874782 / -0.2% 89090974 / 89166621 / -0.1% 0.80 / 0.81 / -0.2%
tpcds_q40/datafusion:parquet 29355535 / 28384260 / +3.4% 49255906 / 49888408 / -1.3% 0.60 / 0.57 / +4.7%
tpcds_q41/datafusion:parquet 19456262 / 20556382 / -5.4% 33033756 / 33096574 / -0.2% 0.59 / 0.62 / -5.2%
tpcds_q42/datafusion:parquet 18081340 / 17957516 / +0.7% 30113515 / 31560733 / -4.6% 0.60 / 0.57 / +5.5%
tpcds_q43/datafusion:parquet 19527844 / 19332442 / +1.0% 33398143 / 33407068 / -0.0% 0.58 / 0.58 / +1.0%
tpcds_q44/datafusion:parquet 33979782 / 33575655 / +1.2% 51274367 / 51068525 / +0.4% 0.66 / 0.66 / +0.8%
tpcds_q45/datafusion:parquet 38042903 / 37993418 / +0.1% 52921540 / 53213741 / -0.5% 0.72 / 0.71 / +0.7%
tpcds_q46/datafusion:parquet 29140098 / 29463263 / -1.1% 49590890 / 49143133 / +0.9% 0.59 / 0.60 / -2.0%
tpcds_q47/datafusion:parquet 98680428 / 98495040 / +0.2% 124403525 / 123088282 / +1.1% 0.79 / 0.80 / -0.9%
tpcds_q48/datafusion:parquet 40908460 / 41949387 / -2.5% 59626589 / 61147874 / -2.5% 0.69 / 0.69 / +0.0%
tpcds_q49/datafusion:parquet 74310458 / 74818625 / -0.7% 96089894 / 95276559 / +0.9% 0.77 / 0.79 / -1.5%
tpcds_q50/datafusion:parquet 47280672 / 47560402 / -0.6% 68123899 / 68632701 / -0.7% 0.69 / 0.69 / +0.2%
tpcds_q51/datafusion:parquet 70990524 / 71157570 / -0.2% 84299398 / 91726861 / -8.1% 0.84 / 0.78 / +8.6%
tpcds_q52/datafusion:parquet 18544402 / 18646448 / -0.5% 33142867 / 32233703 / +2.8% 0.56 / 0.58 / -3.3%
tpcds_q53/datafusion:parquet 22653109 / 22186510 / +2.1% 39579340 / 38955097 / +1.6% 0.57 / 0.57 / +0.5%
tpcds_q54/datafusion:parquet 55142506 / 53822855 / +2.5% 73186548 / 75449886 / -3.0% 0.75 / 0.71 / +5.6%
tpcds_q55/datafusion:parquet 18211396 / 18092693 / +0.7% 30533025 / 31513125 / -3.1% 0.60 / 0.57 / +3.9%
tpcds_q56/datafusion:parquet 45538474 / 44883793 / +1.5% 60940058 / 61183702 / -0.4% 0.75 / 0.73 / +1.9%
tpcds_q57/datafusion:parquet 99044746 / 100059494 / -1.0% 115928333 / 117209076 / -1.1% 0.85 / 0.85 / +0.1%
tpcds_q58/datafusion:parquet 64184232 / 64110570 / +0.1% 80705863 / 83547357 / -3.4% 0.80 / 0.77 / +3.6%
tpcds_q59/datafusion:parquet 47523384 / 47985834 / -1.0% 61781413 / 64963856 / -4.9% 0.77 / 0.74 / +4.1%
tpcds_q60/datafusion:parquet 45285092 / 45757204 / -1.0% 61359020 / 59891797 / +2.4% 0.74 / 0.76 / -3.4%
tpcds_q61/datafusion:parquet 37295098 / 37629775 / -0.9% 60385495 / 60410641 / -0.0% 0.62 / 0.62 / -0.8%
tpcds_q62/datafusion:parquet 25775956 / 24806766 / +3.9% 38643056 / 37956361 / +1.8% 0.67 / 0.65 / +2.1%
tpcds_q63/datafusion:parquet 22496706 / 22381012 / +0.5% 38671306 / 39466968 / -2.0% 0.58 / 0.57 / +2.6%
tpcds_q64/datafusion:parquet 206111437 / 204074782 / +1.0% 232493121 / 234950902 / -1.0% 0.89 / 0.87 / +2.1%
tpcds_q65/datafusion:parquet 37196696 / 37459104 / -0.7% 54988505 / 52403882 / +4.9% 0.68 / 0.71 / -5.4%
tpcds_q66/datafusion:parquet 61808570 / 60835616 / +1.6% 79596565 / 78800200 / +1.0% 0.78 / 0.77 / +0.6%
tpcds_q67/datafusion:parquet 69529909 / 69517751 / +0.0% 94815307 / 94623963 / +0.2% 0.73 / 0.73 / -0.2%
tpcds_q68/datafusion:parquet 28093146 / 29525924 / -4.9% 48250418 / 49916810 / -3.3% 0.58 / 0.59 / -1.6%
tpcds_q69/datafusion:parquet 49040322 / 50366937 / -2.6% 64731872 / 67196559 / -3.7% 0.76 / 0.75 / +1.1%
tpcds_q70/datafusion:parquet 37157034 / 36924100 / +0.6% 55353211 / 56617582 / -2.2% 0.67 / 0.65 / +2.9%
tpcds_q71/datafusion:parquet 28382272 / 27149503 / +4.5% 42298886 / 43353198 / -2.4% 0.67 / 0.63 / +7.1%
tpcds_q72/datafusion:parquet 560334332 / 562322333 / -0.4% 588812000 / 589115760 / -0.1% 0.95 / 0.95 / -0.3%
tpcds_q73/datafusion:parquet 23095402 / 22783696 / +1.4% 37981523 / 38087114 / -0.3% 0.61 / 0.60 / +1.6%
tpcds_q74/datafusion:parquet 67096515 / 68922596 / -2.6% 87040411 / 88023625 / -1.1% 0.77 / 0.78 / -1.5%
tpcds_q75/datafusion:parquet 150458766 / 145194639 / +3.6% 174643887 / 169420082 / +3.1% 0.86 / 0.86 / +0.5%
tpcds_q76/datafusion:parquet 52983764 / 53298780 / -0.6% 71168585 / 67406065 / +5.6% 0.74 / 0.79 / -5.8%
tpcds_q77/datafusion:parquet 56108298 / 55127777 / +1.8% 76802160 / 75018143 / +2.4% 0.73 / 0.73 / -0.6%
tpcds_q78/datafusion:parquet 91850498 / 92808430 / -1.0% 119108642 / 119338885 / -0.2% 0.77 / 0.78 / -0.8%
tpcds_q79/datafusion:parquet 25875502 / 25923438 / -0.2% 43677830 / 44064912 / -0.9% 0.59 / 0.59 / +0.7%
tpcds_q80/datafusion:parquet 81301234 / 81979336 / -0.8% 110342762 / 112821458 / -2.2% 0.74 / 0.73 / +1.4%
tpcds_q81/datafusion:parquet 42677756 / 40491206 / +5.4% 59918395 / 61291286 / -2.2% 0.71 / 0.66 / +7.8%
tpcds_q82/datafusion:parquet 26764094 / 26164786 / +2.3% 40044171 / 40038666 / +0.0% 0.67 / 0.65 / +2.3%
tpcds_q83/datafusion:parquet 58782957 / 57467336 / +2.3% 77473309 / 77315143 / +0.2% 0.76 / 0.74 / +2.1%
tpcds_q84/datafusion:parquet 29753115 / 30262945 / -1.7% 46210306 / 43064970 / +7.3% 0.64 / 0.70 / -8.4%
tpcds_q85/datafusion:parquet 83181776 / 82910382 / +0.3% 105960359 / 106993982 / -1.0% 0.79 / 0.77 / +1.3%
tpcds_q86/datafusion:parquet 20355875 / 20274558 / +0.4% 34076774 / 34795681 / -2.1% 0.60 / 0.58 / +2.5%
tpcds_q87/datafusion:parquet 46620412 / 46960876 / -0.7% 62665974 / 64758733 / -3.2% 0.74 / 0.73 / +2.6%
tpcds_q88/datafusion:parquet 49773548 / 46638045 / +6.7% 63813129 / 64994054 / -1.8% 0.78 / 0.72 / +8.7%
tpcds_q89/datafusion:parquet 26182170 / 25541054 / +2.5% 43024470 / 42782698 / +0.6% 0.61 / 0.60 / +1.9%
tpcds_q90/datafusion:parquet 20305328 / 19182770 / +5.9% 31655408 / 32641252 / -3.0% 0.64 / 0.59 / +9.1%
tpcds_q91/datafusion:parquet 36536804 / 36974026 / -1.2% 53224851 / 54805310 / -2.9% 0.69 / 0.67 / +1.8%
tpcds_q92/datafusion:parquet 25929948 / 26069692 / -0.5% 40671866 / 40744090 / -0.2% 0.64 / 0.64 / -0.4%
tpcds_q93/datafusion:parquet 26179218 / 26915638 / -2.7% 47340957 / 47267585 / +0.2% 0.55 / 0.57 / -2.9%
tpcds_q94/datafusion:parquet 34468992 / 34614050 / -0.4% 49590142 / 49328487 / +0.5% 0.70 / 0.70 / -0.9%
tpcds_q95/datafusion:parquet 64590809 / 64861340 / -0.4% 79566736 / 78743039 / +1.0% 0.81 / 0.82 / -1.4%
tpcds_q96/datafusion:parquet 16425225 / 16814866 / -2.3% 28825364 / 30981778 / -7.0% 0.57 / 0.54 / +5.0%
tpcds_q97/datafusion:parquet 34868478 / 35177364 / -0.9% 51438166 / 52915844 / -2.8% 0.68 / 0.66 / +2.0%
tpcds_q98/datafusion:parquet 25074202 / 25111460 / -0.1% 38566502 / 39760706 / -3.0% 0.65 / 0.63 / +2.9%
tpcds_q99/datafusion:parquet 29450510 / 29588132 / -0.5% 43354453 / 42840674 / +1.2% 0.68 / 0.69 / -1.6%
duckdb / vortex-file-compressed / ns (0.999x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15405581 / 15165242 / +1.6% 22666919 / 26233844 / -13.6% 🟢 0.68 / 0.58 / +17.6%
tpcds_q02/duckdb:vortex-file-compressed 15778533 / 15380758 / +2.6% 20408894 / 20609394 / -1.0% 0.77 / 0.75 / +3.6%
tpcds_q03/duckdb:vortex-file-compressed 11577724 / 12375548 / -6.4% 19041042 / 21174389 / -10.1% 🟢 0.61 / 0.58 / +4.0%
tpcds_q04/duckdb:vortex-file-compressed 52788992 / 52315528 / +0.9% 61386044 / 63646408 / -3.6% 0.86 / 0.82 / +4.6%
tpcds_q05/duckdb:vortex-file-compressed 19525194 / 19570788 / -0.2% 27899595 / 28011121 / -0.4% 0.70 / 0.70 / +0.2%
tpcds_q06/duckdb:vortex-file-compressed 27326866 / 27176047 / +0.6% 39187054 / 40037693 / -2.1% 0.70 / 0.68 / +2.7%
tpcds_q07/duckdb:vortex-file-compressed 15807868 / 15632729 / +1.1% 25894700 / 28156092 / -8.0% 0.61 / 0.56 / +10.0%
tpcds_q08/duckdb:vortex-file-compressed 22956789 / 23237125 / -1.2% 31555530 / 36097109 / -12.6% 🟢 0.73 / 0.64 / +13.0%
tpcds_q09/duckdb:vortex-file-compressed 10517512 / 10740193 / -2.1% 17732346 / 18698725 / -5.2% 0.59 / 0.57 / +3.3%
tpcds_q10/duckdb:vortex-file-compressed 30417520 / 30754948 / -1.1% 42983759 / 43140283 / -0.4% 0.71 / 0.71 / -0.7%
tpcds_q11/duckdb:vortex-file-compressed 41142698 / 41101447 / +0.1% 53645527 / 53516118 / +0.2% 0.77 / 0.77 / -0.1%
tpcds_q12/duckdb:vortex-file-compressed 10793050 / 10641514 / +1.4% 15917751 / 17209536 / -7.5% 0.68 / 0.62 / +9.7%
tpcds_q13/duckdb:vortex-file-compressed 21801435 / 21780657 / +0.1% 35186435 / 37345361 / -5.8% 0.62 / 0.58 / +6.2%
tpcds_q14/duckdb:vortex-file-compressed 58468348 / 59022265 / -0.9% 69722508 / 75869316 / -8.1% 0.84 / 0.78 / +7.8%
tpcds_q15/duckdb:vortex-file-compressed 22501279 / 22397497 / +0.5% 29237469 / 27098405 / +7.9% 0.77 / 0.83 / -6.9%
tpcds_q16/duckdb:vortex-file-compressed 18784916 / 18890372 / -0.6% 26845796 / 27103124 / -0.9% 0.70 / 0.70 / +0.4%
tpcds_q17/duckdb:vortex-file-compressed 30991450 / 30988800 / +0.0% 46032869 / 48230152 / -4.6% 0.67 / 0.64 / +4.8%
tpcds_q18/duckdb:vortex-file-compressed 29417217 / 29808852 / -1.3% 38371730 / 38855617 / -1.2% 0.77 / 0.77 / -0.1%
tpcds_q19/duckdb:vortex-file-compressed 24886973 / 24446414 / +1.8% 33555076 / 34751061 / -3.4% 0.74 / 0.70 / +5.4%
tpcds_q20/duckdb:vortex-file-compressed 11126112 / 11611942 / -4.2% 18506861 / 15210926 / +21.7% 🔴 0.60 / 0.76 / -21.2%
tpcds_q21/duckdb:vortex-file-compressed 9636702 / 9854328 / -2.2% 17534336 / 17856652 / -1.8% 0.55 / 0.55 / -0.4%
tpcds_q22/duckdb:vortex-file-compressed 29154281 / 29383963 / -0.8% 39247015 / 40319727 / -2.7% 0.74 / 0.73 / +1.9%
tpcds_q23/duckdb:vortex-file-compressed 37479764 / 35875252 / +4.5% 49182172 / 47193152 / +4.2% 0.76 / 0.76 / +0.2%
tpcds_q24/duckdb:vortex-file-compressed 28814181 / 28313328 / +1.8% 38163707 / 38808025 / -1.7% 0.76 / 0.73 / +3.5%
tpcds_q25/duckdb:vortex-file-compressed 26918024 / 25999813 / +3.5% 39479708 / 42447158 / -7.0% 0.68 / 0.61 / +11.3%
tpcds_q26/duckdb:vortex-file-compressed 15063684 / 14624563 / +3.0% 23523361 / 20656973 / +13.9% 🔴 0.64 / 0.71 / -9.5%
tpcds_q27/duckdb:vortex-file-compressed 17469537 / 17636664 / -0.9% 29495377 / 29510437 / -0.1% 0.59 / 0.60 / -0.9%
tpcds_q28/duckdb:vortex-file-compressed 8253434 / 8752496 / -5.7% 16582105 / 14268363 / +16.2% 🔴 0.50 / 0.61 / -18.9%
tpcds_q29/duckdb:vortex-file-compressed 29681050 / 29923032 / -0.8% 44210148 / 46096715 / -4.1% 0.67 / 0.65 / +3.4%
tpcds_q30/duckdb:vortex-file-compressed 20062178 / 19900722 / +0.8% 26695833 / 27446654 / -2.7% 0.75 / 0.73 / +3.6%
tpcds_q31/duckdb:vortex-file-compressed 19964372 / 19962824 / +0.0% 29319412 / 29638465 / -1.1% 0.68 / 0.67 / +1.1%
tpcds_q32/duckdb:vortex-file-compressed 10829248 / 10803862 / +0.2% 17366703 / 17064940 / +1.8% 0.62 / 0.63 / -1.5%
tpcds_q33/duckdb:vortex-file-compressed 17393394 / 17645171 / -1.4% 29015099 / 32182035 / -9.8% 0.60 / 0.55 / +9.3%
tpcds_q34/duckdb:vortex-file-compressed 13754594 / 14180062 / -3.0% 24111936 / 21544364 / +11.9% 🔴 0.57 / 0.66 / -13.3%
tpcds_q35/duckdb:vortex-file-compressed 48534950 / 48609806 / -0.2% 63219018 / 64439810 / -1.9% 0.77 / 0.75 / +1.8%
tpcds_q36/duckdb:vortex-file-compressed 15042956 / 14881830 / +1.1% 26259629 / 32160309 / -18.3% 🟢 0.57 / 0.46 / +23.8%
tpcds_q37/duckdb:vortex-file-compressed 14051406 / 13832222 / +1.6% 22617782 / 22621985 / -0.0% 0.62 / 0.61 / +1.6%
tpcds_q38/duckdb:vortex-file-compressed 22622922 / 22535540 / +0.4% 28563085 / 29407743 / -2.9% 0.79 / 0.77 / +3.4%
tpcds_q39/duckdb:vortex-file-compressed 18224429 / 18413078 / -1.0% 26807426 / 27414060 / -2.2% 0.68 / 0.67 / +1.2%
tpcds_q40/duckdb:vortex-file-compressed 13748124 / 13531731 / +1.6% 19896129 / 22815511 / -12.8% 🟢 0.69 / 0.59 / +16.5%
tpcds_q41/duckdb:vortex-file-compressed 6575102 / 6727019 / -2.3% 9099923 / 12582262 / -27.7% 🟢 0.72 / 0.53 / +35.1%
tpcds_q42/duckdb:vortex-file-compressed 8445588 / 8482072 / -0.4% 16683552 / 18284188 / -8.8% 0.51 / 0.46 / +9.1%
tpcds_q43/duckdb:vortex-file-compressed 10088731 / 10023972 / +0.6% 18058010 / 19252061 / -6.2% 0.56 / 0.52 / +7.3%
tpcds_q44/duckdb:vortex-file-compressed 14276094 / 14204668 / +0.5% 24172563 / 25506623 / -5.2% 0.59 / 0.56 / +6.0%
tpcds_q45/duckdb:vortex-file-compressed 23748906 / 23702717 / +0.2% 31759688 / 30857842 / +2.9% 0.75 / 0.77 / -2.7%
tpcds_q46/duckdb:vortex-file-compressed 17145880 / 17308053 / -0.9% 28917470 / 31114023 / -7.1% 0.59 / 0.56 / +6.6%
tpcds_q47/duckdb:vortex-file-compressed 30293933 / 30510568 / -0.7% 41384595 / 45439509 / -8.9% 0.73 / 0.67 / +9.0%
tpcds_q48/duckdb:vortex-file-compressed 19992988 / 19769394 / +1.1% 30633297 / 31919798 / -4.0% 0.65 / 0.62 / +5.4%
tpcds_q49/duckdb:vortex-file-compressed 18189966 / 18630939 / -2.4% 34622128 / 35498627 / -2.5% 0.53 / 0.52 / +0.1%
tpcds_q50/duckdb:vortex-file-compressed 16595591 / 16502036 / +0.6% 28879838 / 28572606 / +1.1% 0.57 / 0.58 / -0.5%
tpcds_q51/duckdb:vortex-file-compressed 52586911 / 53010783 / -0.8% 70839783 / 62348272 / +13.6% 🔴 0.74 / 0.85 / -12.7%
tpcds_q52/duckdb:vortex-file-compressed 8557222 / 9033804 / -5.3% 16979087 / 18982877 / -10.6% 🟢 0.50 / 0.48 / +5.9%
tpcds_q53/duckdb:vortex-file-compressed 14342850 / 14342732 / +0.0% 25458553 / 25213691 / +1.0% 0.56 / 0.57 / -1.0%
tpcds_q54/duckdb:vortex-file-compressed 20985556 / 20800618 / +0.9% 30201197 / 32245129 / -6.3% 0.69 / 0.65 / +7.7%
tpcds_q55/duckdb:vortex-file-compressed 8943604 / 10212706 / -12.4% 🟢 20640082 / 18594866 / +11.0% 🔴 0.43 / 0.55 / -21.1%
tpcds_q56/duckdb:vortex-file-compressed 17782689 / 18111580 / -1.8% 32913181 / 32820557 / +0.3% 0.54 / 0.55 / -2.1%
tpcds_q57/duckdb:vortex-file-compressed 24462863 / 25108599 / -2.6% 31853740 / 35834982 / -11.1% 🟢 0.77 / 0.70 / +9.6%
tpcds_q58/duckdb:vortex-file-compressed 18556284 / 18513169 / +0.2% 27384390 / 28665825 / -4.5% 0.68 / 0.65 / +4.9%
tpcds_q59/duckdb:vortex-file-compressed 18467306 / 20015972 / -7.7% 24254851 / 25928756 / -6.5% 0.76 / 0.77 / -1.4%
tpcds_q60/duckdb:vortex-file-compressed 17731916 / 18855700 / -6.0% 28720951 / 29148999 / -1.5% 0.62 / 0.65 / -4.6%
tpcds_q61/duckdb:vortex-file-compressed 20732888 / 20720300 / +0.1% 31289779 / 34814946 / -10.1% 🟢 0.66 / 0.60 / +11.3%
tpcds_q62/duckdb:vortex-file-compressed 10461182 / 10270924 / +1.9% 16357498 / 17826118 / -8.2% 0.64 / 0.58 / +11.0%
tpcds_q63/duckdb:vortex-file-compressed 13314310 / 13616360 / -2.2% 22846672 / 24539888 / -6.9% 0.58 / 0.55 / +5.0%
tpcds_q64/duckdb:vortex-file-compressed 63141372 / 63573324 / -0.7% 77050605 / 80031672 / -3.7% 0.82 / 0.79 / +3.2%
tpcds_q65/duckdb:vortex-file-compressed 13370907 / 13455796 / -0.6% 21565704 / 21681255 / -0.5% 0.62 / 0.62 / -0.1%
tpcds_q66/duckdb:vortex-file-compressed 23845848 / 23181780 / +2.9% 33180680 / 33871769 / -2.0% 0.72 / 0.68 / +5.0%
tpcds_q67/duckdb:vortex-file-compressed 65767900 / 64484688 / +2.0% 83273237 / 83086018 / +0.2% 0.79 / 0.78 / +1.8%
tpcds_q68/duckdb:vortex-file-compressed 17243356 / 16957851 / +1.7% 33981598 / 32421422 / +4.8% 0.51 / 0.52 / -3.0%
tpcds_q69/duckdb:vortex-file-compressed 31288406 / 31719735 / -1.4% 46794896 / 44483360 / +5.2% 0.67 / 0.71 / -6.2%
tpcds_q70/duckdb:vortex-file-compressed 18905214 / 19042756 / -0.7% 31236118 / 32389702 / -3.6% 0.61 / 0.59 / +2.9%
tpcds_q71/duckdb:vortex-file-compressed 13713572 / 14131276 / -3.0% 25365248 / 24071208 / +5.4% 0.54 / 0.59 / -7.9%
tpcds_q72/duckdb:vortex-file-compressed 62587002 / 62682323 / -0.2% 74247136 / 74854778 / -0.8% 0.84 / 0.84 / +0.7%
tpcds_q73/duckdb:vortex-file-compressed 13381375 / 13242242 / +1.1% 22710072 / 25706973 / -11.7% 🟢 0.59 / 0.52 / +14.4%
tpcds_q74/duckdb:vortex-file-compressed 28109089 / 28166638 / -0.2% 37925216 / 40170323 / -5.6% 0.74 / 0.70 / +5.7%
tpcds_q75/duckdb:vortex-file-compressed 28526944 / 29009972 / -1.7% 42125100 / 39874407 / +5.6% 0.68 / 0.73 / -6.9%
tpcds_q76/duckdb:vortex-file-compressed 15534137 / 14089880 / +10.3% 🔴 26487706 / 26106820 / +1.5% 0.59 / 0.54 / +8.7%
tpcds_q77/duckdb:vortex-file-compressed 16308916 / 17020404 / -4.2% 24642218 / 26399411 / -6.7% 0.66 / 0.64 / +2.7%
tpcds_q78/duckdb:vortex-file-compressed 38039473 / 38684372 / -1.7% 50187463 / 47587014 / +5.5% 0.76 / 0.81 / -6.8%
tpcds_q79/duckdb:vortex-file-compressed 14731988 / 14518179 / +1.5% 24773108 / 25371857 / -2.4% 0.59 / 0.57 / +3.9%
tpcds_q80/duckdb:vortex-file-compressed 28502779 / 29723538 / -4.1% 46814243 / 44790498 / +4.5% 0.61 / 0.66 / -8.3%
tpcds_q81/duckdb:vortex-file-compressed 22992336 / 22972180 / +0.1% 32976204 / 32818051 / +0.5% 0.70 / 0.70 / -0.4%
tpcds_q82/duckdb:vortex-file-compressed 33011112 / 32324054 / +2.1% 42133426 / 39646854 / +6.3% 0.78 / 0.82 / -3.9%
tpcds_q83/duckdb:vortex-file-compressed 21033494 / 22960004 / -8.4% 25913604 / 25588492 / +1.3% 0.81 / 0.90 / -9.5%
tpcds_q84/duckdb:vortex-file-compressed 13513580 / 13249312 / +2.0% 19321545 / 23846283 / -19.0% 🟢 0.70 / 0.56 / +25.9%
tpcds_q85/duckdb:vortex-file-compressed 33032495 / 32959830 / +0.2% 41236593 / 42362898 / -2.7% 0.80 / 0.78 / +3.0%
tpcds_q86/duckdb:vortex-file-compressed 11026467 / 10941340 / +0.8% 19016041 / 18946760 / +0.4% 0.58 / 0.58 / +0.4%
tpcds_q87/duckdb:vortex-file-compressed 23983458 / 24686634 / -2.8% 31467530 / 34506594 / -8.8% 0.76 / 0.72 / +6.5%
tpcds_q88/duckdb:vortex-file-compressed 35759289 / 36242020 / -1.3% 47691607 / 50675671 / -5.9% 0.75 / 0.72 / +4.8%
tpcds_q89/duckdb:vortex-file-compressed 15880576 / 13743122 / +15.6% 🔴 22384285 / 23486341 / -4.7% 0.71 / 0.59 / +21.2%
tpcds_q90/duckdb:vortex-file-compressed 9839783 / 8274548 / +18.9% 🔴 13294954 / 14651666 / -9.3% 0.74 / 0.56 / +31.1%
tpcds_q91/duckdb:vortex-file-compressed 17205054 / 17227874 / -0.1% 22587257 / 23313664 / -3.1% 0.76 / 0.74 / +3.1%
tpcds_q92/duckdb:vortex-file-compressed 14283120 / 14188566 / +0.7% 22180017 / 22520101 / -1.5% 0.64 / 0.63 / +2.2%
tpcds_q93/duckdb:vortex-file-compressed 17180586 / 16620348 / +3.4% 23786206 / 23501553 / +1.2% 0.72 / 0.71 / +2.1%
tpcds_q94/duckdb:vortex-file-compressed 17280418 / 17431823 / -0.9% 28442151 / 26894164 / +5.8% 0.61 / 0.65 / -6.3%
tpcds_q95/duckdb:vortex-file-compressed 71787500 / 72513978 / -1.0% 79578772 / 80638256 / -1.3% 0.90 / 0.90 / +0.3%
tpcds_q96/duckdb:vortex-file-compressed 8351730 / 8414718 / -0.7% 16320619 / 17676692 / -7.7% 0.51 / 0.48 / +7.5%
tpcds_q97/duckdb:vortex-file-compressed 23265235 / 23397355 / -0.6% 31881632 / 29658334 / +7.5% 0.73 / 0.79 / -7.5%
tpcds_q98/duckdb:vortex-file-compressed 14720118 / 13708410 / +7.4% 26648103 / 22339151 / +19.3% 🔴 0.55 / 0.61 / -10.0%
tpcds_q99/duckdb:vortex-file-compressed 14504678 / 14413710 / +0.6% 20316065 / 21714647 / -6.4% 0.71 / 0.66 / +7.6%
duckdb / parquet / ns (1.002x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24866252 / 23537511 / +5.6% 36180162 / 38081028 / -5.0% 0.69 / 0.62 / +11.2%
tpcds_q02/duckdb:parquet 16781716 / 15359602 / +9.3% 20492911 / 19943074 / +2.8% 0.82 / 0.77 / +6.3%
tpcds_q03/duckdb:parquet 8831096 / 8708997 / +1.4% 15684623 / 16028585 / -2.1% 0.56 / 0.54 / +3.6%
tpcds_q04/duckdb:parquet 127640848 / 127421330 / +0.2% 132616471 / 135788728 / -2.3% 0.96 / 0.94 / +2.6%
tpcds_q05/duckdb:parquet 21620540 / 21541148 / +0.4% 25670554 / 28854300 / -11.0% 🟢 0.84 / 0.75 / +12.8%
tpcds_q06/duckdb:parquet 25896627 / 26633120 / -2.8% 40744856 / 37833777 / +7.7% 0.64 / 0.70 / -9.7%
tpcds_q07/duckdb:parquet 15109383 / 15275677 / -1.1% 22607795 / 23134088 / -2.3% 0.67 / 0.66 / +1.2%
tpcds_q08/duckdb:parquet 25687497 / 25590490 / +0.4% 33743050 / 33191265 / +1.7% 0.76 / 0.77 / -1.3%
tpcds_q09/duckdb:parquet 19029426 / 19401336 / -1.9% 24736590 / 23141975 / +6.9% 0.77 / 0.84 / -8.2%
tpcds_q10/duckdb:parquet 27888844 / 28850976 / -3.3% 38096445 / 40294395 / -5.5% 0.73 / 0.72 / +2.2%
tpcds_q11/duckdb:parquet 71177292 / 71552302 / -0.5% 79324508 / 78331266 / +1.3% 0.90 / 0.91 / -1.8%
tpcds_q12/duckdb:parquet 12560824 / 12735832 / -1.4% 17195781 / 17284056 / -0.5% 0.73 / 0.74 / -0.9%
tpcds_q13/duckdb:parquet 23838292 / 25262581 / -5.6% 31824172 / 35656437 / -10.7% 🟢 0.75 / 0.71 / +5.7%
tpcds_q14/duckdb:parquet 61583234 / 61065876 / +0.8% 67989007 / 69041030 / -1.5% 0.91 / 0.88 / +2.4%
tpcds_q15/duckdb:parquet 24735933 / 24872174 / -0.5% 31406081 / 33930543 / -7.4% 0.79 / 0.73 / +7.4%
tpcds_q16/duckdb:parquet 20133868 / 22146242 / -9.1% 30291365 / 31481314 / -3.8% 0.66 / 0.70 / -5.5%
tpcds_q17/duckdb:parquet 32036838 / 32384104 / -1.1% 41119083 / 40444880 / +1.7% 0.78 / 0.80 / -2.7%
tpcds_q18/duckdb:parquet 41825408 / 38924276 / +7.5% 50480587 / 52568708 / -4.0% 0.83 / 0.74 / +11.9%
tpcds_q19/duckdb:parquet 24422774 / 24462964 / -0.2% 31993575 / 34911887 / -8.4% 0.76 / 0.70 / +8.9%
tpcds_q20/duckdb:parquet 13604092 / 13518640 / +0.6% 18500838 / 18334133 / +0.9% 0.74 / 0.74 / -0.3%
tpcds_q21/duckdb:parquet 9441103 / 9542860 / -1.1% 12766684 / 14204683 / -10.1% 🟢 0.74 / 0.67 / +10.1%
tpcds_q22/duckdb:parquet 35693734 / 35238094 / +1.3% 41516608 / 39103858 / +6.2% 0.86 / 0.90 / -4.6%
tpcds_q23/duckdb:parquet 40623981 / 40255534 / +0.9% 46634456 / 48496960 / -3.8% 0.87 / 0.83 / +4.9%
tpcds_q24/duckdb:parquet 33417884 / 33601052 / -0.5% 44089250 / 44095714 / -0.0% 0.76 / 0.76 / -0.5%
tpcds_q25/duckdb:parquet 30045658 / 30114822 / -0.2% 40121640 / 42815031 / -6.3% 0.75 / 0.70 / +6.5%
tpcds_q26/duckdb:parquet 30817922 / 31110258 / -0.9% 38911542 / 37928331 / +2.6% 0.79 / 0.82 / -3.4%
tpcds_q27/duckdb:parquet 31721827 / 31703888 / +0.1% 43435984 / 41878321 / +3.7% 0.73 / 0.76 / -3.5%
tpcds_q28/duckdb:parquet 17230295 / 17262172 / -0.2% 19517829 / 20784370 / -6.1% 0.88 / 0.83 / +6.3%
tpcds_q29/duckdb:parquet 30577639 / 30647837 / -0.2% 38916465 / 40126437 / -3.0% 0.79 / 0.76 / +2.9%
tpcds_q30/duckdb:parquet 33186663 / 32546434 / +2.0% 41007816 / 41424338 / -1.0% 0.81 / 0.79 / +3.0%
tpcds_q31/duckdb:parquet 20780176 / 20441950 / +1.7% 27126442 / 25488261 / +6.4% 0.77 / 0.80 / -4.5%
tpcds_q32/duckdb:parquet 12483945 / 11246518 / +11.0% 🔴 17589158 / 16956087 / +3.7% 0.71 / 0.66 / +7.0%
tpcds_q33/duckdb:parquet 16163552 / 15852970 / +2.0% 24478904 / 30093445 / -18.7% 🟢 0.66 / 0.53 / +25.3%
tpcds_q34/duckdb:parquet 16143510 / 16220510 / -0.5% 24551351 / 21889752 / +12.2% 🔴 0.66 / 0.74 / -11.3%
tpcds_q35/duckdb:parquet 46618148 / 46801536 / -0.4% 57202181 / 57002438 / +0.4% 0.81 / 0.82 / -0.7%
tpcds_q36/duckdb:parquet 15116774 / 17997894 / -16.0% 🟢 23140171 / 29600188 / -21.8% 🟢 0.65 / 0.61 / +7.4%
tpcds_q37/duckdb:parquet 11522020 / 12448540 / -7.4% 16936028 / 18286712 / -7.4% 0.68 / 0.68 / -0.1%
tpcds_q38/duckdb:parquet 26328173 / 26273840 / +0.2% 30056102 / 30333565 / -0.9% 0.88 / 0.87 / +1.1%
tpcds_q39/duckdb:parquet 24677232 / 24595328 / +0.3% 29530516 / 28918262 / +2.1% 0.84 / 0.85 / -1.7%
tpcds_q40/duckdb:parquet 15803840 / 15778760 / +0.2% 21523203 / 21247110 / +1.3% 0.73 / 0.74 / -1.1%
tpcds_q41/duckdb:parquet 7751011 / 7790892 / -0.5% 13788522 / 12777396 / +7.9% 0.56 / 0.61 / -7.8%
tpcds_q42/duckdb:parquet 8238862 / 8336603 / -1.2% 14885506 / 15230601 / -2.3% 0.55 / 0.55 / +1.1%
tpcds_q43/duckdb:parquet 10641016 / 10603698 / +0.4% 15832728 / 15654287 / +1.1% 0.67 / 0.68 / -0.8%
tpcds_q44/duckdb:parquet 16260801 / 16051312 / +1.3% 22240506 / 22405406 / -0.7% 0.73 / 0.72 / +2.1%
tpcds_q45/duckdb:parquet 23067002 / 23323878 / -1.1% 28832113 / 29694535 / -2.9% 0.80 / 0.79 / +1.9%
tpcds_q46/duckdb:parquet 36142195 / 36200941 / -0.2% 45595912 / 45347423 / +0.5% 0.79 / 0.80 / -0.7%
tpcds_q47/duckdb:parquet 31334052 / 31022757 / +1.0% 37319860 / 40492827 / -7.8% 0.84 / 0.77 / +9.6%
tpcds_q48/duckdb:parquet 20797272 / 21094521 / -1.4% 28813432 / 29283114 / -1.6% 0.72 / 0.72 / +0.2%
tpcds_q49/duckdb:parquet 18880441 / 18867382 / +0.1% 27626241 / 30942434 / -10.7% 🟢 0.68 / 0.61 / +12.1%
tpcds_q50/duckdb:parquet 17717272 / 18039395 / -1.8% 25205530 / 25915744 / -2.7% 0.70 / 0.70 / +1.0%
tpcds_q51/duckdb:parquet 53854738 / 53447238 / +0.8% 62560635 / 60852713 / +2.8% 0.86 / 0.88 / -2.0%
tpcds_q52/duckdb:parquet 9762352 / 9179378 / +6.4% 15426791 / 15531275 / -0.7% 0.63 / 0.59 / +7.1%
tpcds_q53/duckdb:parquet 11560814 / 11768212 / -1.8% 17608832 / 17521887 / +0.5% 0.66 / 0.67 / -2.2%
tpcds_q54/duckdb:parquet 20857120 / 20338449 / +2.6% 30193729 / 29063635 / +3.9% 0.69 / 0.70 / -1.3%
tpcds_q55/duckdb:parquet 8569996 / 8463765 / +1.3% 15294601 / 14719623 / +3.9% 0.56 / 0.57 / -2.6%
tpcds_q56/duckdb:parquet 16068614 / 16221726 / -0.9% 23397487 / 26958597 / -13.2% 🟢 0.69 / 0.60 / +14.1%
tpcds_q57/duckdb:parquet 28858389 / 28988153 / -0.4% 34188064 / 34171239 / +0.0% 0.84 / 0.85 / -0.5%
tpcds_q58/duckdb:parquet 18251632 / 18336374 / -0.5% 24609713 / 26214325 / -6.1% 0.74 / 0.70 / +6.0%
tpcds_q59/duckdb:parquet 20049284 / 20157281 / -0.5% 24883751 / 25340440 / -1.8% 0.81 / 0.80 / +1.3%
tpcds_q60/duckdb:parquet 17046566 / 16925551 / +0.7% 24688442 / 24901171 / -0.9% 0.69 / 0.68 / +1.6%
tpcds_q61/duckdb:parquet 21469183 / 21589221 / -0.6% 28819307 / 28688553 / +0.5% 0.74 / 0.75 / -1.0%
tpcds_q62/duckdb:parquet 10790447 / 10833776 / -0.4% 14788708 / 14741398 / +0.3% 0.73 / 0.73 / -0.7%
tpcds_q63/duckdb:parquet 11395977 / 10907022 / +4.5% 16496695 / 16679000 / -1.1% 0.69 / 0.65 / +5.6%
tpcds_q64/duckdb:parquet 53285305 / 52864910 / +0.8% 68499626 / 66387491 / +3.2% 0.78 / 0.80 / -2.3%
tpcds_q65/duckdb:parquet 17995385 / 14488227 / +24.2% 🔴 20962431 / 24848081 / -15.6% 🟢 0.86 / 0.58 / +47.2%
tpcds_q66/duckdb:parquet 24635258 / 24992554 / -1.4% 30780186 / 31580132 / -2.5% 0.80 / 0.79 / +1.1%
tpcds_q67/duckdb:parquet 76943754 / 76739389 / +0.3% 84606691 / 84709084 / -0.1% 0.91 / 0.91 / +0.4%
tpcds_q68/duckdb:parquet 29144970 / 29155210 / -0.0% 46690887 / 40973249 / +14.0% 🔴 0.62 / 0.71 / -12.3%
tpcds_q69/duckdb:parquet 28972444 / 29871272 / -3.0% 42094021 / 38411480 / +9.6% 0.69 / 0.78 / -11.5%
tpcds_q70/duckdb:parquet 16210873 / 16136040 / +0.5% 23360523 / 26609238 / -12.2% 🟢 0.69 / 0.61 / +14.4%
tpcds_q71/duckdb:parquet 15309162 / 14707833 / +4.1% 19973054 / 21545450 / -7.3% 0.77 / 0.68 / +12.3%
tpcds_q72/duckdb:parquet 81963596 / 81392492 / +0.7% 88252409 / 88991149 / -0.8% 0.93 / 0.91 / +1.5%
tpcds_q73/duckdb:parquet 14794066 / 13404292 / +10.4% 🔴 19591373 / 19806885 / -1.1% 0.76 / 0.68 / +11.6%
tpcds_q74/duckdb:parquet 98734136 / 98888963 / -0.2% 107598699 / 107600238 / -0.0% 0.92 / 0.92 / -0.2%
tpcds_q75/duckdb:parquet 40261547 / 41811192 / -3.7% 50448920 / 50641825 / -0.4% 0.80 / 0.83 / -3.3%
tpcds_q76/duckdb:parquet 13480260 / 14172796 / -4.9% 19997311 / 20705767 / -3.4% 0.67 / 0.68 / -1.5%
tpcds_q77/duckdb:parquet 17182986 / 17878730 / -3.9% 24781909 / 25801049 / -3.9% 0.69 / 0.69 / +0.1%
tpcds_q78/duckdb:parquet 48340538 / 48188124 / +0.3% 53470246 / 54491172 / -1.9% 0.90 / 0.88 / +2.2%
tpcds_q79/duckdb:parquet 20349472 / 20494796 / -0.7% 28756105 / 29285962 / -1.8% 0.71 / 0.70 / +1.1%
tpcds_q80/duckdb:parquet 30991010 / 31191693 / -0.6% 38746738 / 44307866 / -12.6% 🟢 0.80 / 0.70 / +13.6%
tpcds_q81/duckdb:parquet 31154730 / 29923510 / +4.1% 40189698 / 39502196 / +1.7% 0.78 / 0.76 / +2.3%
tpcds_q82/duckdb:parquet 13565402 / 14288526 / -5.1% 18217582 / 21791651 / -16.4% 🟢 0.74 / 0.66 / +13.6%
tpcds_q83/duckdb:parquet 15772944 / 15943786 / -1.1% 21166318 / 20625840 / +2.6% 0.75 / 0.77 / -3.6%
tpcds_q84/duckdb:parquet 17464237 / 17539178 / -0.4% 24179782 / 23517059 / +2.8% 0.72 / 0.75 / -3.2%
tpcds_q85/duckdb:parquet 34703264 / 34981826 / -0.8% 44726188 / 45626265 / -2.0% 0.78 / 0.77 / +1.2%
tpcds_q86/duckdb:parquet 13274680 / 10894862 / +21.8% 🔴 15892719 / 15593185 / +1.9% 0.84 / 0.70 / +19.5%
tpcds_q87/duckdb:parquet 28068322 / 28332142 / -0.9% 33105239 / 32936536 / +0.5% 0.85 / 0.86 / -1.4%
tpcds_q88/duckdb:parquet 28860506 / 26838252 / +7.5% 31705790 / 30521128 / +3.9% 0.91 / 0.88 / +3.5%
tpcds_q89/duckdb:parquet 12606599 / 12713529 / -0.8% 22157164 / 18600503 / +19.1% 🔴 0.57 / 0.68 / -16.8%
tpcds_q90/duckdb:parquet 6815468 / 7102070 / -4.0% 11618058 / 11365245 / +2.2% 0.59 / 0.62 / -6.1%
tpcds_q91/duckdb:parquet 20670190 / 20781674 / -0.5% 29442591 / 28966692 / +1.6% 0.70 / 0.72 / -2.1%
tpcds_q92/duckdb:parquet 11531672 / 11482088 / +0.4% 18194091 / 18324353 / -0.7% 0.63 / 0.63 / +1.2%
tpcds_q93/duckdb:parquet 21560958 / 21256206 / +1.4% 28563258 / 29354507 / -2.7% 0.75 / 0.72 / +4.2%
tpcds_q94/duckdb:parquet 17381829 / 15871356 / +9.5% 24682567 / 28122126 / -12.2% 🟢 0.70 / 0.56 / +24.8%
tpcds_q95/duckdb:parquet 90169876 / 89829964 / +0.4% 96981147 / 97501924 / -0.5% 0.93 / 0.92 / +0.9%
tpcds_q96/duckdb:parquet 6894822 / 8210670 / -16.0% 🟢 10825327 / 10520618 / +2.9% 0.64 / 0.78 / -18.4%
tpcds_q97/duckdb:parquet 25593342 / 25768700 / -0.7% 31954726 / 31187503 / +2.5% 0.80 / 0.83 / -3.1%
tpcds_q98/duckdb:parquet 14855894 / 14893963 / -0.3% 21512683 / 22444755 / -4.2% 0.69 / 0.66 / +4.1%
tpcds_q99/duckdb:parquet 17233522 / 17315148 / -0.5% 21429268 / 21347050 / +0.4% 0.80 / 0.81 / -0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR dfcb8c8e vs base d6037bc2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.8%
Engines: DataFusion No clear signal (+3.6%, low confidence) · DuckDB No clear signal (-10.7%, low confidence)
Vortex (geomean): hot 0.939x ➖ · cold 1.022x ➖
Parquet (geomean): hot 0.976x ➖ · cold 1.049x ➖
Shifts: Parquet (control) -2.4% · Median polish -4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.974x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6786789 / 7026196 / -3.4% 20809482 / 20660787 / +0.7% 0.33 / 0.34 / -4.1%
fineweb_q01/datafusion:vortex-file-compressed 13159398 / 13782804 / -4.5% 53663460 / 47283648 / +13.5% 🔴 0.25 / 0.29 / -15.9%
fineweb_q02/datafusion:vortex-file-compressed 14501482 / 13491562 / +7.5% 53022913 / 48550488 / +9.2% 0.27 / 0.28 / -1.6%
fineweb_q03/datafusion:vortex-file-compressed 19598668 / 20674226 / -5.2% 114533198 / 104581605 / +9.5% 0.17 / 0.20 / -13.4%
fineweb_q04/datafusion:vortex-file-compressed 74296418 / 78354000 / -5.2% 168587700 / 162836892 / +3.5% 0.44 / 0.48 / -8.4%
fineweb_q05/datafusion:vortex-file-compressed 57698889 / 60967234 / -5.4% 139667313 / 141734474 / -1.5% 0.41 / 0.43 / -4.0%
fineweb_q06/datafusion:vortex-file-compressed 19821084 / 19554022 / +1.4% 113905877 / 107046710 / +6.4% 0.17 / 0.18 / -4.7%
fineweb_q07/datafusion:vortex-file-compressed 18211672 / 18664849 / -2.4% 114847704 / 101030981 / +13.7% 🔴 0.16 / 0.18 / -14.2%
fineweb_q08/datafusion:vortex-file-compressed 10910592 / 11545579 / -5.5% 51406632 / 40657636 / +26.4% 🔴 0.21 / 0.28 / -25.3%
datafusion / parquet / ns (0.940x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9474314 / 9650254 / -1.8% 34808305 / 34142570 / +1.9% 0.27 / 0.28 / -3.7%
fineweb_q01/datafusion:parquet 68733558 / 75321674 / -8.7% 167049619 / 145708321 / +14.6% 🔴 0.41 / 0.52 / -20.4%
fineweb_q02/datafusion:parquet 69939208 / 74237256 / -5.8% 157985153 / 147886243 / +6.8% 0.44 / 0.50 / -11.8%
fineweb_q03/datafusion:parquet 70340394 / 73450124 / -4.2% 163703410 / 147128566 / +11.3% 🔴 0.43 / 0.50 / -13.9%
fineweb_q04/datafusion:parquet 75325518 / 81649730 / -7.7% 162893915 / 147113043 / +10.7% 🔴 0.46 / 0.56 / -16.7%
fineweb_q05/datafusion:parquet 74610435 / 82126242 / -9.2% 164344553 / 148163666 / +10.9% 🔴 0.45 / 0.55 / -18.1%
fineweb_q06/datafusion:parquet 69601920 / 73960496 / -5.9% 165414798 / 143967166 / +14.9% 🔴 0.42 / 0.51 / -18.1%
fineweb_q07/datafusion:parquet 70451332 / 73724456 / -4.4% 152904923 / 146345160 / +4.5% 0.46 / 0.50 / -8.5%
fineweb_q08/datafusion:parquet 68497578 / 72790050 / -5.9% 158275105 / 144102480 / +9.8% 0.43 / 0.51 / -14.3%
duckdb / vortex-file-compressed / ns (0.906x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3481845 / 4038426 / -13.8% 🟢 8290204 / 4960106 / +67.1% 🔴 0.42 / 0.81 / -48.4%
fineweb_q01/duckdb:vortex-file-compressed 21514622 / 23644731 / -9.0% 59476734 / 61457771 / -3.2% 0.36 / 0.38 / -6.0%
fineweb_q02/duckdb:vortex-file-compressed 13546528 / 17951792 / -24.5% 🟢 35885192 / 43434352 / -17.4% 🟢 0.38 / 0.41 / -8.7%
fineweb_q03/duckdb:vortex-file-compressed 26235239 / 35629844 / -26.4% 🟢 109974415 / 218901339 / -49.8% 🟢 0.24 / 0.16 / +46.6%
fineweb_q04/duckdb:vortex-file-compressed 73983498 / 74132342 / -0.2% 114195841 / 116975690 / -2.4% 0.65 / 0.63 / +2.2%
fineweb_q05/duckdb:vortex-file-compressed 59275911 / 60673156 / -2.3% 103662739 / 100686047 / +3.0% 0.57 / 0.60 / -5.1%
fineweb_q06/duckdb:vortex-file-compressed 34689993 / 33500702 / +3.6% 105549163 / 106150672 / -0.6% 0.33 / 0.32 / +4.1%
fineweb_q07/duckdb:vortex-file-compressed 28778194 / 29401304 / -2.1% 98876296 / 105109825 / -5.9% 0.29 / 0.28 / +4.1%
fineweb_q08/duckdb:vortex-file-compressed 6989122 / 7330588 / -4.7% 16015480 / 14588009 / +9.8% 0.44 / 0.50 / -13.2%
duckdb / parquet / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23005380 / 22507987 / +2.2% 23197920 / 23020774 / +0.8% 0.99 / 0.98 / +1.4%
fineweb_q01/duckdb:parquet 44556444 / 44380128 / +0.4% 54367503 / 55499457 / -2.0% 0.82 / 0.80 / +2.5%
fineweb_q02/duckdb:parquet 44093458 / 43261716 / +1.9% 53288595 / 53611045 / -0.6% 0.83 / 0.81 / +2.5%
fineweb_q03/duckdb:parquet 95788792 / 94583245 / +1.3% 184096031 / 178572611 / +3.1% 0.52 / 0.53 / -1.8%
fineweb_q04/duckdb:parquet 152842712 / 150366988 / +1.6% 213932717 / 205160764 / +4.3% 0.71 / 0.73 / -2.5%
fineweb_q05/duckdb:parquet 146610910 / 142436676 / +2.9% 199132664 / 199977550 / -0.4% 0.74 / 0.71 / +3.4%
fineweb_q06/duckdb:parquet 70840489 / 69987735 / +1.2% 124269015 / 126112735 / -1.5% 0.57 / 0.55 / +2.7%
fineweb_q07/duckdb:parquet 72165594 / 71874205 / +0.4% 152511511 / 154443730 / -1.3% 0.47 / 0.47 / +1.7%
fineweb_q08/duckdb:parquet 22118011 / 21975485 / +0.6% 27669360 / 27013605 / +2.4% 0.80 / 0.81 / -1.7%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR dfcb8c8e vs base d6037bc2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-3.1%, low confidence)
Vortex (geomean): hot 0.985x ➖ · cold 0.970x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.987x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16401708 / 16364220 / +0.2% 44020671 / 45146072 / -2.5% 0.37 / 0.36 / +2.8%
tpch_q02/datafusion:vortex-file-compressed 17465853 / 17654444 / -1.1% 37098547 / 37167669 / -0.2% 0.47 / 0.47 / -0.9%
tpch_q03/datafusion:vortex-file-compressed 19680762 / 19447345 / +1.2% 45360271 / 49880256 / -9.1% 0.43 / 0.39 / +11.3%
tpch_q04/datafusion:vortex-file-compressed 10512505 / 10377172 / +1.3% 32870042 / 32446920 / +1.3% 0.32 / 0.32 / +0.0%
tpch_q05/datafusion:vortex-file-compressed 37047881 / 36775868 / +0.7% 65069120 / 64102115 / +1.5% 0.57 / 0.57 / -0.8%
tpch_q06/datafusion:vortex-file-compressed 6401575 / 6373966 / +0.4% 27499732 / 29109065 / -5.5% 0.23 / 0.22 / +6.3%
tpch_q07/datafusion:vortex-file-compressed 51757512 / 52181319 / -0.8% 80324399 / 84370370 / -4.8% 0.64 / 0.62 / +4.2%
tpch_q08/datafusion:vortex-file-compressed 52362060 / 51946914 / +0.8% 77157284 / 80777601 / -4.5% 0.68 / 0.64 / +5.5%
tpch_q09/datafusion:vortex-file-compressed 49423212 / 49196242 / +0.5% 75943737 / 77525743 / -2.0% 0.65 / 0.63 / +2.6%
tpch_q10/datafusion:vortex-file-compressed 17089859 / 17389168 / -1.7% 47329127 / 49075953 / -3.6% 0.36 / 0.35 / +1.9%
tpch_q11/datafusion:vortex-file-compressed 15000453 / 15246332 / -1.6% 33443435 / 35280896 / -5.2% 0.45 / 0.43 / +3.8%
tpch_q12/datafusion:vortex-file-compressed 23161891 / 22931362 / +1.0% 48029113 / 50282150 / -4.5% 0.48 / 0.46 / +5.7%
tpch_q13/datafusion:vortex-file-compressed 20369369 / 20248195 / +0.6% 40083461 / 38370987 / +4.5% 0.51 / 0.53 / -3.7%
tpch_q14/datafusion:vortex-file-compressed 15204760 / 15135681 / +0.5% 38951858 / 41078804 / -5.2% 0.39 / 0.37 / +5.9%
tpch_q15/datafusion:vortex-file-compressed 18720281 / 18866738 / -0.8% 47224206 / 45525319 / +3.7% 0.40 / 0.41 / -4.3%
tpch_q16/datafusion:vortex-file-compressed 18965913 / 18733446 / +1.2% 38801702 / 39047055 / -0.6% 0.49 / 0.48 / +1.9%
tpch_q17/datafusion:vortex-file-compressed 28229823 / 28177671 / +0.2% 57649910 / 58281591 / -1.1% 0.49 / 0.48 / +1.3%
tpch_q18/datafusion:vortex-file-compressed 36916139 / 37089901 / -0.5% 56610940 / 57243840 / -1.1% 0.65 / 0.65 / +0.6%
tpch_q19/datafusion:vortex-file-compressed 13781490 / 13881034 / -0.7% 38072213 / 40729450 / -6.5% 0.36 / 0.34 / +6.2%
tpch_q20/datafusion:vortex-file-compressed 21232232 / 20828212 / +1.9% 44891238 / 45684554 / -1.7% 0.47 / 0.46 / +3.7%
tpch_q21/datafusion:vortex-file-compressed 39898873 / 39554664 / +0.9% 66584042 / 68247931 / -2.4% 0.60 / 0.58 / +3.4%
tpch_q22/datafusion:vortex-file-compressed 11395054 / 11652159 / -2.2% 31137505 / 32221408 / -3.4% 0.37 / 0.36 / +1.2%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67318467 / 67083260 / +0.4% 83788260 / 86823705 / -3.5% 0.80 / 0.77 / +4.0%
tpch_q02/datafusion:parquet 53537263 / 53468544 / +0.1% 71210693 / 71764563 / -0.8% 0.75 / 0.75 / +0.9%
tpch_q03/datafusion:parquet 73281784 / 73390646 / -0.1% 96458107 / 100717419 / -4.2% 0.76 / 0.73 / +4.3%
tpch_q04/datafusion:parquet 39799036 / 40868724 / -2.6% 62003971 / 62196842 / -0.3% 0.64 / 0.66 / -2.3%
tpch_q05/datafusion:parquet 88317470 / 87473711 / +1.0% 115579320 / 118322853 / -2.3% 0.76 / 0.74 / +3.4%
tpch_q06/datafusion:parquet 28161941 / 28172161 / -0.0% 45333674 / 50871152 / -10.9% 🟢 0.62 / 0.55 / +12.2%
tpch_q07/datafusion:parquet 96050118 / 94888612 / +1.2% 125267518 / 127300465 / -1.6% 0.77 / 0.75 / +2.9%
tpch_q08/datafusion:parquet 97102455 / 98769236 / -1.7% 125725175 / 125255457 / +0.4% 0.77 / 0.79 / -2.1%
tpch_q09/datafusion:parquet 114498731 / 113957650 / +0.5% 143078778 / 146057233 / -2.0% 0.80 / 0.78 / +2.6%
tpch_q10/datafusion:parquet 80363060 / 80632747 / -0.3% 106326038 / 115421381 / -7.9% 0.76 / 0.70 / +8.2%
tpch_q11/datafusion:parquet 39291465 / 39538823 / -0.6% 59650107 / 63939279 / -6.7% 0.66 / 0.62 / +6.5%
tpch_q12/datafusion:parquet 62579177 / 62569291 / +0.0% 86152283 / 88980722 / -3.2% 0.73 / 0.70 / +3.3%
tpch_q13/datafusion:parquet 160277131 / 159484112 / +0.5% 180212742 / 183502733 / -1.8% 0.89 / 0.87 / +2.3%
tpch_q14/datafusion:parquet 40256725 / 39891969 / +0.9% 63084032 / 66029572 / -4.5% 0.64 / 0.60 / +5.6%
tpch_q15/datafusion:parquet 47560544 / 46350844 / +2.6% 66439109 / 67763077 / -2.0% 0.72 / 0.68 / +4.7%
tpch_q16/datafusion:parquet 38805747 / 39045862 / -0.6% 59396152 / 56200095 / +5.7% 0.65 / 0.69 / -6.0%
tpch_q17/datafusion:parquet 117688484 / 116317255 / +1.2% 141670430 / 144068778 / -1.7% 0.83 / 0.81 / +2.9%
tpch_q18/datafusion:parquet 115479413 / 116432519 / -0.8% 134967598 / 138480296 / -2.5% 0.86 / 0.84 / +1.8%
tpch_q19/datafusion:parquet 49755392 / 50159623 / -0.8% 76678112 / 78702682 / -2.6% 0.65 / 0.64 / +1.8%
tpch_q20/datafusion:parquet 59861797 / 59055805 / +1.4% 81985433 / 86264861 / -5.0% 0.73 / 0.68 / +6.7%
tpch_q21/datafusion:parquet 99334204 / 98969382 / +0.4% 123299984 / 125118844 / -1.5% 0.81 / 0.79 / +1.8%
tpch_q22/datafusion:parquet 42123458 / 41602645 / +1.3% 59668792 / 59769990 / -0.2% 0.71 / 0.70 / +1.4%
duckdb / vortex-file-compressed / ns (0.969x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11268790 / 12223481 / -7.8% 20951288 / 24476516 / -14.4% 🟢 0.54 / 0.50 / +7.7%
tpch_q02/duckdb:vortex-file-compressed 17508342 / 17573208 / -0.4% 25258561 / 27824412 / -9.2% 0.69 / 0.63 / +9.8%
tpch_q03/duckdb:vortex-file-compressed 18395726 / 18772267 / -2.0% 34826159 / 38148499 / -8.7% 0.53 / 0.49 / +7.3%
tpch_q04/duckdb:vortex-file-compressed 16478369 / 16546266 / -0.4% 30065748 / 31299365 / -3.9% 0.55 / 0.53 / +3.7%
tpch_q05/duckdb:vortex-file-compressed 22525492 / 21944815 / +2.6% 34567421 / 43170777 / -19.9% 🟢 0.65 / 0.51 / +28.2%
tpch_q06/duckdb:vortex-file-compressed 5496874 / 5912897 / -7.0% 15893489 / 16610056 / -4.3% 0.35 / 0.36 / -2.8%
tpch_q07/duckdb:vortex-file-compressed 20675328 / 20717869 / -0.2% 34886409 / 34420713 / +1.4% 0.59 / 0.60 / -1.5%
tpch_q08/duckdb:vortex-file-compressed 22982755 / 23403814 / -1.8% 36971493 / 41222137 / -10.3% 🟢 0.62 / 0.57 / +9.5%
tpch_q09/duckdb:vortex-file-compressed 29445098 / 31075453 / -5.2% 49329321 / 52262695 / -5.6% 0.60 / 0.59 / +0.4%
tpch_q10/duckdb:vortex-file-compressed 28057049 / 28505831 / -1.6% 42435669 / 44591980 / -4.8% 0.66 / 0.64 / +3.4%
tpch_q11/duckdb:vortex-file-compressed 8146829 / 10954467 / -25.6% 🟢 15158263 / 17046947 / -11.1% 🟢 0.54 / 0.64 / -16.4%
tpch_q12/duckdb:vortex-file-compressed 17223820 / 16377896 / +5.2% 33734593 / 31798860 / +6.1% 0.51 / 0.52 / -0.9%
tpch_q13/duckdb:vortex-file-compressed 24161600 / 21995651 / +9.8% 38395157 / 41095044 / -6.6% 0.63 / 0.54 / +17.6%
tpch_q14/duckdb:vortex-file-compressed 13347175 / 13542974 / -1.4% 25065372 / 27464279 / -8.7% 0.53 / 0.49 / +8.0%
tpch_q15/duckdb:vortex-file-compressed 8902970 / 9041372 / -1.5% 18427556 / 19046550 / -3.2% 0.48 / 0.47 / +1.8%
tpch_q16/duckdb:vortex-file-compressed 18299044 / 18565669 / -1.4% 26206126 / 24864736 / +5.4% 0.70 / 0.75 / -6.5%
tpch_q17/duckdb:vortex-file-compressed 14924796 / 16442743 / -9.2% 36118836 / 32862899 / +9.9% 0.41 / 0.50 / -17.4%
tpch_q18/duckdb:vortex-file-compressed 25609984 / 24343582 / +5.2% 35756528 / 36273330 / -1.4% 0.72 / 0.67 / +6.7%
tpch_q19/duckdb:vortex-file-compressed 23790933 / 23206573 / +2.5% 38645969 / 36192735 / +6.8% 0.62 / 0.64 / -4.0%
tpch_q20/duckdb:vortex-file-compressed 17034514 / 17385178 / -2.0% 36895435 / 34642026 / +6.5% 0.46 / 0.50 / -8.0%
tpch_q21/duckdb:vortex-file-compressed 65926342 / 67183321 / -1.9% 85029667 / 84466562 / +0.7% 0.78 / 0.80 / -2.5%
tpch_q22/duckdb:vortex-file-compressed 12089861 / 14455490 / -16.4% 🟢 22082856 / 20847669 / +5.9% 0.55 / 0.69 / -21.0%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60255068 / 60317176 / -0.1% 66604591 / 66648701 / -0.1% 0.90 / 0.91 / -0.0%
tpch_q02/duckdb:parquet 34678422 / 34623048 / +0.2% 43903507 / 42817093 / +2.5% 0.79 / 0.81 / -2.3%
tpch_q03/duckdb:parquet 62355807 / 62014319 / +0.6% 73651988 / 73758590 / -0.1% 0.85 / 0.84 / +0.7%
tpch_q04/duckdb:parquet 43481291 / 43195903 / +0.7% 55469594 / 52748191 / +5.2% 0.78 / 0.82 / -4.3%
tpch_q05/duckdb:parquet 60747976 / 61259666 / -0.8% 72000095 / 73748735 / -2.4% 0.84 / 0.83 / +1.6%
tpch_q06/duckdb:parquet 20362088 / 20045285 / +1.6% 25077080 / 25109988 / -0.1% 0.81 / 0.80 / +1.7%
tpch_q07/duckdb:parquet 60959215 / 60723327 / +0.4% 71807928 / 71541521 / +0.4% 0.85 / 0.85 / +0.0%
tpch_q08/duckdb:parquet 73380722 / 73272438 / +0.1% 86340772 / 86351316 / -0.0% 0.85 / 0.85 / +0.2%
tpch_q09/duckdb:parquet 113702278 / 114034794 / -0.3% 127871067 / 128456520 / -0.5% 0.89 / 0.89 / +0.2%
tpch_q10/duckdb:parquet 108436128 / 110397083 / -1.8% 122890653 / 124849966 / -1.6% 0.88 / 0.88 / -0.2%
tpch_q11/duckdb:parquet 19959288 / 19711967 / +1.3% 24038488 / 23611969 / +1.8% 0.83 / 0.83 / -0.5%
tpch_q12/duckdb:parquet 41545615 / 41146734 / +1.0% 49772309 / 48938307 / +1.7% 0.83 / 0.84 / -0.7%
tpch_q13/duckdb:parquet 238610014 / 238752291 / -0.1% 247225794 / 248165975 / -0.4% 0.97 / 0.96 / +0.3%
tpch_q14/duckdb:parquet 43485854 / 43571013 / -0.2% 52635606 / 52250600 / +0.7% 0.83 / 0.83 / -0.9%
tpch_q15/duckdb:parquet 24851727 / 24758290 / +0.4% 30937700 / 31235434 / -1.0% 0.80 / 0.79 / +1.3%
tpch_q16/duckdb:parquet 49961159 / 50608977 / -1.3% 58022755 / 57330013 / +1.2% 0.86 / 0.88 / -2.5%
tpch_q17/duckdb:parquet 44528871 / 44394427 / +0.3% 53721098 / 53679338 / +0.1% 0.83 / 0.83 / +0.2%
tpch_q18/duckdb:parquet 89910032 / 92252151 / -2.5% 99163254 / 103555455 / -4.2% 0.91 / 0.89 / +1.8%
tpch_q19/duckdb:parquet 61296047 / 61000083 / +0.5% 71044956 / 71016356 / +0.0% 0.86 / 0.86 / +0.4%
tpch_q20/duckdb:parquet 58892232 / 58451703 / +0.8% 71283000 / 70618209 / +0.9% 0.83 / 0.83 / -0.2%
tpch_q21/duckdb:parquet 137465094 / 137928994 / -0.3% 148175668 / 147766061 / +0.3% 0.93 / 0.93 / -0.6%
tpch_q22/duckdb:parquet 50558937 / 50283364 / +0.5% 58446170 / 58191687 / +0.4% 0.87 / 0.86 / +0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR dfcb8c8e vs base d6037bc2
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.5%
Engines: DataFusion No clear signal (-9.6%, environment too noisy confidence) · DuckDB No clear signal (+1.0%, environment too noisy confidence)
Vortex (geomean): hot 0.964x ➖ · cold 0.994x ➖
Parquet (geomean): hot 1.009x ➖ · cold 1.130x ➖
Shifts: Parquet (control) +0.9% · Median polish +2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.907x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 54130098 / 55998776 / -3.3% 110779882 / 200527963 / -44.8% 🟢 0.49 / 0.28 / +75.0%
fineweb_q01/datafusion:vortex-file-compressed 407279452 / 388002186 / +5.0% 832009920 / 724768153 / +14.8% 0.49 / 0.54 / -8.6%
fineweb_q02/datafusion:vortex-file-compressed 430478774 / 374672964 / +14.9% 607199061 / 520031305 / +16.8% 0.71 / 0.72 / -1.6%
fineweb_q03/datafusion:vortex-file-compressed 611788789 / 1822266530 / -66.4% 🟢 814762363 / 768759282 / +6.0% 0.75 / 2.37 / -68.3%
fineweb_q04/datafusion:vortex-file-compressed 435410052 / 422465774 / +3.1% 433561948 / 420759381 / +3.0% 1.00 / 1.00 / +0.0%
fineweb_q05/datafusion:vortex-file-compressed 437118422 / 444775574 / -1.7% 447004097 / 452818251 / -1.3% 0.98 / 0.98 / -0.4%
fineweb_q06/datafusion:vortex-file-compressed 812544915 / 698533304 / +16.3% 810664931 / 685424914 / +18.3% 1.00 / 1.02 / -1.6%
fineweb_q07/datafusion:vortex-file-compressed 551627159 / 612257328 / -9.9% 503982917 / 556903917 / -9.5% 1.09 / 1.10 / -0.4%
fineweb_q08/datafusion:vortex-file-compressed 176147572 / 176425848 / -0.2% 194817946 / 195765550 / -0.5% 0.90 / 0.90 / +0.3%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 567381373 / 565360104 / +0.4% 1106532909 / 731309672 / +51.3% 🔴 0.51 / 0.77 / -33.7%
fineweb_q01/datafusion:parquet 784583055 / 937633982 / -16.3% 1065356103 / 729915270 / +46.0% 🔴 0.74 / 1.28 / -42.7%
fineweb_q02/datafusion:parquet 818245704 / 701105204 / +16.7% 802065787 / 668891826 / +19.9% 1.02 / 1.05 / -2.7%
fineweb_q03/datafusion:parquet 844639656 / 732746034 / +15.3% 749912429 / 667116821 / +12.4% 1.13 / 1.10 / +2.5%
fineweb_q04/datafusion:parquet 721086646 / 777328968 / -7.2% 916832984 / 949915156 / -3.5% 0.79 / 0.82 / -3.9%
fineweb_q05/datafusion:parquet 774630726 / 732624322 / +5.7% 958807004 / 716517348 / +33.8% 🔴 0.81 / 1.02 / -21.0%
fineweb_q06/datafusion:parquet 776346870 / 734808477 / +5.7% 807624397 / 638662783 / +26.5% 0.96 / 1.15 / -16.5%
fineweb_q07/datafusion:parquet 793545841 / 867966250 / -8.6% 792934206 / 675561678 / +17.4% 1.00 / 1.28 / -22.1%
fineweb_q08/datafusion:parquet 756408970 / 786138949 / -3.8% 838076369 / 742278165 / +12.9% 0.90 / 1.06 / -14.8%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 60153338 / 53315016 / +12.8% 73124418 / 70539299 / +3.7% 0.82 / 0.76 / +8.8%
fineweb_q01/duckdb:vortex-file-compressed 410581368 / 405381442 / +1.3% 494844458 / 531882019 / -7.0% 0.83 / 0.76 / +8.9%
fineweb_q02/duckdb:vortex-file-compressed 563241912 / 558958943 / +0.8% 633708277 / 604699256 / +4.8% 0.89 / 0.92 / -3.8%
fineweb_q03/duckdb:vortex-file-compressed 1084870720 / 994500838 / +9.1% 1192320317 / 1163874048 / +2.4% 0.91 / 0.85 / +6.5%
fineweb_q04/duckdb:vortex-file-compressed 976578098 / 975173854 / +0.1% 1007971843 / 1026272380 / -1.8% 0.97 / 0.95 / +2.0%
fineweb_q05/duckdb:vortex-file-compressed 865194246 / 894904810 / -3.3% 935467666 / 968543641 / -3.4% 0.92 / 0.92 / +0.1%
fineweb_q06/duckdb:vortex-file-compressed 1270797902 / 1184564434 / +7.3% 1192613606 / 1148158649 / +3.9% 1.07 / 1.03 / +3.3%
fineweb_q07/duckdb:vortex-file-compressed 1020794936 / 1101394915 / -7.3% 989822184 / 999441141 / -1.0% 1.03 / 1.10 / -6.4%
fineweb_q08/duckdb:vortex-file-compressed 413533230 / 403406806 / +2.5% 491985160 / 471724218 / +4.3% 0.84 / 0.86 / -1.7%
duckdb / parquet / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 496138517 / 461596745 / +7.5% 544305775 / 513575176 / +6.0% 0.91 / 0.90 / +1.4%
fineweb_q01/duckdb:parquet 606170556 / 567668842 / +6.8% 642887719 / 682549243 / -5.8% 0.94 / 0.83 / +13.4%
fineweb_q02/duckdb:parquet 587944036 / 703692055 / -16.4% 560804263 / 557917615 / +0.5% 1.05 / 1.26 / -16.9%
fineweb_q03/duckdb:parquet 1352797416 / 1457592607 / -7.2% 1534309730 / 1358299785 / +13.0% 0.88 / 1.07 / -17.8%
fineweb_q04/duckdb:parquet 786674208 / 733760795 / +7.2% 832102385 / 789467090 / +5.4% 0.95 / 0.93 / +1.7%
fineweb_q05/duckdb:parquet 1011801674 / 824121333 / +22.8% 994078551 / 871488358 / +14.1% 1.02 / 0.95 / +7.6%
fineweb_q06/duckdb:parquet 1678153489 / 1543663006 / +8.7% 1591693011 / 1760539063 / -9.6% 1.05 / 0.88 / +20.2%
fineweb_q07/duckdb:parquet 1017515938 / 1019703718 / -0.2% 1057671554 / 1027358063 / +3.0% 0.96 / 0.99 / -3.1%
fineweb_q08/duckdb:parquet 497850058 / 558076094 / -10.8% 499352608 / 455738125 / +9.6% 1.00 / 1.22 / -18.6%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR dfcb8c8e vs base d6037bc2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-2.7%, low confidence) · DuckDB No clear signal (+2.2%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.980x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1233937 / 1277858 / -3.4% 20131614 / 22001146 / -8.5% 0.06 / 0.06 / +5.5%
clickbench_q01/datafusion:vortex-file-compressed 6927069 / 7026869 / -1.4% 30606008 / 30297295 / +1.0% 0.23 / 0.23 / -2.4%
clickbench_q02/datafusion:vortex-file-compressed 13403529 / 12495708 / +7.3% 36917937 / 40846308 / -9.6% 0.36 / 0.31 / +18.7%
clickbench_q03/datafusion:vortex-file-compressed 12937487 / 12759804 / +1.4% 47300628 / 51986328 / -9.0% 0.27 / 0.25 / +11.4%
clickbench_q04/datafusion:vortex-file-compressed 56565282 / 56908643 / -0.6% 91346854 / 94493617 / -3.3% 0.62 / 0.60 / +2.8%
clickbench_q05/datafusion:vortex-file-compressed 77894170 / 77134072 / +1.0% 118041942 / 119422380 / -1.2% 0.66 / 0.65 / +2.2%
clickbench_q06/datafusion:vortex-file-compressed 1240624 / 1289964 / -3.8% 19935768 / 21370997 / -6.7% 0.06 / 0.06 / +3.1%
clickbench_q07/datafusion:vortex-file-compressed 13887885 / 13330566 / +4.2% 35887489 / 36720643 / -2.3% 0.39 / 0.36 / +6.6%
clickbench_q08/datafusion:vortex-file-compressed 77441028 / 80087234 / -3.3% 122145493 / 115472896 / +5.8% 0.63 / 0.69 / -8.6%
clickbench_q09/datafusion:vortex-file-compressed 174699900 / 172065102 / +1.5% 214052710 / 215614673 / -0.7% 0.82 / 0.80 / +2.3%
clickbench_q10/datafusion:vortex-file-compressed 40765362 / 39211119 / +4.0% 69241617 / 72950162 / -5.1% 0.59 / 0.54 / +9.5%
clickbench_q11/datafusion:vortex-file-compressed 55257330 / 53789694 / +2.7% 79416936 / 81379917 / -2.4% 0.70 / 0.66 / +5.3%
clickbench_q12/datafusion:vortex-file-compressed 75638779 / 76083334 / -0.6% 118163930 / 118733083 / -0.5% 0.64 / 0.64 / -0.1%
clickbench_q13/datafusion:vortex-file-compressed 124725545 / 122001700 / +2.2% 177653638 / 180806342 / -1.7% 0.70 / 0.67 / +4.0%
clickbench_q14/datafusion:vortex-file-compressed 83172062 / 85388487 / -2.6% 118174907 / 116239764 / +1.7% 0.70 / 0.73 / -4.2%
clickbench_q15/datafusion:vortex-file-compressed 64947926 / 62716728 / +3.6% 93172406 / 94375876 / -1.3% 0.70 / 0.66 / +4.9%
clickbench_q16/datafusion:vortex-file-compressed 156453329 / 155651816 / +0.5% 210408605 / 200961627 / +4.7% 0.74 / 0.77 / -4.0%
clickbench_q17/datafusion:vortex-file-compressed 151939752 / 155516794 / -2.3% 206862343 / 211981671 / -2.4% 0.73 / 0.73 / +0.1%
clickbench_q18/datafusion:vortex-file-compressed 299592250 / 302689370 / -1.0% 368387041 / 362738164 / +1.6% 0.81 / 0.83 / -2.5%
clickbench_q19/datafusion:vortex-file-compressed 8271848 / 8377062 / -1.3% 43673900 / 49562242 / -11.9% 🟢 0.19 / 0.17 / +12.1%
clickbench_q20/datafusion:vortex-file-compressed 67575440 / 68757188 / -1.7% 228635931 / 225688630 / +1.3% 0.30 / 0.30 / -3.0%
clickbench_q21/datafusion:vortex-file-compressed 96925795 / 98124171 / -1.2% 267065889 / 264376612 / +1.0% 0.36 / 0.37 / -2.2%
clickbench_q22/datafusion:vortex-file-compressed 118719091 / 121601120 / -2.4% 342655798 / 339489273 / +0.9% 0.35 / 0.36 / -3.3%
clickbench_q23/datafusion:vortex-file-compressed 343701562 / 384179952 / -10.5% 🟢 634241831 / 650635890 / -2.5% 0.54 / 0.59 / -8.2%
clickbench_q24/datafusion:vortex-file-compressed 21131996 / 21778803 / -3.0% 63541071 / 62631531 / +1.5% 0.33 / 0.35 / -4.4%
clickbench_q25/datafusion:vortex-file-compressed 28323898 / 25569445 / +10.8% 🔴 57717238 / 56702771 / +1.8% 0.49 / 0.45 / +8.8%
clickbench_q26/datafusion:vortex-file-compressed 21912738 / 21195808 / +3.4% 59341008 / 67479160 / -12.1% 🟢 0.37 / 0.31 / +17.6%
clickbench_q27/datafusion:vortex-file-compressed 99669109 / 100975817 / -1.3% 243492735 / 240273758 / +1.3% 0.41 / 0.42 / -2.6%
clickbench_q28/datafusion:vortex-file-compressed 569635849 / 570176517 / -0.1% 619044198 / 638797005 / -3.1% 0.92 / 0.89 / +3.1%
clickbench_q29/datafusion:vortex-file-compressed 24542736 / 24876594 / -1.3% 47736340 / 52270838 / -8.7% 0.51 / 0.48 / +8.0%
clickbench_q30/datafusion:vortex-file-compressed 84471302 / 84412644 / +0.1% 121584243 / 116355363 / +4.5% 0.69 / 0.73 / -4.2%
clickbench_q31/datafusion:vortex-file-compressed 83462641 / 83050484 / +0.5% 146975304 / 147832039 / -0.6% 0.57 / 0.56 / +1.1%
clickbench_q32/datafusion:vortex-file-compressed 305753042 / 298202207 / +2.5% 378875592 / 377321606 / +0.4% 0.81 / 0.79 / +2.1%
clickbench_q33/datafusion:vortex-file-compressed 336213334 / 335112892 / +0.3% 417417846 / 408165365 / +2.3% 0.81 / 0.82 / -1.9%
clickbench_q34/datafusion:vortex-file-compressed 338391908 / 341968073 / -1.0% 424270942 / 412167054 / +2.9% 0.80 / 0.83 / -3.9%
clickbench_q35/datafusion:vortex-file-compressed 57429802 / 57684964 / -0.4% 87802038 / 87598043 / +0.2% 0.65 / 0.66 / -0.7%
clickbench_q36/datafusion:vortex-file-compressed 37693604 / 37705719 / -0.0% 64682330 / 66719588 / -3.1% 0.58 / 0.57 / +3.1%
clickbench_q37/datafusion:vortex-file-compressed 22283328 / 21745756 / +2.5% 46329805 / 49476425 / -6.4% 0.48 / 0.44 / +9.4%
clickbench_q38/datafusion:vortex-file-compressed 12619550 / 12400570 / +1.8% 38780091 / 39836747 / -2.7% 0.33 / 0.31 / +4.5%
clickbench_q39/datafusion:vortex-file-compressed 78731740 / 78858318 / -0.2% 112355361 / 111370828 / +0.9% 0.70 / 0.71 / -1.0%
clickbench_q40/datafusion:vortex-file-compressed 11156128 / 11652952 / -4.3% 36115000 / 38348012 / -5.8% 0.31 / 0.30 / +1.7%
clickbench_q41/datafusion:vortex-file-compressed 10842082 / 10935576 / -0.9% 34804656 / 36079952 / -3.5% 0.31 / 0.30 / +2.8%
clickbench_q42/datafusion:vortex-file-compressed 11199372 / 11244426 / -0.4% 33954197 / 35820435 / -5.2% 0.33 / 0.31 / +5.1%
datafusion / parquet / ns (1.028x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1239831 / 1269212 / -2.3% 48436747 / 49671982 / -2.5% 0.03 / 0.03 / +0.2%
clickbench_q01/datafusion:parquet 16013642 / 15830790 / +1.2% 67257938 / 66792167 / +0.7% 0.24 / 0.24 / +0.5%
clickbench_q02/datafusion:parquet 18967044 / 18791914 / +0.9% 82170587 / 82223071 / -0.1% 0.23 / 0.23 / +1.0%
clickbench_q03/datafusion:parquet 17367628 / 17345418 / +0.1% 80155482 / 81197234 / -1.3% 0.22 / 0.21 / +1.4%
clickbench_q04/datafusion:parquet 62746848 / 61292346 / +2.4% 128193553 / 122703792 / +4.5% 0.49 / 0.50 / -2.0%
clickbench_q05/datafusion:parquet 88629458 / 86919438 / +2.0% 156734875 / 155576872 / +0.7% 0.57 / 0.56 / +1.2%
clickbench_q06/datafusion:parquet 1270636 / 1261905 / +0.7% 48586253 / 48687322 / -0.2% 0.03 / 0.03 / +0.9%
clickbench_q07/datafusion:parquet 16564800 / 16671054 / -0.6% 66317022 / 68397691 / -3.0% 0.25 / 0.24 / +2.5%
clickbench_q08/datafusion:parquet 85524226 / 85130552 / +0.5% 160934097 / 158389456 / +1.6% 0.53 / 0.54 / -1.1%
clickbench_q09/datafusion:parquet 190465908 / 188283868 / +1.2% 268553059 / 269992652 / -0.5% 0.71 / 0.70 / +1.7%
clickbench_q10/datafusion:parquet 36411800 / 35980258 / +1.2% 99296071 / 99020969 / +0.3% 0.37 / 0.36 / +0.9%
clickbench_q11/datafusion:parquet 43556965 / 41342503 / +5.4% 111641501 / 108080703 / +3.3% 0.39 / 0.38 / +2.0%
clickbench_q12/datafusion:parquet 96999730 / 93859676 / +3.3% 163115094 / 159786023 / +2.1% 0.59 / 0.59 / +1.2%
clickbench_q13/datafusion:parquet 149806013 / 143239508 / +4.6% 225805639 / 219671098 / +2.8% 0.66 / 0.65 / +1.7%
clickbench_q14/datafusion:parquet 101805136 / 99805066 / +2.0% 170630513 / 169729934 / +0.5% 0.60 / 0.59 / +1.5%
clickbench_q15/datafusion:parquet 75535556 / 70369934 / +7.3% 132888234 / 129380350 / +2.7% 0.57 / 0.54 / +4.5%
clickbench_q16/datafusion:parquet 157128798 / 152745678 / +2.9% 235267812 / 231527226 / +1.6% 0.67 / 0.66 / +1.2%
clickbench_q17/datafusion:parquet 157884400 / 152017450 / +3.9% 238994299 / 241003570 / -0.8% 0.66 / 0.63 / +4.7%
clickbench_q18/datafusion:parquet 311359323 / 310537638 / +0.3% 419915874 / 405254007 / +3.6% 0.74 / 0.77 / -3.2%
clickbench_q19/datafusion:parquet 19244506 / 20014577 / -3.8% 72949260 / 77345856 / -5.7% 0.26 / 0.26 / +1.9%
clickbench_q20/datafusion:parquet 177873100 / 168338143 / +5.7% 275071453 / 282610617 / -2.7% 0.65 / 0.60 / +8.6%
clickbench_q21/datafusion:parquet 175789859 / 162586705 / +8.1% 291034154 / 296463848 / -1.8% 0.60 / 0.55 / +10.1%
clickbench_q22/datafusion:parquet 260007617 / 247244004 / +5.2% 412550815 / 426271487 / -3.2% 0.63 / 0.58 / +8.7%
clickbench_q23/datafusion:parquet 1222057044 / 958033460 / +27.6% 🔴 1223338800 / 1188081892 / +3.0% 1.00 / 0.81 / +23.9%
clickbench_q24/datafusion:parquet 30086596 / 29687785 / +1.3% 85444576 / 88595086 / -3.6% 0.35 / 0.34 / +5.1%
clickbench_q25/datafusion:parquet 36227629 / 36038258 / +0.5% 99241404 / 100670421 / -1.4% 0.37 / 0.36 / +2.0%
clickbench_q26/datafusion:parquet 30680776 / 31076550 / -1.3% 85435981 / 89322154 / -4.4% 0.36 / 0.35 / +3.2%
clickbench_q27/datafusion:parquet 195098616 / 181681856 / +7.4% 284877431 / 282810554 / +0.7% 0.68 / 0.64 / +6.6%
clickbench_q28/datafusion:parquet 626732134 / 618188886 / +1.4% 697268914 / 703746785 / -0.9% 0.90 / 0.88 / +2.3%
clickbench_q29/datafusion:parquet 28347430 / 29160904 / -2.8% 89864266 / 92433642 / -2.8% 0.32 / 0.32 / -0.0%
clickbench_q30/datafusion:parquet 92584877 / 88375794 / +4.8% 165618416 / 174461962 / -5.1% 0.56 / 0.51 / +10.4%
clickbench_q31/datafusion:parquet 104952362 / 98630254 / +6.4% 190088311 / 194643150 / -2.3% 0.55 / 0.51 / +9.0%
clickbench_q32/datafusion:parquet 333154730 / 312151684 / +6.7% 426110061 / 411892021 / +3.5% 0.78 / 0.76 / +3.2%
clickbench_q33/datafusion:parquet 382273392 / 364431568 / +4.9% 473740705 / 457565242 / +3.5% 0.81 / 0.80 / +1.3%
clickbench_q34/datafusion:parquet 383523804 / 368467538 / +4.1% 474471925 / 459295201 / +3.3% 0.81 / 0.80 / +0.8%
clickbench_q35/datafusion:parquet 64013114 / 62238170 / +2.9% 122030827 / 125320460 / -2.6% 0.52 / 0.50 / +5.6%
clickbench_q36/datafusion:parquet 73407664 / 72923986 / +0.7% 132163993 / 137425131 / -3.8% 0.56 / 0.53 / +4.7%
clickbench_q37/datafusion:parquet 35598100 / 35407364 / +0.5% 90135409 / 91617279 / -1.6% 0.39 / 0.39 / +2.2%
clickbench_q38/datafusion:parquet 47773576 / 47201662 / +1.2% 105639577 / 107103084 / -1.4% 0.45 / 0.44 / +2.6%
clickbench_q39/datafusion:parquet 144244684 / 142504575 / +1.2% 204738993 / 207781095 / -1.5% 0.70 / 0.69 / +2.7%
clickbench_q40/datafusion:parquet 20281032 / 20079467 / +1.0% 75506006 / 77018654 / -2.0% 0.27 / 0.26 / +3.0%
clickbench_q41/datafusion:parquet 18882951 / 18578103 / +1.6% 74397200 / 74859829 / -0.6% 0.25 / 0.25 / +2.3%
clickbench_q42/datafusion:parquet 19318292 / 19179280 / +0.7% 73335196 / 74388541 / -1.4% 0.26 / 0.26 / +2.2%
duckdb / vortex-file-compressed / ns (1.005x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1654954 / 1580790 / +4.7% 23535139 / 26351019 / -10.7% 🟢 0.07 / 0.06 / +17.2%
clickbench_q01/duckdb:vortex-file-compressed 12062256 / 12074268 / -0.1% 27129934 / 25909663 / +4.7% 0.44 / 0.47 / -4.6%
clickbench_q02/duckdb:vortex-file-compressed 14234322 / 16326912 / -12.8% 🟢 32212909 / 32805534 / -1.8% 0.44 / 0.50 / -11.2%
clickbench_q03/duckdb:vortex-file-compressed 17724345 / 18192644 / -2.6% 44674171 / 49525202 / -9.8% 0.40 / 0.37 / +8.0%
clickbench_q04/duckdb:vortex-file-compressed 75327722 / 68795704 / +9.5% 98078695 / 101471375 / -3.3% 0.77 / 0.68 / +13.3%
clickbench_q05/duckdb:vortex-file-compressed 69777036 / 70734976 / -1.4% 96164902 / 94604085 / +1.6% 0.73 / 0.75 / -3.0%
clickbench_q06/duckdb:vortex-file-compressed 1833246 / 1892660 / -3.1% 29443307 / 29315843 / +0.4% 0.06 / 0.06 / -3.6%
clickbench_q07/duckdb:vortex-file-compressed 15959120 / 14476832 / +10.2% 🔴 36217884 / 29741876 / +21.8% 🔴 0.44 / 0.49 / -9.5%
clickbench_q08/duckdb:vortex-file-compressed 84927808 / 86277628 / -1.6% 119435903 / 125439785 / -4.8% 0.71 / 0.69 / +3.4%
clickbench_q09/duckdb:vortex-file-compressed 111574647 / 110210952 / +1.2% 144626557 / 154656273 / -6.5% 0.77 / 0.71 / +8.3%
clickbench_q10/duckdb:vortex-file-compressed 44861650 / 42802702 / +4.8% 79638837 / 75658341 / +5.3% 0.56 / 0.57 / -0.4%
clickbench_q11/duckdb:vortex-file-compressed 58260246 / 59811950 / -2.6% 85870441 / 90815831 / -5.4% 0.68 / 0.66 / +3.0%
clickbench_q12/duckdb:vortex-file-compressed 76205138 / 75687386 / +0.7% 107417834 / 111266189 / -3.5% 0.71 / 0.68 / +4.3%
clickbench_q13/duckdb:vortex-file-compressed 143936816 / 151871796 / -5.2% 177447839 / 194852061 / -8.9% 0.81 / 0.78 / +4.1%
clickbench_q14/duckdb:vortex-file-compressed 82456164 / 86213754 / -4.4% 111150788 / 117867111 / -5.7% 0.74 / 0.73 / +1.4%
clickbench_q15/duckdb:vortex-file-compressed 92015979 / 96786038 / -4.9% 129387924 / 132019367 / -2.0% 0.71 / 0.73 / -3.0%
clickbench_q16/duckdb:vortex-file-compressed 163059276 / 167114254 / -2.4% 211482878 / 216458679 / -2.3% 0.77 / 0.77 / -0.1%
clickbench_q17/duckdb:vortex-file-compressed 164139523 / 169188067 / -3.0% 211450804 / 207799775 / +1.8% 0.78 / 0.81 / -4.7%
clickbench_q18/duckdb:vortex-file-compressed 333920950 / 320696794 / +4.1% 411014491 / 374836582 / +9.7% 0.81 / 0.86 / -5.0%
clickbench_q19/duckdb:vortex-file-compressed 17845050 / 16236211 / +9.9% 41101919 / 41511083 / -1.0% 0.43 / 0.39 / +11.0%
clickbench_q20/duckdb:vortex-file-compressed 124950337 / 128715542 / -2.9% 199397547 / 201832233 / -1.2% 0.63 / 0.64 / -1.7%
clickbench_q21/duckdb:vortex-file-compressed 179279744 / 184030028 / -2.6% 294650691 / 324119836 / -9.1% 0.61 / 0.57 / +7.2%
clickbench_q22/duckdb:vortex-file-compressed 269147268 / 264176874 / +1.9% 437502037 / 479022046 / -8.7% 0.62 / 0.55 / +11.6%
clickbench_q23/duckdb:vortex-file-compressed 73025817 / 69574750 / +5.0% 120135038 / 112088996 / +7.2% 0.61 / 0.62 / -2.1%
clickbench_q24/duckdb:vortex-file-compressed 28241374 / 26466083 / +6.7% 42978665 / 44134781 / -2.6% 0.66 / 0.60 / +9.6%
clickbench_q25/duckdb:vortex-file-compressed 36043157 / 35819172 / +0.6% 54412907 / 58254618 / -6.6% 0.66 / 0.61 / +7.7%
clickbench_q26/duckdb:vortex-file-compressed 21669718 / 20637668 / +5.0% 38038102 / 39638199 / -4.0% 0.57 / 0.52 / +9.4%
clickbench_q27/duckdb:vortex-file-compressed 172652368 / 173709338 / -0.6% 268865225 / 286977040 / -6.3% 0.64 / 0.61 / +6.1%
clickbench_q28/duckdb:vortex-file-compressed 642175844 / 651417141 / -1.4% 675213014 / 706326089 / -4.4% 0.95 / 0.92 / +3.1%
clickbench_q29/duckdb:vortex-file-compressed 19607764 / 18090272 / +8.4% 38555485 / 37425900 / +3.0% 0.51 / 0.48 / +5.2%
clickbench_q30/duckdb:vortex-file-compressed 92812985 / 98879665 / -6.1% 123715690 / 133424620 / -7.3% 0.75 / 0.74 / +1.2%
clickbench_q31/duckdb:vortex-file-compressed 139902422 / 141141522 / -0.9% 208781141 / 220112523 / -5.1% 0.67 / 0.64 / +4.5%
clickbench_q32/duckdb:vortex-file-compressed 435727640 / 452546409 / -3.7% 484286867 / 490666424 / -1.3% 0.90 / 0.92 / -2.4%
clickbench_q33/duckdb:vortex-file-compressed 403407034 / 410481700 / -1.7% 509052968 / 516048050 / -1.4% 0.79 / 0.80 / -0.4%
clickbench_q34/duckdb:vortex-file-compressed 427284792 / 416499742 / +2.6% 536541938 / 538348987 / -0.3% 0.80 / 0.77 / +2.9%
clickbench_q35/duckdb:vortex-file-compressed 104560119 / 104349368 / +0.2% 135377386 / 139599151 / -3.0% 0.77 / 0.75 / +3.3%
clickbench_q36/duckdb:vortex-file-compressed 17814114 / 16348355 / +9.0% 34545052 / 31999737 / +8.0% 0.52 / 0.51 / +0.9%
clickbench_q37/duckdb:vortex-file-compressed 12629566 / 12514446 / +0.9% 29712272 / 27612693 / +7.6% 0.43 / 0.45 / -6.2%
clickbench_q38/duckdb:vortex-file-compressed 14162782 / 14165554 / -0.0% 29718470 / 31517560 / -5.7% 0.48 / 0.45 / +6.0%
clickbench_q39/duckdb:vortex-file-compressed 25171980 / 24695728 / +1.9% 43941210 / 46977235 / -6.5% 0.57 / 0.53 / +9.0%
clickbench_q40/duckdb:vortex-file-compressed 10983848 / 11355789 / -3.3% 28824305 / 29026802 / -0.7% 0.38 / 0.39 / -2.6%
clickbench_q41/duckdb:vortex-file-compressed 12533418 / 12696586 / -1.3% 29406165 / 31037363 / -5.3% 0.43 / 0.41 / +4.2%
clickbench_q42/duckdb:vortex-file-compressed 13912772 / 13013474 / +6.9% 30115050 / 30141565 / -0.1% 0.46 / 0.43 / +7.0%
duckdb / parquet / ns (0.983x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 7573146 / 8706266 / -13.0% 🟢 23858924 / 23103282 / +3.3% 0.32 / 0.38 / -15.8%
clickbench_q01/duckdb:parquet 9263248 / 9358030 / -1.0% 19836477 / 21638566 / -8.3% 0.47 / 0.43 / +8.0%
clickbench_q02/duckdb:parquet 14746132 / 15021124 / -1.8% 31614667 / 32913210 / -3.9% 0.47 / 0.46 / +2.2%
clickbench_q03/duckdb:parquet 15082632 / 15829214 / -4.7% 50390772 / 54223300 / -7.1% 0.30 / 0.29 / +2.5%
clickbench_q04/duckdb:parquet 69300591 / 69241474 / +0.1% 93267478 / 91311395 / +2.1% 0.74 / 0.76 / -2.0%
clickbench_q05/duckdb:parquet 82115368 / 81314521 / +1.0% 117849463 / 129986389 / -9.3% 0.70 / 0.63 / +11.4%
clickbench_q06/duckdb:parquet 14394851 / 17631072 / -18.4% 🟢 28679689 / 27737966 / +3.4% 0.50 / 0.64 / -21.0%
clickbench_q07/duckdb:parquet 11406555 / 11366487 / +0.4% 25089374 / 22718165 / +10.4% 🔴 0.45 / 0.50 / -9.1%
clickbench_q08/duckdb:parquet 84910016 / 83453878 / +1.7% 128688506 / 131237983 / -1.9% 0.66 / 0.64 / +3.8%
clickbench_q09/duckdb:parquet 118862322 / 115640260 / +2.8% 159566418 / 160306106 / -0.5% 0.74 / 0.72 / +3.3%
clickbench_q10/duckdb:parquet 32450626 / 34600591 / -6.2% 65924627 / 69259723 / -4.8% 0.49 / 0.50 / -1.5%
clickbench_q11/duckdb:parquet 36458239 / 36278903 / +0.5% 76988739 / 82438269 / -6.6% 0.47 / 0.44 / +7.6%
clickbench_q12/duckdb:parquet 92976758 / 91934228 / +1.1% 154989344 / 134102363 / +15.6% 🔴 0.60 / 0.69 / -12.5%
clickbench_q13/duckdb:parquet 146411159 / 145483204 / +0.6% 207069735 / 210373860 / -1.6% 0.71 / 0.69 / +2.2%
clickbench_q14/duckdb:parquet 98509740 / 98202322 / +0.3% 141010004 / 141183592 / -0.1% 0.70 / 0.70 / +0.4%
clickbench_q15/duckdb:parquet 93243198 / 91901444 / +1.5% 126224638 / 121427519 / +4.0% 0.74 / 0.76 / -2.4%
clickbench_q16/duckdb:parquet 168599935 / 171489876 / -1.7% 223104111 / 226667315 / -1.6% 0.76 / 0.76 / -0.1%
clickbench_q17/duckdb:parquet 182697600 / 180961562 / +1.0% 234216790 / 232263906 / +0.8% 0.78 / 0.78 / +0.1%
clickbench_q18/duckdb:parquet 320486877 / 343994246 / -6.8% 404774745 / 411327447 / -1.6% 0.79 / 0.84 / -5.3%
clickbench_q19/duckdb:parquet 12928781 / 13713836 / -5.7% 43522563 / 43285060 / +0.5% 0.30 / 0.32 / -6.2%
clickbench_q20/duckdb:parquet 134128268 / 134411169 / -0.2% 241457892 / 243609134 / -0.9% 0.56 / 0.55 / +0.7%
clickbench_q21/duckdb:parquet 179438466 / 181726696 / -1.3% 316756254 / 321428311 / -1.5% 0.57 / 0.57 / +0.2%
clickbench_q22/duckdb:parquet 241253003 / 251974915 / -4.3% 410933793 / 421657536 / -2.5% 0.59 / 0.60 / -1.8%
clickbench_q23/duckdb:parquet 146147089 / 144807872 / +0.9% 163581697 / 166495566 / -1.8% 0.89 / 0.87 / +2.7%
clickbench_q24/duckdb:parquet 42905614 / 42927254 / -0.1% 60661510 / 65797841 / -7.8% 0.71 / 0.65 / +8.4%
clickbench_q25/duckdb:parquet 39965651 / 40577998 / -1.5% 88132327 / 96929895 / -9.1% 0.45 / 0.42 / +8.3%
clickbench_q26/duckdb:parquet 31867936 / 30660028 / +3.9% 44706692 / 47765593 / -6.4% 0.71 / 0.64 / +11.1%
clickbench_q27/duckdb:parquet 142505421 / 144346226 / -1.3% 251823420 / 259903826 / -3.1% 0.57 / 0.56 / +1.9%
clickbench_q28/duckdb:parquet 898500826 / 905480214 / -0.8% 1035808062 / 994348029 / +4.2% 0.87 / 0.91 / -4.7%
clickbench_q29/duckdb:parquet 16787135 / 17644337 / -4.9% 29783388 / 32504410 / -8.4% 0.56 / 0.54 / +3.8%
clickbench_q30/duckdb:parquet 90727732 / 91432529 / -0.8% 173935896 / 171552049 / +1.4% 0.52 / 0.53 / -2.1%
clickbench_q31/duckdb:parquet 144584312 / 145301566 / -0.5% 288026691 / 291321737 / -1.1% 0.50 / 0.50 / +0.6%
clickbench_q32/duckdb:parquet 454484208 / 460725720 / -1.4% 493107003 / 580481653 / -15.1% 🟢 0.92 / 0.79 / +16.1%
clickbench_q33/duckdb:parquet 448840558 / 460139702 / -2.5% 480511977 / 492915264 / -2.5% 0.93 / 0.93 / +0.1%
clickbench_q34/duckdb:parquet 456038608 / 463103250 / -1.5% 500528837 / 496262255 / +0.9% 0.91 / 0.93 / -2.4%
clickbench_q35/duckdb:parquet 100368594 / 100535434 / -0.2% 130359002 / 120321920 / +8.3% 0.77 / 0.84 / -7.9%
clickbench_q36/duckdb:parquet 30975546 / 31129598 / -0.5% 41172457 / 63836924 / -35.5% 🟢 0.75 / 0.49 / +54.3%
clickbench_q37/duckdb:parquet 22668646 / 22520103 / +0.7% 31818273 / 31242935 / +1.8% 0.71 / 0.72 / -1.2%
clickbench_q38/duckdb:parquet 23738629 / 24132721 / -1.6% 42171592 / 33532001 / +25.8% 🔴 0.56 / 0.72 / -21.8%
clickbench_q39/duckdb:parquet 56077808 / 56722082 / -1.1% 66046734 / 65842979 / +0.3% 0.85 / 0.86 / -1.4%
clickbench_q40/duckdb:parquet 13094574 / 12834790 / +2.0% 22862188 / 21552389 / +6.1% 0.57 / 0.60 / -3.8%
clickbench_q41/duckdb:parquet 13333814 / 13069666 / +2.0% 22821558 / 23412973 / -2.5% 0.58 / 0.56 / +4.7%
clickbench_q42/duckdb:parquet 14287618 / 15077209 / -5.2% 25250833 / 24380426 / +3.6% 0.57 / 0.62 / -8.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR dfcb8c8e vs base d6037bc2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+2.4%, environment too noisy confidence) · DuckDB No clear signal (-3.0%, environment too noisy confidence)
Vortex (geomean): hot 1.018x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.021x ➖ · cold 1.025x ➖
Shifts: Parquet (control) +2.1% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.037x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 225149973 / 207143042 / +8.7% 732064905 / 913065787 / -19.8% 0.31 / 0.23 / +35.6%
tpch_q02/datafusion:vortex-file-compressed 332799318 / 317909180 / +4.7% 753679095 / 664588260 / +13.4% 0.44 / 0.48 / -7.7%
tpch_q03/datafusion:vortex-file-compressed 329397322 / 356415045 / -7.6% 1235270360 / 1399335323 / -11.7% 0.27 / 0.25 / +4.7%
tpch_q04/datafusion:vortex-file-compressed 168222613 / 153802726 / +9.4% 425634371 / 414587960 / +2.7% 0.40 / 0.37 / +6.5%
tpch_q05/datafusion:vortex-file-compressed 346298171 / 324046059 / +6.9% 564889352 / 584974299 / -3.4% 0.61 / 0.55 / +10.7%
tpch_q06/datafusion:vortex-file-compressed 253032610 / 259185406 / -2.4% 388737724 / 340997885 / +14.0% 0.65 / 0.76 / -14.4%
tpch_q07/datafusion:vortex-file-compressed 368672138 / 387323406 / -4.8% 509575380 / 459465780 / +10.9% 0.72 / 0.84 / -14.2%
tpch_q08/datafusion:vortex-file-compressed 552025013 / 539478309 / +2.3% 707263106 / 1896702733 / -62.7% 🟢 0.78 / 0.28 / +174.4%
tpch_q09/datafusion:vortex-file-compressed 464572604 / 440719735 / +5.4% 525286735 / 470999806 / +11.5% 0.88 / 0.94 / -5.5%
tpch_q10/datafusion:vortex-file-compressed 361496338 / 311756758 / +16.0% 520504090 / 516730904 / +0.7% 0.69 / 0.60 / +15.1%
tpch_q11/datafusion:vortex-file-compressed 276386005 / 280476665 / -1.5% 393689069 / 394239031 / -0.1% 0.70 / 0.71 / -1.3%
tpch_q12/datafusion:vortex-file-compressed 322763536 / 309803776 / +4.2% 492140486 / 462426832 / +6.4% 0.66 / 0.67 / -2.1%
tpch_q13/datafusion:vortex-file-compressed 126607425 / 168874291 / -25.0% 423209383 / 619432757 / -31.7% 🟢 0.30 / 0.27 / +9.7%
tpch_q14/datafusion:vortex-file-compressed 180712136 / 189825256 / -4.8% 388691221 / 246153497 / +57.9% 🔴 0.46 / 0.77 / -39.7%
tpch_q15/datafusion:vortex-file-compressed 291734430 / 284119267 / +2.7% 476459314 / 457805766 / +4.1% 0.61 / 0.62 / -1.3%
tpch_q16/datafusion:vortex-file-compressed 166831437 / 155645137 / +7.2% 305604880 / 274594428 / +11.3% 0.55 / 0.57 / -3.7%
tpch_q17/datafusion:vortex-file-compressed 279563674 / 267226212 / +4.6% 463937730 / 396920142 / +16.9% 0.60 / 0.67 / -10.5%
tpch_q18/datafusion:vortex-file-compressed 300450982 / 243498485 / +23.4% 961546434 / 386464050 / +148.8% 🔴 0.31 / 0.63 / -50.4%
tpch_q19/datafusion:vortex-file-compressed 352510428 / 335779542 / +5.0% 513960214 / 473211497 / +8.6% 0.69 / 0.71 / -3.3%
tpch_q20/datafusion:vortex-file-compressed 302721423 / 280549644 / +7.9% 465892969 / 401779029 / +16.0% 0.65 / 0.70 / -6.9%
tpch_q21/datafusion:vortex-file-compressed 521373670 / 437618747 / +19.1% 959522655 / 1058894433 / -9.4% 0.54 / 0.41 / +31.5%
tpch_q22/datafusion:vortex-file-compressed 157799011 / 143397448 / +10.0% 378962170 / 315384274 / +20.2% 0.42 / 0.45 / -8.4%
datafusion / parquet / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164290095 / 163825082 / +0.3% 578858852 / 491688601 / +17.7% 0.28 / 0.33 / -14.8%
tpch_q02/datafusion:parquet 267823833 / 257490466 / +4.0% 633915582 / 478392308 / +32.5% 🔴 0.42 / 0.54 / -21.5%
tpch_q03/datafusion:parquet 269532085 / 274554876 / -1.8% 771884590 / 765931664 / +0.8% 0.35 / 0.36 / -2.6%
tpch_q04/datafusion:parquet 135990694 / 155436663 / -12.5% 337770573 / 391624546 / -13.8% 0.40 / 0.40 / +1.4%
tpch_q05/datafusion:parquet 334506336 / 333895706 / +0.2% 458370826 / 459088752 / -0.2% 0.73 / 0.73 / +0.3%
tpch_q06/datafusion:parquet 126215588 / 131533293 / -4.0% 232185925 / 522033260 / -55.5% 🟢 0.54 / 0.25 / +115.7%
tpch_q07/datafusion:parquet 358197478 / 329094010 / +8.8% 463544950 / 449879914 / +3.0% 0.77 / 0.73 / +5.6%
tpch_q08/datafusion:parquet 445681764 / 424503998 / +5.0% 541169329 / 545899479 / -0.9% 0.82 / 0.78 / +5.9%
tpch_q09/datafusion:parquet 436484190 / 444902667 / -1.9% 633628903 / 608132277 / +4.2% 0.69 / 0.73 / -5.8%
tpch_q10/datafusion:parquet 384103618 / 370647159 / +3.6% 697575031 / 512294289 / +36.2% 🔴 0.55 / 0.72 / -23.9%
tpch_q11/datafusion:parquet 289536973 / 260848473 / +11.0% 515448965 / 432218249 / +19.3% 0.56 / 0.60 / -6.9%
tpch_q12/datafusion:parquet 194332012 / 178959295 / +8.6% 404983878 / 423607484 / -4.4% 0.48 / 0.42 / +13.6%
tpch_q13/datafusion:parquet 394491636 / 396777926 / -0.6% 596421708 / 627558838 / -5.0% 0.66 / 0.63 / +4.6%
tpch_q14/datafusion:parquet 160062356 / 164627528 / -2.8% 272499706 / 256617409 / +6.2% 0.59 / 0.64 / -8.4%
tpch_q15/datafusion:parquet 284719161 / 258319898 / +10.2% 417205774 / 630115998 / -33.8% 🟢 0.68 / 0.41 / +66.5%
tpch_q16/datafusion:parquet 107016356 / 110831990 / -3.4% 296374934 / 262914351 / +12.7% 0.36 / 0.42 / -14.3%
tpch_q17/datafusion:parquet 314149984 / 304554345 / +3.2% 713363665 / 405643523 / +75.9% 🔴 0.44 / 0.75 / -41.3%
tpch_q18/datafusion:parquet 386720002 / 406101315 / -4.8% 504322635 / 531893943 / -5.2% 0.77 / 0.76 / +0.4%
tpch_q19/datafusion:parquet 186827566 / 160224569 / +16.6% 283301389 / 277640805 / +2.0% 0.66 / 0.58 / +14.3%
tpch_q20/datafusion:parquet 241794415 / 249308954 / -3.0% 437769016 / 417183224 / +4.9% 0.55 / 0.60 / -7.6%
tpch_q21/datafusion:parquet 312966176 / 328063891 / -4.6% 420411147 / 425502619 / -1.2% 0.74 / 0.77 / -3.4%
tpch_q22/datafusion:parquet 166395379 / 166803204 / -0.2% 357423889 / 307132423 / +16.4% 0.47 / 0.54 / -14.3%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 197418271 / 199570873 / -1.1% 255220694 / 277427962 / -8.0% 0.77 / 0.72 / +7.5%
tpch_q02/duckdb:vortex-file-compressed 387619254 / 376751760 / +2.9% 414629422 / 453930097 / -8.7% 0.93 / 0.83 / +12.6%
tpch_q03/duckdb:vortex-file-compressed 420513026 / 389603964 / +7.9% 447981293 / 483655670 / -7.4% 0.94 / 0.81 / +16.5%
tpch_q04/duckdb:vortex-file-compressed 239973756 / 240863723 / -0.4% 290297575 / 244722048 / +18.6% 0.83 / 0.98 / -16.0%
tpch_q05/duckdb:vortex-file-compressed 362717111 / 360022076 / +0.7% 421775715 / 410736828 / +2.7% 0.86 / 0.88 / -1.9%
tpch_q06/duckdb:vortex-file-compressed 259814039 / 268817264 / -3.3% 306745625 / 296875702 / +3.3% 0.85 / 0.91 / -6.5%
tpch_q07/duckdb:vortex-file-compressed 409595127 / 471972291 / -13.2% 573605620 / 469567036 / +22.2% 0.71 / 1.01 / -29.0%
tpch_q08/duckdb:vortex-file-compressed 550034179 / 548807006 / +0.2% 549485617 / 634332512 / -13.4% 1.00 / 0.87 / +15.7%
tpch_q09/duckdb:vortex-file-compressed 443731040 / 496324655 / -10.6% 458252007 / 563758998 / -18.7% 0.97 / 0.88 / +10.0%
tpch_q10/duckdb:vortex-file-compressed 391253943 / 465526827 / -16.0% 398319089 / 475761593 / -16.3% 0.98 / 0.98 / +0.4%
tpch_q11/duckdb:vortex-file-compressed 150382267 / 148428059 / +1.3% 156611150 / 164590606 / -4.8% 0.96 / 0.90 / +6.5%
tpch_q12/duckdb:vortex-file-compressed 407144537 / 449077631 / -9.3% 655780163 / 404233864 / +62.2% 🔴 0.62 / 1.11 / -44.1%
tpch_q13/duckdb:vortex-file-compressed 272777326 / 280815219 / -2.9% 244273300 / 384444785 / -36.5% 🟢 1.12 / 0.73 / +52.9%
tpch_q14/duckdb:vortex-file-compressed 259167256 / 233794953 / +10.9% 272239533 / 270010692 / +0.8% 0.95 / 0.87 / +9.9%
tpch_q15/duckdb:vortex-file-compressed 159869479 / 144862740 / +10.4% 190231078 / 217073232 / -12.4% 0.84 / 0.67 / +25.9%
tpch_q16/duckdb:vortex-file-compressed 177165301 / 187152383 / -5.3% 193565872 / 224832643 / -13.9% 0.92 / 0.83 / +10.0%
tpch_q17/duckdb:vortex-file-compressed 452101974 / 362587252 / +24.7% 478141476 / 410022478 / +16.6% 0.95 / 0.88 / +6.9%
tpch_q18/duckdb:vortex-file-compressed 335906517 / 295169073 / +13.8% 318682623 / 346712832 / -8.1% 1.05 / 0.85 / +23.8%
tpch_q19/duckdb:vortex-file-compressed 333633195 / 325075439 / +2.6% 362110901 / 405975882 / -10.8% 0.92 / 0.80 / +15.1%
tpch_q20/duckdb:vortex-file-compressed 387493067 / 400508991 / -3.2% 447285540 / 480323384 / -6.9% 0.87 / 0.83 / +3.9%
tpch_q21/duckdb:vortex-file-compressed 728209369 / 560974020 / +29.8% 821943222 / 792134454 / +3.8% 0.89 / 0.71 / +25.1%
tpch_q22/duckdb:vortex-file-compressed 110701969 / 145847360 / -24.1% 148416761 / 144263647 / +2.9% 0.75 / 1.01 / -26.2%
duckdb / parquet / ns (1.031x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 273971927 / 270638367 / +1.2% 270088062 / 295169389 / -8.5% 1.01 / 0.92 / +10.6%
tpch_q02/duckdb:parquet 610258359 / 607114514 / +0.5% 609304888 / 625696037 / -2.6% 1.00 / 0.97 / +3.2%
tpch_q03/duckdb:parquet 721402132 / 661548586 / +9.0% 790116411 / 750016072 / +5.3% 0.91 / 0.88 / +3.5%
tpch_q04/duckdb:parquet 465946025 / 417059830 / +11.7% 460136165 / 521821433 / -11.8% 1.01 / 0.80 / +26.7%
tpch_q05/duckdb:parquet 880527238 / 896260507 / -1.8% 1130404522 / 945269782 / +19.6% 0.78 / 0.95 / -17.8%
tpch_q06/duckdb:parquet 307348414 / 277460978 / +10.8% 312130305 / 287345652 / +8.6% 0.98 / 0.97 / +2.0%
tpch_q07/duckdb:parquet 792511714 / 770786433 / +2.8% 810554756 / 758097030 / +6.9% 0.98 / 1.02 / -3.8%
tpch_q08/duckdb:parquet 965398073 / 980352635 / -1.5% 998531758 / 1098549562 / -9.1% 0.97 / 0.89 / +8.3%
tpch_q09/duckdb:parquet 944688061 / 1042730652 / -9.4% 932967997 / 918367817 / +1.6% 1.01 / 1.14 / -10.8%
tpch_q10/duckdb:parquet 934997619 / 930763568 / +0.5% 899822209 / 890047802 / +1.1% 1.04 / 1.05 / -0.6%
tpch_q11/duckdb:parquet 382020378 / 408822789 / -6.6% 358183314 / 501668326 / -28.6% 1.07 / 0.81 / +30.9%
tpch_q12/duckdb:parquet 565025755 / 477905323 / +18.2% 568527705 / 526415094 / +8.0% 0.99 / 0.91 / +9.5%
tpch_q13/duckdb:parquet 748156814 / 741449424 / +0.9% 938011448 / 922592118 / +1.7% 0.80 / 0.80 / -0.8%
tpch_q14/duckdb:parquet 486439085 / 465782907 / +4.4% 499328132 / 449509365 / +11.1% 0.97 / 1.04 / -6.0%
tpch_q15/duckdb:parquet 344452431 / 336985458 / +2.2% 363443138 / 334973082 / +8.5% 0.95 / 1.01 / -5.8%
tpch_q16/duckdb:parquet 450848471 / 451875398 / -0.2% 415919611 / 470619457 / -11.6% 1.08 / 0.96 / +12.9%
tpch_q17/duckdb:parquet 446662942 / 418483681 / +6.7% 500639924 / 552764622 / -9.4% 0.89 / 0.76 / +17.8%
tpch_q18/duckdb:parquet 597394513 / 613672101 / -2.7% 582637781 / 567957810 / +2.6% 1.03 / 1.08 / -5.1%
tpch_q19/duckdb:parquet 579559793 / 527947103 / +9.8% 628109113 / 563714109 / +11.4% 0.92 / 0.94 / -1.5%
tpch_q20/duckdb:parquet 840559482 / 762132637 / +10.3% 1244243087 / 773693762 / +60.8% 🔴 0.68 / 0.99 / -31.4%
tpch_q21/duckdb:parquet 631976674 / 621714649 / +1.7% 648257955 / 682530580 / -5.0% 0.97 / 0.91 / +7.0%
tpch_q22/duckdb:parquet 400450206 / 390135585 / +2.6% 521170422 / 390203214 / +33.6% 🔴 0.77 / 1.00 / -23.1%

@myrrc myrrc left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@robert3005
robert3005 merged commit 89b8177 into develop Sep 11, 2026
184 of 192 checks passed
@robert3005
robert3005 deleted the rk/scalarfilterpushdown branch September 11, 2026 09:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants