Adamg/remove map fn limit by AdamGS · Pull Request #8766 · vortex-data/vortex

AdamGS · 2026-07-15T11:47:34Z

Rationale for this change

Reviving #7565.

Scans previously rejected the combination of a filter and a limit, so SELECT ... WHERE ... LIMIT n
read and decoded every matching row and relied on the engine to throw rows away. The blocker was
structural: the ScanBuilder::map API threaded a generic result type through the entire scan stack,
which made shared limit accounting across splits and partitions awkward to express.

What changes are included in this PR?

This PR makes two key simplifications to the Scan/ScanBuilder API:

Makes the limit work with and without a filter
Removes the map API that allows executing work as part of the decode/filter work that the scan does. Aside from removing this somewhat complex API, it also removes the generic type boundary on the scan, which makes stuff like the limit work much easier.

What APIs are changed? Are there any user-facing changes?

Scan, ScanBuilder and RepeatedScan now don't have a generic bound.
ScanBuilder::map and ScanBuilder::build are removed

github-actions · 2026-08-07T15:08:47Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`72927cc`	statpopgen	1	Explore Profiling Data
🟢 Done	`72927cc`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`72927cc`	tpch-s3	1	Explore Profiling Data
🟢 Done	`72927cc`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`72927cc`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`72927cc`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`72927cc`	fineweb	1	Explore Profiling Data
🟢 Done	`72927cc`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`72927cc`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`72927cc`	polarsignals	1	Explore Profiling Data

Previous Runs (10)

Status	Commit	Job	Attempt	Link
🟢 Done	`4547be5`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`4547be5`	tpch-s3	1	Explore Profiling Data
🟢 Done	`4547be5`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`4547be5`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`4547be5`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`4547be5`	polarsignals	1	Explore Profiling Data
🟢 Done	`4547be5`	statpopgen	1	Explore Profiling Data
🟢 Done	`4547be5`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`4547be5`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`4547be5`	fineweb	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-08-07T15:10:27Z

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: DataFusion No clear signal (+4.8%, low confidence) · DuckDB No clear signal (-7.9%, low confidence)
Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.049x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	9068823	8347075	1.09
fineweb_q01/datafusion:vortex-file-compressed	31131749	28967251	1.07
fineweb_q02/datafusion:vortex-file-compressed	37622056	35452753	1.06
fineweb_q03/datafusion:vortex-file-compressed	43395490	41935353	1.03
fineweb_q04/datafusion:vortex-file-compressed	208885419	204272578	1.02
fineweb_q05/datafusion:vortex-file-compressed	156725414	153126437	1.02
fineweb_q06/datafusion:vortex-file-compressed	38357097	37258365	1.03
fineweb_q07/datafusion:vortex-file-compressed	40138621	38781767	1.03
fineweb_q08/datafusion:vortex-file-compressed	16653661	15474920	1.08

datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	8865574	8505717	1.04
fineweb_q01/datafusion:parquet	193464904	197083374	0.98
fineweb_q02/datafusion:parquet	197637500	196251017	1.01
fineweb_q03/datafusion:parquet	190904528	193111679	0.99
fineweb_q04/datafusion:parquet	205975273	207900138	0.99
fineweb_q05/datafusion:parquet	204903422	206303087	0.99
fineweb_q06/datafusion:parquet	198793069	197750439	1.01
fineweb_q07/datafusion:parquet	193206969	192584395	1.00
fineweb_q08/datafusion:parquet	188680240	188734572	1.00

duckdb / vortex-file-compressed / ns (0.928x ➖, 2↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	4761686	5047086	0.94
fineweb_q01/duckdb:vortex-file-compressed	44451366	45155257	0.98
fineweb_q02/duckdb:vortex-file-compressed	47759838	50670489	0.94
fineweb_q03/duckdb:vortex-file-compressed	68509930	70010843	0.98
fineweb_q04/duckdb:vortex-file-compressed	291041450	291742075	1.00
fineweb_q05/duckdb:vortex-file-compressed	216828866	230027059	0.94
fineweb_q06/duckdb:vortex-file-compressed 🚀	69163053	83499929	0.83
fineweb_q07/duckdb:vortex-file-compressed	77053591	81640767	0.94
fineweb_q08/duckdb:vortex-file-compressed 🚀	30354626	37470221	0.81

duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	37486487	36345055	1.03
fineweb_q01/duckdb:parquet	76972459	76257435	1.01
fineweb_q02/duckdb:parquet	79118247	77749699	1.02
fineweb_q03/duckdb:parquet	208172842	205778858	1.01
fineweb_q04/duckdb:parquet	228279580	235463608	0.97
fineweb_q05/duckdb:parquet	202430510	200690735	1.01
fineweb_q06/duckdb:parquet	141682727	142888900	0.99
fineweb_q07/duckdb:parquet	143419037	142312811	1.01
fineweb_q08/duckdb:parquet	40119818	39213515	1.02

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
sample.vortex	1.0	vortex-compact	1.23 GB	0 B	1.23 GB	-100.0%

Totals:

vortex-compact: 1.23 GB → 0 B (-100.0%)
vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

github-actions · 2026-08-07T15:12:48Z

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.6%
Engines: DataFusion No clear signal (+15.8%, environment too noisy confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): 1.088x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +3.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.199x ❌, 0↑ 5↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚨	485978272	360069300	1.35
clickbench-sorted_q24/datafusion:vortex-file-compressed	22981148	22178776	1.04
clickbench-sorted_q26/datafusion:vortex-file-compressed	22242679	23370113	0.95
clickbench-sorted_q36/datafusion:vortex-file-compressed	53984513	53737204	1.00
clickbench-sorted_q37/datafusion:vortex-file-compressed 🚨	44640650	35063344	1.27
clickbench-sorted_q38/datafusion:vortex-file-compressed 🚨	49544216	33768905	1.47
clickbench-sorted_q39/datafusion:vortex-file-compressed 🚨	143527283	90499014	1.59
clickbench-sorted_q40/datafusion:vortex-file-compressed	19157239	17436873	1.10
clickbench-sorted_q41/datafusion:vortex-file-compressed 🚨	22810774	17035675	1.34
clickbench-sorted_q42/datafusion:vortex-file-compressed	13634504	12966400	1.05

datafusion / parquet / ns (1.036x ➖, 1↑ 2↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet	2911932889	2911647571	1.00
clickbench-sorted_q24/datafusion:parquet 🚨	40151511	32706882	1.23
clickbench-sorted_q26/datafusion:parquet 🚀	50053341	56914029	0.88
clickbench-sorted_q36/datafusion:parquet	184621416	172780654	1.07
clickbench-sorted_q37/datafusion:parquet	100839677	107257970	0.94
clickbench-sorted_q38/datafusion:parquet	160866785	148427103	1.08
clickbench-sorted_q39/datafusion:parquet	302524657	299325324	1.01
clickbench-sorted_q40/datafusion:parquet	66644205	65824002	1.01
clickbench-sorted_q41/datafusion:parquet 🚨	63315630	57504499	1.10
clickbench-sorted_q42/datafusion:parquet	37401500	34930904	1.07

duckdb / vortex-file-compressed / ns (0.987x ➖, 1↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed	250864702	246699454	1.02
clickbench-sorted_q24/duckdb:vortex-file-compressed	42568336	41421619	1.03
clickbench-sorted_q26/duckdb:vortex-file-compressed	69503925	65636402	1.06
clickbench-sorted_q36/duckdb:vortex-file-compressed	63937137	65773914	0.97
clickbench-sorted_q37/duckdb:vortex-file-compressed	54086974	55374740	0.98
clickbench-sorted_q38/duckdb:vortex-file-compressed	62234882	63969570	0.97
clickbench-sorted_q39/duckdb:vortex-file-compressed	116536596	114590045	1.02
clickbench-sorted_q40/duckdb:vortex-file-compressed 🚀	34370457	40011207	0.86
clickbench-sorted_q41/duckdb:vortex-file-compressed	36883281	39140114	0.94
clickbench-sorted_q42/duckdb:vortex-file-compressed	30834851	29573336	1.04

duckdb / parquet / ns (0.987x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet	244902506	249849411	0.98
clickbench-sorted_q24/duckdb:parquet	28453544	30464209	0.93
clickbench-sorted_q26/duckdb:parquet	22175081	23278952	0.95
clickbench-sorted_q36/duckdb:parquet	67358410	67882687	0.99
clickbench-sorted_q37/duckdb:parquet	61825797	58121360	1.06
clickbench-sorted_q38/duckdb:parquet	59516210	60059180	0.99
clickbench-sorted_q39/duckdb:parquet	110207307	111413379	0.99
clickbench-sorted_q40/duckdb:parquet	29537650	29211202	1.01
clickbench-sorted_q41/duckdb:parquet	28589849	28047255	1.02
clickbench-sorted_q42/duckdb:parquet	19773890	21017344	0.94

File Size Changes (201 files changed, -42.8% overall, 55↑ 146↓)

File	Scale	Format	Base	HEAD	Change	%
hits_064.vortex	1.0	vortex-file-compressed	191.14 MB	193.14 MB	+2.00 MB	+1.0%
hits_096.vortex	1.0	vortex-file-compressed	198.15 MB	200.00 MB	+1.85 MB	+0.9%
hits_090.vortex	1.0	vortex-file-compressed	192.85 MB	194.59 MB	+1.74 MB	+0.9%
hits_074.vortex	1.0	vortex-file-compressed	198.04 MB	199.80 MB	+1.76 MB	+0.9%
hits_034.vortex	1.0	vortex-file-compressed	182.03 MB	183.61 MB	+1.57 MB	+0.9%
hits_081.vortex	1.0	vortex-file-compressed	198.53 MB	200.18 MB	+1.65 MB	+0.8%
hits_028.vortex	1.0	vortex-file-compressed	151.83 MB	153.02 MB	+1.19 MB	+0.8%
hits_007.vortex	1.0	vortex-file-compressed	199.07 MB	200.09 MB	+1.01 MB	+0.5%
hits_050.vortex	1.0	vortex-file-compressed	160.28 MB	161.06 MB	+798.13 KB	+0.5%
hits_095.vortex	1.0	vortex-file-compressed	154.33 MB	155.05 MB	+736.57 KB	+0.5%
hits_099.vortex	1.0	vortex-file-compressed	171.22 MB	171.92 MB	+713.91 KB	+0.4%
hits_004.vortex	1.0	vortex-file-compressed	131.32 MB	131.82 MB	+508.68 KB	+0.4%
hits_071.vortex	1.0	vortex-file-compressed	140.03 MB	140.52 MB	+497.86 KB	+0.3%
hits_041.vortex	1.0	vortex-file-compressed	131.24 MB	131.65 MB	+425.32 KB	+0.3%
hits_061.vortex	1.0	vortex-file-compressed	160.89 MB	161.35 MB	+472.94 KB	+0.3%
hits_052.vortex	1.0	vortex-file-compressed	131.10 MB	131.46 MB	+368.99 KB	+0.3%
hits_094.vortex	1.0	vortex-file-compressed	158.38 MB	158.81 MB	+437.63 KB	+0.3%
hits_087.vortex	1.0	vortex-file-compressed	161.10 MB	161.53 MB	+432.26 KB	+0.3%
hits_038.vortex	1.0	vortex-file-compressed	190.10 MB	190.55 MB	+457.92 KB	+0.2%
hits_063.vortex	1.0	vortex-file-compressed	131.48 MB	131.77 MB	+296.57 KB	+0.2%
hits_054.vortex	1.0	vortex-file-compressed	146.97 MB	147.26 MB	+304.21 KB	+0.2%
hits_035.vortex	1.0	vortex-file-compressed	102.82 MB	103.01 MB	+192.81 KB	+0.2%
hits_022.vortex	1.0	vortex-file-compressed	198.76 MB	199.07 MB	+322.62 KB	+0.2%
hits_015.vortex	1.0	vortex-file-compressed	131.23 MB	131.43 MB	+203.05 KB	+0.2%
hits_092.vortex	1.0	vortex-file-compressed	199.50 MB	199.80 MB	+308.16 KB	+0.2%
hits_078.vortex	1.0	vortex-file-compressed	130.94 MB	131.09 MB	+148.66 KB	+0.1%
hits_048.vortex	1.0	vortex-file-compressed	199.40 MB	199.63 MB	+225.95 KB	+0.1%
hits_040.vortex	1.0	vortex-file-compressed	142.97 MB	143.12 MB	+148.82 KB	+0.1%
hits_049.vortex	1.0	vortex-file-compressed	191.48 MB	191.66 MB	+185.66 KB	+0.1%
hits_000.vortex	1.0	vortex-file-compressed	131.54 MB	131.66 MB	+121.61 KB	+0.1%
hits_046.vortex	1.0	vortex-file-compressed	101.08 MB	101.16 MB	+85.12 KB	+0.1%
hits_056.vortex	1.0	vortex-file-compressed	135.74 MB	135.84 MB	+106.66 KB	+0.1%
hits_011.vortex	1.0	vortex-file-compressed	199.23 MB	199.38 MB	+149.43 KB	+0.1%
hits_014.vortex	1.0	vortex-file-compressed	172.08 MB	172.20 MB	+116.16 KB	+0.1%
hits_089.vortex	1.0	vortex-file-compressed	131.68 MB	131.77 MB	+87.03 KB	+0.1%
hits_069.vortex	1.0	vortex-file-compressed	142.26 MB	142.36 MB	+93.98 KB	+0.1%
hits_029.vortex	1.0	vortex-file-compressed	199.83 MB	199.96 MB	+131.68 KB	+0.1%
hits_021.vortex	1.0	vortex-file-compressed	154.25 MB	154.34 MB	+91.98 KB	+0.1%
hits_088.vortex	1.0	vortex-file-compressed	172.12 MB	172.22 MB	+100.89 KB	+0.1%
hits_060.vortex	1.0	vortex-file-compressed	193.11 MB	193.20 MB	+96.57 KB	+0.0%
hits_037.vortex	1.0	vortex-file-compressed	177.28 MB	177.36 MB	+83.34 KB	+0.0%
hits_085.vortex	1.0	vortex-file-compressed	199.59 MB	199.68 MB	+88.80 KB	+0.0%
hits_020.vortex	1.0	vortex-file-compressed	160.29 MB	160.36 MB	+68.04 KB	+0.0%
hits_024.vortex	1.0	vortex-file-compressed	161.02 MB	161.07 MB	+58.16 KB	+0.0%
hits_091.vortex	1.0	vortex-file-compressed	147.07 MB	147.10 MB	+40.16 KB	+0.0%
hits_084.vortex	1.0	vortex-file-compressed	154.53 MB	154.57 MB	+35.81 KB	+0.0%
hits_001.vortex	1.0	vortex-file-compressed	193.50 MB	193.53 MB	+37.61 KB	+0.0%
hits_053.vortex	1.0	vortex-file-compressed	189.97 MB	190.00 MB	+34.82 KB	+0.0%
hits_032.vortex	1.0	vortex-file-compressed	154.74 MB	154.76 MB	+21.29 KB	+0.0%
hits_059.vortex	1.0	vortex-file-compressed	199.04 MB	199.07 MB	+27.02 KB	+0.0%
hits_051.vortex	1.0	vortex-file-compressed	172.50 MB	172.52 MB	+20.52 KB	+0.0%
hits_076.vortex	1.0	vortex-file-compressed	160.92 MB	160.93 MB	+8.10 KB	+0.0%
hits_012.vortex	1.0	vortex-file-compressed	191.05 MB	191.05 MB	+9.10 KB	+0.0%
hits_055.vortex	1.0	vortex-file-compressed	199.60 MB	199.61 MB	+8.60 KB	+0.0%
hits_003.vortex	1.0	vortex-file-compressed	136.64 MB	136.64 MB	+4.27 KB	+0.0%
hits_080.vortex	1.0	vortex-file-compressed	126.97 MB	126.97 MB	3.50 KB	-0.0%
hits_070.vortex	1.0	vortex-file-compressed	199.94 MB	199.94 MB	6.05 KB	-0.0%
hits_057.vortex	1.0	vortex-file-compressed	160.45 MB	160.44 MB	8.40 KB	-0.0%
hits_036.vortex	1.0	vortex-file-compressed	171.43 MB	171.42 MB	9.92 KB	-0.0%
hits_023.vortex	1.0	vortex-file-compressed	195.37 MB	195.36 MB	18.54 KB	-0.0%
hits_065.vortex	1.0	vortex-file-compressed	161.44 MB	161.43 MB	16.49 KB	-0.0%
hits_077.vortex	1.0	vortex-file-compressed	172.46 MB	172.43 MB	33.93 KB	-0.0%
hits_045.vortex	1.0	vortex-file-compressed	140.80 MB	140.76 MB	36.16 KB	-0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.47 MB	126.43 MB	37.93 KB	-0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.93 MB	131.89 MB	43.50 KB	-0.0%
hits_083.vortex	1.0	vortex-file-compressed	157.32 MB	157.27 MB	58.51 KB	-0.0%
hits_098.vortex	1.0	vortex-file-compressed	137.58 MB	137.49 MB	90.43 KB	-0.1%
hits_013.vortex	1.0	vortex-file-compressed	161.27 MB	161.15 MB	115.21 KB	-0.1%
hits_067.vortex	1.0	vortex-file-compressed	131.89 MB	131.79 MB	101.16 KB	-0.1%
hits_008.vortex	1.0	vortex-file-compressed	140.41 MB	140.30 MB	109.97 KB	-0.1%
hits_009.vortex	1.0	vortex-file-compressed	101.49 MB	101.41 MB	81.73 KB	-0.1%
hits_062.vortex	1.0	vortex-file-compressed	170.80 MB	170.66 MB	142.26 KB	-0.1%
hits_010.vortex	1.0	vortex-file-compressed	169.22 MB	169.08 MB	148.73 KB	-0.1%
hits_047.vortex	1.0	vortex-file-compressed	154.60 MB	154.46 MB	149.66 KB	-0.1%
hits_016.vortex	1.0	vortex-file-compressed	180.66 MB	180.48 MB	183.80 KB	-0.1%
hits_026.vortex	1.0	vortex-file-compressed	131.33 MB	131.20 MB	134.37 KB	-0.1%
hits_002.vortex	1.0	vortex-file-compressed	161.15 MB	160.99 MB	169.87 KB	-0.1%
hits_068.vortex	1.0	vortex-file-compressed	160.83 MB	160.65 MB	184.38 KB	-0.1%
hits_082.vortex	1.0	vortex-file-compressed	140.83 MB	140.64 MB	186.70 KB	-0.1%
hits_017.vortex	1.0	vortex-file-compressed	147.16 MB	146.96 MB	200.84 KB	-0.1%
hits_058.vortex	1.0	vortex-file-compressed	155.43 MB	155.19 MB	250.01 KB	-0.2%
hits_097.vortex	1.0	vortex-file-compressed	193.27 MB	192.95 MB	326.31 KB	-0.2%
hits_093.vortex	1.0	vortex-file-compressed	131.90 MB	131.66 MB	248.35 KB	-0.2%
hits_072.vortex	1.0	vortex-file-compressed	102.56 MB	102.35 MB	212.77 KB	-0.2%
hits_044.vortex	1.0	vortex-file-compressed	200.20 MB	199.75 MB	461.10 KB	-0.2%
hits_042.vortex	1.0	vortex-file-compressed	202.08 MB	201.61 MB	483.01 KB	-0.2%
hits_019.vortex	1.0	vortex-file-compressed	141.38 MB	141.05 MB	338.05 KB	-0.2%
hits_079.vortex	1.0	vortex-file-compressed	181.40 MB	180.96 MB	451.69 KB	-0.2%
hits_039.vortex	1.0	vortex-file-compressed	161.52 MB	161.10 MB	436.30 KB	-0.3%
hits_031.vortex	1.0	vortex-file-compressed	160.51 MB	160.06 MB	459.40 KB	-0.3%
hits_043.vortex	1.0	vortex-file-compressed	126.93 MB	126.54 MB	395.54 KB	-0.3%
hits_073.vortex	1.0	vortex-file-compressed	173.27 MB	172.74 MB	545.14 KB	-0.3%
hits_005.vortex	1.0	vortex-file-compressed	168.33 MB	167.81 MB	535.37 KB	-0.3%
hits_018.vortex	1.0	vortex-file-compressed	200.31 MB	199.62 MB	705.16 KB	-0.3%
hits_025.vortex	1.0	vortex-file-compressed	172.61 MB	171.99 MB	631.74 KB	-0.4%
hits_033.vortex	1.0	vortex-file-compressed	200.73 MB	199.96 MB	790.32 KB	-0.4%
hits_066.vortex	1.0	vortex-file-compressed	164.79 MB	163.34 MB	1.45 MB	-0.9%
hits_075.vortex	1.0	vortex-file-compressed	191.47 MB	189.65 MB	1.83 MB	-1.0%
hits_086.vortex	1.0	vortex-file-compressed	194.55 MB	192.17 MB	2.38 MB	-1.2%
hits_027.vortex	1.0	vortex-file-compressed	192.74 MB	190.08 MB	2.66 MB	-1.4%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
hits_000.vortex	1.0	vortex-compact	98.11 MB	0 B	98.11 MB	-100.0%
hits_001.vortex	1.0	vortex-compact	140.51 MB	0 B	140.51 MB	-100.0%
hits_002.vortex	1.0	vortex-compact	124.18 MB	0 B	124.18 MB	-100.0%
hits_003.vortex	1.0	vortex-compact	104.57 MB	0 B	104.57 MB	-100.0%
hits_004.vortex	1.0	vortex-compact	98.19 MB	0 B	98.19 MB	-100.0%
hits_005.vortex	1.0	vortex-compact	116.41 MB	0 B	116.41 MB	-100.0%
hits_006.vortex	1.0	vortex-compact	96.10 MB	0 B	96.10 MB	-100.0%
hits_007.vortex	1.0	vortex-compact	153.88 MB	0 B	153.88 MB	-100.0%
hits_008.vortex	1.0	vortex-compact	105.71 MB	0 B	105.71 MB	-100.0%
hits_009.vortex	1.0	vortex-compact	75.29 MB	0 B	75.29 MB	-100.0%
hits_010.vortex	1.0	vortex-compact	123.36 MB	0 B	123.36 MB	-100.0%
hits_011.vortex	1.0	vortex-compact	152.85 MB	0 B	152.85 MB	-100.0%
hits_012.vortex	1.0	vortex-compact	140.10 MB	0 B	140.10 MB	-100.0%
hits_013.vortex	1.0	vortex-compact	125.69 MB	0 B	125.69 MB	-100.0%
hits_014.vortex	1.0	vortex-compact	134.15 MB	0 B	134.15 MB	-100.0%
hits_015.vortex	1.0	vortex-compact	98.21 MB	0 B	98.21 MB	-100.0%
hits_016.vortex	1.0	vortex-compact	127.56 MB	0 B	127.56 MB	-100.0%
hits_017.vortex	1.0	vortex-compact	112.29 MB	0 B	112.29 MB	-100.0%
hits_018.vortex	1.0	vortex-compact	153.86 MB	0 B	153.86 MB	-100.0%
hits_019.vortex	1.0	vortex-compact	106.22 MB	0 B	106.22 MB	-100.0%
hits_020.vortex	1.0	vortex-compact	111.70 MB	0 B	111.70 MB	-100.0%
hits_021.vortex	1.0	vortex-compact	110.68 MB	0 B	110.68 MB	-100.0%
hits_022.vortex	1.0	vortex-compact	153.05 MB	0 B	153.05 MB	-100.0%
hits_023.vortex	1.0	vortex-compact	141.91 MB	0 B	141.91 MB	-100.0%
hits_024.vortex	1.0	vortex-compact	123.91 MB	0 B	123.91 MB	-100.0%
hits_025.vortex	1.0	vortex-compact	133.49 MB	0 B	133.49 MB	-100.0%
hits_026.vortex	1.0	vortex-compact	98.18 MB	0 B	98.18 MB	-100.0%
hits_027.vortex	1.0	vortex-compact	139.27 MB	0 B	139.27 MB	-100.0%
hits_028.vortex	1.0	vortex-compact	115.72 MB	0 B	115.72 MB	-100.0%
hits_029.vortex	1.0	vortex-compact	153.62 MB	0 B	153.62 MB	-100.0%
hits_030.vortex	1.0	vortex-compact	99.11 MB	0 B	99.11 MB	-100.0%
hits_031.vortex	1.0	vortex-compact	111.63 MB	0 B	111.63 MB	-100.0%
hits_032.vortex	1.0	vortex-compact	110.65 MB	0 B	110.65 MB	-100.0%
hits_033.vortex	1.0	vortex-compact	153.86 MB	0 B	153.86 MB	-100.0%
hits_034.vortex	1.0	vortex-compact	133.85 MB	0 B	133.85 MB	-100.0%
hits_035.vortex	1.0	vortex-compact	75.99 MB	0 B	75.99 MB	-100.0%
hits_036.vortex	1.0	vortex-compact	133.27 MB	0 B	133.27 MB	-100.0%
hits_037.vortex	1.0	vortex-compact	132.54 MB	0 B	132.54 MB	-100.0%
hits_038.vortex	1.0	vortex-compact	139.57 MB	0 B	139.57 MB	-100.0%
hits_039.vortex	1.0	vortex-compact	126.34 MB	0 B	126.34 MB	-100.0%
hits_040.vortex	1.0	vortex-compact	110.50 MB	0 B	110.50 MB	-100.0%
hits_041.vortex	1.0	vortex-compact	97.46 MB	0 B	97.46 MB	-100.0%
hits_042.vortex	1.0	vortex-compact	136.51 MB	0 B	136.51 MB	-100.0%
hits_043.vortex	1.0	vortex-compact	94.36 MB	0 B	94.36 MB	-100.0%
hits_044.vortex	1.0	vortex-compact	153.80 MB	0 B	153.80 MB	-100.0%
hits_045.vortex	1.0	vortex-compact	106.21 MB	0 B	106.21 MB	-100.0%
hits_046.vortex	1.0	vortex-compact	74.94 MB	0 B	74.94 MB	-100.0%
hits_047.vortex	1.0	vortex-compact	110.54 MB	0 B	110.54 MB	-100.0%
hits_048.vortex	1.0	vortex-compact	152.65 MB	0 B	152.65 MB	-100.0%
hits_049.vortex	1.0	vortex-compact	140.52 MB	0 B	140.52 MB	-100.0%
hits_050.vortex	1.0	vortex-compact	124.91 MB	0 B	124.91 MB	-100.0%
hits_051.vortex	1.0	vortex-compact	134.09 MB	0 B	134.09 MB	-100.0%
hits_052.vortex	1.0	vortex-compact	98.63 MB	0 B	98.63 MB	-100.0%
hits_053.vortex	1.0	vortex-compact	138.55 MB	0 B	138.55 MB	-100.0%
hits_054.vortex	1.0	vortex-compact	112.31 MB	0 B	112.31 MB	-100.0%
hits_055.vortex	1.0	vortex-compact	153.48 MB	0 B	153.48 MB	-100.0%
hits_056.vortex	1.0	vortex-compact	100.89 MB	0 B	100.89 MB	-100.0%
hits_057.vortex	1.0	vortex-compact	111.83 MB	0 B	111.83 MB	-100.0%
hits_058.vortex	1.0	vortex-compact	111.11 MB	0 B	111.11 MB	-100.0%
hits_059.vortex	1.0	vortex-compact	152.05 MB	0 B	152.05 MB	-100.0%
hits_060.vortex	1.0	vortex-compact	141.19 MB	0 B	141.19 MB	-100.0%
hits_061.vortex	1.0	vortex-compact	123.98 MB	0 B	123.98 MB	-100.0%
hits_062.vortex	1.0	vortex-compact	132.86 MB	0 B	132.86 MB	-100.0%
hits_063.vortex	1.0	vortex-compact	97.89 MB	0 B	97.89 MB	-100.0%
hits_064.vortex	1.0	vortex-compact	138.80 MB	0 B	138.80 MB	-100.0%
hits_065.vortex	1.0	vortex-compact	123.98 MB	0 B	123.98 MB	-100.0%
hits_066.vortex	1.0	vortex-compact	116.79 MB	0 B	116.79 MB	-100.0%
hits_067.vortex	1.0	vortex-compact	98.65 MB	0 B	98.65 MB	-100.0%
hits_068.vortex	1.0	vortex-compact	112.58 MB	0 B	112.58 MB	-100.0%
hits_069.vortex	1.0	vortex-compact	99.72 MB	0 B	99.72 MB	-100.0%
hits_070.vortex	1.0	vortex-compact	153.61 MB	0 B	153.61 MB	-100.0%
hits_071.vortex	1.0	vortex-compact	106.20 MB	0 B	106.20 MB	-100.0%
hits_072.vortex	1.0	vortex-compact	75.71 MB	0 B	75.71 MB	-100.0%
hits_073.vortex	1.0	vortex-compact	134.37 MB	0 B	134.37 MB	-100.0%
hits_074.vortex	1.0	vortex-compact	153.13 MB	0 B	153.13 MB	-100.0%
hits_075.vortex	1.0	vortex-compact	139.16 MB	0 B	139.16 MB	-100.0%
hits_076.vortex	1.0	vortex-compact	125.38 MB	0 B	125.38 MB	-100.0%
hits_077.vortex	1.0	vortex-compact	134.11 MB	0 B	134.11 MB	-100.0%
hits_078.vortex	1.0	vortex-compact	97.70 MB	0 B	97.70 MB	-100.0%
hits_079.vortex	1.0	vortex-compact	128.12 MB	0 B	128.12 MB	-100.0%
hits_080.vortex	1.0	vortex-compact	97.25 MB	0 B	97.25 MB	-100.0%
hits_081.vortex	1.0	vortex-compact	153.70 MB	0 B	153.70 MB	-100.0%
hits_082.vortex	1.0	vortex-compact	106.26 MB	0 B	106.26 MB	-100.0%
hits_083.vortex	1.0	vortex-compact	110.12 MB	0 B	110.12 MB	-100.0%
hits_084.vortex	1.0	vortex-compact	110.70 MB	0 B	110.70 MB	-100.0%
hits_085.vortex	1.0	vortex-compact	153.59 MB	0 B	153.59 MB	-100.0%
hits_086.vortex	1.0	vortex-compact	140.74 MB	0 B	140.74 MB	-100.0%
hits_087.vortex	1.0	vortex-compact	125.27 MB	0 B	125.27 MB	-100.0%
hits_088.vortex	1.0	vortex-compact	134.23 MB	0 B	134.23 MB	-100.0%
hits_089.vortex	1.0	vortex-compact	98.80 MB	0 B	98.80 MB	-100.0%
hits_090.vortex	1.0	vortex-compact	141.31 MB	0 B	141.31 MB	-100.0%
hits_091.vortex	1.0	vortex-compact	112.38 MB	0 B	112.38 MB	-100.0%
hits_092.vortex	1.0	vortex-compact	153.26 MB	0 B	153.26 MB	-100.0%
hits_093.vortex	1.0	vortex-compact	98.41 MB	0 B	98.41 MB	-100.0%
hits_094.vortex	1.0	vortex-compact	110.87 MB	0 B	110.87 MB	-100.0%
hits_095.vortex	1.0	vortex-compact	110.71 MB	0 B	110.71 MB	-100.0%
hits_096.vortex	1.0	vortex-compact	153.28 MB	0 B	153.28 MB	-100.0%
hits_097.vortex	1.0	vortex-compact	141.96 MB	0 B	141.96 MB	-100.0%
hits_098.vortex	1.0	vortex-compact	102.95 MB	0 B	102.95 MB	-100.0%
hits_099.vortex	1.0	vortex-compact	133.11 MB	0 B	133.11 MB	-100.0%

Totals:

vortex-compact: 11.94 GB → 0 B (-100.0%)
vortex-file-compressed: 15.97 GB → 15.98 GB (+0.0%)

github-actions · 2026-08-07T15:14:14Z

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.3%, environment too noisy confidence)
Vortex (geomean): 0.991x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.989x ➖, 1↑ 1↓)

name	PR `72927cc` (ns)	base `6337c7e` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀	309186965	345135509	0.90
tpch_q02/datafusion:vortex-file-compressed	110615716	102787593	1.08
tpch_q03/datafusion:vortex-file-compressed	159575962	163975673	0.97
tpch_q04/datafusion:vortex-file-compressed	70124353	69323822	1.01
tpch_q05/datafusion:vortex-file-compressed	274412973	272949884	1.01
tpch_q06/datafusion:vortex-file-compressed	25451029	26086031	0.98
tpch_q07/datafusion:vortex-file-compressed	368164570	361718238	1.02
tpch_q08/datafusion:vortex-file-compressed	289429755	291033799	0.99
tpch_q09/datafusion:vortex-file-compressed	463693857	492164379	0.94
tpch_q10/datafusion:vortex-file-compressed	179654812	181294338	0.99
tpch_q11/datafusion:vortex-file-compressed	74230255	81365965	0.91
tpch_q12/datafusion:vortex-file-compressed	83561366	87678757	0.95
tpch_q13/datafusion:vortex-file-compressed	115254081	119015423	0.97
tpch_q14/datafusion:vortex-file-compressed	41236173	40986765	1.01
tpch_q15/datafusion:vortex-file-compressed 🚨	79852333	72533376	1.10
tpch_q16/datafusion:vortex-file-compressed	67170882	72745033	0.92
tpch_q17/datafusion:vortex-file-compressed	432868990	430836152	1.00
tpch_q18/datafusion:vortex-file-compressed	638625255	635395791	1.01
tpch_q19/datafusion:vortex-file-compressed	62094773	62007229	1.00
tpch_q20/datafusion:vortex-file-compressed	139456935	138578307	1.01
tpch_q21/datafusion:vortex-file-compressed	480128590	467941193	1.03
tpch_q22/datafusion:vortex-file-compressed	41708199	41805038	1.00

datafusion / parquet / ns (0.991x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `6337c7e` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	320613095	322356930	0.99
tpch_q02/datafusion:parquet	226895075	224030596	1.01
tpch_q03/datafusion:parquet	230102616	230570249	1.00
tpch_q04/datafusion:parquet	100815712	101181984	1.00
tpch_q05/datafusion:parquet	368839223	362522932	1.02
tpch_q06/datafusion:parquet	74502706	73144030	1.02
tpch_q07/datafusion:parquet	510078928	530481299	0.96
tpch_q08/datafusion:parquet	407371222	414512877	0.98
tpch_q09/datafusion:parquet	663374485	660561757	1.00
tpch_q10/datafusion:parquet	559473517	547073910	1.02
tpch_q11/datafusion:parquet	154958144	160678476	0.96
tpch_q12/datafusion:parquet	148915085	153788261	0.97
tpch_q13/datafusion:parquet	347833065	352677653	0.99
tpch_q14/datafusion:parquet	119677664	121327783	0.99
tpch_q15/datafusion:parquet	186160153	192670516	0.97
tpch_q16/datafusion:parquet	139210161	140204649	0.99
tpch_q17/datafusion:parquet	514082216	507164876	1.01
tpch_q18/datafusion:parquet	689109309	709750975	0.97
tpch_q19/datafusion:parquet	195921559	200692904	0.98
tpch_q20/datafusion:parquet	294977544	307901479	0.96
tpch_q21/datafusion:parquet	543974535	546113959	1.00
tpch_q22/datafusion:parquet	261641299	258496752	1.01

duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `6337c7e` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	89054975	90336887	0.99
tpch_q02/duckdb:vortex-file-compressed	72222350	73714843	0.98
tpch_q03/duckdb:vortex-file-compressed	139312942	138638582	1.00
tpch_q04/duckdb:vortex-file-compressed	167001082	169502874	0.99
tpch_q05/duckdb:vortex-file-compressed	154723808	150954320	1.02
tpch_q06/duckdb:vortex-file-compressed	40813446	40569474	1.01
tpch_q07/duckdb:vortex-file-compressed	130764226	133512183	0.98
tpch_q08/duckdb:vortex-file-compressed	179078318	183368481	0.98
tpch_q09/duckdb:vortex-file-compressed	304077133	305877364	0.99
tpch_q10/duckdb:vortex-file-compressed	221803472	222836604	1.00
tpch_q11/duckdb:vortex-file-compressed	42278398	42294372	1.00
tpch_q12/duckdb:vortex-file-compressed	116027428	119619282	0.97
tpch_q13/duckdb:vortex-file-compressed	170301551	173474786	0.98
tpch_q14/duckdb:vortex-file-compressed	60491023	63176213	0.96
tpch_q15/duckdb:vortex-file-compressed	87250218	88597509	0.98
tpch_q16/duckdb:vortex-file-compressed	86952225	84957092	1.02
tpch_q17/duckdb:vortex-file-compressed	108064188	109509267	0.99
tpch_q18/duckdb:vortex-file-compressed	259693411	261891214	0.99
tpch_q19/duckdb:vortex-file-compressed	86905681	84528626	1.03
tpch_q20/duckdb:vortex-file-compressed	142783409	148850794	0.96
tpch_q21/duckdb:vortex-file-compressed	481543716	482783256	1.00
tpch_q22/duckdb:vortex-file-compressed	79243061	77364657	1.02

duckdb / parquet / ns (0.995x ➖, 1↑ 1↓)

name	PR `72927cc` (ns)	base `6337c7e` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet 🚀	106140175	144200743	0.74
tpch_q02/duckdb:parquet	98472966	100259503	0.98
tpch_q03/duckdb:parquet	166392074	166309840	1.00
tpch_q04/duckdb:parquet	119698105	120251809	1.00
tpch_q05/duckdb:parquet	185602521	187647250	0.99
tpch_q06/duckdb:parquet	58926799	57364240	1.03
tpch_q07/duckdb:parquet	140930451	148071446	0.95
tpch_q08/duckdb:parquet	220618934	218196591	1.01
tpch_q09/duckdb:parquet	348080120	347160505	1.00
tpch_q10/duckdb:parquet	655620614	649779186	1.01
tpch_q11/duckdb:parquet	41455039	41460454	1.00
tpch_q12/duckdb:parquet	116653040	118902107	0.98
tpch_q13/duckdb:parquet	395241084	403227113	0.98
tpch_q14/duckdb:parquet	152627653	150240688	1.02
tpch_q15/duckdb:parquet	78439604	71708430	1.09
tpch_q16/duckdb:parquet	154348906	157996001	0.98
tpch_q17/duckdb:parquet	122655972	125341623	0.98
tpch_q18/duckdb:parquet 🚨	335083993	276279493	1.21
tpch_q19/duckdb:parquet	244376542	237870804	1.03
tpch_q20/duckdb:parquet	195218483	194986999	1.00
tpch_q21/duckdb:parquet	428632946	436488365	0.98
tpch_q22/duckdb:parquet	335000842	334071732	1.00

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)

File	Scale	Format	Base	Change	%
customer.vortex	10.0	vortex-compact	74.00 MB	74.00 MB	-100.0%
duckdb.db	10.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
lineitem.vortex	10.0	vortex-compact	1.28 GB	1.28 GB	-100.0%
nation.vortex	10.0	vortex-compact	8.63 KB	8.63 KB	-100.0%
orders.vortex	10.0	vortex-compact	344.31 MB	344.31 MB	-100.0%
part.vortex	10.0	vortex-compact	35.89 MB	35.89 MB	-100.0%
partsupp.vortex	10.0	vortex-compact	203.66 MB	203.66 MB	-100.0%
region.vortex	10.0	vortex-compact	6.39 KB	6.39 KB	-100.0%
supplier.vortex	10.0	vortex-compact	4.73 MB	4.73 MB	-100.0%

Totals:

vortex-compact: 1.92 GB → 0 B (-100.0%)
vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

github-actions · 2026-08-07T15:15:10Z

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.5%
Engines: DuckDB No clear signal (-6.5%, low confidence)
Vortex (geomean): 0.934x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (0.934x ➖, 4↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed	13843574	13590733	1.02
statpopgen_q01/duckdb:vortex-file-compressed	13166100	12934544	1.02
statpopgen_q02/duckdb:vortex-file-compressed	565108072	562802257	1.00
statpopgen_q03/duckdb:vortex-file-compressed 🚀	1299901310	1724679616	0.75
statpopgen_q04/duckdb:vortex-file-compressed	1204269702	1233397074	0.98
statpopgen_q05/duckdb:vortex-file-compressed 🚀	533935122	656792747	0.81
statpopgen_q06/duckdb:vortex-file-compressed 🚀	1766109925	2176728463	0.81
statpopgen_q07/duckdb:vortex-file-compressed	257492739	247106477	1.04
statpopgen_q08/duckdb:vortex-file-compressed	305867871	302313732	1.01
statpopgen_q09/duckdb:vortex-file-compressed 🚀	928666573	1046065379	0.89
statpopgen_q10/duckdb:vortex-file-compressed	3135810237	3156945783	0.99

duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	375309029	376273468	1.00
statpopgen_q01/duckdb:parquet	467091611	466682667	1.00
statpopgen_q02/duckdb:parquet	786323606	783987094	1.00
statpopgen_q03/duckdb:parquet	1060354204	1058910760	1.00
statpopgen_q04/duckdb:parquet	1058287452	1054072369	1.00
statpopgen_q05/duckdb:parquet	771406054	772177333	1.00
statpopgen_q06/duckdb:parquet	1025227177	1025132034	1.00
statpopgen_q07/duckdb:parquet	945996945	965427634	0.98
statpopgen_q08/duckdb:parquet	960406678	968461717	0.99
statpopgen_q09/duckdb:parquet	1003951455	1008350811	1.00
statpopgen_q10/duckdb:parquet	1663524062	1648842368	1.01

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	100000	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex	100000	vortex-compact	960.75 MB	0 B	960.75 MB	-100.0%

Totals:

vortex-compact: 961.01 MB → 0 B (-100.0%)
vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

github-actions · 2026-08-07T15:32:11Z

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.130x ❌

datafusion / vortex-file-compressed / ns (1.130x ❌, 1↑ 4↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨	143763192	119392351	1.20
polarsignals_q01/datafusion:vortex-file-compressed 🚨	252939514	161397208	1.57
polarsignals_q02/datafusion:vortex-file-compressed	20397432	20031647	1.02
polarsignals_q03/datafusion:vortex-file-compressed 🚨	267919382	166006130	1.61
polarsignals_q04/datafusion:vortex-file-compressed	11503122	11159148	1.03
polarsignals_q05/datafusion:vortex-file-compressed	13982898	14962023	0.93
polarsignals_q06/datafusion:vortex-file-compressed	24893876	24357401	1.02
polarsignals_q07/datafusion:vortex-file-compressed	11926574	12086691	0.99
polarsignals_q08/datafusion:vortex-file-compressed 🚨	356857273	275912648	1.29
polarsignals_q09/datafusion:vortex-file-compressed 🚀	11220730	12897413	0.87

No file size changes detected.

github-actions · 2026-08-07T15:36:40Z

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Engines: DataFusion No clear signal (+3.8%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.030x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.044x ➖, 0↑ 3↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	43308976	43441589	1.00
tpch_q02/datafusion:vortex-file-compressed	23333960	22867253	1.02
tpch_q03/datafusion:vortex-file-compressed	30374149	30112915	1.01
tpch_q04/datafusion:vortex-file-compressed	15122949	15563325	0.97
tpch_q05/datafusion:vortex-file-compressed	50799135	50314908	1.01
tpch_q06/datafusion:vortex-file-compressed	8108068	8111412	1.00
tpch_q07/datafusion:vortex-file-compressed	56143801	55503988	1.01
tpch_q08/datafusion:vortex-file-compressed	45822980	45986854	1.00
tpch_q09/datafusion:vortex-file-compressed	56247570	56492457	1.00
tpch_q10/datafusion:vortex-file-compressed 🚨	41262356	28877786	1.43
tpch_q11/datafusion:vortex-file-compressed	18205896	17541163	1.04
tpch_q12/datafusion:vortex-file-compressed	27325744	26698840	1.02
tpch_q13/datafusion:vortex-file-compressed	24882067	24885449	1.00
tpch_q14/datafusion:vortex-file-compressed 🚨	16824089	14539773	1.16
tpch_q15/datafusion:vortex-file-compressed	21027264	21587070	0.97
tpch_q16/datafusion:vortex-file-compressed	24482043	24621844	0.99
tpch_q17/datafusion:vortex-file-compressed	57112285	56672890	1.01
tpch_q18/datafusion:vortex-file-compressed	71783263	69179871	1.04
tpch_q19/datafusion:vortex-file-compressed	19474202	19405076	1.00
tpch_q20/datafusion:vortex-file-compressed	31761558	32506779	0.98
tpch_q21/datafusion:vortex-file-compressed	61042788	60410341	1.01
tpch_q22/datafusion:vortex-file-compressed 🚨	17585769	12191350	1.44

datafusion / parquet / ns (1.006x ➖, 0↑ 1↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	109571887	112775271	0.97
tpch_q02/datafusion:parquet	70105839	71888536	0.98
tpch_q03/datafusion:parquet	101216456	98978084	1.02
tpch_q04/datafusion:parquet	50618890	50417328	1.00
tpch_q05/datafusion:parquet	127076973	120817220	1.05
tpch_q06/datafusion:parquet 🚨	45112828	39319117	1.15
tpch_q07/datafusion:parquet	128104243	131224128	0.98
tpch_q08/datafusion:parquet	121673864	124047871	0.98
tpch_q09/datafusion:parquet	154759108	156250080	0.99
tpch_q10/datafusion:parquet	127853285	128148286	1.00
tpch_q11/datafusion:parquet	51764283	50557367	1.02
tpch_q12/datafusion:parquet	107365068	98721965	1.09
tpch_q13/datafusion:parquet	229198924	227396872	1.01
tpch_q14/datafusion:parquet	48265439	50689076	0.95
tpch_q15/datafusion:parquet	70427564	70783456	0.99
tpch_q16/datafusion:parquet	50753758	49171274	1.03
tpch_q17/datafusion:parquet	155537084	152387762	1.02
tpch_q18/datafusion:parquet	179760137	182219131	0.99
tpch_q19/datafusion:parquet	73498819	81492176	0.90
tpch_q20/datafusion:parquet	95793285	95894891	1.00
tpch_q21/datafusion:parquet	173521399	169975477	1.02
tpch_q22/datafusion:parquet	57113067	56485287	1.01

duckdb / vortex-file-compressed / ns (1.017x ➖, 0↑ 1↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	23542929	23584204	1.00
tpch_q02/duckdb:vortex-file-compressed	35897137	34820837	1.03
tpch_q03/duckdb:vortex-file-compressed	39397902	39388150	1.00
tpch_q04/duckdb:vortex-file-compressed	33549304	33298349	1.01
tpch_q05/duckdb:vortex-file-compressed 🚨	46625236	42044279	1.11
tpch_q06/duckdb:vortex-file-compressed	12587011	13045475	0.96
tpch_q07/duckdb:vortex-file-compressed	45303327	44422158	1.02
tpch_q08/duckdb:vortex-file-compressed	54964365	53836102	1.02
tpch_q09/duckdb:vortex-file-compressed	62160695	64763151	0.96
tpch_q10/duckdb:vortex-file-compressed	55436041	52709568	1.05
tpch_q11/duckdb:vortex-file-compressed	19741621	19182442	1.03
tpch_q12/duckdb:vortex-file-compressed	31661473	30909424	1.02
tpch_q13/duckdb:vortex-file-compressed	49343238	45629876	1.08
tpch_q14/duckdb:vortex-file-compressed	25112780	24911388	1.01
tpch_q15/duckdb:vortex-file-compressed	20332821	20451134	0.99
tpch_q16/duckdb:vortex-file-compressed	34902675	33950050	1.03
tpch_q17/duckdb:vortex-file-compressed	34263207	36284433	0.94
tpch_q18/duckdb:vortex-file-compressed	53463612	50350196	1.06
tpch_q19/duckdb:vortex-file-compressed	37881992	38175008	0.99
tpch_q20/duckdb:vortex-file-compressed	39546506	39978871	0.99
tpch_q21/duckdb:vortex-file-compressed	126412182	122331429	1.03
tpch_q22/duckdb:vortex-file-compressed	23553754	22785098	1.03

duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	81512298	81612141	1.00
tpch_q02/duckdb:parquet	45752434	46388936	0.99
tpch_q03/duckdb:parquet	80841251	80950193	1.00
tpch_q04/duckdb:parquet	57296467	57968195	0.99
tpch_q05/duckdb:parquet	78536185	78908748	1.00
tpch_q06/duckdb:parquet	24967715	25202502	0.99
tpch_q07/duckdb:parquet	80047304	82254484	0.97
tpch_q08/duckdb:parquet	95758945	96200830	1.00
tpch_q09/duckdb:parquet	147827352	148289877	1.00
tpch_q10/duckdb:parquet	140786104	141432257	1.00
tpch_q11/duckdb:parquet	25105466	25689544	0.98
tpch_q12/duckdb:parquet	53054206	53371616	0.99
tpch_q13/duckdb:parquet	287192330	284542054	1.01
tpch_q14/duckdb:parquet	56140748	56084563	1.00
tpch_q15/duckdb:parquet	30638182	30802524	0.99
tpch_q16/duckdb:parquet	67429924	66178777	1.02
tpch_q17/duckdb:parquet	58053688	58008831	1.00
tpch_q18/duckdb:parquet	128753321	126936249	1.01
tpch_q19/duckdb:parquet	77943267	77235151	1.01
tpch_q20/duckdb:parquet	77273502	77443677	1.00
tpch_q21/duckdb:parquet	190171535	190780757	1.00
tpch_q22/duckdb:parquet	64159055	63213333	1.01

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)

File	Scale	Format	Base	Change	%
customer.vortex	1.0	vortex-compact	7.40 MB	7.40 MB	-100.0%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
lineitem.vortex	1.0	vortex-compact	126.01 MB	126.01 MB	-100.0%
nation.vortex	1.0	vortex-compact	8.63 KB	8.63 KB	-100.0%
orders.vortex	1.0	vortex-compact	31.73 MB	31.73 MB	-100.0%
part.vortex	1.0	vortex-compact	3.55 MB	3.55 MB	-100.0%
partsupp.vortex	1.0	vortex-compact	20.29 MB	20.29 MB	-100.0%
region.vortex	1.0	vortex-compact	6.39 KB	6.39 KB	-100.0%
supplier.vortex	1.0	vortex-compact	497.62 KB	497.62 KB	-100.0%

Totals:

vortex-compact: 189.74 MB → 0 B (-100.0%)
vortex-file-compressed: 242.86 MB → 242.86 MB (0.0%)

github-actions · 2026-08-07T15:37:37Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+2.2%, low confidence) · DuckDB No clear signal (-1.2%, environment too noisy confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.026x ➖, 0↑ 11↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed	29117889	27659666	1.05
tpcds_q02/datafusion:vortex-file-compressed	51953524	52622569	0.99
tpcds_q03/datafusion:vortex-file-compressed	14475095	13756342	1.05
tpcds_q04/datafusion:vortex-file-compressed	230275521	217923872	1.06
tpcds_q05/datafusion:vortex-file-compressed	64715324	64296687	1.01
tpcds_q06/datafusion:vortex-file-compressed	26559400	26089236	1.02
tpcds_q07/datafusion:vortex-file-compressed	42799452	42443160	1.01
tpcds_q08/datafusion:vortex-file-compressed	33916696	33747604	1.01
tpcds_q09/datafusion:vortex-file-compressed	26800894	26584638	1.01
tpcds_q10/datafusion:vortex-file-compressed 🚨	53181505	36433702	1.46
tpcds_q11/datafusion:vortex-file-compressed 🚨	130978686	115476521	1.13
tpcds_q12/datafusion:vortex-file-compressed	20259851	21039804	0.96
tpcds_q13/datafusion:vortex-file-compressed	53079610	48420110	1.10
tpcds_q14/datafusion:vortex-file-compressed	203414464	200726000	1.01
tpcds_q15/datafusion:vortex-file-compressed	29356998	29118921	1.01
tpcds_q16/datafusion:vortex-file-compressed	24051283	24207880	0.99
tpcds_q17/datafusion:vortex-file-compressed	70590419	70777170	1.00
tpcds_q18/datafusion:vortex-file-compressed	89889181	91623285	0.98
tpcds_q19/datafusion:vortex-file-compressed	21278339	21414482	0.99
tpcds_q20/datafusion:vortex-file-compressed 🚨	26713772	22050834	1.21
tpcds_q21/datafusion:vortex-file-compressed	31158930	32506252	0.96
tpcds_q22/datafusion:vortex-file-compressed	110645412	109250235	1.01
tpcds_q23/datafusion:vortex-file-compressed	134774432	128630959	1.05
tpcds_q24/datafusion:vortex-file-compressed	95827242	95131480	1.01
tpcds_q25/datafusion:vortex-file-compressed	73830975	72895762	1.01
tpcds_q26/datafusion:vortex-file-compressed	37617958	36739461	1.02
tpcds_q27/datafusion:vortex-file-compressed	95189839	93768526	1.02
tpcds_q28/datafusion:vortex-file-compressed	26872295	27367228	0.98
tpcds_q29/datafusion:vortex-file-compressed	69250773	68699892	1.01
tpcds_q30/datafusion:vortex-file-compressed	33654836	31525521	1.07
tpcds_q31/datafusion:vortex-file-compressed	74808284	76531493	0.98
tpcds_q32/datafusion:vortex-file-compressed	18133009	18855639	0.96
tpcds_q33/datafusion:vortex-file-compressed	32513701	32556867	1.00
tpcds_q34/datafusion:vortex-file-compressed	25199875	25498668	0.99
tpcds_q35/datafusion:vortex-file-compressed 🚨	53404059	45146058	1.18
tpcds_q36/datafusion:vortex-file-compressed	64722456	67731044	0.96
tpcds_q37/datafusion:vortex-file-compressed	18247200	18351064	0.99
tpcds_q38/datafusion:vortex-file-compressed	40460211	39086112	1.04
tpcds_q39/datafusion:vortex-file-compressed	100351653	100780053	1.00
tpcds_q40/datafusion:vortex-file-compressed	33337232	34186244	0.98
tpcds_q41/datafusion:vortex-file-compressed	24173507	23731736	1.02
tpcds_q42/datafusion:vortex-file-compressed	13923556	13182092	1.06
tpcds_q43/datafusion:vortex-file-compressed	19016389	19035862	1.00
tpcds_q44/datafusion:vortex-file-compressed	33819232	34882780	0.97
tpcds_q45/datafusion:vortex-file-compressed	33540173	32571577	1.03
tpcds_q46/datafusion:vortex-file-compressed	34832106	36957502	0.94
tpcds_q47/datafusion:vortex-file-compressed	127072777	128260107	0.99
tpcds_q48/datafusion:vortex-file-compressed 🚨	43829923	38443746	1.14
tpcds_q49/datafusion:vortex-file-compressed	72947580	71588310	1.02
tpcds_q50/datafusion:vortex-file-compressed	45917069	46359757	0.99
tpcds_q51/datafusion:vortex-file-compressed	76361686	76430037	1.00
tpcds_q52/datafusion:vortex-file-compressed	13957357	14282764	0.98
tpcds_q53/datafusion:vortex-file-compressed	24411428	24153051	1.01
tpcds_q54/datafusion:vortex-file-compressed	37159391	37842084	0.98
tpcds_q55/datafusion:vortex-file-compressed	13665103	13907599	0.98
tpcds_q56/datafusion:vortex-file-compressed	33500053	33012041	1.01
tpcds_q57/datafusion:vortex-file-compressed	98914623	99993788	0.99
tpcds_q58/datafusion:vortex-file-compressed	61344998	62933842	0.97
tpcds_q59/datafusion:vortex-file-compressed	56415813	56040677	1.01
tpcds_q60/datafusion:vortex-file-compressed	32415292	32695896	0.99
tpcds_q61/datafusion:vortex-file-compressed	36293810	36141973	1.00
tpcds_q62/datafusion:vortex-file-compressed	24741840	24492045	1.01
tpcds_q63/datafusion:vortex-file-compressed	23927127	24911072	0.96
tpcds_q64/datafusion:vortex-file-compressed 🚨	515145243	458184137	1.12
tpcds_q65/datafusion:vortex-file-compressed	73809976	72147329	1.02
tpcds_q66/datafusion:vortex-file-compressed	79383371	78658194	1.01
tpcds_q67/datafusion:vortex-file-compressed	115632603	119999451	0.96
tpcds_q68/datafusion:vortex-file-compressed	33321922	33052443	1.01
tpcds_q69/datafusion:vortex-file-compressed 🚨	49066840	34106579	1.44
tpcds_q70/datafusion:vortex-file-compressed	116402947	108586556	1.07
tpcds_q71/datafusion:vortex-file-compressed	23312059	23304281	1.00
tpcds_q72/datafusion:vortex-file-compressed	1484046846	1488790262	1.00
tpcds_q73/datafusion:vortex-file-compressed	24388889	24447568	1.00
tpcds_q74/datafusion:vortex-file-compressed 🚨	83519673	74296363	1.12
tpcds_q75/datafusion:vortex-file-compressed	149198441	156660745	0.95
tpcds_q76/datafusion:vortex-file-compressed	43313706	43973768	0.98
tpcds_q77/datafusion:vortex-file-compressed	44032787	44988106	0.98
tpcds_q78/datafusion:vortex-file-compressed	113766611	108810504	1.05
tpcds_q79/datafusion:vortex-file-compressed	27975262	28351724	0.99
tpcds_q80/datafusion:vortex-file-compressed	103524915	103604414	1.00
tpcds_q81/datafusion:vortex-file-compressed 🚨	35727594	29843916	1.20
tpcds_q82/datafusion:vortex-file-compressed	19928190	18840406	1.06
tpcds_q83/datafusion:vortex-file-compressed	43840235	43579156	1.01
tpcds_q84/datafusion:vortex-file-compressed 🚨	16565107	13950288	1.19
tpcds_q85/datafusion:vortex-file-compressed	126374171	115504657	1.09
tpcds_q86/datafusion:vortex-file-compressed	19276573	19599119	0.98
tpcds_q87/datafusion:vortex-file-compressed	40625389	41192552	0.99
tpcds_q88/datafusion:vortex-file-compressed	53146079	54369469	0.98
tpcds_q89/datafusion:vortex-file-compressed	28193984	27736946	1.02
tpcds_q90/datafusion:vortex-file-compressed	14488063	13915200	1.04
tpcds_q91/datafusion:vortex-file-compressed 🚨	25725996	19574400	1.31
tpcds_q92/datafusion:vortex-file-compressed	16855761	17151669	0.98
tpcds_q93/datafusion:vortex-file-compressed	32457455	32159912	1.01
tpcds_q94/datafusion:vortex-file-compressed	23455012	23288023	1.01
tpcds_q95/datafusion:vortex-file-compressed	63734813	63064590	1.01
tpcds_q96/datafusion:vortex-file-compressed	11182038	11481951	0.97
tpcds_q97/datafusion:vortex-file-compressed	30371000	27663258	1.10
tpcds_q98/datafusion:vortex-file-compressed	24103027	26172534	0.92
tpcds_q99/datafusion:vortex-file-compressed	28016885	28014394	1.00

datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet	30806142	31346328	0.98
tpcds_q02/datafusion:parquet	52679552	51618672	1.02
tpcds_q03/datafusion:parquet	17586695	17220796	1.02
tpcds_q04/datafusion:parquet	348804570	324704983	1.07
tpcds_q05/datafusion:parquet	80482372	80210082	1.00
tpcds_q06/datafusion:parquet	30891618	31010575	1.00
tpcds_q07/datafusion:parquet	99132908	98234702	1.01
tpcds_q08/datafusion:parquet	38185282	38515140	0.99
tpcds_q09/datafusion:parquet	36417860	37811743	0.96
tpcds_q10/datafusion:parquet	88456446	87275197	1.01
tpcds_q11/datafusion:parquet	166218561	160939858	1.03
tpcds_q12/datafusion:parquet	22213534	22969082	0.97
tpcds_q13/datafusion:parquet	99675328	96189132	1.04
tpcds_q14/datafusion:parquet	279011898	274279668	1.02
tpcds_q15/datafusion:parquet	38704403	36861862	1.05
tpcds_q16/datafusion:parquet	47732365	48423259	0.99
tpcds_q17/datafusion:parquet	107717301	107501096	1.00
tpcds_q18/datafusion:parquet	131541867	134643557	0.98
tpcds_q19/datafusion:parquet	28686236	29016677	0.99
tpcds_q20/datafusion:parquet	22924317	23503857	0.98
tpcds_q21/datafusion:parquet	22452067	23068777	0.97
tpcds_q22/datafusion:parquet	134687909	141709629	0.95
tpcds_q23/datafusion:parquet	173197952	177307818	0.98
tpcds_q24/datafusion:parquet	138056923	139847934	0.99
tpcds_q25/datafusion:parquet	106699665	107640751	0.99
tpcds_q26/datafusion:parquet	90384015	86568102	1.04
tpcds_q27/datafusion:parquet	165862670	159721266	1.04
tpcds_q28/datafusion:parquet	40675651	41511394	0.98
tpcds_q29/datafusion:parquet	104737308	107391419	0.98
tpcds_q30/datafusion:parquet	42629051	42465776	1.00
tpcds_q31/datafusion:parquet	93682560	95282513	0.98
tpcds_q32/datafusion:parquet	23539958	24273092	0.97
tpcds_q33/datafusion:parquet	37981927	37513885	1.01
tpcds_q34/datafusion:parquet	28902451	30582504	0.95
tpcds_q35/datafusion:parquet	89301485	89289750	1.00
tpcds_q36/datafusion:parquet	72344761	66369311	1.09
tpcds_q37/datafusion:parquet	24294211	23775718	1.02
tpcds_q38/datafusion:parquet	56210139	57571784	0.98
tpcds_q39/datafusion:parquet	84780199	82759336	1.02
tpcds_q40/datafusion:parquet	35097077	35550162	0.99
tpcds_q41/datafusion:parquet	19077646	19185642	0.99
tpcds_q42/datafusion:parquet	16500723	16535905	1.00
tpcds_q43/datafusion:parquet	22808445	23351287	0.98
tpcds_q44/datafusion:parquet	41108210	39733101	1.03
tpcds_q45/datafusion:parquet	46137784	44985379	1.03
tpcds_q46/datafusion:parquet	42149336	41781805	1.01
tpcds_q47/datafusion:parquet	151868720	149601848	1.02
tpcds_q48/datafusion:parquet	86545141	88469405	0.98
tpcds_q49/datafusion:parquet	78789151	75985947	1.04
tpcds_q50/datafusion:parquet	69246332	71342956	0.97
tpcds_q51/datafusion:parquet	83292394	81809003	1.02
tpcds_q52/datafusion:parquet	17446751	16886987	1.03
tpcds_q53/datafusion:parquet	24849372	25113059	0.99
tpcds_q54/datafusion:parquet	47443711	47111238	1.01
tpcds_q55/datafusion:parquet	16333193	16236207	1.01
tpcds_q56/datafusion:parquet	36275749	36081894	1.01
tpcds_q57/datafusion:parquet	131867774	122916119	1.07
tpcds_q58/datafusion:parquet	83204302	81807017	1.02
tpcds_q59/datafusion:parquet	75803569	74571611	1.02
tpcds_q60/datafusion:parquet	36741153	35539340	1.03
tpcds_q61/datafusion:parquet	45301579	46828856	0.97
tpcds_q62/datafusion:parquet	28575794	27861148	1.03
tpcds_q63/datafusion:parquet	25386276	25449638	1.00
tpcds_q64/datafusion:parquet	367342356	366729684	1.00
tpcds_q65/datafusion:parquet	49124366	50909249	0.96
tpcds_q66/datafusion:parquet	88507828	89546416	0.99
tpcds_q67/datafusion:parquet	143362811	139256774	1.03
tpcds_q68/datafusion:parquet	40938634	41095279	1.00
tpcds_q69/datafusion:parquet	85523744	88081708	0.97
tpcds_q70/datafusion:parquet	43971698	43250451	1.02
tpcds_q71/datafusion:parquet	25906381	27916857	0.93
tpcds_q72/datafusion:parquet	452095235	436612457	1.04
tpcds_q73/datafusion:parquet	28264508	28036785	1.01
tpcds_q74/datafusion:parquet	100096281	99940054	1.00
tpcds_q75/datafusion:parquet	181629465	172940940	1.05
tpcds_q76/datafusion:parquet	60992094	59437713	1.03
tpcds_q77/datafusion:parquet	54954247	54310864	1.01
tpcds_q78/datafusion:parquet	129201498	125149461	1.03
tpcds_q79/datafusion:parquet	34724810	34051350	1.02
tpcds_q80/datafusion:parquet	96636694	93715420	1.03
tpcds_q81/datafusion:parquet	38977300	42561373	0.92
tpcds_q82/datafusion:parquet	24637542	23452198	1.05
tpcds_q83/datafusion:parquet	56952239	56820235	1.00
tpcds_q84/datafusion:parquet	48126529	48858169	0.99
tpcds_q85/datafusion:parquet	196847834	193996905	1.01
tpcds_q86/datafusion:parquet	21621303	22681322	0.95
tpcds_q87/datafusion:parquet	63152222	59517683	1.06
tpcds_q88/datafusion:parquet	59700560	59717888	1.00
tpcds_q89/datafusion:parquet	30423868	29679027	1.03
tpcds_q90/datafusion:parquet	19636026	19202252	1.02
tpcds_q91/datafusion:parquet	67997170	64788245	1.05
tpcds_q92/datafusion:parquet	25350471	25119179	1.01
tpcds_q93/datafusion:parquet	36183064	35803948	1.01
tpcds_q94/datafusion:parquet	30678779	29138596	1.05
tpcds_q95/datafusion:parquet	89073156	87835974	1.01
tpcds_q96/datafusion:parquet	16104756	17082139	0.94
tpcds_q97/datafusion:parquet	39021939	39973778	0.98
tpcds_q98/datafusion:parquet	26491580	27972571	0.95
tpcds_q99/datafusion:parquet	33946210	34264880	0.99

duckdb / vortex-file-compressed / ns (0.983x ➖, 6↑ 3↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed	29997805	28339903	1.06
tpcds_q02/duckdb:vortex-file-compressed	29352093	28906679	1.02
tpcds_q03/duckdb:vortex-file-compressed 🚀	21368051	23795250	0.90
tpcds_q04/duckdb:vortex-file-compressed	99655906	101058426	0.99
tpcds_q05/duckdb:vortex-file-compressed	39838641	42440908	0.94
tpcds_q06/duckdb:vortex-file-compressed	49101947	50932798	0.96
tpcds_q07/duckdb:vortex-file-compressed 🚀	30724381	36236890	0.85
tpcds_q08/duckdb:vortex-file-compressed	33568723	33563187	1.00
tpcds_q09/duckdb:vortex-file-compressed	17498723	18681876	0.94
tpcds_q10/duckdb:vortex-file-compressed	58990045	55006167	1.07
tpcds_q11/duckdb:vortex-file-compressed	75244554	75782417	0.99
tpcds_q12/duckdb:vortex-file-compressed	17771480	19307949	0.92
tpcds_q13/duckdb:vortex-file-compressed	40727070	42752261	0.95
tpcds_q14/duckdb:vortex-file-compressed	113167213	117334885	0.96
tpcds_q15/duckdb:vortex-file-compressed	35558392	36115414	0.98
tpcds_q16/duckdb:vortex-file-compressed	35237108	36179260	0.97
tpcds_q17/duckdb:vortex-file-compressed	57586055	61676889	0.93
tpcds_q18/duckdb:vortex-file-compressed	50951883	50775010	1.00
tpcds_q19/duckdb:vortex-file-compressed	39372763	42545474	0.93
tpcds_q20/duckdb:vortex-file-compressed	18628879	20274137	0.92
tpcds_q21/duckdb:vortex-file-compressed	23535863	21474508	1.10
tpcds_q22/duckdb:vortex-file-compressed	66651112	66187928	1.01
tpcds_q23/duckdb:vortex-file-compressed	76048369	77360767	0.98
tpcds_q24/duckdb:vortex-file-compressed	49546976	50637600	0.98
tpcds_q25/duckdb:vortex-file-compressed	49479841	48886164	1.01
tpcds_q26/duckdb:vortex-file-compressed	23410238	23312505	1.00
tpcds_q27/duckdb:vortex-file-compressed	33981395	34055269	1.00
tpcds_q28/duckdb:vortex-file-compressed 🚨	17042310	14789337	1.15
tpcds_q29/duckdb:vortex-file-compressed	55328854	53666125	1.03
tpcds_q30/duckdb:vortex-file-compressed	38435563	38089210	1.01
tpcds_q31/duckdb:vortex-file-compressed	35638199	35951666	0.99
tpcds_q32/duckdb:vortex-file-compressed	19124044	18980992	1.01
tpcds_q33/duckdb:vortex-file-compressed	32730918	32808731	1.00
tpcds_q34/duckdb:vortex-file-compressed	30358379	31081324	0.98
tpcds_q35/duckdb:vortex-file-compressed	84545463	`8674150`	0.97
tpcds_q36/duckdb:vortex-file-compressed	31962395	32190918	0.99
tpcds_q37/duckdb:vortex-file-compressed	26271998	25965282	1.01
tpcds_q38/duckdb:vortex-file-compressed	44305233	45771846	0.97
tpcds_q39/duckdb:vortex-file-compressed	36041197	34075861	1.06
tpcds_q40/duckdb:vortex-file-compressed	23728915	23922489	0.99
tpcds_q41/duckdb:vortex-file-compressed	14339309	15637149	0.92
tpcds_q42/duckdb:vortex-file-compressed	20281846	22071979	0.92
tpcds_q43/duckdb:vortex-file-compressed	21200852	22812096	0.93
tpcds_q44/duckdb:vortex-file-compressed	26557323	27559648	0.96
tpcds_q45/duckdb:vortex-file-compressed	37815900	39777395	0.95
tpcds_q46/duckdb:vortex-file-compressed	41184132	43107041	0.96
tpcds_q47/duckdb:vortex-file-compressed	58833846	59691697	0.99
tpcds_q48/duckdb:vortex-file-compressed	37891321	40309340	0.94
tpcds_q49/duckdb:vortex-file-compressed	41082184	41370600	0.99
tpcds_q50/duckdb:vortex-file-compressed	37195707	35770458	1.04
tpcds_q51/duckdb:vortex-file-compressed	113116296	114618242	0.99
tpcds_q52/duckdb:vortex-file-compressed	17542937	19013996	0.92
tpcds_q53/duckdb:vortex-file-compressed	30361542	30447269	1.00
tpcds_q54/duckdb:vortex-file-compressed	46229179	47292829	0.98
tpcds_q55/duckdb:vortex-file-compressed 🚀	16431645	19456281	0.84
tpcds_q56/duckdb:vortex-file-compressed	33141053	31761284	1.04
tpcds_q57/duckdb:vortex-file-compressed	46219689	45073769	1.03
tpcds_q58/duckdb:vortex-file-compressed	42921790	45480050	0.94
tpcds_q59/duckdb:vortex-file-compressed	40334937	41371626	0.97
tpcds_q60/duckdb:vortex-file-compressed 🚨	40698477	35893573	1.13
tpcds_q61/duckdb:vortex-file-compressed	39233853	40883832	0.96
tpcds_q62/duckdb:vortex-file-compressed	21365915	21081865	1.01
tpcds_q63/duckdb:vortex-file-compressed 🚀	27364656	30931069	0.88
tpcds_q64/duckdb:vortex-file-compressed	115354435	115890582	1.00
tpcds_q65/duckdb:vortex-file-compressed	26828405	27789718	0.97
tpcds_q66/duckdb:vortex-file-compressed	40237269	40558526	0.99
tpcds_q67/duckdb:vortex-file-compressed	132335999	130738422	1.01
tpcds_q68/duckdb:vortex-file-compressed	37181844	40144654	0.93
tpcds_q69/duckdb:vortex-file-compressed	58029097	60431854	0.96
tpcds_q70/duckdb:vortex-file-compressed 🚨	45624016	41404645	1.10
tpcds_q71/duckdb:vortex-file-compressed	27256506	25707875	1.06
tpcds_q72/duckdb:vortex-file-compressed	153004867	154793872	0.99
tpcds_q73/duckdb:vortex-file-compressed	31431230	33078643	0.95
tpcds_q74/duckdb:vortex-file-compressed	51096136	52126670	0.98
tpcds_q75/duckdb:vortex-file-compressed	61316535	60043899	1.02
tpcds_q76/duckdb:vortex-file-compressed 🚀	23336941	26425425	0.88
tpcds_q77/duckdb:vortex-file-compressed	34994124	36523784	0.96
tpcds_q78/duckdb:vortex-file-compressed	79218665	79008510	1.00
tpcds_q79/duckdb:vortex-file-compressed	33852661	32909702	1.03
tpcds_q80/duckdb:vortex-file-compressed	57263993	60508367	0.95
tpcds_q81/duckdb:vortex-file-compressed	43499441	44795435	0.97
tpcds_q82/duckdb:vortex-file-compressed	54855146	56286651	0.97
tpcds_q83/duckdb:vortex-file-compressed	42167607	44079176	0.96
tpcds_q84/duckdb:vortex-file-compressed 🚀	28357407	31588251	0.90
tpcds_q85/duckdb:vortex-file-compressed	56669600	55921260	1.01
tpcds_q86/duckdb:vortex-file-compressed	19374564	19101211	1.01
tpcds_q87/duckdb:vortex-file-compressed	48640190	46807598	1.04
tpcds_q88/duckdb:vortex-file-compressed	65477164	66190622	0.99
tpcds_q89/duckdb:vortex-file-compressed	25706145	27194993	0.95
tpcds_q90/duckdb:vortex-file-compressed	16559599	16654080	0.99
tpcds_q91/duckdb:vortex-file-compressed	35048647	34863080	1.01
tpcds_q92/duckdb:vortex-file-compressed	24476928	24363176	1.00
tpcds_q93/duckdb:vortex-file-compressed	30923779	29352065	1.05
tpcds_q94/duckdb:vortex-file-compressed	33696237	35907820	0.94
tpcds_q95/duckdb:vortex-file-compressed	149924475	148091390	1.01
tpcds_q96/duckdb:vortex-file-compressed	19311657	18901435	1.02
tpcds_q97/duckdb:vortex-file-compressed	45327818	44072848	1.03
tpcds_q98/duckdb:vortex-file-compressed	24720095	24190877	1.02
tpcds_q99/duckdb:vortex-file-compressed	24577736	26338814	0.93

duckdb / parquet / ns (0.994x ➖, 7↑ 2↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet	31736543	31804052	1.00
tpcds_q02/duckdb:parquet	21429336	21822150	0.98
tpcds_q03/duckdb:parquet	12252003	12215378	1.00
tpcds_q04/duckdb:parquet	199082644	193658756	1.03
tpcds_q05/duckdb:parquet	33520242	32251380	1.04
tpcds_q06/duckdb:parquet	35276763	34613039	1.02
tpcds_q07/duckdb:parquet	22840870	23278249	0.98
tpcds_q08/duckdb:parquet	34951360	33302379	1.05
tpcds_q09/duckdb:parquet	32028668	30309345	1.06
tpcds_q10/duckdb:parquet	43518826	40445390	1.08
tpcds_q11/duckdb:parquet	103110774	102843368	1.00
tpcds_q12/duckdb:parquet	18007076	17390592	1.04
tpcds_q13/duckdb:parquet	39891689	39712927	1.00
tpcds_q14/duckdb:parquet	101807585	104815165	0.97
tpcds_q15/duckdb:parquet	35840883	35809973	1.00
tpcds_q16/duckdb:parquet	27805826	27233952	1.02
tpcds_q17/duckdb:parquet	44349221	44714460	0.99
tpcds_q18/duckdb:parquet	56485566	57427359	0.98
tpcds_q19/duckdb:parquet	33774257	33678154	1.00
tpcds_q20/duckdb:parquet	19297134	19209531	1.00
tpcds_q21/duckdb:parquet	13933166	14192439	0.98
tpcds_q22/duckdb:parquet 🚨	70751228	51175425	1.38
tpcds_q23/duckdb:parquet	68710117	70044156	0.98
tpcds_q24/duckdb:parquet	48459769	48932989	0.99
tpcds_q25/duckdb:parquet	42070180	41699253	1.01
tpcds_q26/duckdb:parquet	44989987	44213640	1.02
tpcds_q27/duckdb:parquet	57512254	57898285	0.99
tpcds_q28/duckdb:parquet	28588928	29184236	0.98
tpcds_q29/duckdb:parquet	42842614	42882053	1.00
tpcds_q30/duckdb:parquet	43670175	43920592	0.99
tpcds_q31/duckdb:parquet	29767955	29343502	1.01
tpcds_q32/duckdb:parquet	14911184	14928632	1.00
tpcds_q33/duckdb:parquet	24548614	23899152	1.03
tpcds_q34/duckdb:parquet	21991710	22011981	1.00
tpcds_q35/duckdb:parquet	66897602	66864505	1.00
tpcds_q36/duckdb:parquet	21624048	21816060	0.99
tpcds_q37/duckdb:parquet	17800486	17590593	1.01
tpcds_q38/duckdb:parquet	40803937	42087166	0.97
tpcds_q39/duckdb:parquet	38705103	37510603	1.03
tpcds_q40/duckdb:parquet	22554553	22452958	1.00
tpcds_q41/duckdb:parquet	10215294	10470918	0.98
tpcds_q42/duckdb:parquet	11706948	11664106	1.00
tpcds_q43/duckdb:parquet	14506380	14554916	1.00
tpcds_q44/duckdb:parquet	24613531	24506185	1.00
tpcds_q45/duckdb:parquet	32864934	32523078	1.01
tpcds_q46/duckdb:parquet	54251799	54781101	0.99
tpcds_q47/duckdb:parquet	52102306	52172545	1.00
tpcds_q48/duckdb:parquet	34854425	34967229	1.00
tpcds_q49/duckdb:parquet	29757544	27870649	1.07
tpcds_q50/duckdb:parquet 🚀	24409866	30008370	0.81
tpcds_q51/duckdb:parquet	100496473	100142953	1.00
tpcds_q52/duckdb:parquet	12201008	13075161	0.93
tpcds_q53/duckdb:parquet	16202301	15899562	1.02
tpcds_q54/duckdb:parquet	30163790	29753350	1.01
tpcds_q55/duckdb:parquet	13591126	13274428	1.02
tpcds_q56/duckdb:parquet	25458888	24543069	1.04
tpcds_q57/duckdb:parquet	42598927	43271051	0.98
tpcds_q58/duckdb:parquet	27582730	27469900	1.00
tpcds_q59/duckdb:parquet 🚀	29525828	41127694	0.72
tpcds_q60/duckdb:parquet	26498087	25183500	1.05
tpcds_q61/duckdb:parquet	33827654	31275498	1.08
tpcds_q62/duckdb:parquet	14719019	15088558	0.98
tpcds_q63/duckdb:parquet	15331743	17026206	0.90
tpcds_q64/duckdb:parquet	80541224	83571957	0.96
tpcds_q65/duckdb:parquet 🚀	21954578	24733421	0.89
tpcds_q66/duckdb:parquet	34155313	34550393	0.99
tpcds_q67/duckdb:parquet	126268808	124638417	1.01
tpcds_q68/duckdb:parquet 🚀	37974530	43966463	0.86
tpcds_q69/duckdb:parquet	41352283	42054650	0.98
tpcds_q70/duckdb:parquet	27651801	27334203	1.01
tpcds_q71/duckdb:parquet	21248376	21240684	1.00
tpcds_q72/duckdb:parquet	142599530	152600382	0.93
tpcds_q73/duckdb:parquet 🚀	18681528	21486019	0.87
tpcds_q74/duckdb:parquet	145598872	142870484	1.02
tpcds_q75/duckdb:parquet	60505636	60749185	1.00
tpcds_q76/duckdb:parquet	19112338	19634528	0.97
tpcds_q77/duckdb:parquet	24264925	24762115	0.98
tpcds_q78/duckdb:parquet	77441217	77715956	1.00
tpcds_q79/duckdb:parquet 🚀	27260802	33024553	0.83
tpcds_q80/duckdb:parquet	48828346	48603916	1.00
tpcds_q81/duckdb:parquet	41420353	40918576	1.01
tpcds_q82/duckdb:parquet	19513705	19536515	1.00
tpcds_q83/duckdb:parquet	22118980	21928813	1.01
tpcds_q84/duckdb:parquet	23630694	23462657	1.01
tpcds_q85/duckdb:parquet	47357747	47506456	1.00
tpcds_q86/duckdb:parquet	14584467	14745413	0.99
tpcds_q87/duckdb:parquet	44107807	43985181	1.00
tpcds_q88/duckdb:parquet	43216224	42976987	1.01
tpcds_q89/duckdb:parquet 🚀	18157887	20389042	0.89
tpcds_q90/duckdb:parquet	9596823	9494769	1.01
tpcds_q91/duckdb:parquet	27458968	26455618	1.04
tpcds_q92/duckdb:parquet	15780073	15376722	1.03
tpcds_q93/duckdb:parquet 🚨	35105025	30787049	1.14
tpcds_q94/duckdb:parquet	21928285	22027820	1.00
tpcds_q95/duckdb:parquet	138513898	137847621	1.00
tpcds_q96/duckdb:parquet	9919668	10061779	0.99
tpcds_q97/duckdb:parquet	39048636	39111263	1.00
tpcds_q98/duckdb:parquet	21961615	22684200	0.97
tpcds_q99/duckdb:parquet	23756907	23452512	1.01

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)

File	Scale	Format	Base	Change	%
call_center.vortex	1.0	vortex-compact	50.71 KB	50.71 KB	-100.0%
catalog_page.vortex	1.0	vortex-compact	364.34 KB	364.34 KB	-100.0%
catalog_returns.vortex	1.0	vortex-compact	6.05 MB	6.05 MB	-100.0%
catalog_sales.vortex	1.0	vortex-compact	59.50 MB	59.50 MB	-100.0%
customer.vortex	1.0	vortex-compact	3.29 MB	3.29 MB	-100.0%
customer_address.vortex	1.0	vortex-compact	639.69 KB	639.69 KB	-100.0%
customer_demographics.vortex	1.0	vortex-compact	426.00 KB	426.00 KB	-100.0%
date_dim.vortex	1.0	vortex-compact	145.50 KB	145.50 KB	-100.0%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
household_demographics.vortex	1.0	vortex-compact	11.73 KB	11.73 KB	-100.0%
income_band.vortex	1.0	vortex-compact	6.70 KB	6.70 KB	-100.0%
inventory.vortex	1.0	vortex-compact	16.07 MB	16.07 MB	-100.0%
item.vortex	1.0	vortex-compact	1003.01 KB	1003.01 KB	-100.0%
promotion.vortex	1.0	vortex-compact	52.33 KB	52.33 KB	-100.0%
reason.vortex	1.0	vortex-compact	6.49 KB	6.49 KB	-100.0%
ship_mode.vortex	1.0	vortex-compact	11.26 KB	11.26 KB	-100.0%
store.vortex	1.0	vortex-compact	46.18 KB	46.18 KB	-100.0%
store_returns.vortex	1.0	vortex-compact	9.37 MB	9.37 MB	-100.0%
store_sales.vortex	1.0	vortex-compact	78.13 MB	78.13 MB	-100.0%
time_dim.vortex	1.0	vortex-compact	98.38 KB	98.38 KB	-100.0%
warehouse.vortex	1.0	vortex-compact	23.28 KB	23.28 KB	-100.0%
web_page.vortex	1.0	vortex-compact	27.63 KB	27.63 KB	-100.0%
web_returns.vortex	1.0	vortex-compact	3.01 MB	3.01 MB	-100.0%
web_sales.vortex	1.0	vortex-compact	29.46 MB	29.46 MB	-100.0%
web_site.vortex	1.0	vortex-compact	44.53 KB	44.53 KB	-100.0%

Totals:

vortex-compact: 208.03 MB → 0 B (-100.0%)
vortex-file-compressed: 270.07 MB → 270.07 MB (0.0%)

github-actions · 2026-08-07T15:51:44Z

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +15.0%
Engines: DataFusion No clear signal (+5.7%, environment too noisy confidence) · DuckDB No clear signal (+25.2%, environment too noisy confidence)
Vortex (geomean): 1.026x ➖
Parquet (geomean): 0.892x ➖
Shifts: Parquet (control) -10.8% · Median polish +0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.084x ➖, 0↑ 1↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨	58621835	36853062	1.59
fineweb_q01/datafusion:vortex-file-compressed	449921963	367210527	1.23
fineweb_q02/datafusion:vortex-file-compressed	449717352	362529711	1.24
fineweb_q03/datafusion:vortex-file-compressed	493800683	500747442	0.99
fineweb_q04/datafusion:vortex-file-compressed	433370224	421745304	1.03
fineweb_q05/datafusion:vortex-file-compressed	410991526	391677277	1.05
fineweb_q06/datafusion:vortex-file-compressed	671155454	712539748	0.94
fineweb_q07/datafusion:vortex-file-compressed	538619690	585952743	0.92
fineweb_q08/datafusion:vortex-file-compressed	199222855	214424473	0.93

datafusion / parquet / ns (1.026x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	508568596	507912174	1.00
fineweb_q01/datafusion:parquet	954883121	925712727	1.03
fineweb_q02/datafusion:parquet	888777628	851948616	1.04
fineweb_q03/datafusion:parquet	862107817	872860772	0.99
fineweb_q04/datafusion:parquet	898994771	874185689	1.03
fineweb_q05/datafusion:parquet	958145891	1078047008	0.89
fineweb_q06/datafusion:parquet	1161785114	898887991	1.29
fineweb_q07/datafusion:parquet	852995886	892148264	0.96
fineweb_q08/datafusion:parquet	871039974	832437149	1.05

duckdb / vortex-file-compressed / ns (0.971x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	47662099	49190341	0.97
fineweb_q01/duckdb:vortex-file-compressed	558873735	598219431	0.93
fineweb_q02/duckdb:vortex-file-compressed	505197425	531339569	0.95
fineweb_q03/duckdb:vortex-file-compressed	1490865314	1514131262	0.98
fineweb_q04/duckdb:vortex-file-compressed	1831992847	1865560211	0.98
fineweb_q05/duckdb:vortex-file-compressed	1687520585	1696582850	0.99
fineweb_q06/duckdb:vortex-file-compressed	1679573715	1765856172	0.95
fineweb_q07/duckdb:vortex-file-compressed	1508821557	1510197509	1.00
fineweb_q08/duckdb:vortex-file-compressed	675074565	693070735	0.97

duckdb / parquet / ns (0.775x ➖, 1↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀	537935628	5247172579	0.10
fineweb_q01/duckdb:parquet	5299748880	5310376732	1.00
fineweb_q02/duckdb:parquet	5255347680	5316139206	0.99
fineweb_q03/duckdb:parquet	5349494037	5345880227	1.00
fineweb_q04/duckdb:parquet	5287400690	5284078531	1.00
fineweb_q05/duckdb:parquet	5326200808	5324613471	1.00
fineweb_q06/duckdb:parquet	5384883350	5392531228	1.00
fineweb_q07/duckdb:parquet	5327749661	5304320444	1.00
fineweb_q08/duckdb:parquet	5233021091	5259800807	0.99

github-actions · 2026-08-07T16:21:14Z

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.4%
Engines: DataFusion No clear signal (+7.4%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): 1.035x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.060x ➖, 0↑ 8↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed	1960807	1999666	0.98
clickbench_q01/datafusion:vortex-file-compressed	11599185	11903265	0.97
clickbench_q02/datafusion:vortex-file-compressed	24616204	23551637	1.05
clickbench_q03/datafusion:vortex-file-compressed	25515938	26647119	0.96
clickbench_q04/datafusion:vortex-file-compressed	157982044	159075800	0.99
clickbench_q05/datafusion:vortex-file-compressed	217788983	214881409	1.01
clickbench_q06/datafusion:vortex-file-compressed	1981915	2017655	0.98
clickbench_q07/datafusion:vortex-file-compressed	14927951	14975524	1.00
clickbench_q08/datafusion:vortex-file-compressed	225357730	226876130	0.99
clickbench_q09/datafusion:vortex-file-compressed	365030954	342126985	1.07
clickbench_q10/datafusion:vortex-file-compressed	54268498	51778630	1.05
clickbench_q11/datafusion:vortex-file-compressed	64437219	60689086	1.06
clickbench_q12/datafusion:vortex-file-compressed	193843902	197221124	0.98
clickbench_q13/datafusion:vortex-file-compressed	339251809	337551465	1.01
clickbench_q14/datafusion:vortex-file-compressed	204620502	206214184	0.99
clickbench_q15/datafusion:vortex-file-compressed	191710568	193552847	0.99
clickbench_q16/datafusion:vortex-file-compressed	479069851	487947864	0.98
clickbench_q17/datafusion:vortex-file-compressed	471467072	463943520	1.02
clickbench_q18/datafusion:vortex-file-compressed	927772407	953454456	0.97
clickbench_q19/datafusion:vortex-file-compressed	17840536	17560782	1.02
clickbench_q20/datafusion:vortex-file-compressed	208228127	197109752	1.06
clickbench_q21/datafusion:vortex-file-compressed	270127603	259573539	1.04
clickbench_q22/datafusion:vortex-file-compressed	356553840	348588175	1.02
clickbench_q23/datafusion:vortex-file-compressed 🚨	922003332	390458371	2.36
clickbench_q24/datafusion:vortex-file-compressed 🚨	42111564	36160528	1.16
clickbench_q25/datafusion:vortex-file-compressed	50029974	49237783	1.02
clickbench_q26/datafusion:vortex-file-compressed 🚨	39226235	35611264	1.10
clickbench_q27/datafusion:vortex-file-compressed	297733602	288406178	1.03
clickbench_q28/datafusion:vortex-file-compressed	1442182226	1430668316	1.01
clickbench_q29/datafusion:vortex-file-compressed	41420374	41533909	1.00
clickbench_q30/datafusion:vortex-file-compressed	168813212	173379702	0.97
clickbench_q31/datafusion:vortex-file-compressed	199282445	201085849	0.99
clickbench_q32/datafusion:vortex-file-compressed	846479304	837576783	1.01
clickbench_q33/datafusion:vortex-file-compressed	974421797	996910148	0.98
clickbench_q34/datafusion:vortex-file-compressed	975859131	1004232771	0.97
clickbench_q35/datafusion:vortex-file-compressed	162955646	165333395	0.99
clickbench_q36/datafusion:vortex-file-compressed	60787205	62296641	0.98
clickbench_q37/datafusion:vortex-file-compressed 🚨	30969960	28078632	1.10
clickbench_q38/datafusion:vortex-file-compressed 🚨	27122788	16453877	1.65
clickbench_q39/datafusion:vortex-file-compressed 🚨	173972583	126712299	1.37
clickbench_q40/datafusion:vortex-file-compressed	13236085	12793016	1.03
clickbench_q41/datafusion:vortex-file-compressed 🚨	15150474	12421182	1.22
clickbench_q42/datafusion:vortex-file-compressed 🚨	15665845	13875734	1.13

datafusion / parquet / ns (0.986x ➖, 1↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet	1985798	1949685	1.02
clickbench_q01/datafusion:parquet	18375860	17344523	1.06
clickbench_q02/datafusion:parquet	31659716	32510097	0.97
clickbench_q03/datafusion:parquet	26505370	26897880	0.99
clickbench_q04/datafusion:parquet	172375088	172868762	1.00
clickbench_q05/datafusion:parquet	237063909	241593462	0.98
clickbench_q06/datafusion:parquet	1991742	1937005	1.03
clickbench_q07/datafusion:parquet	17956798	18170550	0.99
clickbench_q08/datafusion:parquet	233390919	232042836	1.01
clickbench_q09/datafusion:parquet	377742400	378693531	1.00
clickbench_q10/datafusion:parquet	71655245	72856144	0.98
clickbench_q11/datafusion:parquet	92345285	94618246	0.98
clickbench_q12/datafusion:parquet	241594009	237821313	1.02
clickbench_q13/datafusion:parquet	391097322	396296206	0.99
clickbench_q14/datafusion:parquet	252356428	256953399	0.98
clickbench_q15/datafusion:parquet	195429825	203915187	0.96
clickbench_q16/datafusion:parquet	479346149	492015130	0.97
clickbench_q17/datafusion:parquet	472843608	480168255	0.98
clickbench_q18/datafusion:parquet	948074633	932917554	1.02
clickbench_q19/datafusion:parquet 🚀	22873862	29249192	0.78
clickbench_q20/datafusion:parquet	468554091	458178349	1.02
clickbench_q21/datafusion:parquet	495415362	494679132	1.00
clickbench_q22/datafusion:parquet	650851005	659696028	0.99
clickbench_q23/datafusion:parquet	2868421093	2870095692	1.00
clickbench_q24/datafusion:parquet	48485542	50590051	0.96
clickbench_q25/datafusion:parquet	101587544	100100264	1.01
clickbench_q26/datafusion:parquet	48471151	51658924	0.94
clickbench_q27/datafusion:parquet	536886177	538052482	1.00
clickbench_q28/datafusion:parquet	1540464600	1565188322	0.98
clickbench_q29/datafusion:parquet	42065679	42754105	0.98
clickbench_q30/datafusion:parquet	241346422	245810995	0.98
clickbench_q31/datafusion:parquet	281283842	271569508	1.04
clickbench_q32/datafusion:parquet	852407399	872596463	0.98
clickbench_q33/datafusion:parquet	1077008688	1098800949	0.98
clickbench_q34/datafusion:parquet	1089879126	1102485541	0.99
clickbench_q35/datafusion:parquet	172894215	167897273	1.03
clickbench_q36/datafusion:parquet	117330853	119366452	0.98
clickbench_q37/datafusion:parquet	47842888	47490208	1.01
clickbench_q38/datafusion:parquet	69844948	69319519	1.01
clickbench_q39/datafusion:parquet	234229691	234227789	1.00
clickbench_q40/datafusion:parquet	25563309	27349571	0.93
clickbench_q41/datafusion:parquet	24197622	24527644	0.99
clickbench_q42/datafusion:parquet	25161620	26158698	0.96

duckdb / vortex-file-compressed / ns (1.010x ➖, 1↑ 5↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed	16481298	15162859	1.09
clickbench_q01/duckdb:vortex-file-compressed	19457103	20271528	0.96
clickbench_q02/duckdb:vortex-file-compressed	28973600	31042884	0.93
clickbench_q03/duckdb:vortex-file-compressed	34869775	31837834	1.10
clickbench_q04/duckdb:vortex-file-compressed	133937942	128028493	1.05
clickbench_q05/duckdb:vortex-file-compressed	163721866	163806929	1.00
clickbench_q06/duckdb:vortex-file-compressed	22620539	22906769	0.99
clickbench_q07/duckdb:vortex-file-compressed	23459559	24204506	0.97
clickbench_q08/duckdb:vortex-file-compressed	164835735	168365472	0.98
clickbench_q09/duckdb:vortex-file-compressed	200336872	203160859	0.99
clickbench_q10/duckdb:vortex-file-compressed	72559120	68409156	1.06
clickbench_q11/duckdb:vortex-file-compressed	70167396	69255633	1.01
clickbench_q12/duckdb:vortex-file-compressed	194005069	199953197	0.97
clickbench_q13/duckdb:vortex-file-compressed	346287302	346033845	1.00
clickbench_q14/duckdb:vortex-file-compressed	212418667	218732614	0.97
clickbench_q15/duckdb:vortex-file-compressed	188094420	183607313	1.02
clickbench_q16/duckdb:vortex-file-compressed	404593244	386742967	1.05
clickbench_q17/duckdb:vortex-file-compressed	379205444	383439493	0.99
clickbench_q18/duckdb:vortex-file-compressed	732845792	733845785	1.00
clickbench_q19/duckdb:vortex-file-compressed 🚀	27619230	40775524	0.68
clickbench_q20/duckdb:vortex-file-compressed	244758423	247069137	0.99
clickbench_q21/duckdb:vortex-file-compressed	327072797	344056119	0.95
clickbench_q22/duckdb:vortex-file-compressed 🚨	516337354	465121761	1.11
clickbench_q23/duckdb:vortex-file-compressed	193183861	181587349	1.06
clickbench_q24/duckdb:vortex-file-compressed	59767550	55414961	1.08
clickbench_q25/duckdb:vortex-file-compressed	75930787	76791551	0.99
clickbench_q26/duckdb:vortex-file-compressed	73435528	71560481	1.03
clickbench_q27/duckdb:vortex-file-compressed	187225146	183835409	1.02
clickbench_q28/duckdb:vortex-file-compressed	1286219494	1283343052	1.00
clickbench_q29/duckdb:vortex-file-compressed	29454340	32480645	0.91
clickbench_q30/duckdb:vortex-file-compressed	160918819	155833214	1.03
clickbench_q31/duckdb:vortex-file-compressed	290228800	314891281	0.92
clickbench_q32/duckdb:vortex-file-compressed	926304564	922505486	1.00
clickbench_q33/duckdb:vortex-file-compressed	1106347487	1083671874	1.02
clickbench_q34/duckdb:vortex-file-compressed	1164172171	1163343658	1.00
clickbench_q35/duckdb:vortex-file-compressed	209306646	213568630	0.98
clickbench_q36/duckdb:vortex-file-compressed 🚨	41584950	36526409	1.14
clickbench_q37/duckdb:vortex-file-compressed 🚨	27728362	24546283	1.13
clickbench_q38/duckdb:vortex-file-compressed	33538490	32046757	1.05
clickbench_q39/duckdb:vortex-file-compressed	54992922	51161819	1.07
clickbench_q40/duckdb:vortex-file-compressed 🚨	28530141	25723750	1.11
clickbench_q41/duckdb:vortex-file-compressed 🚨	28194608	25241817	1.12
clickbench_q42/duckdb:vortex-file-compressed	27491498	25814278	1.06

duckdb / parquet / ns (0.995x ➖, 1↑ 0↓)

name	PR `72927cc` (ns)	base `4b37237` (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	16701518	16792848	0.99
clickbench_q01/duckdb:parquet	18496163	18635327	0.99
clickbench_q02/duckdb:parquet	24134115	24944034	0.97
clickbench_q03/duckdb:parquet	26388736	26161974	1.01
clickbench_q04/duckdb:parquet	129637412	131665356	0.98
clickbench_q05/duckdb:parquet	187657519	174315220	1.08
clickbench_q06/duckdb:parquet	23862549	22670299	1.05
clickbench_q07/duckdb:parquet	18780500	20160932	0.93
clickbench_q08/duckdb:parquet	164018381	163680847	1.00
clickbench_q09/duckdb:parquet	226521555	228666610	0.99
clickbench_q10/duckdb:parquet	58031410	58587387	0.99
clickbench_q11/duckdb:parquet	67021076	68288193	0.98
clickbench_q12/duckdb:parquet	174617080	174246237	1.00
clickbench_q13/duckdb:parquet	308373326	308296873	1.00
clickbench_q14/duckdb:parquet	188000004	188423254	1.00
clickbench_q15/duckdb:parquet	183802906	188647603	0.97
clickbench_q16/duckdb:parquet	356008253	352657701	1.01
clickbench_q17/duckdb:parquet	359933885	365228572	0.99
clickbench_q18/duckdb:parquet	687408297	689735444	1.00
clickbench_q19/duckdb:parquet	21685065	19987344	1.08
clickbench_q20/duckdb:parquet	265885390	259015567	1.03
clickbench_q21/duckdb:parquet	314079791	321016341	0.98
clickbench_q22/duckdb:parquet	484088238	461979490	1.05
clickbench_q23/duckdb:parquet	250161791	247399544	1.01
clickbench_q24/duckdb:parquet	66226119	70856936	0.93
clickbench_q25/duckdb:parquet	72524358	74001720	0.98
clickbench_q26/duckdb:parquet	48248545	49600969	0.97
clickbench_q27/duckdb:parquet	275174901	277047714	0.99
clickbench_q28/duckdb:parquet	1723312942	1701952945	1.01
clickbench_q29/duckdb:parquet	26199587	27018908	0.97
clickbench_q30/duckdb:parquet	177579795	179011907	0.99
clickbench_q31/duckdb:parquet	313400380	309724654	1.01
clickbench_q32/duckdb:parquet	903971620	906934144	1.00
clickbench_q33/duckdb:parquet	778862402	802469195	0.97
clickbench_q34/duckdb:parquet	791803548	804586988	0.98
clickbench_q35/duckdb:parquet	209906915	206643078	1.02
clickbench_q36/duckdb:parquet	50823164	50559779	1.01
clickbench_q37/duckdb:parquet	36813816	37629464	0.98
clickbench_q38/duckdb:parquet	38236024	39000667	0.98
clickbench_q39/duckdb:parquet	88679144	87360118	1.02
clickbench_q40/duckdb:parquet	19681032	20425779	0.96
clickbench_q41/duckdb:parquet 🚀	19396809	21626862	0.90
clickbench_q42/duckdb:parquet	24762677	23743270	1.04

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)

File	Scale	Format	Base	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
hits_0.vortex	1.0	vortex-compact	58.91 MB	58.91 MB	-100.0%
hits_1.vortex	1.0	vortex-compact	90.70 MB	90.70 MB	-100.0%
hits_10.vortex	1.0	vortex-compact	49.51 MB	49.51 MB	-100.0%
hits_11.vortex	1.0	vortex-compact	56.14 MB	56.14 MB	-100.0%
hits_12.vortex	1.0	vortex-compact	69.89 MB	69.89 MB	-100.0%
hits_13.vortex	1.0	vortex-compact	69.27 MB	69.27 MB	-100.0%
hits_14.vortex	1.0	vortex-compact	74.91 MB	74.91 MB	-100.0%
hits_15.vortex	1.0	vortex-compact	48.44 MB	48.44 MB	-100.0%
hits_16.vortex	1.0	vortex-compact	49.59 MB	49.59 MB	-100.0%
hits_17.vortex	1.0	vortex-compact	58.82 MB	58.82 MB	-100.0%
hits_18.vortex	1.0	vortex-compact	64.92 MB	64.92 MB	-100.0%
hits_19.vortex	1.0	vortex-compact	49.76 MB	49.76 MB	-100.0%
hits_2.vortex	1.0	vortex-compact	129.19 MB	129.19 MB	-100.0%
hits_20.vortex	1.0	vortex-compact	38.39 MB	38.39 MB	-100.0%
hits_21.vortex	1.0	vortex-compact	52.02 MB	52.02 MB	-100.0%
hits_22.vortex	1.0	vortex-compact	46.25 MB	46.25 MB	-100.0%
hits_23.vortex	1.0	vortex-compact	46.16 MB	46.16 MB	-100.0%
hits_24.vortex	1.0	vortex-compact	45.14 MB	45.14 MB	-100.0%
hits_25.vortex	1.0	vortex-compact	73.91 MB	73.91 MB	-100.0%
hits_26.vortex	1.0	vortex-compact	72.02 MB	72.02 MB	-100.0%
hits_27.vortex	1.0	vortex-compact	69.89 MB	69.89 MB	-100.0%
hits_28.vortex	1.0	vortex-compact	70.95 MB	70.95 MB	-100.0%
hits_29.vortex	1.0	vortex-compact	36.71 MB	36.71 MB	-100.0%
hits_3.vortex	1.0	vortex-compact	95.15 MB	95.15 MB	-100.0%
hits_30.vortex	1.0	vortex-compact	58.60 MB	58.60 MB	-100.0%
hits_31.vortex	1.0	vortex-compact	55.80 MB	55.80 MB	-100.0%
hits_32.vortex	1.0	vortex-compact	44.64 MB	44.64 MB	-100.0%
hits_33.vortex	1.0	vortex-compact	35.95 MB	35.95 MB	-100.0%
hits_34.vortex	1.0	vortex-compact	58.26 MB	58.26 MB	-100.0%
hits_35.vortex	1.0	vortex-compact	75.56 MB	75.56 MB	-100.0%
hits_36.vortex	1.0	vortex-compact	49.24 MB	49.24 MB	-100.0%
hits_37.vortex	1.0	vortex-compact	54.78 MB	54.78 MB	-100.0%
hits_38.vortex	1.0	vortex-compact	63.42 MB	63.42 MB	-100.0%
hits_39.vortex	1.0	vortex-compact	50.12 MB	50.12 MB	-100.0%
hits_4.vortex	1.0	vortex-compact	71.97 MB	71.97 MB	-100.0%
hits_40.vortex	1.0	vortex-compact	77.45 MB	77.45 MB	-100.0%
hits_41.vortex	1.0	vortex-compact	166.08 MB	166.08 MB	-100.0%
hits_42.vortex	1.0	vortex-compact	164.55 MB	164.55 MB	-100.0%
hits_43.vortex	1.0	vortex-compact	169.23 MB	169.23 MB	-100.0%
hits_44.vortex	1.0	vortex-compact	133.29 MB	133.29 MB	-100.0%
hits_45.vortex	1.0	vortex-compact	75.82 MB	75.82 MB	-100.0%
hits_46.vortex	1.0	vortex-compact	42.30 MB	42.30 MB	-100.0%
hits_47.vortex	1.0	vortex-compact	18.24 MB	18.24 MB	-100.0%
hits_48.vortex	1.0	vortex-compact	17.88 MB	17.88 MB	-100.0%
hits_49.vortex	1.0	vortex-compact	51.02 MB	51.02 MB	-100.0%
hits_5.vortex	1.0	vortex-compact	63.35 MB	63.35 MB	-100.0%
hits_50.vortex	1.0	vortex-compact	114.23 MB	114.23 MB	-100.0%
hits_51.vortex	1.0	vortex-compact	168.37 MB	168.37 MB	-100.0%
hits_52.vortex	1.0	vortex-compact	65.11 MB	65.11 MB	-100.0%
hits_53.vortex	1.0	vortex-compact	60.07 MB	60.07 MB	-100.0%
hits_54.vortex	1.0	vortex-compact	117.60 MB	117.60 MB	-100.0%
hits_55.vortex	1.0	vortex-compact	92.59 MB	92.59 MB	-100.0%
hits_56.vortex	1.0	vortex-compact	78.61 MB	78.61 MB	-100.0%
hits_57.vortex	1.0	vortex-compact	83.76 MB	83.76 MB	-100.0%
hits_58.vortex	1.0	vortex-compact	61.27 MB	61.27 MB	-100.0%
hits_59.vortex	1.0	vortex-compact	66.71 MB	66.71 MB	-100.0%
hits_6.vortex	1.0	vortex-compact	63.60 MB	63.60 MB	-100.0%
hits_60.vortex	1.0	vortex-compact	64.95 MB	64.95 MB	-100.0%
hits_61.vortex	1.0	vortex-compact	57.76 MB	57.76 MB	-100.0%
hits_62.vortex	1.0	vortex-compact	75.48 MB	75.48 MB	-100.0%
hits_63.vortex	1.0	vortex-compact	46.47 MB	46.47 MB	-100.0%
hits_64.vortex	1.0	vortex-compact	54.12 MB	54.12 MB	-100.0%
hits_65.vortex	1.0	vortex-compact	129.43 MB	129.43 MB	-100.0%
hits_66.vortex	1.0	vortex-compact	53.55 MB	53.55 MB	-100.0%
hits_67.vortex	1.0	vortex-compact	114.47 MB	114.47 MB	-100.0%
hits_68.vortex	1.0	vortex-compact	76.70 MB	76.70 MB	-100.0%
hits_69.vortex	1.0	vortex-compact	81.01 MB	81.01 MB	-100.0%
hits_7.vortex	1.0	vortex-compact	64.21 MB	64.21 MB	-100.0%
hits_70.vortex	1.0	vortex-compact	61.87 MB	61.87 MB	-100.0%
hits_71.vortex	1.0	vortex-compact	69.99 MB	69.99 MB	-100.0%
hits_72.vortex	1.0	vortex-compact	52.77 MB	52.77 MB	-100.0%
hits_73.vortex	1.0	vortex-compact	71.09 MB	71.09 MB	-100.0%
hits_74.vortex	1.0	vortex-compact	71.90 MB	71.90 MB	-100.0%
hits_75.vortex	1.0	vortex-compact	45.15 MB	45.15 MB	-100.0%
hits_76.vortex	1.0	vortex-compact	77.13 MB	77.13 MB	-100.0%
hits_77.vortex	1.0	vortex-compact	118.53 MB	118.53 MB	-100.0%
hits_78.vortex	1.0	vortex-compact	97.88 MB	97.88 MB	-100.0%
hits_79.vortex	1.0	vortex-compact	86.20 MB	86.20 MB	-100.0%
hits_8.vortex	1.0	vortex-compact	63.42 MB	63.42 MB	-100.0%
hits_80.vortex	1.0	vortex-compact	68.70 MB	68.70 MB	-100.0%
hits_81.vortex	1.0	vortex-compact	65.98 MB	65.98 MB	-100.0%
hits_82.vortex	1.0	vortex-compact	67.46 MB	67.46 MB	-100.0%
hits_83.vortex	1.0	vortex-compact	53.64 MB	53.64 MB	-100.0%
hits_84.vortex	1.0	vortex-compact	74.38 MB	74.38 MB	-100.0%
hits_85.vortex	1.0	vortex-compact	52.89 MB	52.89 MB	-100.0%
hits_86.vortex	1.0	vortex-compact	49.15 MB	49.15 MB	-100.0%
hits_87.vortex	1.0	vortex-compact	118.89 MB	118.89 MB	-100.0%
hits_88.vortex	1.0	vortex-compact	73.61 MB	73.61 MB	-100.0%
hits_89.vortex	1.0	vortex-compact	114.12 MB	114.12 MB	-100.0%
hits_9.vortex	1.0	vortex-compact	66.35 MB	66.35 MB	-100.0%
hits_90.vortex	1.0	vortex-compact	82.12 MB	82.12 MB	-100.0%
hits_91.vortex	1.0	vortex-compact	61.27 MB	61.27 MB	-100.0%
hits_92.vortex	1.0	vortex-compact	94.43 MB	94.43 MB	-100.0%
hits_93.vortex	1.0	vortex-compact	59.95 MB	59.95 MB	-100.0%
hits_94.vortex	1.0	vortex-compact	90.92 MB	90.92 MB	-100.0%
hits_95.vortex	1.0	vortex-compact	58.23 MB	58.23 MB	-100.0%
hits_96.vortex	1.0	vortex-compact	91.76 MB	91.76 MB	-100.0%
hits_97.vortex	1.0	vortex-compact	69.60 MB	69.60 MB	-100.0%
hits_98.vortex	1.0	vortex-compact	73.18 MB	73.18 MB	-100.0%
hits_99.vortex	1.0	vortex-compact	77.67 MB	77.67 MB	-100.0%

Totals:

vortex-compact: 7.11 GB → 0 B (-100.0%)
vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

github-actions · 2026-08-07T16:23:02Z

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.9%
Engines: DataFusion No clear signal (-5.6%, environment too noisy confidence) · DuckDB No clear signal (-8.3%, environment too noisy confidence)
Vortex (geomean): 0.946x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.012x ➖, 1↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	252229089	235781304	1.07
tpch_q02/datafusion:vortex-file-compressed	488563977	415294821	1.18
tpch_q03/datafusion:vortex-file-compressed	370865722	332693655	1.11
tpch_q04/datafusion:vortex-file-compressed	159584146	168220531	0.95
tpch_q05/datafusion:vortex-file-compressed	315226014	320468309	0.98
tpch_q06/datafusion:vortex-file-compressed	260324770	241357814	1.08
tpch_q07/datafusion:vortex-file-compressed	358630020	328703637	1.09
tpch_q08/datafusion:vortex-file-compressed 🚀	497836205	760942214	0.65
tpch_q09/datafusion:vortex-file-compressed	348534562	325593986	1.07
tpch_q10/datafusion:vortex-file-compressed	410309289	350585396	1.17
tpch_q11/datafusion:vortex-file-compressed	273780263	288530818	0.95
tpch_q12/datafusion:vortex-file-compressed	312468138	337849015	0.92
tpch_q13/datafusion:vortex-file-compressed	127180236	114877460	1.11
tpch_q14/datafusion:vortex-file-compressed	175237813	167649445	1.05
tpch_q15/datafusion:vortex-file-compressed	289842309	285195552	1.02
tpch_q16/datafusion:vortex-file-compressed	192611824	196486047	0.98
tpch_q17/datafusion:vortex-file-compressed	302439494	286759065	1.05
tpch_q18/datafusion:vortex-file-compressed	243329128	261176691	0.93
tpch_q19/datafusion:vortex-file-compressed	407216324	339191445	1.20
tpch_q20/datafusion:vortex-file-compressed	363719298	351129232	1.04
tpch_q21/datafusion:vortex-file-compressed	409165656	442205975	0.93
tpch_q22/datafusion:vortex-file-compressed	142727121	157257381	0.91

datafusion / parquet / ns (1.073x ➖, 0↑ 2↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	216697567	209060353	1.04
tpch_q02/datafusion:parquet	279482458	284123362	0.98
tpch_q03/datafusion:parquet	296855525	288804253	1.03
tpch_q04/datafusion:parquet	160818314	142711960	1.13
tpch_q05/datafusion:parquet	366086236	363233066	1.01
tpch_q06/datafusion:parquet	142567547	145892609	0.98
tpch_q07/datafusion:parquet	376167886	367624008	1.02
tpch_q08/datafusion:parquet	442204535	434419596	1.02
tpch_q09/datafusion:parquet	464358193	468938466	0.99
tpch_q10/datafusion:parquet	422602138	403585220	1.05
tpch_q11/datafusion:parquet	278875478	271927517	1.03
tpch_q12/datafusion:parquet	207705382	204848288	1.01
tpch_q13/datafusion:parquet	453522550	457430546	0.99
tpch_q14/datafusion:parquet	171084259	164750781	1.04
tpch_q15/datafusion:parquet	289321171	278208052	1.04
tpch_q16/datafusion:parquet 🚨	270308129	119533694	2.26
tpch_q17/datafusion:parquet 🚨	473100768	306221619	1.54
tpch_q18/datafusion:parquet	443258675	456881734	0.97
tpch_q19/datafusion:parquet	176009472	191693727	0.92
tpch_q20/datafusion:parquet	281050970	271760160	1.03
tpch_q21/datafusion:parquet	413912283	435653407	0.95
tpch_q22/datafusion:parquet	185378819	169907462	1.09

duckdb / vortex-file-compressed / ns (0.884x ➖, 3↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀	254241949	791089233	0.32
tpch_q02/duckdb:vortex-file-compressed 🚀	598335869	1496366697	0.40
tpch_q03/duckdb:vortex-file-compressed	503234274	468030330	1.08
tpch_q04/duckdb:vortex-file-compressed	283852242	266966833	1.06
tpch_q05/duckdb:vortex-file-compressed	489639567	501534273	0.98
tpch_q06/duckdb:vortex-file-compressed	268736065	269185136	1.00
tpch_q07/duckdb:vortex-file-compressed	544066663	601264241	0.90
tpch_q08/duckdb:vortex-file-compressed	719142506	745848694	0.96
tpch_q09/duckdb:vortex-file-compressed	545416782	582353665	0.94
tpch_q10/duckdb:vortex-file-compressed	473706896	508865479	0.93
tpch_q11/duckdb:vortex-file-compressed	264374632	270241243	0.98
tpch_q12/duckdb:vortex-file-compressed	419085346	444676787	0.94
tpch_q13/duckdb:vortex-file-compressed	317413669	327219721	0.97
tpch_q14/duckdb:vortex-file-compressed 🚀	249963186	367884386	0.68
tpch_q15/duckdb:vortex-file-compressed	172198733	178054444	0.97
tpch_q16/duckdb:vortex-file-compressed	230396463	221733091	1.04
tpch_q17/duckdb:vortex-file-compressed	444876643	456580133	0.97
tpch_q18/duckdb:vortex-file-compressed	342199542	346906201	0.99
tpch_q19/duckdb:vortex-file-compressed	358643891	350703995	1.02
tpch_q20/duckdb:vortex-file-compressed	514101029	501452744	1.03
tpch_q21/duckdb:vortex-file-compressed	693514624	693702554	1.00
tpch_q22/duckdb:vortex-file-compressed	150122722	151412479	0.99

duckdb / parquet / ns (0.964x ➖, 0↑ 0↓)

name	PR `72927cc` (ns)	base `2c9e095` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	333289575	336379339	0.99
tpch_q02/duckdb:parquet	649137181	656484489	0.99
tpch_q03/duckdb:parquet	739634323	792164494	0.93
tpch_q04/duckdb:parquet	444709110	517102536	0.86
tpch_q05/duckdb:parquet	1064799217	962782634	1.11
tpch_q06/duckdb:parquet	285758309	318275467	0.90
tpch_q07/duckdb:parquet	867015205	893229397	0.97
tpch_q08/duckdb:parquet	1021648412	1053241514	0.97
tpch_q09/duckdb:parquet	1031162129	1057298677	0.98
tpch_q10/duckdb:parquet	998588015	1017449445	0.98
tpch_q11/duckdb:parquet	452764777	451775020	1.00
tpch_q12/duckdb:parquet	550148131	600097592	0.92
tpch_q13/duckdb:parquet	862571465	849770002	1.02
tpch_q14/duckdb:parquet	517174386	529157905	0.98
tpch_q15/duckdb:parquet	364056396	386806726	0.94
tpch_q16/duckdb:parquet	499559606	538832708	0.93
tpch_q17/duckdb:parquet	474404246	501779470	0.95
tpch_q18/duckdb:parquet	634714967	668785784	0.95
tpch_q19/duckdb:parquet	586520344	569942243	1.03
tpch_q20/duckdb:parquet	837657360	845506516	0.99
tpch_q21/duckdb:parquet	707584537	784833381	0.90
tpch_q22/duckdb:parquet	438217705	457216682	0.96

github-actions · 2026-09-01T01:47:48Z

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

AdamGS added changelog/feature A new feature action/benchmark-sql-full labels Jul 15, 2026

github-actions Bot removed the action/benchmark-sql-full label Jul 15, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch from 112e14e to a684568 Compare July 17, 2026 09:45

AdamGS added the action/benchmark-sql label Jul 17, 2026

github-actions Bot removed the action/benchmark-sql label Jul 17, 2026

AdamGS added the action/benchmark-sql label Jul 17, 2026

github-actions Bot removed the action/benchmark-sql label Jul 17, 2026

AdamGS added the action/benchmark-sql-full label Jul 17, 2026

github-actions Bot removed the action/benchmark-sql-full label Jul 17, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch from 882dc6e to eaff866 Compare July 17, 2026 12:39

AdamGS added the action/benchmark-sql label Jul 17, 2026

github-actions Bot removed the action/benchmark-sql label Jul 17, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch from b0b6794 to da0d99c Compare July 17, 2026 14:50

AdamGS added the action/benchmark-sql label Jul 17, 2026

github-actions Bot removed the action/benchmark-sql label Jul 17, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch from 3b330f4 to bf8ba8a Compare July 17, 2026 15:47

AdamGS added the action/benchmark-sql-full label Jul 17, 2026

github-actions Bot removed the action/benchmark-sql-full label Jul 17, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch 2 times, most recently from 7015650 to 26a82c5 Compare July 28, 2026 10:35

AdamGS added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/benchmark-sql and removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Jul 28, 2026

github-actions Bot removed the action/benchmark-sql label Jul 28, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch 2 times, most recently from f1ba9b0 to 01e195e Compare July 29, 2026 16:04

AdamGS added the action/benchmark-sql label Jul 29, 2026

github-actions Bot removed the action/benchmark-sql label Jul 29, 2026

AdamGS added the action/benchmark-sql label Jul 29, 2026

AdamGS force-pushed the adamg/remove-map-fn-limit branch from e8926b6 to 302e5ac Compare August 4, 2026 13:47

AdamGS force-pushed the adamg/remove-map-fn-limit branch from 302e5ac to c78c784 Compare August 5, 2026 13:33

Base automatically changed from adamg/splits-optimization to develop August 6, 2026 15:11

AdamGS force-pushed the adamg/remove-map-fn-limit branch from c78c784 to 4b9c142 Compare August 6, 2026 15:19

vortex-data deleted a comment from github-actions Bot Aug 6, 2026

AdamGS added 3 commits September 11, 2026 12:43

Remove ScanBuilder map function limit

a22cbf8

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

thing

850f3a5

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

Fix scan consumers and minimum-version CI

b8f98ff

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

Navigation Menu

Uh oh!

Adamg/remove map fn limit - #8766

Adamg/remove map fn limit#8766
AdamGS wants to merge 3 commits into
developfrom
adamg/remove-map-fn-limit

AdamGS commented Jul 15, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 7, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Sep 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

AdamGS commented Jul 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

What APIs are changed? Are there any user-facing changes?

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Sep 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

AdamGS commented Jul 15, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading

github-actions Bot commented Aug 7, 2026 •

edited

Loading