bench: write Lance at storage version 2.2 in the compression benchmark by joseph-isaacs · Pull Request #9832 · vortex-data/vortex

joseph-isaacs · 2026-09-10T16:05:38Z

Summary

LanceCompressor wrote storage version 2.0. Structural encoding arrives in 2.1 (is_structural = version >= V2_1), and that is what turns on Lance's compressive encodings — bitpacking, FSST, general compression. At 2.0 the compression suite was charting a near-uncompressed Lance file against compressed Vortex and Parquet, and reporting Lance files larger than Parquet's. The Lance ratios in the develop benchmark history are therefore not a measurement of Lance's compression.

This writes 2.2, the newest stable storage version. The other two Lance writers in lance-bench — convert.rs (SQL suite) and random_access.rs — remain at 2.1, so the SQL and random-access suites keep writing the data they already write.

Why 2.2 is named explicitly

LanceFileVersion::Stable resolves to default(), which is 2.1 — it marks the default version for new datasets, not the newest stable version. Reaching for Stable would leave the writer where it already was, so 2.2 has to be named directly.

2.2 is stable rather than experimental: is_unstable() is self >= Next, and the variant order is Legacy < V2_0 < V2_1 < Stable < V2_2 < Next < V2_3, so 2.2 sits below the unstable boundary. Verified against the pinned lance 10.0.0 — lance-file maps V2_2 → ConcreteFileVersion::V2_2 for writing and resolves (2, 2) back to V2_2 when reading, and is_structural still holds at 2.2.

What 2.2 writes locally

Each version measured on wide table cols=1000 chunks=1 rows=1000 with a binary differing only in the storage-version constant, against an identical Parquet baseline of 9,324,004 bytes in all three runs, so the rows are directly comparable:

Storage version	Lance bytes	vs Parquet
2.0 (the code this PR replaces)	16,315,490	1.75x
2.1	8,649,004	0.93x
2.2 (this branch)	8,404,981	0.90x

2.2 is 1.94x smaller than the 2.0 file, and a further 2.8% below 2.1. The run included the decompress op, so the pinned reader reads back what the 2.2 writer emits — this is a round-trip, not a write-only check. Timings from that run are from a debug build and are not reported here; the hardware numbers below come from CI.

Benchmark result

These numbers were measured at 2.1, from the action/bench-all run on commit 98736325, which wrote 2.1. They establish the size of the 2.0 bug; 2.2 has not been measured on the benchmark hardware, and the first 2.2 numbers there will come from the post-merge develop run. The local table above suggests 2.2 lands a further ~3% below these figures.

vortex / lance / bytes: 0.457x, 15 improved, 0 regressed — every dataset's Lance file shrank against the 2.0 baseline:

Dataset	2.0 baseline	2.1	Change
Food	276,848,943	64,619,601	-76.7%
Bimbo	3,115,736,833	1,004,828,887	-67.7%
TPC-H l_comment	855,169,631	324,595,977	-62.0%
taxi	470,881,754	186,147,964	-60.5%
HashTags	732,891,323	303,020,270	-58.7%
CMSprovider	2,128,903,413	949,620,925	-55.4%
wide table (all sizes)	16,315,490	8,649,004	-47.0%
Euro2016	324,920,968	207,971,950	-36.0%
Arade	474,714,325	331,997,163	-30.1%

Vortex, Parquet and Arrow IPC sizes were unchanged at +0.0%, as expected — the change only affects what the Lance writer emits.

Two consistency checks

wide table cols=1000 chunks=1 rows=1000 came back as 8,649,004 / 16,315,490 bytes, byte-for-byte identical to a local A/B built either side of the one-line change. CI on dedicated hardware reproduced the local number exactly.

The Random Access suite reported Lance at 1.000x, 0 up 0 down. That is the control: random_access.rs already wrote 2.1, so it should not move, and it did not. Only the suite whose writer changed changed — and that property is why random_access.rs is being left alone here.

Times move too, and that is the point

Lance decompression got slower at 2.1 — Euro2016 +413%, HashTags +264%, TPC-H l_comment +194%, Bimbo +116%. That is not a regression: at 2.0 Lance was reading a barely-compressed file, so there was little to decode. Compress time is mixed for the same reason (Arade -88.1%, CMSprovider -70.5%, TPC-H -56%, against Bimbo +29.1%, HashTags +18.9%, taxi +18.7%).

One ratio is worth calling out rather than burying: on the synthetic wide tables the vortex:lance size ratio moved from 0.571 to 1.076, meaning Lance produced a smaller file than Vortex there. That comparison was previously hidden behind an uncompressed baseline.

Changes

benchmarks/lance-bench/src/compress.rs — write LanceFileVersion::V2_2 instead of V2_0, with a short comment on the two non-obvious facts: 2.1 and above is where structural encoding applies the compressive encodings, and Stable is not a way to ask for the newest stable version. The variant-order proof lives in the commit message, not next to the line.
benchmarks/compress-bench/README.md — document the lance feature, the local invocation, the storage version and the Stable-resolves-to-2.1 gotcha.
scripts/compress-split.py — note in --formats help that lance needs a binary built with the feature.

Benchmark coverage is deliberately unchanged. Lance runs in the post-merge develop benchmark only, which already passes --formats arrow-ipc,parquet,lance,vortex; the pull-request Compression matrix is left alone so it does not grow. No workflow files are modified.

Because the develop S3 baseline was recorded at 2.0, the first post-merge run will show the Lance rows moving by roughly the amounts above. That is the correction landing, not a regression.

CI status

Five checks were red on this branch for a reason that was not this PR: develop had a stale onpair golden snapshot, which broke Rust (btrblocks golden corpus) and the workspace Rust tests jobs on every open PR. That is fixed on develop by #9835, and this branch has merged it — cargo test -p vortex-btrblocks --test golden passes locally on the merge.

No CI job exercises the Lance path on a pull request, because the PR Compression matrix is built without the lance feature. The first CI run to write a Lance file at 2.2 will be the post-merge develop benchmark, which makes the local round-trip above the only pre-merge validation of the 2.2 writer.

Checks

cargo build -p compress-bench --features lance at 2.2 — clean.
compress-bench --ops compress --ops decompress on the synthetic wide table at 2.2 — round-trips, 8,404,981 bytes (table above).
Local A/B across the 2.0 -> 2.1 change, reproduced exactly by CI (above).
2.2 verified statically against lance 10.0.0: stable by variant order, writable via ConcreteFileVersion::V2_2, readable via the reader's (2, 2) mapping, is_structural satisfied.
cargo test -p vortex-btrblocks --test golden after merging Fix onpair btrblocks golden snapshot #9835 — golden_onpair and golden_regular both pass.
cargo +nightly fmt --all -- --check — clean.
ruff format --check and ruff check on scripts/compress-split.py — pass.
Full action/bench-all run at 2.1: Compression, Random Access, String Encoding and the SQL matrix. Every SQL suite returned "No clear signal", correct for a change that only alters what the compression benchmark writes.

Not run: the benchmark hardware has not measured 2.2, and no PR CI job builds the lance feature, so the CI table above remains a 2.1 measurement.

🤖 Generated with Claude Code

https://claude.ai/code/session_01TkDpMmCYNaj43ENFUyDULe

`LanceCompressor` wrote storage version 2.0, the pre-structural-encoding layout that applies almost no compression. The other two Lance writers in `lance-bench` (`convert.rs`, `random_access.rs`) already use 2.1, which is also Lance's own default and the first version with the compressive encodings (bitpacking, FSST, general compression). The compression suite was therefore charting a near-uncompressed Lance file against compressed Vortex and Parquet. Lance was also missing from pull-request compression runs: `pr-bench-compress.yml` left `with_lance` at its default of false, so the binary was built without the feature and `compress-split.py` defaulted to `arrow-ipc,parquet,vortex`. Only the `develop` run covered Lance. - Write Lance at storage version 2.1 in `LanceCompressor`. - Put `lance` in `compress-split.py`'s default `--formats`, matching `random-access-split.py`, and drop the now-redundant explicit list from `develop-bench.yml`. - Set `with_lance: true` for the PR compression benchmark. - Document the feature, the format list and the storage version in the compress-bench README. Lance rows in the PR `Compression` comment will read as a large change against the S3 baseline, which was recorded at 2.0. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01TkDpMmCYNaj43ENFUyDULe

github-actions · 2026-09-10T16:13:53Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`9873632`	random-access-bench	1	Explore Profiling Data
🟢 Done	`9873632`	compress-bench	1	Explore Profiling Data
🟢 Done	`9873632`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`9873632`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`9873632`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`9873632`	string-bench	1	Explore Profiling Data
🟢 Done	`9873632`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`9873632`	statpopgen	1	Explore Profiling Data
🟢 Done	`9873632`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`9873632`	fineweb	1	Explore Profiling Data
🟢 Done	`9873632`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`9873632`	appian-nvme	1	Explore Profiling Data
🟢 Done	`9873632`	tpch-s3	1	Explore Profiling Data
🟢 Done	`9873632`	polarsignals	1	Explore Profiling Data
🟢 Done	`9873632`	tpcds-nvme	1	Explore Profiling Data

Powered by Polar Signals Cloud

codspeed-hq · 2026-09-10T16:13:57Z

Merging this PR will degrade performance by 13.06%

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 1 regressed benchmark
✅ 2195 untouched benchmarks
⏩ 218 skipped benchmarks¹

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	WallTime	`arrow_checked_add_u32_neon[16384]`	13.3 µs	20.4 µs	-34.91%
⚡	WallTime	`deferred_i64_avx512[PerRowPerRow]`	11.6 µs	10 µs	+16.12%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing claude/lance-compression-benchmarks-sgwcnd (b7e0285) with develop (2dffb68)}

218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

joseph-isaacs · 2026-09-10T16:15:09Z

CodSpeed Performance Analysis is red on 9873632 with three regressions. They are not this PR's, and I am not planning a fix. Recording why.

This PR changes six files: three workflow YAMLs, benchmarks/lance-bench/src/compress.rs, benchmarks/compress-bench/README.md and scripts/compress-split.py (+27/-5). The regressed benchmarks live in vortex-compute/benches/lane_kernels.rs and vortex-buffer/benches/collect_bool.rs. Neither crate is touched, and neither depends on the ones that are — compress-bench has no reverse dependencies in the workspace at all, and lance-bench is only an optional dependency of random-access-bench. There is no compilation path from this diff to those benchmarks.

The report also contradicts itself on hardware:

Benchmark	ISA
`arrow_checked_add_u32_neon[16384]`	ARM NEON
`words_gather_dispatch_avx512[1024]`	x86 AVX-512
`words_gather_scalar_avx2[65536]`	x86 AVX2

A NEON benchmark and an AVX-512 benchmark cannot both execute on one machine, so these samples were not all taken on the same hardware as their baselines. That is precisely what CodSpeed's own two warnings on the report say — "Different runtime environments detected" and "Unknown Walltime execution environment detected — using the Walltime instrument on standard Hosted Runners will lead to inconsistent data". All three regressions are WallTime-mode; the single Simulation-mode change on the report (run_end_compress.rs::decompress, the deterministic instrument) is an improvement and is equally unrelated to this diff.

I have not spent a re-run on this one. A CodSpeed re-run would resample the same cross-environment variance rather than settle anything, and the static evidence above is stronger than another sample would be. Separately, Python (windows-x64) also went red on this commit: that job died after one second with no logs at all, i.e. runner loss before any test body ran, and that one I will re-run once the parent workflow finishes.

Happy to revisit if a reviewer reads the CodSpeed data differently.

Generated by Claude Code

github-actions · 2026-09-10T16:16:49Z

Benchmarks: String Encoding 📖

Commits: PR 98736325 vs base 56bf0a7d

vortex / vortex-file-compressed / ms (0.996x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	35.953232 / 36.112322 / -0.4%
read/clickbench/URL/shard-0/onpair-12	24.156664 / 24.484552 / -1.3%
read/tpch/l_comment/fsst	66.882806 / 67.213488 / -0.5%
read/tpch/l_comment/onpair-12	64.566219 / 65.289297 / -1.1%
write/clickbench/URL/shard-0/fsst	617.158015 / 617.840594 / -0.1%
write/clickbench/URL/shard-0/onpair-12	1712.95076 / 1713.17701 / -0.0%
write/tpch/l_comment/fsst	2121.07408 / 2119.65089 / +0.1%
write/tpch/l_comment/onpair-12	2901.60259 / 2892.00075 / +0.3%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	46.3287717 / 46.3287717 / +0.0%
size/clickbench/URL/shard-0/onpair-12	29.7417205 / 29.7417205 / +0.0%
size/tpch/l_comment/fsst	26.895107 / 26.895107 / +0.0%
size/tpch/l_comment/onpair-12	22.6667937 / 22.6667937 / +0.0%

github-actions · 2026-09-10T16:17:50Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 98736325 vs base 56bf0a7d
Vortex (geomean): hot 1.011x ➖ · cold 1.013x ➖

datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	46005344 / 45594206 / +0.9%	95927748 / 95811135 / +0.1%	0.48 / 0.48 / +0.8%
polarsignals_q01/datafusion:vortex-file-compressed	51315652 / 51106932 / +0.4%	121251014 / 119717941 / +1.3%	0.42 / 0.43 / -0.9%
polarsignals_q02/datafusion:vortex-file-compressed	35038233 / 35257418 / -0.6%	88343408 / 85286109 / +3.6%	0.40 / 0.41 / -4.1%
polarsignals_q03/datafusion:vortex-file-compressed	53755642 / 53491368 / +0.5%	118517165 / 122474557 / -3.2%	0.45 / 0.44 / +3.8%
polarsignals_q04/datafusion:vortex-file-compressed	9506562 / 9509879 / -0.0%	53024449 / 52059390 / +1.9%	0.18 / 0.18 / -1.9%
polarsignals_q05/datafusion:vortex-file-compressed	12703680 / 11934542 / +6.4%	56786990 / 56305690 / +0.9%	0.22 / 0.21 / +5.5%
polarsignals_q06/datafusion:vortex-file-compressed	21871377 / 21220370 / +3.1%	65526528 / 64814233 / +1.1%	0.33 / 0.33 / +1.9%
polarsignals_q07/datafusion:vortex-file-compressed	11471611 / 11569078 / -0.8%	59361741 / 56290218 / +5.5%	0.19 / 0.21 / -6.0%
polarsignals_q08/datafusion:vortex-file-compressed	100521432 / 100797256 / -0.3%	171127890 / 166619193 / +2.7%	0.59 / 0.60 / -2.9%
polarsignals_q09/datafusion:vortex-file-compressed	10268762 / 10077666 / +1.9%	51889599 / 52051348 / -0.3%	0.20 / 0.19 / +2.2%

No file size changes detected.

github-actions · 2026-09-10T16:19:43Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.4%
Engines: DataFusion No clear signal (+5.1%, low confidence) · DuckDB No clear signal (+3.8%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.958x ➖ · cold 1.080x ➖
Shifts: Parquet (control) -4.2% · Median polish -1.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6854240 / 7090938 / -3.3%	21651639 / 22533575 / -3.9%	0.32 / 0.31 / +0.6%
fineweb_q01/datafusion:vortex-file-compressed	13425542 / 13872546 / -3.2%	49458634 / 46542041 / +6.3%	0.27 / 0.30 / -8.9%
fineweb_q02/datafusion:vortex-file-compressed	13288886 / 12945440 / +2.7%	52096603 / 51175607 / +1.8%	0.26 / 0.25 / +0.8%
fineweb_q03/datafusion:vortex-file-compressed	19753588 / 21557908 / -8.4%	114572224 / 105237437 / +8.9%	0.17 / 0.20 / -15.8%
fineweb_q04/datafusion:vortex-file-compressed	72922078 / 77817362 / -6.3%	160119805 / 159871345 / +0.2%	0.46 / 0.49 / -6.4%
fineweb_q05/datafusion:vortex-file-compressed	57902940 / 60078946 / -3.6%	140184280 / 140727458 / -0.4%	0.41 / 0.43 / -3.2%
fineweb_q06/datafusion:vortex-file-compressed	19190622 / 20103914 / -4.5%	118921606 / 104290808 / +14.0% 🔴	0.16 / 0.19 / -16.3%
fineweb_q07/datafusion:vortex-file-compressed	17748679 / 19429232 / -8.6%	113534839 / 101478920 / +11.9% 🔴	0.16 / 0.19 / -18.3%
fineweb_q08/datafusion:vortex-file-compressed	12394073 / 9917834 / +25.0% 🔴	47323566 / 47135362 / +0.4%	0.26 / 0.21 / +24.5%

datafusion / vortex-compact / ns (0.985x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	6803094 / 7122100 / -4.5%	21198206 / 21175463 / +0.1%	0.32 / 0.34 / -4.6%
fineweb_q01/datafusion:vortex-compact	44243944 / 45200948 / -2.1%	79323799 / 75911488 / +4.5%	0.56 / 0.60 / -6.3%
fineweb_q02/datafusion:vortex-compact	44017250 / 44126734 / -0.2%	81473390 / 77907137 / +4.6%	0.54 / 0.57 / -4.6%
fineweb_q03/datafusion:vortex-compact	168912220 / 170229809 / -0.8%	229215217 / 228717427 / +0.2%	0.74 / 0.74 / -1.0%
fineweb_q04/datafusion:vortex-compact	175830117 / 192498554 / -8.7%	246470763 / 246858279 / -0.2%	0.71 / 0.78 / -8.5%
fineweb_q05/datafusion:vortex-compact	160441148 / 153156251 / +4.8%	237793749 / 235608609 / +0.9%	0.67 / 0.65 / +3.8%
fineweb_q06/datafusion:vortex-compact	87121588 / 87264279 / -0.2%	165963141 / 158370214 / +4.8%	0.52 / 0.55 / -4.7%
fineweb_q07/datafusion:vortex-compact	88649597 / 88176994 / +0.5%	155290402 / 160211562 / -3.1%	0.57 / 0.55 / +3.7%
fineweb_q08/datafusion:vortex-compact	8338369 / 8517355 / -2.1%	38195847 / 43427405 / -12.0% 🟢	0.22 / 0.20 / +11.3%

datafusion / parquet / ns (0.937x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9203991 / 9130908 / +0.8%	34320208 / 35499341 / -3.3%	0.27 / 0.26 / +4.3%
fineweb_q01/datafusion:parquet	69877747 / 74990968 / -6.8%	162353680 / 144770918 / +12.1% 🔴	0.43 / 0.52 / -16.9%
fineweb_q02/datafusion:parquet	70353260 / 76227589 / -7.7%	161360474 / 145565563 / +10.9% 🔴	0.44 / 0.52 / -16.7%
fineweb_q03/datafusion:parquet	69933646 / 73632122 / -5.0%	158921338 / 145506403 / +9.2%	0.44 / 0.51 / -13.0%
fineweb_q04/datafusion:parquet	75227958 / 82309804 / -8.6%	164076557 / 148976596 / +10.1% 🔴	0.46 / 0.55 / -17.0%
fineweb_q05/datafusion:parquet	76020602 / 82584556 / -7.9%	158015369 / 147020569 / +7.5%	0.48 / 0.56 / -14.4%
fineweb_q06/datafusion:parquet	71634914 / 79186168 / -9.5%	164799409 / 153725804 / +7.2%	0.43 / 0.52 / -15.6%
fineweb_q07/datafusion:parquet	70174246 / 73734528 / -4.8%	161762748 / 144700204 / +11.8% 🔴	0.43 / 0.51 / -14.9%
fineweb_q08/datafusion:parquet	68861676 / 73915567 / -6.8%	167781291 / 144540879 / +16.1% 🔴	0.41 / 0.51 / -19.7%

duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	2087980 / 2074474 / +0.7%	4715314 / 7522330 / -37.3% 🟢	0.44 / 0.28 / +60.6%
fineweb_q01/duckdb:vortex-file-compressed	22162002 / 21940069 / +1.0%	63720051 / 61907258 / +2.9%	0.35 / 0.35 / -1.9%
fineweb_q02/duckdb:vortex-file-compressed	17887480 / 17191144 / +4.1%	47723765 / 45834821 / +4.1%	0.37 / 0.38 / -0.1%
fineweb_q03/duckdb:vortex-file-compressed	21858878 / 23459744 / -6.8%	94548992 / 94244120 / +0.3%	0.23 / 0.25 / -7.1%
fineweb_q04/duckdb:vortex-file-compressed	83323588 / 82170466 / +1.4%	137070428 / 145879381 / -6.0%	0.61 / 0.56 / +7.9%
fineweb_q05/duckdb:vortex-file-compressed	61790405 / 64785300 / -4.6%	121702246 / 114469759 / +6.3%	0.51 / 0.57 / -10.3%
fineweb_q06/duckdb:vortex-file-compressed	25613617 / 22497142 / +13.9% 🔴	96472141 / 104726964 / -7.9%	0.27 / 0.21 / +23.6%
fineweb_q07/duckdb:vortex-file-compressed	22470136 / 22061650 / +1.9%	92197684 / 91256238 / +1.0%	0.24 / 0.24 / +0.8%
fineweb_q08/duckdb:vortex-file-compressed	11176512 / 10993645 / +1.7%	47589923 / 48574876 / -2.0%	0.23 / 0.23 / +3.8%

duckdb / vortex-compact / ns (1.022x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	2365256 / 2297544 / +2.9%	8105033 / 7820874 / +3.6%	0.29 / 0.29 / -0.7%
fineweb_q01/duckdb:vortex-compact	58957160 / 48915268 / +20.5% 🔴	78987951 / 76069103 / +3.8%	0.75 / 0.64 / +16.1%
fineweb_q02/duckdb:vortex-compact	57764702 / 52772948 / +9.5%	96215975 / 97664480 / -1.5%	0.60 / 0.54 / +11.1%
fineweb_q03/duckdb:vortex-compact	187119470 / 184081928 / +1.7%	223888892 / 235076214 / -4.8%	0.84 / 0.78 / +6.7%
fineweb_q04/duckdb:vortex-compact	193766592 / 203951856 / -5.0%	292008736 / 279555739 / +4.5%	0.66 / 0.73 / -9.0%
fineweb_q05/duckdb:vortex-compact	191194028 / 188416224 / +1.5%	213803059 / 246879043 / -13.4% 🟢	0.89 / 0.76 / +17.2%
fineweb_q06/duckdb:vortex-compact	96364480 / 94084494 / +2.4%	160777076 / 169438871 / -5.1%	0.60 / 0.56 / +7.9%
fineweb_q07/duckdb:vortex-compact	96024363 / 105128620 / -8.7%	152172856 / 148990456 / +2.1%	0.63 / 0.71 / -10.6%
fineweb_q08/duckdb:vortex-compact	9273174 / 9526940 / -2.7%	43849160 / 40936925 / +7.1%	0.21 / 0.23 / -9.1%

duckdb / parquet / ns (0.980x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	21764466 / 24158354 / -9.9%	26402774 / 23086472 / +14.4% 🔴	0.82 / 1.05 / -21.2%
fineweb_q01/duckdb:parquet	44258448 / 44882926 / -1.4%	62838429 / 53350022 / +17.8% 🔴	0.70 / 0.84 / -16.3%
fineweb_q02/duckdb:parquet	43901870 / 44194111 / -0.7%	56831467 / 52514892 / +8.2%	0.77 / 0.84 / -8.2%
fineweb_q03/duckdb:parquet	95589092 / 94493956 / +1.2%	182103372 / 174815436 / +4.2%	0.52 / 0.54 / -2.9%
fineweb_q04/duckdb:parquet	151952936 / 151338926 / +0.4%	212628615 / 198400089 / +7.2%	0.71 / 0.76 / -6.3%
fineweb_q05/duckdb:parquet	143703235 / 142562814 / +0.8%	195490042 / 186744435 / +4.7%	0.74 / 0.76 / -3.7%
fineweb_q06/duckdb:parquet	70389086 / 71703766 / -1.8%	126687047 / 125153074 / +1.2%	0.56 / 0.57 / -3.0%
fineweb_q07/duckdb:parquet	71727614 / 72209834 / -0.7%	162105835 / 152948970 / +6.0%	0.44 / 0.47 / -6.3%
fineweb_q08/duckdb:parquet	22945096 / 24205103 / -5.2%	24217208 / 23965629 / +1.0%	0.95 / 1.01 / -6.2%

No file size changes detected.

github-actions · 2026-09-10T16:20:58Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.983x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.987x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	23986968 / 24356796 / -1.5%	41747631 / 43586183 / -4.2%	0.57 / 0.56 / +2.8%
tpcds_q02/datafusion:vortex-file-compressed	45095488 / 45771886 / -1.5%	61887275 / 62815747 / -1.5%	0.73 / 0.73 / +0.0%
tpcds_q03/datafusion:vortex-file-compressed	11444396 / 11576390 / -1.1%	28746108 / 28674052 / +0.3%	0.40 / 0.40 / -1.4%
tpcds_q04/datafusion:vortex-file-compressed	112860996 / 112188164 / +0.6%	140713692 / 141630379 / -0.6%	0.80 / 0.79 / +1.3%
tpcds_q05/datafusion:vortex-file-compressed	59759756 / 60637176 / -1.4%	82003541 / 82271329 / -0.3%	0.73 / 0.74 / -1.1%
tpcds_q06/datafusion:vortex-file-compressed	23412336 / 23192452 / +0.9%	44804600 / 48004637 / -6.7%	0.52 / 0.48 / +8.2%
tpcds_q07/datafusion:vortex-file-compressed	31965328 / 31984132 / -0.1%	55706952 / 58697269 / -5.1%	0.57 / 0.54 / +5.3%
tpcds_q08/datafusion:vortex-file-compressed	26484372 / 26159867 / +1.2%	44736300 / 46606020 / -4.0%	0.59 / 0.56 / +5.5%
tpcds_q09/datafusion:vortex-file-compressed	17924798 / 16569952 / +8.2%	35403814 / 36201297 / -2.2%	0.51 / 0.46 / +10.6%
tpcds_q10/datafusion:vortex-file-compressed	29777548 / 28842567 / +3.2%	51599352 / 51618031 / -0.0%	0.58 / 0.56 / +3.3%
tpcds_q11/datafusion:vortex-file-compressed	60397839 / 60300704 / +0.2%	85331752 / 87031114 / -2.0%	0.71 / 0.69 / +2.2%
tpcds_q12/datafusion:vortex-file-compressed	16194295 / 16863018 / -4.0%	31605452 / 32634192 / -3.2%	0.51 / 0.52 / -0.8%
tpcds_q13/datafusion:vortex-file-compressed	37411264 / 37499734 / -0.2%	59279213 / 62815454 / -5.6%	0.63 / 0.60 / +5.7%
tpcds_q14/datafusion:vortex-file-compressed	91562212 / 91903736 / -0.4%	122448309 / 121489796 / +0.8%	0.75 / 0.76 / -1.2%
tpcds_q15/datafusion:vortex-file-compressed	25087718 / 25195936 / -0.4%	45068568 / 46007840 / -2.0%	0.56 / 0.55 / +1.6%
tpcds_q16/datafusion:vortex-file-compressed	20623688 / 20968788 / -1.6%	42050252 / 42702256 / -1.5%	0.49 / 0.49 / -0.1%
tpcds_q17/datafusion:vortex-file-compressed	61074476 / 59242438 / +3.1%	78491637 / 86838422 / -9.6%	0.78 / 0.68 / +14.1%
tpcds_q18/datafusion:vortex-file-compressed	68192988 / 69875337 / -2.4%	92674892 / 93486484 / -0.9%	0.74 / 0.75 / -1.6%
tpcds_q19/datafusion:vortex-file-compressed	18098762 / 18123373 / -0.1%	40228129 / 41314774 / -2.6%	0.45 / 0.44 / +2.6%
tpcds_q20/datafusion:vortex-file-compressed	17149118 / 18040020 / -4.9%	34190147 / 36157224 / -5.4%	0.50 / 0.50 / +0.5%
tpcds_q21/datafusion:vortex-file-compressed	17453060 / 17029387 / +2.5%	38955220 / 41146035 / -5.3%	0.45 / 0.41 / +8.3%
tpcds_q22/datafusion:vortex-file-compressed	49459636 / 49322755 / +0.3%	69373070 / 70587770 / -1.7%	0.71 / 0.70 / +2.0%
tpcds_q23/datafusion:vortex-file-compressed	71507033 / 73697721 / -3.0%	97393022 / 103028754 / -5.5%	0.73 / 0.72 / +2.6%
tpcds_q24/datafusion:vortex-file-compressed	69580202 / 69462298 / +0.2%	91994878 / 93183690 / -1.3%	0.76 / 0.75 / +1.5%
tpcds_q25/datafusion:vortex-file-compressed	47909494 / 50227090 / -4.6%	74605629 / 77206047 / -3.4%	0.64 / 0.65 / -1.3%
tpcds_q26/datafusion:vortex-file-compressed	30565447 / 30954080 / -1.3%	52924370 / 52503029 / +0.8%	0.58 / 0.59 / -2.0%
tpcds_q27/datafusion:vortex-file-compressed	64924364 / 59796709 / +8.6%	82994269 / 85906936 / -3.4%	0.78 / 0.70 / +12.4%
tpcds_q28/datafusion:vortex-file-compressed	18037256 / 17773332 / +1.5%	37423408 / 38966077 / -4.0%	0.48 / 0.46 / +5.7%
tpcds_q29/datafusion:vortex-file-compressed	59656533 / 52964724 / +12.6% 🔴	76886340 / 78077584 / -1.5%	0.78 / 0.68 / +14.4%
tpcds_q30/datafusion:vortex-file-compressed	28087620 / 28300738 / -0.8%	45002681 / 47203649 / -4.7%	0.62 / 0.60 / +4.1%
tpcds_q31/datafusion:vortex-file-compressed	63411719 / 64775502 / -2.1%	89873892 / 92587279 / -2.9%	0.71 / 0.70 / +0.9%
tpcds_q32/datafusion:vortex-file-compressed	13959790 / 13782804 / +1.3%	32530952 / 31239693 / +4.1%	0.43 / 0.44 / -2.7%
tpcds_q33/datafusion:vortex-file-compressed	27013537 / 26878149 / +0.5%	47845135 / 49568240 / -3.5%	0.56 / 0.54 / +4.1%
tpcds_q34/datafusion:vortex-file-compressed	17994952 / 18199842 / -1.1%	37347719 / 38993826 / -4.2%	0.48 / 0.47 / +3.2%
tpcds_q35/datafusion:vortex-file-compressed	34573568 / 34621635 / -0.1%	56449831 / 58853022 / -4.1%	0.61 / 0.59 / +4.1%
tpcds_q36/datafusion:vortex-file-compressed	48079137 / 47854444 / +0.5%	68192287 / 69740040 / -2.2%	0.71 / 0.69 / +2.7%
tpcds_q37/datafusion:vortex-file-compressed	12940145 / 13204876 / -2.0%	35708008 / 37031956 / -3.6%	0.36 / 0.36 / +1.6%
tpcds_q38/datafusion:vortex-file-compressed	30183416 / 29968224 / +0.7%	51035714 / 53557138 / -4.7%	0.59 / 0.56 / +5.7%
tpcds_q39/datafusion:vortex-file-compressed	65786996 / 66454650 / -1.0%	93011403 / 92359409 / +0.7%	0.71 / 0.72 / -1.7%
tpcds_q40/datafusion:vortex-file-compressed	25672308 / 25213358 / +1.8%	45474702 / 46618464 / -2.5%	0.56 / 0.54 / +4.4%
tpcds_q41/datafusion:vortex-file-compressed	16499179 / 16497422 / +0.0%	30508052 / 30932423 / -1.4%	0.54 / 0.53 / +1.4%
tpcds_q42/datafusion:vortex-file-compressed	11219060 / 11197500 / +0.2%	28214144 / 28890726 / -2.3%	0.40 / 0.39 / +2.6%
tpcds_q43/datafusion:vortex-file-compressed	13219524 / 13181323 / +0.3%	32256688 / 31938991 / +1.0%	0.41 / 0.41 / -0.7%
tpcds_q44/datafusion:vortex-file-compressed	26053412 / 26366330 / -1.2%	49638559 / 50307463 / -1.3%	0.52 / 0.52 / +0.1%
tpcds_q45/datafusion:vortex-file-compressed	28700468 / 28600068 / +0.4%	49603262 / 51310777 / -3.3%	0.58 / 0.56 / +3.8%
tpcds_q46/datafusion:vortex-file-compressed	23584314 / 24178166 / -2.5%	46519001 / 47995326 / -3.1%	0.51 / 0.50 / +0.6%
tpcds_q47/datafusion:vortex-file-compressed	77359106 / 77535395 / -0.2%	105506788 / 107083107 / -1.5%	0.73 / 0.72 / +1.3%
tpcds_q48/datafusion:vortex-file-compressed	32474316 / 32377656 / +0.3%	53900362 / 55047075 / -2.1%	0.60 / 0.59 / +2.4%
tpcds_q49/datafusion:vortex-file-compressed	60253644 / 60377220 / -0.2%	89562083 / 84224994 / +6.3%	0.67 / 0.72 / -6.2%
tpcds_q50/datafusion:vortex-file-compressed	33117822 / 34040198 / -2.7%	55586318 / 55680195 / -0.2%	0.60 / 0.61 / -2.5%
tpcds_q51/datafusion:vortex-file-compressed	61429672 / 60892766 / +0.9%	83252389 / 86988609 / -4.3%	0.74 / 0.70 / +5.4%
tpcds_q52/datafusion:vortex-file-compressed	11591028 / 11673527 / -0.7%	28288387 / 28586298 / -1.0%	0.41 / 0.41 / +0.3%
tpcds_q53/datafusion:vortex-file-compressed	18317170 / 18591982 / -1.5%	38028721 / 37810064 / +0.6%	0.48 / 0.49 / -2.0%
tpcds_q54/datafusion:vortex-file-compressed	33995218 / 33711225 / +0.8%	56747239 / 59020112 / -3.9%	0.60 / 0.57 / +4.9%
tpcds_q55/datafusion:vortex-file-compressed	11270489 / 11224282 / +0.4%	26826401 / 27014821 / -0.7%	0.42 / 0.42 / +1.1%
tpcds_q56/datafusion:vortex-file-compressed	26076804 / 26601276 / -2.0%	49152388 / 49004452 / +0.3%	0.53 / 0.54 / -2.3%
tpcds_q57/datafusion:vortex-file-compressed	74638030 / 74382756 / +0.3%	96174661 / 98862659 / -2.7%	0.78 / 0.75 / +3.1%
tpcds_q58/datafusion:vortex-file-compressed	40590104 / 40640005 / -0.1%	65492716 / 66348075 / -1.3%	0.62 / 0.61 / +1.2%
tpcds_q59/datafusion:vortex-file-compressed	31171142 / 31005503 / +0.5%	52647295 / 52845934 / -0.4%	0.59 / 0.59 / +0.9%
tpcds_q60/datafusion:vortex-file-compressed	25986724 / 26207231 / -0.8%	47568208 / 48027271 / -1.0%	0.55 / 0.55 / +0.1%
tpcds_q61/datafusion:vortex-file-compressed	23250837 / 26233188 / -11.4% 🟢	44977783 / 47964067 / -6.2%	0.52 / 0.55 / -5.5%
tpcds_q62/datafusion:vortex-file-compressed	17205824 / 17376509 / -1.0%	35588221 / 37180790 / -4.3%	0.48 / 0.47 / +3.4%
tpcds_q63/datafusion:vortex-file-compressed	18625502 / 18668208 / -0.2%	38865731 / 39588937 / -1.8%	0.48 / 0.47 / +1.6%
tpcds_q64/datafusion:vortex-file-compressed	334546096 / 331922032 / +0.8%	355246363 / 363903196 / -2.4%	0.94 / 0.91 / +3.2%
tpcds_q65/datafusion:vortex-file-compressed	75408954 / 75398684 / +0.0%	95969678 / 96057322 / -0.1%	0.79 / 0.78 / +0.1%
tpcds_q66/datafusion:vortex-file-compressed	53134053 / 53139250 / -0.0%	76181408 / 77414301 / -1.6%	0.70 / 0.69 / +1.6%
tpcds_q67/datafusion:vortex-file-compressed	55313192 / 54933989 / +0.7%	83578983 / 85989304 / -2.8%	0.66 / 0.64 / +3.6%
tpcds_q68/datafusion:vortex-file-compressed	23100924 / 23468092 / -1.6%	48917397 / 48070416 / +1.8%	0.47 / 0.49 / -3.3%
tpcds_q69/datafusion:vortex-file-compressed	28587884 / 29112368 / -1.8%	50401859 / 51396589 / -1.9%	0.57 / 0.57 / +0.1%
tpcds_q70/datafusion:vortex-file-compressed	70072482 / 70665652 / -0.8%	89746436 / 92681456 / -3.2%	0.78 / 0.76 / +2.4%
tpcds_q71/datafusion:vortex-file-compressed	19561894 / 19802277 / -1.2%	40184772 / 41016064 / -2.0%	0.49 / 0.48 / +0.8%
tpcds_q72/datafusion:vortex-file-compressed	485149418 / 470950966 / +3.0%	473748255 / 527395956 / -10.2% 🟢	1.02 / 0.89 / +14.7%
tpcds_q73/datafusion:vortex-file-compressed	16633500 / 17222822 / -3.4%	38170990 / 38121890 / +0.1%	0.44 / 0.45 / -3.5%
tpcds_q74/datafusion:vortex-file-compressed	44607198 / 44532175 / +0.2%	68731503 / 69588516 / -1.2%	0.65 / 0.64 / +1.4%
tpcds_q75/datafusion:vortex-file-compressed	132120674 / 130916770 / +0.9%	155790965 / 158692712 / -1.8%	0.85 / 0.82 / +2.8%
tpcds_q76/datafusion:vortex-file-compressed	42861050 / 42453439 / +1.0%	62138005 / 64876765 / -4.2%	0.69 / 0.65 / +5.4%
tpcds_q77/datafusion:vortex-file-compressed	34187648 / 35218914 / -2.9%	55926898 / 58276254 / -4.0%	0.61 / 0.60 / +1.1%
tpcds_q78/datafusion:vortex-file-compressed	79978847 / 79743801 / +0.3%	107554340 / 109232165 / -1.5%	0.74 / 0.73 / +1.9%
tpcds_q79/datafusion:vortex-file-compressed	20243780 / 21278289 / -4.9%	40841321 / 40183179 / +1.6%	0.50 / 0.53 / -6.4%
tpcds_q80/datafusion:vortex-file-compressed	76960250 / 77572511 / -0.8%	107238710 / 110880201 / -3.3%	0.72 / 0.70 / +2.6%
tpcds_q81/datafusion:vortex-file-compressed	28122833 / 28216730 / -0.3%	45084024 / 46047881 / -2.1%	0.62 / 0.61 / +1.8%
tpcds_q82/datafusion:vortex-file-compressed	13075526 / 13515451 / -3.3%	37003107 / 35895353 / +3.1%	0.35 / 0.38 / -6.2%
tpcds_q83/datafusion:vortex-file-compressed	35966899 / 36103501 / -0.4%	57192880 / 60402346 / -5.3%	0.63 / 0.60 / +5.2%
tpcds_q84/datafusion:vortex-file-compressed	12365162 / 12151651 / +1.8%	28663091 / 29272582 / -2.1%	0.43 / 0.42 / +3.9%
tpcds_q85/datafusion:vortex-file-compressed	63052782 / 63101852 / -0.1%	86961295 / 89448017 / -2.8%	0.73 / 0.71 / +2.8%
tpcds_q86/datafusion:vortex-file-compressed	16594352 / 16724918 / -0.8%	32932128 / 34595913 / -4.8%	0.50 / 0.48 / +4.2%
tpcds_q87/datafusion:vortex-file-compressed	29728341 / 29397098 / +1.1%	51838313 / 51332709 / +1.0%	0.57 / 0.57 / +0.1%
tpcds_q88/datafusion:vortex-file-compressed	31975174 / 32254764 / -0.9%	60318699 / 58418722 / +3.3%	0.53 / 0.55 / -4.0%
tpcds_q89/datafusion:vortex-file-compressed	20731678 / 21119975 / -1.8%	40605153 / 42306618 / -4.0%	0.51 / 0.50 / +2.3%
tpcds_q90/datafusion:vortex-file-compressed	10702795 / 10612992 / +0.8%	26796289 / 27124659 / -1.2%	0.40 / 0.39 / +2.1%
tpcds_q91/datafusion:vortex-file-compressed	17735947 / 18337834 / -3.3%	36975110 / 36935156 / +0.1%	0.48 / 0.50 / -3.4%
tpcds_q92/datafusion:vortex-file-compressed	14093528 / 13908792 / +1.3%	31440614 / 31408751 / +0.1%	0.45 / 0.44 / +1.2%
tpcds_q93/datafusion:vortex-file-compressed	22739740 / 22523933 / +1.0%	41801688 / 45001353 / -7.1%	0.54 / 0.50 / +8.7%
tpcds_q94/datafusion:vortex-file-compressed	19590138 / 20028225 / -2.2%	39425065 / 40424608 / -2.5%	0.50 / 0.50 / +0.3%
tpcds_q95/datafusion:vortex-file-compressed	46090396 / 47027056 / -2.0%	66522874 / 70326698 / -5.4%	0.69 / 0.67 / +3.6%
tpcds_q96/datafusion:vortex-file-compressed	8271678 / 8043728 / +2.8%	24070911 / 24151786 / -0.3%	0.34 / 0.33 / +3.2%
tpcds_q97/datafusion:vortex-file-compressed	21111035 / 21321574 / -1.0%	42478248 / 44530806 / -4.6%	0.50 / 0.48 / +3.8%
tpcds_q98/datafusion:vortex-file-compressed	16551752 / 16936682 / -2.3%	37054636 / 36666879 / +1.1%	0.45 / 0.46 / -3.3%
tpcds_q99/datafusion:vortex-file-compressed	19793919 / 19906975 / -0.6%	39819015 / 39280910 / +1.4%	0.50 / 0.51 / -1.9%

datafusion / vortex-compact / ns (0.999x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	25452670 / 26016744 / -2.2%	44269370 / 45383085 / -2.5%	0.57 / 0.57 / +0.3%
tpcds_q02/datafusion:vortex-compact	48501979 / 48343254 / +0.3%	66882379 / 66986983 / -0.2%	0.73 / 0.72 / +0.5%
tpcds_q03/datafusion:vortex-compact	13219982 / 12408116 / +6.5%	33510800 / 33605727 / -0.3%	0.39 / 0.37 / +6.8%
tpcds_q04/datafusion:vortex-compact	122233604 / 121569505 / +0.5%	149870762 / 152037962 / -1.4%	0.82 / 0.80 / +2.0%
tpcds_q05/datafusion:vortex-compact	61244478 / 61900425 / -1.1%	82239245 / 83032206 / -1.0%	0.74 / 0.75 / -0.1%
tpcds_q06/datafusion:vortex-compact	26272998 / 24883296 / +5.6%	44540651 / 46824116 / -4.9%	0.59 / 0.53 / +11.0%
tpcds_q07/datafusion:vortex-compact	33930660 / 35438743 / -4.3%	58140079 / 56357228 / +3.2%	0.58 / 0.63 / -7.2%
tpcds_q08/datafusion:vortex-compact	30654321 / 30586923 / +0.2%	47525811 / 48774627 / -2.6%	0.65 / 0.63 / +2.9%
tpcds_q09/datafusion:vortex-compact	21233523 / 22900004 / -7.3%	40751715 / 41131028 / -0.9%	0.52 / 0.56 / -6.4%
tpcds_q10/datafusion:vortex-compact	37757730 / 37787806 / -0.1%	58504504 / 61747186 / -5.3%	0.65 / 0.61 / +5.5%
tpcds_q11/datafusion:vortex-compact	68627204 / 68135218 / +0.7%	94704262 / 95146173 / -0.5%	0.72 / 0.72 / +1.2%
tpcds_q12/datafusion:vortex-compact	21000770 / 20857252 / +0.7%	38647475 / 39588482 / -2.4%	0.54 / 0.53 / +3.1%
tpcds_q13/datafusion:vortex-compact	60671082 / 60362120 / +0.5%	80417358 / 80548662 / -0.2%	0.75 / 0.75 / +0.7%
tpcds_q14/datafusion:vortex-compact	96257480 / 95523370 / +0.8%	122600441 / 122289355 / +0.3%	0.79 / 0.78 / +0.5%
tpcds_q15/datafusion:vortex-compact	26962990 / 27183667 / -0.8%	46529500 / 46772562 / -0.5%	0.58 / 0.58 / -0.3%
tpcds_q16/datafusion:vortex-compact	23162914 / 23465115 / -1.3%	46688465 / 48496827 / -3.7%	0.50 / 0.48 / +2.5%
tpcds_q17/datafusion:vortex-compact	66821336 / 64714186 / +3.3%	81964512 / 94730817 / -13.5% 🟢	0.82 / 0.68 / +19.3%
tpcds_q18/datafusion:vortex-compact	68214908 / 68761522 / -0.8%	90948120 / 91419464 / -0.5%	0.75 / 0.75 / -0.3%
tpcds_q19/datafusion:vortex-compact	22700232 / 23545259 / -3.6%	42452340 / 45030588 / -5.7%	0.53 / 0.52 / +2.3%
tpcds_q20/datafusion:vortex-compact	21808834 / 21734554 / +0.3%	42241510 / 42446847 / -0.5%	0.52 / 0.51 / +0.8%
tpcds_q21/datafusion:vortex-compact	17819938 / 18948236 / -6.0%	41116508 / 42994961 / -4.4%	0.43 / 0.44 / -1.7%
tpcds_q22/datafusion:vortex-compact	49768030 / 49572134 / +0.4%	72616715 / 72919810 / -0.4%	0.69 / 0.68 / +0.8%
tpcds_q23/datafusion:vortex-compact	75535968 / 76443988 / -1.2%	100664622 / 105848852 / -4.9%	0.75 / 0.72 / +3.9%
tpcds_q24/datafusion:vortex-compact	77638555 / 78519556 / -1.1%	100419486 / 104310596 / -3.7%	0.77 / 0.75 / +2.7%
tpcds_q25/datafusion:vortex-compact	56020886 / 58013090 / -3.4%	87339158 / 84132956 / +3.8%	0.64 / 0.69 / -7.0%
tpcds_q26/datafusion:vortex-compact	32637889 / 33076031 / -1.3%	52080396 / 51432207 / +1.3%	0.63 / 0.64 / -2.6%
tpcds_q27/datafusion:vortex-compact	62853146 / 64851630 / -3.1%	84547933 / 84923778 / -0.4%	0.74 / 0.76 / -2.7%
tpcds_q28/datafusion:vortex-compact	27544535 / 28010462 / -1.7%	47013574 / 50501369 / -6.9%	0.59 / 0.55 / +5.6%
tpcds_q29/datafusion:vortex-compact	65549720 / 62672315 / +4.6%	82031768 / 83887959 / -2.2%	0.80 / 0.75 / +7.0%
tpcds_q30/datafusion:vortex-compact	30614126 / 30168342 / +1.5%	47487894 / 49465784 / -4.0%	0.64 / 0.61 / +5.7%
tpcds_q31/datafusion:vortex-compact	77555528 / 77601122 / -0.1%	104029398 / 102394263 / +1.6%	0.75 / 0.76 / -1.6%
tpcds_q32/datafusion:vortex-compact	16824050 / 16047378 / +4.8%	34778102 / 35220301 / -1.3%	0.48 / 0.46 / +6.2%
tpcds_q33/datafusion:vortex-compact	27733981 / 28578076 / -3.0%	49118916 / 50978797 / -3.6%	0.56 / 0.56 / +0.7%
tpcds_q34/datafusion:vortex-compact	21114907 / 21528426 / -1.9%	44106787 / 42135900 / +4.7%	0.48 / 0.51 / -6.3%
tpcds_q35/datafusion:vortex-compact	41506546 / 41756218 / -0.6%	63593380 / 66702684 / -4.7%	0.65 / 0.63 / +4.3%
tpcds_q36/datafusion:vortex-compact	52920120 / 51855189 / +2.1%	77270233 / 80236561 / -3.7%	0.68 / 0.65 / +6.0%
tpcds_q37/datafusion:vortex-compact	15993656 / 15328338 / +4.3%	40450153 / 37150592 / +8.9%	0.40 / 0.41 / -4.2%
tpcds_q38/datafusion:vortex-compact	33387487 / 33271580 / +0.3%	55016695 / 56462327 / -2.6%	0.61 / 0.59 / +3.0%
tpcds_q39/datafusion:vortex-compact	67087080 / 66137386 / +1.4%	87876444 / 88407792 / -0.6%	0.76 / 0.75 / +2.0%
tpcds_q40/datafusion:vortex-compact	28502633 / 28347444 / +0.5%	49058838 / 49292121 / -0.5%	0.58 / 0.58 / +1.0%
tpcds_q41/datafusion:vortex-compact	18833312 / 18848702 / -0.1%	32847286 / 33702810 / -2.5%	0.57 / 0.56 / +2.5%
tpcds_q42/datafusion:vortex-compact	12484613 / 12405918 / +0.6%	32000091 / 31860470 / +0.4%	0.39 / 0.39 / +0.2%
tpcds_q43/datafusion:vortex-compact	15787796 / 16241675 / -2.8%	33095720 / 34092913 / -2.9%	0.48 / 0.48 / +0.1%
tpcds_q44/datafusion:vortex-compact	29460760 / 31460679 / -6.4%	54397420 / 55514340 / -2.0%	0.54 / 0.57 / -4.4%
tpcds_q45/datafusion:vortex-compact	30709410 / 31103458 / -1.3%	48780427 / 49702091 / -1.9%	0.63 / 0.63 / +0.6%
tpcds_q46/datafusion:vortex-compact	30681992 / 28240114 / +8.6%	50626132 / 54588021 / -7.3%	0.61 / 0.52 / +17.1%
tpcds_q47/datafusion:vortex-compact	87093550 / 86986616 / +0.1%	117248596 / 119039641 / -1.5%	0.74 / 0.73 / +1.7%
tpcds_q48/datafusion:vortex-compact	50856163 / 50904828 / -0.1%	70278514 / 70048326 / +0.3%	0.72 / 0.73 / -0.4%
tpcds_q49/datafusion:vortex-compact	65044995 / 66522422 / -2.2%	88570595 / 94075814 / -5.9%	0.73 / 0.71 / +3.9%
tpcds_q50/datafusion:vortex-compact	38381992 / 37774322 / +1.6%	56360476 / 60302614 / -6.5%	0.68 / 0.63 / +8.7%
tpcds_q51/datafusion:vortex-compact	62502774 / 62334933 / +0.3%	85996471 / 86159307 / -0.2%	0.73 / 0.72 / +0.5%
tpcds_q52/datafusion:vortex-compact	13237592 / 12785326 / +3.5%	31958404 / 33795914 / -5.4%	0.41 / 0.38 / +9.5%
tpcds_q53/datafusion:vortex-compact	21389744 / 22515330 / -5.0%	45871648 / 42919293 / +6.9%	0.47 / 0.52 / -11.1%
tpcds_q54/datafusion:vortex-compact	39198002 / 39298639 / -0.3%	60190571 / 65236917 / -7.7%	0.65 / 0.60 / +8.1%
tpcds_q55/datafusion:vortex-compact	12907523 / 12838678 / +0.5%	33124611 / 32324570 / +2.5%	0.39 / 0.40 / -1.9%
tpcds_q56/datafusion:vortex-compact	29653236 / 28629464 / +3.6%	53453085 / 51830487 / +3.1%	0.55 / 0.55 / +0.4%
tpcds_q57/datafusion:vortex-compact	78360700 / 78384498 / -0.0%	104197424 / 105221514 / -1.0%	0.75 / 0.74 / +1.0%
tpcds_q58/datafusion:vortex-compact	46777616 / 47121750 / -0.7%	69474628 / 71514231 / -2.9%	0.67 / 0.66 / +2.2%
tpcds_q59/datafusion:vortex-compact	39186656 / 39851466 / -1.7%	58463158 / 60153518 / -2.8%	0.67 / 0.66 / +1.2%
tpcds_q60/datafusion:vortex-compact	28260793 / 28444884 / -0.6%	49754561 / 51704594 / -3.8%	0.57 / 0.55 / +3.2%
tpcds_q61/datafusion:vortex-compact	27853701 / 29101807 / -4.3%	48917143 / 49000831 / -0.2%	0.57 / 0.59 / -4.1%
tpcds_q62/datafusion:vortex-compact	17927930 / 18027648 / -0.6%	35345123 / 35945101 / -1.7%	0.51 / 0.50 / +1.1%
tpcds_q63/datafusion:vortex-compact	21888533 / 23130692 / -5.4%	44887680 / 44440485 / +1.0%	0.49 / 0.52 / -6.3%
tpcds_q64/datafusion:vortex-compact	457656464 / 450859622 / +1.5%	453651276 / 452199950 / +0.3%	1.01 / 1.00 / +1.2%
tpcds_q65/datafusion:vortex-compact	81287892 / 81528968 / -0.3%	102392130 / 100140894 / +2.2%	0.79 / 0.81 / -2.5%
tpcds_q66/datafusion:vortex-compact	54234641 / 56004056 / -3.2%	76630924 / 78475093 / -2.4%	0.71 / 0.71 / -0.8%
tpcds_q67/datafusion:vortex-compact	58467242 / 58604695 / -0.2%	89442002 / 90000433 / -0.6%	0.65 / 0.65 / +0.4%
tpcds_q68/datafusion:vortex-compact	32682954 / 27767034 / +17.7% 🔴	50575384 / 57492648 / -12.0% 🟢	0.65 / 0.48 / +33.8%
tpcds_q69/datafusion:vortex-compact	36092482 / 37068988 / -2.6%	56386293 / 57620040 / -2.1%	0.64 / 0.64 / -0.5%
tpcds_q70/datafusion:vortex-compact	75422788 / 77068238 / -2.1%	95957869 / 98390299 / -2.5%	0.79 / 0.78 / +0.3%
tpcds_q71/datafusion:vortex-compact	21037354 / 20653954 / +1.9%	42680574 / 41831147 / +2.0%	0.49 / 0.49 / -0.2%
tpcds_q72/datafusion:vortex-compact	468734376 / 461944710 / +1.5%	532187242 / 528971319 / +0.6%	0.88 / 0.87 / +0.9%
tpcds_q73/datafusion:vortex-compact	19635938 / 20444941 / -4.0%	41324129 / 41785971 / -1.1%	0.48 / 0.49 / -2.9%
tpcds_q74/datafusion:vortex-compact	50656820 / 52061748 / -2.7%	71461757 / 76131079 / -6.1%	0.71 / 0.68 / +3.7%
tpcds_q75/datafusion:vortex-compact	135377738 / 138194438 / -2.0%	166611282 / 164721169 / +1.1%	0.81 / 0.84 / -3.1%
tpcds_q76/datafusion:vortex-compact	40164570 / 42533831 / -5.6%	64607450 / 64349338 / +0.4%	0.62 / 0.66 / -5.9%
tpcds_q77/datafusion:vortex-compact	38700563 / 37167149 / +4.1%	61209066 / 61960698 / -1.2%	0.63 / 0.60 / +5.4%
tpcds_q78/datafusion:vortex-compact	86549280 / 85769872 / +0.9%	111073478 / 114503646 / -3.0%	0.78 / 0.75 / +4.0%
tpcds_q79/datafusion:vortex-compact	26791712 / 24695404 / +8.5%	44816697 / 45699794 / -1.9%	0.60 / 0.54 / +10.6%
tpcds_q80/datafusion:vortex-compact	78445954 / 78039235 / +0.5%	106494452 / 109616976 / -2.8%	0.74 / 0.71 / +3.5%
tpcds_q81/datafusion:vortex-compact	29917684 / 30042646 / -0.4%	46415604 / 47596803 / -2.5%	0.64 / 0.63 / +2.1%
tpcds_q82/datafusion:vortex-compact	16352500 / 15824833 / +3.3%	41146522 / 39965638 / +3.0%	0.40 / 0.40 / +0.4%
tpcds_q83/datafusion:vortex-compact	36843546 / 37580994 / -2.0%	56878824 / 60268389 / -5.6%	0.65 / 0.62 / +3.9%
tpcds_q84/datafusion:vortex-compact	12996039 / 13315744 / -2.4%	28453368 / 29809668 / -4.5%	0.46 / 0.45 / +2.3%
tpcds_q85/datafusion:vortex-compact	108567225 / 108219484 / +0.3%	132336159 / 134822476 / -1.8%	0.82 / 0.80 / +2.2%
tpcds_q86/datafusion:vortex-compact	16866849 / 16498216 / +2.2%	36318910 / 34887344 / +4.1%	0.46 / 0.47 / -1.8%
tpcds_q87/datafusion:vortex-compact	32651390 / 34384565 / -5.0%	53724480 / 54875254 / -2.1%	0.61 / 0.63 / -3.0%
tpcds_q88/datafusion:vortex-compact	42075165 / 41141574 / +2.3%	71856982 / 67051874 / +7.2%	0.59 / 0.61 / -4.6%
tpcds_q89/datafusion:vortex-compact	23600310 / 25089852 / -5.9%	45853147 / 44918993 / +2.1%	0.51 / 0.56 / -7.9%
tpcds_q90/datafusion:vortex-compact	11338550 / 11391476 / -0.5%	28198237 / 26964368 / +4.6%	0.40 / 0.42 / -4.8%
tpcds_q91/datafusion:vortex-compact	27429390 / 27457712 / -0.1%	46528507 / 46155972 / +0.8%	0.59 / 0.59 / -0.9%
tpcds_q92/datafusion:vortex-compact	15681586 / 15348174 / +2.2%	33926068 / 33163964 / +2.3%	0.46 / 0.46 / -0.1%
tpcds_q93/datafusion:vortex-compact	25621672 / 24931696 / +2.8%	43867713 / 45633786 / -3.9%	0.58 / 0.55 / +6.9%
tpcds_q94/datafusion:vortex-compact	22502063 / 22208304 / +1.3%	41222020 / 40862017 / +0.9%	0.55 / 0.54 / +0.4%
tpcds_q95/datafusion:vortex-compact	49064638 / 49993924 / -1.9%	69503870 / 70621417 / -1.6%	0.71 / 0.71 / -0.3%
tpcds_q96/datafusion:vortex-compact	10932052 / 10609734 / +3.0%	29268700 / 28113616 / +4.1%	0.37 / 0.38 / -1.0%
tpcds_q97/datafusion:vortex-compact	23915990 / 24190006 / -1.1%	44166237 / 46409094 / -4.8%	0.54 / 0.52 / +3.9%
tpcds_q98/datafusion:vortex-compact	22186891 / 22072094 / +0.5%	43690657 / 43497846 / +0.4%	0.51 / 0.51 / +0.1%
tpcds_q99/datafusion:vortex-compact	21044227 / 21007074 / +0.2%	39669730 / 40957129 / -3.1%	0.53 / 0.51 / +3.4%

datafusion / parquet / ns (0.996x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	30735050 / 29096036 / +5.6%	51364691 / 46988540 / +9.3%	0.60 / 0.62 / -3.4%
tpcds_q02/datafusion:parquet	44729533 / 45602831 / -1.9%	60027654 / 62151398 / -3.4%	0.75 / 0.73 / +1.6%
tpcds_q03/datafusion:parquet	18984924 / 19109035 / -0.6%	33107596 / 33500121 / -1.2%	0.57 / 0.57 / +0.5%
tpcds_q04/datafusion:parquet	194455620 / 193994060 / +0.2%	221583991 / 226223939 / -2.1%	0.88 / 0.86 / +2.3%
tpcds_q05/datafusion:parquet	70455228 / 73060286 / -3.6%	89789488 / 94592086 / -5.1%	0.78 / 0.77 / +1.6%
tpcds_q06/datafusion:parquet	34941384 / 34931456 / +0.0%	52255978 / 53156323 / -1.7%	0.67 / 0.66 / +1.8%
tpcds_q07/datafusion:parquet	46276552 / 46551990 / -0.6%	68180435 / 70597157 / -3.4%	0.68 / 0.66 / +2.9%
tpcds_q08/datafusion:parquet	39521882 / 40035355 / -1.3%	51550876 / 55265203 / -6.7%	0.77 / 0.72 / +5.8%
tpcds_q09/datafusion:parquet	33346568 / 29290242 / +13.8% 🔴	44560363 / 44836200 / -0.6%	0.75 / 0.65 / +14.6%
tpcds_q10/datafusion:parquet	48178952 / 50716052 / -5.0%	66829427 / 63837653 / +4.7%	0.72 / 0.79 / -9.3%
tpcds_q11/datafusion:parquet	94697610 / 95000404 / -0.3%	115179296 / 120481657 / -4.4%	0.82 / 0.79 / +4.3%
tpcds_q12/datafusion:parquet	23860964 / 24253426 / -1.6%	36144239 / 37444215 / -3.5%	0.66 / 0.65 / +1.9%
tpcds_q13/datafusion:parquet	44693617 / 43626051 / +2.4%	69621547 / 70198274 / -0.8%	0.64 / 0.62 / +3.3%
tpcds_q14/datafusion:parquet	136589072 / 139334962 / -2.0%	156065384 / 155054830 / +0.7%	0.88 / 0.90 / -2.6%
tpcds_q15/datafusion:parquet	30669420 / 30510026 / +0.5%	50396302 / 51556642 / -2.3%	0.61 / 0.59 / +2.8%
tpcds_q16/datafusion:parquet	38099956 / 37398922 / +1.9%	55344553 / 56703958 / -2.4%	0.69 / 0.66 / +4.4%
tpcds_q17/datafusion:parquet	74178729 / 73965592 / +0.3%	102653054 / 104948596 / -2.2%	0.72 / 0.70 / +2.5%
tpcds_q18/datafusion:parquet	59562306 / 61092143 / -2.5%	79982166 / 80299563 / -0.4%	0.74 / 0.76 / -2.1%
tpcds_q19/datafusion:parquet	31802082 / 31561130 / +0.8%	49150242 / 50846032 / -3.3%	0.65 / 0.62 / +4.2%
tpcds_q20/datafusion:parquet	25355831 / 25675914 / -1.2%	40639965 / 40605445 / +0.1%	0.62 / 0.63 / -1.3%
tpcds_q21/datafusion:parquet	20108810 / 20026928 / +0.4%	32999613 / 33898099 / -2.7%	0.61 / 0.59 / +3.1%
tpcds_q22/datafusion:parquet	76853453 / 77131487 / -0.4%	90982422 / 92565829 / -1.7%	0.84 / 0.83 / +1.4%
tpcds_q23/datafusion:parquet	116212992 / 114386208 / +1.6%	138730330 / 141401393 / -1.9%	0.84 / 0.81 / +3.6%
tpcds_q24/datafusion:parquet	90008066 / 90885860 / -1.0%	115524525 / 121337595 / -4.8%	0.78 / 0.75 / +4.0%
tpcds_q25/datafusion:parquet	74789036 / 75205991 / -0.6%	99885057 / 107424961 / -7.0%	0.75 / 0.70 / +7.0%
tpcds_q26/datafusion:parquet	41895334 / 43482581 / -3.7%	58870257 / 60325675 / -2.4%	0.71 / 0.72 / -1.3%
tpcds_q27/datafusion:parquet	76048845 / 80134216 / -5.1%	100123458 / 100562423 / -0.4%	0.76 / 0.80 / -4.7%
tpcds_q28/datafusion:parquet	26930002 / 27015062 / -0.3%	43755060 / 46439592 / -5.8%	0.62 / 0.58 / +5.8%
tpcds_q29/datafusion:parquet	75852932 / 77030505 / -1.5%	105461324 / 102693403 / +2.7%	0.72 / 0.75 / -4.1%
tpcds_q30/datafusion:parquet	44144227 / 47556310 / -7.2%	63681128 / 66282301 / -3.9%	0.69 / 0.72 / -3.4%
tpcds_q31/datafusion:parquet	89781614 / 92205724 / -2.6%	105267777 / 105785764 / -0.5%	0.85 / 0.87 / -2.1%
tpcds_q32/datafusion:parquet	25344762 / 25990507 / -2.5%	41086693 / 42837002 / -4.1%	0.62 / 0.61 / +1.7%
tpcds_q33/datafusion:parquet	39688492 / 38733357 / +2.5%	56008541 / 56470568 / -0.8%	0.71 / 0.69 / +3.3%
tpcds_q34/datafusion:parquet	23541603 / 24137660 / -2.5%	37589408 / 39024114 / -3.7%	0.63 / 0.62 / +1.3%
tpcds_q35/datafusion:parquet	55169715 / 54729017 / +0.8%	70166688 / 75850270 / -7.5%	0.79 / 0.72 / +9.0%
tpcds_q36/datafusion:parquet	51516724 / 51887792 / -0.7%	78399031 / 74051483 / +5.9%	0.66 / 0.70 / -6.2%
tpcds_q37/datafusion:parquet	25313390 / 26071016 / -2.9%	41192139 / 39965689 / +3.1%	0.61 / 0.65 / -5.8%
tpcds_q38/datafusion:parquet	43558860 / 43792216 / -0.5%	61800995 / 64854061 / -4.7%	0.70 / 0.68 / +4.4%
tpcds_q39/datafusion:parquet	72572527 / 71344876 / +1.7%	90155231 / 92164935 / -2.2%	0.80 / 0.77 / +4.0%
tpcds_q40/datafusion:parquet	27949552 / 28723188 / -2.7%	49094190 / 49187905 / -0.2%	0.57 / 0.58 / -2.5%
tpcds_q41/datafusion:parquet	19878056 / 19725610 / +0.8%	33723627 / 34270811 / -1.6%	0.59 / 0.58 / +2.4%
tpcds_q42/datafusion:parquet	17933001 / 18312582 / -2.1%	32347894 / 33592167 / -3.7%	0.55 / 0.55 / +1.7%
tpcds_q43/datafusion:parquet	19064417 / 19840959 / -3.9%	33537717 / 35488883 / -5.5%	0.57 / 0.56 / +1.7%
tpcds_q44/datafusion:parquet	33389176 / 32659909 / +2.2%	53187230 / 52692213 / +0.9%	0.63 / 0.62 / +1.3%
tpcds_q45/datafusion:parquet	37672022 / 37848012 / -0.5%	52215263 / 55984524 / -6.7%	0.72 / 0.68 / +6.7%
tpcds_q46/datafusion:parquet	29219346 / 29402539 / -0.6%	49517839 / 52618367 / -5.9%	0.59 / 0.56 / +5.6%
tpcds_q47/datafusion:parquet	97902629 / 97610886 / +0.3%	123129624 / 125057489 / -1.5%	0.80 / 0.78 / +1.9%
tpcds_q48/datafusion:parquet	40539873 / 41736593 / -2.9%	61277419 / 62972724 / -2.7%	0.66 / 0.66 / -0.2%
tpcds_q49/datafusion:parquet	75019120 / 73892053 / +1.5%	99264311 / 98721551 / +0.5%	0.76 / 0.75 / +1.0%
tpcds_q50/datafusion:parquet	47266198 / 47508598 / -0.5%	68612522 / 72293153 / -5.1%	0.69 / 0.66 / +4.8%
tpcds_q51/datafusion:parquet	71149730 / 71333914 / -0.3%	86127833 / 95083315 / -9.4%	0.83 / 0.75 / +10.1%
tpcds_q52/datafusion:parquet	18620292 / 18665068 / -0.2%	32556642 / 32234645 / +1.0%	0.57 / 0.58 / -1.2%
tpcds_q53/datafusion:parquet	22047098 / 22611295 / -2.5%	39883619 / 42187781 / -5.5%	0.55 / 0.54 / +3.1%
tpcds_q54/datafusion:parquet	54887216 / 55443496 / -1.0%	75359348 / 75329641 / +0.0%	0.73 / 0.74 / -1.0%
tpcds_q55/datafusion:parquet	18218666 / 18222225 / -0.0%	30663438 / 30754402 / -0.3%	0.59 / 0.59 / +0.3%
tpcds_q56/datafusion:parquet	45968858 / 44164660 / +4.1%	61189805 / 61209369 / -0.0%	0.75 / 0.72 / +4.1%
tpcds_q57/datafusion:parquet	100279919 / 102085672 / -1.8%	116811354 / 120704677 / -3.2%	0.86 / 0.85 / +1.5%
tpcds_q58/datafusion:parquet	63681652 / 63301310 / +0.6%	83125529 / 84014854 / -1.1%	0.77 / 0.75 / +1.7%
tpcds_q59/datafusion:parquet	46570326 / 47088566 / -1.1%	62527393 / 62886200 / -0.6%	0.74 / 0.75 / -0.5%
tpcds_q60/datafusion:parquet	46226972 / 45629830 / +1.3%	55296793 / 62075949 / -10.9% 🟢	0.84 / 0.74 / +13.7%
tpcds_q61/datafusion:parquet	37691092 / 37165362 / +1.4%	59074555 / 57193886 / +3.3%	0.64 / 0.65 / -1.8%
tpcds_q62/datafusion:parquet	24688536 / 25018712 / -1.3%	38647762 / 39644210 / -2.5%	0.64 / 0.63 / +1.2%
tpcds_q63/datafusion:parquet	21951329 / 22000214 / -0.2%	39743758 / 41887258 / -5.1%	0.55 / 0.53 / +5.2%
tpcds_q64/datafusion:parquet	203181614 / 203619989 / -0.2%	237124560 / 234066838 / +1.3%	0.86 / 0.87 / -1.5%
tpcds_q65/datafusion:parquet	37295682 / 37321454 / -0.1%	54686601 / 57329436 / -4.6%	0.68 / 0.65 / +4.8%
tpcds_q66/datafusion:parquet	61580574 / 62225524 / -1.0%	80751978 / 79553338 / +1.5%	0.76 / 0.78 / -2.5%
tpcds_q67/datafusion:parquet	69211268 / 69714600 / -0.7%	95098729 / 96506207 / -1.5%	0.73 / 0.72 / +0.7%
tpcds_q68/datafusion:parquet	29470981 / 28815183 / +2.3%	49162231 / 51556898 / -4.6%	0.60 / 0.56 / +7.3%
tpcds_q69/datafusion:parquet	50254944 / 50098319 / +0.3%	64182832 / 63407838 / +1.2%	0.78 / 0.79 / -0.9%
tpcds_q70/datafusion:parquet	36444870 / 36610016 / -0.5%	56134039 / 51140264 / +9.8%	0.65 / 0.72 / -9.3%
tpcds_q71/datafusion:parquet	29395631 / 27759584 / +5.9%	42973559 / 44546988 / -3.5%	0.68 / 0.62 / +9.8%
tpcds_q72/datafusion:parquet	551110428 / 559585733 / -1.5%	568192934 / 591366390 / -3.9%	0.97 / 0.95 / +2.5%
tpcds_q73/datafusion:parquet	22768952 / 22972970 / -0.9%	38033063 / 39479854 / -3.7%	0.60 / 0.58 / +2.9%
tpcds_q74/datafusion:parquet	67763936 / 68587478 / -1.2%	86958298 / 85292029 / +2.0%	0.78 / 0.80 / -3.1%
tpcds_q75/datafusion:parquet	147319962 / 145558996 / +1.2%	170860746 / 177050692 / -3.5%	0.86 / 0.82 / +4.9%
tpcds_q76/datafusion:parquet	54618557 / 54637690 / -0.0%	69072483 / 70045941 / -1.4%	0.79 / 0.78 / +1.4%
tpcds_q77/datafusion:parquet	56179226 / 56203101 / -0.0%	75822694 / 80603075 / -5.9%	0.74 / 0.70 / +6.3%
tpcds_q78/datafusion:parquet	90787746 / 90973420 / -0.2%	125159110 / 128204304 / -2.4%	0.73 / 0.71 / +2.2%
tpcds_q79/datafusion:parquet	26029176 / 26449728 / -1.6%	44138221 / 46723136 / -5.5%	0.59 / 0.57 / +4.2%
tpcds_q80/datafusion:parquet	80724673 / 81404587 / -0.8%	112168371 / 116636814 / -3.8%	0.72 / 0.70 / +3.1%
tpcds_q81/datafusion:parquet	41459978 / 43255761 / -4.2%	59163764 / 60057922 / -1.5%	0.70 / 0.72 / -2.7%
tpcds_q82/datafusion:parquet	26535292 / 26854174 / -1.2%	41596486 / 41363516 / +0.6%	0.64 / 0.65 / -1.7%
tpcds_q83/datafusion:parquet	56374635 / 57654452 / -2.2%	76602017 / 77218333 / -0.8%	0.74 / 0.75 / -1.4%
tpcds_q84/datafusion:parquet	30502085 / 30389376 / +0.4%	45138974 / 46953689 / -3.9%	0.68 / 0.65 / +4.4%
tpcds_q85/datafusion:parquet	83671592 / 84632943 / -1.1%	107529799 / 109907741 / -2.2%	0.78 / 0.77 / +1.1%
tpcds_q86/datafusion:parquet	20146658 / 20177384 / -0.2%	34480493 / 35509512 / -2.9%	0.58 / 0.57 / +2.8%
tpcds_q87/datafusion:parquet	45339385 / 45578569 / -0.5%	60503593 / 59618634 / +1.5%	0.75 / 0.76 / -2.0%
tpcds_q88/datafusion:parquet	47588106 / 48049210 / -1.0%	65121519 / 70995309 / -8.3%	0.73 / 0.68 / +8.0%
tpcds_q89/datafusion:parquet	25326840 / 25591832 / -1.0%	43578483 / 44519395 / -2.1%	0.58 / 0.57 / +1.1%
tpcds_q90/datafusion:parquet	20357182 / 19501368 / +4.4%	33830593 / 34168757 / -1.0%	0.60 / 0.57 / +5.4%
tpcds_q91/datafusion:parquet	36633170 / 36826241 / -0.5%	52817190 / 53478907 / -1.2%	0.69 / 0.69 / +0.7%
tpcds_q92/datafusion:parquet	26104252 / 25976875 / +0.5%	41723221 / 41534196 / +0.5%	0.63 / 0.63 / +0.0%
tpcds_q93/datafusion:parquet	26524720 / 26397143 / +0.5%	48169658 / 49511200 / -2.7%	0.55 / 0.53 / +3.3%
tpcds_q94/datafusion:parquet	34452438 / 34679305 / -0.7%	50833612 / 49641485 / +2.4%	0.68 / 0.70 / -3.0%
tpcds_q95/datafusion:parquet	63826494 / 64053624 / -0.4%	81427974 / 81634365 / -0.3%	0.78 / 0.78 / -0.1%
tpcds_q96/datafusion:parquet	16607388 / 16508110 / +0.6%	29795097 / 29936168 / -0.5%	0.56 / 0.55 / +1.1%
tpcds_q97/datafusion:parquet	35473376 / 35282712 / +0.5%	53579360 / 55672477 / -3.8%	0.66 / 0.63 / +4.5%
tpcds_q98/datafusion:parquet	24936176 / 25365504 / -1.7%	39698703 / 41671841 / -4.7%	0.63 / 0.61 / +3.2%
tpcds_q99/datafusion:parquet	29415933 / 29450210 / -0.1%	42926461 / 44839494 / -4.3%	0.69 / 0.66 / +4.3%

duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15466512 / 15755154 / -1.8%	23445376 / 24321686 / -3.6%	0.66 / 0.65 / +1.8%
tpcds_q02/duckdb:vortex-file-compressed	15339176 / 16966816 / -9.6%	21159746 / 21486473 / -1.5%	0.72 / 0.79 / -8.2%
tpcds_q03/duckdb:vortex-file-compressed	12384088 / 12028954 / +3.0%	22142009 / 20817018 / +6.4%	0.56 / 0.58 / -3.2%
tpcds_q04/duckdb:vortex-file-compressed	52361018 / 51781173 / +1.1%	61476128 / 62211847 / -1.2%	0.85 / 0.83 / +2.3%
tpcds_q05/duckdb:vortex-file-compressed	19098086 / 19354591 / -1.3%	26849265 / 28468871 / -5.7%	0.71 / 0.68 / +4.6%
tpcds_q06/duckdb:vortex-file-compressed	27483504 / 27901488 / -1.5%	40843462 / 41527881 / -1.6%	0.67 / 0.67 / +0.2%
tpcds_q07/duckdb:vortex-file-compressed	16641631 / 17372280 / -4.2%	27430214 / 29124845 / -5.8%	0.61 / 0.60 / +1.7%
tpcds_q08/duckdb:vortex-file-compressed	23104336 / 23509610 / -1.7%	32669864 / 36029344 / -9.3%	0.71 / 0.65 / +8.4%
tpcds_q09/duckdb:vortex-file-compressed	10974842 / 10787384 / +1.7%	18590203 / 18932939 / -1.8%	0.59 / 0.57 / +3.6%
tpcds_q10/duckdb:vortex-file-compressed	30880368 / 31054449 / -0.6%	43600766 / 44228167 / -1.4%	0.71 / 0.70 / +0.9%
tpcds_q11/duckdb:vortex-file-compressed	41234796 / 41194780 / +0.1%	54056253 / 52992015 / +2.0%	0.76 / 0.78 / -1.9%
tpcds_q12/duckdb:vortex-file-compressed	12395580 / 12301916 / +0.8%	18139248 / 17956618 / +1.0%	0.68 / 0.69 / -0.3%
tpcds_q13/duckdb:vortex-file-compressed	21536182 / 22484821 / -4.2%	35459012 / 36778355 / -3.6%	0.61 / 0.61 / -0.7%
tpcds_q14/duckdb:vortex-file-compressed	57873330 / 58829688 / -1.6%	72814120 / 74858839 / -2.7%	0.79 / 0.79 / +1.1%
tpcds_q15/duckdb:vortex-file-compressed	22559663 / 22585743 / -0.1%	27916939 / 28563592 / -2.3%	0.81 / 0.79 / +2.2%
tpcds_q16/duckdb:vortex-file-compressed	18931724 / 18812712 / +0.6%	27807918 / 28948068 / -3.9%	0.68 / 0.65 / +4.8%
tpcds_q17/duckdb:vortex-file-compressed	31895850 / 32010814 / -0.4%	47054844 / 47103375 / -0.1%	0.68 / 0.68 / -0.3%
tpcds_q18/duckdb:vortex-file-compressed	29979570 / 30446785 / -1.5%	38810188 / 39649293 / -2.1%	0.77 / 0.77 / +0.6%
tpcds_q19/duckdb:vortex-file-compressed	24916864 / 25747884 / -3.2%	37219176 / 36418258 / +2.2%	0.67 / 0.71 / -5.3%
tpcds_q20/duckdb:vortex-file-compressed	11167518 / 11223594 / -0.5%	15938322 / 16148780 / -1.3%	0.70 / 0.70 / +0.8%
tpcds_q21/duckdb:vortex-file-compressed	12060726 / 10662990 / +13.1% 🔴	21282292 / 23307815 / -8.7%	0.57 / 0.46 / +23.9%
tpcds_q22/duckdb:vortex-file-compressed	29819094 / 30165924 / -1.1%	41358436 / 43464678 / -4.8%	0.72 / 0.69 / +3.9%
tpcds_q23/duckdb:vortex-file-compressed	37081002 / 36654937 / +1.2%	48694632 / 50063237 / -2.7%	0.76 / 0.73 / +4.0%
tpcds_q24/duckdb:vortex-file-compressed	28542479 / 28726112 / -0.6%	41934752 / 41384227 / +1.3%	0.68 / 0.69 / -1.9%
tpcds_q25/duckdb:vortex-file-compressed	27030999 / 26889992 / +0.5%	39775949 / 40389848 / -1.5%	0.68 / 0.67 / +2.1%
tpcds_q26/duckdb:vortex-file-compressed	14750152 / 15028038 / -1.8%	21487140 / 21988494 / -2.3%	0.69 / 0.68 / +0.4%
tpcds_q27/duckdb:vortex-file-compressed	16954976 / 17430338 / -2.7%	28794877 / 28815033 / -0.1%	0.59 / 0.60 / -2.7%
tpcds_q28/duckdb:vortex-file-compressed	8415782 / 7944860 / +5.9%	12822329 / 12520681 / +2.4%	0.66 / 0.63 / +3.4%
tpcds_q29/duckdb:vortex-file-compressed	30638842 / 30307704 / +1.1%	46494148 / 47165372 / -1.4%	0.66 / 0.64 / +2.6%
tpcds_q30/duckdb:vortex-file-compressed	20110439 / 20299434 / -0.9%	29053548 / 29979334 / -3.1%	0.69 / 0.68 / +2.2%
tpcds_q31/duckdb:vortex-file-compressed	19840962 / 20469882 / -3.1%	28439373 / 29213017 / -2.6%	0.70 / 0.70 / -0.4%
tpcds_q32/duckdb:vortex-file-compressed	11175142 / 11399068 / -2.0%	20247202 / 19212262 / +5.4%	0.55 / 0.59 / -7.0%
tpcds_q33/duckdb:vortex-file-compressed	17533114 / 17565332 / -0.2%	31191700 / 33276346 / -6.3%	0.56 / 0.53 / +6.5%
tpcds_q34/duckdb:vortex-file-compressed	14301890 / 13628722 / +4.9%	21761159 / 21104415 / +3.1%	0.66 / 0.65 / +1.8%
tpcds_q35/duckdb:vortex-file-compressed	49057761 / 49158906 / -0.2%	61068807 / 62712626 / -2.6%	0.80 / 0.78 / +2.5%
tpcds_q36/duckdb:vortex-file-compressed	14990468 / 15318354 / -2.1%	28663982 / 29300536 / -2.2%	0.52 / 0.52 / +0.0%
tpcds_q37/duckdb:vortex-file-compressed	14072539 / 15220396 / -7.5%	21544450 / 26190132 / -17.7% 🟢	0.65 / 0.58 / +12.4%
tpcds_q38/duckdb:vortex-file-compressed	22483096 / 22542544 / -0.3%	28093452 / 30052931 / -6.5%	0.80 / 0.75 / +6.7%
tpcds_q39/duckdb:vortex-file-compressed	18920133 / 18927236 / -0.0%	27591466 / 28642164 / -3.7%	0.69 / 0.66 / +3.8%
tpcds_q40/duckdb:vortex-file-compressed	14559854 / 13757995 / +5.8%	22836671 / 21867497 / +4.4%	0.64 / 0.63 / +1.3%
tpcds_q41/duckdb:vortex-file-compressed	6606931 / 6680710 / -1.1%	9839140 / 10060829 / -2.2%	0.67 / 0.66 / +1.1%
tpcds_q42/duckdb:vortex-file-compressed	8784945 / 8807856 / -0.3%	18420327 / 19126094 / -3.7%	0.48 / 0.46 / +3.6%
tpcds_q43/duckdb:vortex-file-compressed	10021102 / 10253775 / -2.3%	19147500 / 19356418 / -1.1%	0.52 / 0.53 / -1.2%
tpcds_q44/duckdb:vortex-file-compressed	14156997 / 14200290 / -0.3%	26278633 / 24569159 / +7.0%	0.54 / 0.58 / -6.8%
tpcds_q45/duckdb:vortex-file-compressed	23901251 / 23809568 / +0.4%	29341801 / 30504010 / -3.8%	0.81 / 0.78 / +4.4%
tpcds_q46/duckdb:vortex-file-compressed	17488300 / 17754530 / -1.5%	27778701 / 29210621 / -4.9%	0.63 / 0.61 / +3.6%
tpcds_q47/duckdb:vortex-file-compressed	30594010 / 31136511 / -1.7%	41270144 / 47482946 / -13.1% 🟢	0.74 / 0.66 / +13.0%
tpcds_q48/duckdb:vortex-file-compressed	19624720 / 20113366 / -2.4%	31988042 / 33827539 / -5.4%	0.61 / 0.59 / +3.2%
tpcds_q49/duckdb:vortex-file-compressed	18552404 / 18783194 / -1.2%	32364634 / 31344951 / +3.3%	0.57 / 0.60 / -4.3%
tpcds_q50/duckdb:vortex-file-compressed	17225805 / 17408653 / -1.1%	28556770 / 29869779 / -4.4%	0.60 / 0.58 / +3.5%
tpcds_q51/duckdb:vortex-file-compressed	65013072 / 52218511 / +24.5% 🔴	66095384 / 89921941 / -26.5% 🟢	0.98 / 0.58 / +69.4%
tpcds_q52/duckdb:vortex-file-compressed	8985029 / 8744687 / +2.7%	19159549 / 19385577 / -1.2%	0.47 / 0.45 / +4.0%
tpcds_q53/duckdb:vortex-file-compressed	14459724 / 15172246 / -4.7%	26551945 / 24143593 / +10.0%	0.54 / 0.63 / -13.3%
tpcds_q54/duckdb:vortex-file-compressed	21385036 / 21377250 / +0.0%	32712499 / 30352457 / +7.8%	0.65 / 0.70 / -7.2%
tpcds_q55/duckdb:vortex-file-compressed	10748326 / 10677230 / +0.7%	18856418 / 18335914 / +2.8%	0.57 / 0.58 / -2.1%
tpcds_q56/duckdb:vortex-file-compressed	17993550 / 18362775 / -2.0%	35788471 / 32113331 / +11.4% 🔴	0.50 / 0.57 / -12.1%
tpcds_q57/duckdb:vortex-file-compressed	24598879 / 24908557 / -1.2%	31965410 / 32203924 / -0.7%	0.77 / 0.77 / -0.5%
tpcds_q58/duckdb:vortex-file-compressed	18301964 / 19090342 / -4.1%	28855459 / 29028111 / -0.6%	0.63 / 0.66 / -3.6%
tpcds_q59/duckdb:vortex-file-compressed	18466857 / 18516370 / -0.3%	25956201 / 25464885 / +1.9%	0.71 / 0.73 / -2.2%
tpcds_q60/duckdb:vortex-file-compressed	17896836 / 18123366 / -1.2%	33507518 / 30931282 / +8.3%	0.53 / 0.59 / -8.8%
tpcds_q61/duckdb:vortex-file-compressed	20803558 / 20501906 / +1.5%	38293574 / 37148450 / +3.1%	0.54 / 0.55 / -1.6%
tpcds_q62/duckdb:vortex-file-compressed	10791738 / 10663846 / +1.2%	19811948 / 17329242 / +14.3% 🔴	0.54 / 0.62 / -11.5%
tpcds_q63/duckdb:vortex-file-compressed	13552405 / 13504318 / +0.4%	23092855 / 24737320 / -6.6%	0.59 / 0.55 / +7.5%
tpcds_q64/duckdb:vortex-file-compressed	63535496 / 63866036 / -0.5%	78298372 / 81486346 / -3.9%	0.81 / 0.78 / +3.5%
tpcds_q65/duckdb:vortex-file-compressed	13533252 / 13312522 / +1.7%	24172906 / 21917432 / +10.3% 🔴	0.56 / 0.61 / -7.8%
tpcds_q66/duckdb:vortex-file-compressed	23639883 / 23596626 / +0.2%	31668120 / 31047914 / +2.0%	0.75 / 0.76 / -1.8%
tpcds_q67/duckdb:vortex-file-compressed	65380292 / 66393170 / -1.5%	91274856 / 84352730 / +8.2%	0.72 / 0.79 / -9.0%
tpcds_q68/duckdb:vortex-file-compressed	16523033 / 18280071 / -9.6%	27719895 / 34861636 / -20.5% 🟢	0.60 / 0.52 / +13.7%
tpcds_q69/duckdb:vortex-file-compressed	31870812 / 32194450 / -1.0%	44456961 / 46209455 / -3.8%	0.72 / 0.70 / +2.9%
tpcds_q70/duckdb:vortex-file-compressed	21384186 / 19435232 / +10.0% 🔴	32401064 / 30707491 / +5.5%	0.66 / 0.63 / +4.3%
tpcds_q71/duckdb:vortex-file-compressed	13381472 / 13484347 / -0.8%	25704685 / 26048370 / -1.3%	0.52 / 0.52 / +0.6%
tpcds_q72/duckdb:vortex-file-compressed	63058792 / 64368006 / -2.0%	83024703 / 80006777 / +3.8%	0.76 / 0.80 / -5.6%
tpcds_q73/duckdb:vortex-file-compressed	13066852 / 13334354 / -2.0%	20195085 / 20873891 / -3.3%	0.65 / 0.64 / +1.3%
tpcds_q74/duckdb:vortex-file-compressed	28353126 / 28510920 / -0.6%	39377772 / 42763812 / -7.9%	0.72 / 0.67 / +8.0%
tpcds_q75/duckdb:vortex-file-compressed	28784070 / 28818404 / -0.1%	39149454 / 39911136 / -1.9%	0.74 / 0.72 / +1.8%
tpcds_q76/duckdb:vortex-file-compressed	13620312 / 13182393 / +3.3%	27806557 / 27771342 / +0.1%	0.49 / 0.47 / +3.2%
tpcds_q77/duckdb:vortex-file-compressed	16198927 / 16901204 / -4.2%	26212197 / 26474639 / -1.0%	0.62 / 0.64 / -3.2%
tpcds_q78/duckdb:vortex-file-compressed	37645239 / 37928847 / -0.7%	47422198 / 46654834 / +1.6%	0.79 / 0.81 / -2.4%
tpcds_q79/duckdb:vortex-file-compressed	15374318 / 15083564 / +1.9%	26307182 / 24489737 / +7.4%	0.58 / 0.62 / -5.1%
tpcds_q80/duckdb:vortex-file-compressed	28944472 / 28889904 / +0.2%	43245585 / 45770518 / -5.5%	0.67 / 0.63 / +6.0%
tpcds_q81/duckdb:vortex-file-compressed	23288268 / 23852757 / -2.4%	31545645 / 31537130 / +0.0%	0.74 / 0.76 / -2.4%
tpcds_q82/duckdb:vortex-file-compressed	32152984 / 32149448 / +0.0%	41339932 / 40106074 / +3.1%	0.78 / 0.80 / -3.0%
tpcds_q83/duckdb:vortex-file-compressed	20970362 / 21047958 / -0.4%	33403693 / 28786129 / +16.0% 🔴	0.63 / 0.73 / -14.1%
tpcds_q84/duckdb:vortex-file-compressed	13836557 / 13787502 / +0.4%	19903935 / 20430851 / -2.6%	0.70 / 0.67 / +3.0%
tpcds_q85/duckdb:vortex-file-compressed	33331867 / 33335766 / -0.0%	43858053 / 43447618 / +0.9%	0.76 / 0.77 / -0.9%
tpcds_q86/duckdb:vortex-file-compressed	11185589 / 11263070 / -0.7%	18539827 / 22631814 / -18.1% 🟢	0.60 / 0.50 / +21.2%
tpcds_q87/duckdb:vortex-file-compressed	24049366 / 24244678 / -0.8%	30919295 / 31475393 / -1.8%	0.78 / 0.77 / +1.0%
tpcds_q88/duckdb:vortex-file-compressed	35906098 / 35897962 / +0.0%	47828481 / 47203370 / +1.3%	0.75 / 0.76 / -1.3%
tpcds_q89/duckdb:vortex-file-compressed	15849290 / 13991204 / +13.3% 🔴	22815986 / 23697409 / -3.7%	0.69 / 0.59 / +17.7%
tpcds_q90/duckdb:vortex-file-compressed	8261267 / 8315430 / -0.7%	15546503 / 13434644 / +15.7% 🔴	0.53 / 0.62 / -14.1%
tpcds_q91/duckdb:vortex-file-compressed	17199820 / 17337806 / -0.8%	23136405 / 23860245 / -3.0%	0.74 / 0.73 / +2.3%
tpcds_q92/duckdb:vortex-file-compressed	14429761 / 14632200 / -1.4%	22947997 / 26135840 / -12.2% 🟢	0.63 / 0.56 / +12.3%
tpcds_q93/duckdb:vortex-file-compressed	16795074 / 17167872 / -2.2%	24143186 / 25339250 / -4.7%	0.70 / 0.68 / +2.7%
tpcds_q94/duckdb:vortex-file-compressed	17404292 / 17743540 / -1.9%	26890733 / 27756726 / -3.1%	0.65 / 0.64 / +1.2%
tpcds_q95/duckdb:vortex-file-compressed	72262595 / 71864054 / +0.6%	85959771 / 81204164 / +5.9%	0.84 / 0.88 / -5.0%
tpcds_q96/duckdb:vortex-file-compressed	8534554 / 8623298 / -1.0%	17195122 / 17918015 / -4.0%	0.50 / 0.48 / +3.1%
tpcds_q97/duckdb:vortex-file-compressed	23361030 / 23654071 / -1.2%	31610068 / 35580527 / -11.2% 🟢	0.74 / 0.66 / +11.2%
tpcds_q98/duckdb:vortex-file-compressed	13979009 / 15260374 / -8.4%	23111722 / 24204181 / -4.5%	0.60 / 0.63 / -4.1%
tpcds_q99/duckdb:vortex-file-compressed	14407732 / 14825117 / -2.8%	23416550 / 22464480 / +4.2%	0.62 / 0.66 / -6.8%

duckdb / vortex-compact / ns (0.996x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	16432105 / 16628064 / -1.2%	24610376 / 25109669 / -2.0%	0.67 / 0.66 / +0.8%
tpcds_q02/duckdb:vortex-compact	16011596 / 15967106 / +0.3%	21705127 / 22297569 / -2.7%	0.74 / 0.72 / +3.0%
tpcds_q03/duckdb:vortex-compact	24366040 / 24537971 / -0.7%	34878309 / 31168210 / +11.9% 🔴	0.70 / 0.79 / -11.3%
tpcds_q04/duckdb:vortex-compact	53236492 / 55260462 / -3.7%	65158027 / 70310029 / -7.3%	0.82 / 0.79 / +4.0%
tpcds_q05/duckdb:vortex-compact	22981632 / 21698318 / +5.9%	30755676 / 31235377 / -1.5%	0.75 / 0.69 / +7.6%
tpcds_q06/duckdb:vortex-compact	32578332 / 33005847 / -1.3%	44896527 / 46164471 / -2.7%	0.73 / 0.71 / +1.5%
tpcds_q07/duckdb:vortex-compact	28793776 / 28350250 / +1.6%	39932108 / 41663800 / -4.2%	0.72 / 0.68 / +6.0%
tpcds_q08/duckdb:vortex-compact	49355254 / 49508638 / -0.3%	57409769 / 58526477 / -1.9%	0.86 / 0.85 / +1.6%
tpcds_q09/duckdb:vortex-compact	12234304 / 12171434 / +0.5%	20666149 / 20575260 / +0.4%	0.59 / 0.59 / +0.1%
tpcds_q10/duckdb:vortex-compact	46009832 / 46148323 / -0.3%	59304357 / 57628308 / +2.9%	0.78 / 0.80 / -3.1%
tpcds_q11/duckdb:vortex-compact	45780134 / 46166053 / -0.8%	57599320 / 56530331 / +1.9%	0.79 / 0.82 / -2.7%
tpcds_q12/duckdb:vortex-compact	13533696 / 13702734 / -1.2%	19433735 / 19743106 / -1.6%	0.70 / 0.69 / +0.3%
tpcds_q13/duckdb:vortex-compact	36483453 / 37897260 / -3.7%	50071020 / 49528467 / +1.1%	0.73 / 0.77 / -4.8%
tpcds_q14/duckdb:vortex-compact	67113278 / 67253429 / -0.2%	78567075 / 79908737 / -1.7%	0.85 / 0.84 / +1.5%
tpcds_q15/duckdb:vortex-compact	26148265 / 26357525 / -0.8%	31358967 / 32035067 / -2.1%	0.83 / 0.82 / +1.3%
tpcds_q16/duckdb:vortex-compact	25068328 / 25360638 / -1.2%	33115711 / 35307495 / -6.2%	0.76 / 0.72 / +5.4%
tpcds_q17/duckdb:vortex-compact	45635894 / 45662446 / -0.1%	58974208 / 59658858 / -1.1%	0.77 / 0.77 / +1.1%
tpcds_q18/duckdb:vortex-compact	36329557 / 36275939 / +0.1%	44669087 / 45622935 / -2.1%	0.81 / 0.80 / +2.3%
tpcds_q19/duckdb:vortex-compact	35675172 / 36028808 / -1.0%	45990789 / 48972691 / -6.1%	0.78 / 0.74 / +5.4%
tpcds_q20/duckdb:vortex-compact	14155646 / 14403790 / -1.7%	19937650 / 20452047 / -2.5%	0.71 / 0.70 / +0.8%
tpcds_q21/duckdb:vortex-compact	11173947 / 13496613 / -17.2% 🟢	20218567 / 24595446 / -17.8% 🟢	0.55 / 0.55 / +0.7%
tpcds_q22/duckdb:vortex-compact	36966932 / 31263583 / +18.2% 🔴	40735427 / 42582096 / -4.3%	0.91 / 0.73 / +23.6%
tpcds_q23/duckdb:vortex-compact	42901889 / 42888718 / +0.0%	53144242 / 57519116 / -7.6%	0.81 / 0.75 / +8.3%
tpcds_q24/duckdb:vortex-compact	39797656 / 40099412 / -0.8%	48295808 / 50717892 / -4.8%	0.82 / 0.79 / +4.2%
tpcds_q25/duckdb:vortex-compact	43822492 / 43816203 / +0.0%	55015129 / 55890505 / -1.6%	0.80 / 0.78 / +1.6%
tpcds_q26/duckdb:vortex-compact	25221203 / 25683525 / -1.8%	31435995 / 34026660 / -7.6%	0.80 / 0.75 / +6.3%
tpcds_q27/duckdb:vortex-compact	33211733 / 34196548 / -2.9%	47178123 / 44105267 / +7.0%	0.70 / 0.78 / -9.2%
tpcds_q28/duckdb:vortex-compact	11977982 / 12152530 / -1.4%	17252537 / 16422611 / +5.1%	0.69 / 0.74 / -6.2%
tpcds_q29/duckdb:vortex-compact	45092136 / 45080107 / +0.0%	57643862 / 58060853 / -0.7%	0.78 / 0.78 / +0.8%
tpcds_q30/duckdb:vortex-compact	22712101 / 22991852 / -1.2%	30815945 / 31948035 / -3.5%	0.74 / 0.72 / +2.4%
tpcds_q31/duckdb:vortex-compact	25516336 / 23989345 / +6.4%	31145406 / 32834247 / -5.1%	0.82 / 0.73 / +12.1%
tpcds_q32/duckdb:vortex-compact	14595276 / 14450674 / +1.0%	25139626 / 22089063 / +13.8% 🔴	0.58 / 0.65 / -11.3%
tpcds_q33/duckdb:vortex-compact	23464078 / 23549512 / -0.4%	38794658 / 35498744 / +9.3%	0.60 / 0.66 / -8.8%
tpcds_q34/duckdb:vortex-compact	22280310 / 22453130 / -0.8%	28859440 / 33025354 / -12.6% 🟢	0.77 / 0.68 / +13.6%
tpcds_q35/duckdb:vortex-compact	62304664 / 63980020 / -2.6%	73976913 / 74280086 / -0.4%	0.84 / 0.86 / -2.2%
tpcds_q36/duckdb:vortex-compact	23020987 / 22415806 / +2.7%	35065296 / 33767551 / +3.8%	0.66 / 0.66 / -1.1%
tpcds_q37/duckdb:vortex-compact	15586983 / 15710804 / -0.8%	27118171 / 26430539 / +2.6%	0.57 / 0.59 / -3.3%
tpcds_q38/duckdb:vortex-compact	26855490 / 26166636 / +2.6%	36606120 / 33273122 / +10.0% 🔴	0.73 / 0.79 / -6.7%
tpcds_q39/duckdb:vortex-compact	20180358 / 20380288 / -1.0%	32667683 / 33743459 / -3.2%	0.62 / 0.60 / +2.3%
tpcds_q40/duckdb:vortex-compact	15925942 / 16193090 / -1.6%	22688707 / 21864087 / +3.8%	0.70 / 0.74 / -5.2%
tpcds_q41/duckdb:vortex-compact	7649249 / 7656444 / -0.1%	11780153 / 12815883 / -8.1%	0.65 / 0.60 / +8.7%
tpcds_q42/duckdb:vortex-compact	11651428 / 12032249 / -3.2%	21040862 / 21880943 / -3.8%	0.55 / 0.55 / +0.7%
tpcds_q43/duckdb:vortex-compact	16538643 / 16683061 / -0.9%	27514983 / 26261189 / +4.8%	0.60 / 0.64 / -5.4%
tpcds_q44/duckdb:vortex-compact	19521356 / 20169440 / -3.2%	29211317 / 32137561 / -9.1%	0.67 / 0.63 / +6.5%
tpcds_q45/duckdb:vortex-compact	27389838 / 27669614 / -1.0%	33163314 / 33788088 / -1.8%	0.83 / 0.82 / +0.9%
tpcds_q46/duckdb:vortex-compact	29498576 / 29295460 / +0.7%	40377692 / 39008993 / +3.5%	0.73 / 0.75 / -2.7%
tpcds_q47/duckdb:vortex-compact	36518438 / 36853034 / -0.9%	53523892 / 45678018 / +17.2% 🔴	0.68 / 0.81 / -15.4%
tpcds_q48/duckdb:vortex-compact	34016814 / 34157668 / -0.4%	48544433 / 56669248 / -14.3% 🟢	0.70 / 0.60 / +16.3%
tpcds_q49/duckdb:vortex-compact	23064231 / 23445115 / -1.6%	36664204 / 37788675 / -3.0%	0.63 / 0.62 / +1.4%
tpcds_q50/duckdb:vortex-compact	28419440 / 28105416 / +1.1%	37702196 / 37781899 / -0.2%	0.75 / 0.74 / +1.3%
tpcds_q51/duckdb:vortex-compact	53603588 / 53185008 / +0.8%	65199988 / 64895766 / +0.5%	0.82 / 0.82 / +0.3%
tpcds_q52/duckdb:vortex-compact	11994135 / 12019505 / -0.2%	21193056 / 22183129 / -4.5%	0.57 / 0.54 / +4.5%
tpcds_q53/duckdb:vortex-compact	22496879 / 22315968 / +0.8%	29785969 / 30531526 / -2.4%	0.76 / 0.73 / +3.3%
tpcds_q54/duckdb:vortex-compact	26054214 / 26139295 / -0.3%	36714609 / 36480789 / +0.6%	0.71 / 0.72 / -1.0%
tpcds_q55/duckdb:vortex-compact	12011016 / 11788002 / +1.9%	23240538 / 24914377 / -6.7%	0.52 / 0.47 / +9.2%
tpcds_q56/duckdb:vortex-compact	23592906 / 23771679 / -0.8%	35088049 / 36565153 / -4.0%	0.67 / 0.65 / +3.4%
tpcds_q57/duckdb:vortex-compact	27868366 / 28353360 / -1.7%	34232110 / 34192508 / +0.1%	0.81 / 0.83 / -1.8%
tpcds_q58/duckdb:vortex-compact	21559110 / 22081535 / -2.4%	32349167 / 32651732 / -0.9%	0.67 / 0.68 / -1.5%
tpcds_q59/duckdb:vortex-compact	23401568 / 23795520 / -1.7%	31828262 / 30508937 / +4.3%	0.74 / 0.78 / -5.7%
tpcds_q60/duckdb:vortex-compact	25299772 / 24710921 / +2.4%	35220127 / 37759887 / -6.7%	0.72 / 0.65 / +9.8%
tpcds_q61/duckdb:vortex-compact	34098082 / 35260212 / -3.3%	43004811 / 45333106 / -5.1%	0.79 / 0.78 / +1.9%
tpcds_q62/duckdb:vortex-compact	11732922 / 11810360 / -0.7%	18069987 / 19005822 / -4.9%	0.65 / 0.62 / +4.5%
tpcds_q63/duckdb:vortex-compact	21531484 / 20623600 / +4.4%	31105127 / 29208632 / +6.5%	0.69 / 0.71 / -2.0%
tpcds_q64/duckdb:vortex-compact	86599701 / 86737165 / -0.2%	99996243 / 105295700 / -5.0%	0.87 / 0.82 / +5.1%
tpcds_q65/duckdb:vortex-compact	18166924 / 18442397 / -1.5%	26159747 / 27095128 / -3.5%	0.69 / 0.68 / +2.0%
tpcds_q66/duckdb:vortex-compact	25736258 / 25795230 / -0.2%	34097153 / 35037717 / -2.7%	0.75 / 0.74 / +2.5%
tpcds_q67/duckdb:vortex-compact	71625328 / 72119306 / -0.7%	85198374 / 87359439 / -2.5%	0.84 / 0.83 / +1.8%
tpcds_q68/duckdb:vortex-compact	29653349 / 29607724 / +0.2%	40005268 / 40130587 / -0.3%	0.74 / 0.74 / +0.5%
tpcds_q69/duckdb:vortex-compact	47429122 / 47630812 / -0.4%	58175351 / 61296107 / -5.1%	0.82 / 0.78 / +4.9%
tpcds_q70/duckdb:vortex-compact	31249206 / 31367476 / -0.4%	41932293 / 40253113 / +4.2%	0.75 / 0.78 / -4.4%
tpcds_q71/duckdb:vortex-compact	21641652 / 19898271 / +8.8%	31773236 / 31707077 / +0.2%	0.68 / 0.63 / +8.5%
tpcds_q72/duckdb:vortex-compact	71004746 / 70609684 / +0.6%	83632206 / 86849456 / -3.7%	0.85 / 0.81 / +4.4%
tpcds_q73/duckdb:vortex-compact	21683217 / 21832207 / -0.7%	28244343 / 31010321 / -8.9%	0.77 / 0.70 / +9.0%
tpcds_q74/duckdb:vortex-compact	33219533 / 32439456 / +2.4%	41609827 / 42556784 / -2.2%	0.80 / 0.76 / +4.7%
tpcds_q75/duckdb:vortex-compact	33151461 / 35273341 / -6.0%	45384403 / 46694990 / -2.8%	0.73 / 0.76 / -3.3%
tpcds_q76/duckdb:vortex-compact	16485458 / 16884622 / -2.4%	27657669 / 32195074 / -14.1% 🟢	0.60 / 0.52 / +13.7%
tpcds_q77/duckdb:vortex-compact	22881774 / 22109162 / +3.5%	31714802 / 32430794 / -2.2%	0.72 / 0.68 / +5.8%
tpcds_q78/duckdb:vortex-compact	42010107 / 42006358 / +0.0%	50658105 / 51808495 / -2.2%	0.83 / 0.81 / +2.3%
tpcds_q79/duckdb:vortex-compact	38179158 / 38116541 / +0.2%	52426710 / 50416507 / +4.0%	0.73 / 0.76 / -3.7%
tpcds_q80/duckdb:vortex-compact	37227410 / 38290030 / -2.8%	48931385 / 55343109 / -11.6% 🟢	0.76 / 0.69 / +10.0%
tpcds_q81/duckdb:vortex-compact	24496218 / 24788825 / -1.2%	35164970 / 33189735 / +6.0%	0.70 / 0.75 / -6.7%
tpcds_q82/duckdb:vortex-compact	36274305 / 36919998 / -1.7%	45171261 / 47122265 / -4.1%	0.80 / 0.78 / +2.5%
tpcds_q83/duckdb:vortex-compact	28106366 / 28303461 / -0.7%	33657214 / 36491975 / -7.8%	0.84 / 0.78 / +7.7%
tpcds_q84/duckdb:vortex-compact	14916618 / 15008122 / -0.6%	25438204 / 24160409 / +5.3%	0.59 / 0.62 / -5.6%
tpcds_q85/duckdb:vortex-compact	42087576 / 42372643 / -0.7%	50625439 / 52338814 / -3.3%	0.83 / 0.81 / +2.7%
tpcds_q86/duckdb:vortex-compact	12030334 / 12203168 / -1.4%	18109068 / 21747278 / -16.7% 🟢	0.66 / 0.56 / +18.4%
tpcds_q87/duckdb:vortex-compact	28135344 / 28713010 / -2.0%	33983489 / 35623045 / -4.6%	0.83 / 0.81 / +2.7%
tpcds_q88/duckdb:vortex-compact	66038656 / 67503048 / -2.2%	77727895 / 79172597 / -1.8%	0.85 / 0.85 / -0.4%
tpcds_q89/duckdb:vortex-compact	21078527 / 21108825 / -0.1%	29749928 / 29511181 / +0.8%	0.71 / 0.72 / -0.9%
tpcds_q90/duckdb:vortex-compact	11768908 / 11703944 / +0.6%	17092983 / 17890883 / -4.5%	0.69 / 0.65 / +5.2%
tpcds_q91/duckdb:vortex-compact	33506016 / 33364416 / +0.4%	40696928 / 40746281 / -0.1%	0.82 / 0.82 / +0.5%
tpcds_q92/duckdb:vortex-compact	20702030 / 20971037 / -1.3%	29448604 / 32028431 / -8.1%	0.70 / 0.65 / +7.4%
tpcds_q93/duckdb:vortex-compact	18515551 / 18448232 / +0.4%	27576603 / 26141828 / +5.5%	0.67 / 0.71 / -4.9%
tpcds_q94/duckdb:vortex-compact	22255584 / 22521549 / -1.2%	33195832 / 31185302 / +6.4%	0.67 / 0.72 / -7.2%
tpcds_q95/duckdb:vortex-compact	77386632 / 78398848 / -1.3%	86670236 / 87885236 / -1.4%	0.89 / 0.89 / +0.1%
tpcds_q96/duckdb:vortex-compact	17298873 / 17279014 / +0.1%	26911354 / 24429442 / +10.2% 🔴	0.64 / 0.71 / -9.1%
tpcds_q97/duckdb:vortex-compact	25621799 / 25503773 / +0.5%	32869355 / 33066762 / -0.6%	0.78 / 0.77 / +1.1%
tpcds_q98/duckdb:vortex-compact	18443928 / 18822028 / -2.0%	31543683 / 30568554 / +3.2%	0.58 / 0.62 / -5.0%
tpcds_q99/duckdb:vortex-compact	16928626 / 16998546 / -0.4%	24764011 / 23676628 / +4.6%	0.68 / 0.72 / -4.8%

duckdb / parquet / ns (0.995x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	23798114 / 23707261 / +0.4%	31590825 / 34319452 / -8.0%	0.75 / 0.69 / +9.1%
tpcds_q02/duckdb:parquet	15408850 / 15751482 / -2.2%	22598709 / 20088574 / +12.5% 🔴	0.68 / 0.78 / -13.0%
tpcds_q03/duckdb:parquet	8780639 / 8774212 / +0.1%	14812308 / 15722585 / -5.8%	0.59 / 0.56 / +6.2%
tpcds_q04/duckdb:parquet	127024058 / 128410666 / -1.1%	132165777 / 133803495 / -1.2%	0.96 / 0.96 / +0.1%
tpcds_q05/duckdb:parquet	21426556 / 21645361 / -1.0%	25709342 / 28686621 / -10.4% 🟢	0.83 / 0.75 / +10.5%
tpcds_q06/duckdb:parquet	26638479 / 26152087 / +1.9%	36219863 / 36993050 / -2.1%	0.74 / 0.71 / +4.0%
tpcds_q07/duckdb:parquet	15323176 / 15347171 / -0.2%	24353415 / 26286665 / -7.4%	0.63 / 0.58 / +7.8%
tpcds_q08/duckdb:parquet	25648166 / 25744148 / -0.4%	33105246 / 33480047 / -1.1%	0.77 / 0.77 / +0.8%
tpcds_q09/duckdb:parquet	18696930 / 19144322 / -2.3%	23810649 / 23476990 / +1.4%	0.79 / 0.82 / -3.7%
tpcds_q10/duckdb:parquet	27467206 / 27741343 / -1.0%	37867256 / 37512942 / +0.9%	0.73 / 0.74 / -1.9%
tpcds_q11/duckdb:parquet	71323868 / 71870168 / -0.8%	76788649 / 79130572 / -3.0%	0.93 / 0.91 / +2.3%
tpcds_q12/duckdb:parquet	12537973 / 12921824 / -3.0%	17732580 / 17746102 / -0.1%	0.71 / 0.73 / -2.9%
tpcds_q13/duckdb:parquet	24013879 / 23893288 / +0.5%	31635142 / 31649240 / -0.0%	0.76 / 0.75 / +0.5%
tpcds_q14/duckdb:parquet	61092875 / 61074529 / +0.0%	71178298 / 74702354 / -4.7%	0.86 / 0.82 / +5.0%
tpcds_q15/duckdb:parquet	25057032 / 25196614 / -0.6%	30862672 / 31046085 / -0.6%	0.81 / 0.81 / +0.0%
tpcds_q16/duckdb:parquet	19774806 / 20030032 / -1.3%	28337736 / 32363850 / -12.4% 🟢	0.70 / 0.62 / +12.8%
tpcds_q17/duckdb:parquet	32227966 / 32583716 / -1.1%	40797499 / 40467320 / +0.8%	0.79 / 0.81 / -1.9%
tpcds_q18/duckdb:parquet	39065676 / 42637848 / -8.4%	49275532 / 50186242 / -1.8%	0.79 / 0.85 / -6.7%
tpcds_q19/duckdb:parquet	24389838 / 24520106 / -0.5%	31678061 / 32726785 / -3.2%	0.77 / 0.75 / +2.8%
tpcds_q20/duckdb:parquet	13603377 / 13736972 / -1.0%	17874580 / 18292762 / -2.3%	0.76 / 0.75 / +1.3%
tpcds_q21/duckdb:parquet	9425013 / 9639073 / -2.2%	12994221 / 13499387 / -3.7%	0.73 / 0.71 / +1.6%
tpcds_q22/duckdb:parquet	37355728 / 35499928 / +5.2%	39521606 / 39371625 / +0.4%	0.95 / 0.90 / +4.8%
tpcds_q23/duckdb:parquet	40436450 / 40942540 / -1.2%	48134693 / 48732064 / -1.2%	0.84 / 0.84 / -0.0%
tpcds_q24/duckdb:parquet	33420366 / 33618632 / -0.6%	45352962 / 44308199 / +2.4%	0.74 / 0.76 / -2.9%
tpcds_q25/duckdb:parquet	30183906 / 30276944 / -0.3%	40144240 / 42732669 / -6.1%	0.75 / 0.71 / +6.1%
tpcds_q26/duckdb:parquet	30854732 / 31049127 / -0.6%	41170703 / 38487656 / +7.0%	0.75 / 0.81 / -7.1%
tpcds_q27/duckdb:parquet	32807435 / 31584020 / +3.9%	43005672 / 41202291 / +4.4%	0.76 / 0.77 / -0.5%
tpcds_q28/duckdb:parquet	17156716 / 17259190 / -0.6%	21624344 / 24915125 / -13.2% 🟢	0.79 / 0.69 / +14.5%
tpcds_q29/duckdb:parquet	30647041 / 31042974 / -1.3%	42398684 / 39739129 / +6.7%	0.72 / 0.78 / -7.5%
tpcds_q30/duckdb:parquet	34391872 / 32703656 / +5.2%	41546054 / 42164824 / -1.5%	0.83 / 0.78 / +6.7%
tpcds_q31/duckdb:parquet	20119035 / 20418720 / -1.5%	29114122 / 32957959 / -11.7% 🟢	0.69 / 0.62 / +11.5%
tpcds_q32/duckdb:parquet	11149930 / 11230768 / -0.7%	17246875 / 16878123 / +2.2%	0.65 / 0.67 / -2.8%
tpcds_q33/duckdb:parquet	15885508 / 16120721 / -1.5%	24970830 / 23045965 / +8.4%	0.64 / 0.70 / -9.1%
tpcds_q34/duckdb:parquet	16107986 / 16133884 / -0.2%	22675281 / 22792228 / -0.5%	0.71 / 0.71 / +0.4%
tpcds_q35/duckdb:parquet	46943984 / 47073803 / -0.3%	59404182 / 57672994 / +3.0%	0.79 / 0.82 / -3.2%
tpcds_q36/duckdb:parquet	14952760 / 15112646 / -1.1%	23640149 / 23582500 / +0.2%	0.63 / 0.64 / -1.3%
tpcds_q37/duckdb:parquet	13280734 / 12270404 / +8.2%	18899998 / 17553401 / +7.7%	0.70 / 0.70 / +0.5%
tpcds_q38/duckdb:parquet	26711050 / 26793119 / -0.3%	34476302 / 30438311 / +13.3% 🔴	0.77 / 0.88 / -12.0%
tpcds_q39/duckdb:parquet	24655364 / 24577037 / +0.3%	32233057 / 29950798 / +7.6%	0.76 / 0.82 / -6.8%
tpcds_q40/duckdb:parquet	16051195 / 15971856 / +0.5%	21503888 / 21598660 / -0.4%	0.75 / 0.74 / +0.9%
tpcds_q41/duckdb:parquet	7860122 / 7759520 / +1.3%	13093135 / 12796424 / +2.3%	0.60 / 0.61 / -1.0%
tpcds_q42/duckdb:parquet	8310122 / 8418804 / -1.3%	14746064 / 14812784 / -0.5%	0.56 / 0.57 / -0.8%
tpcds_q43/duckdb:parquet	10727522 / 10662857 / +0.6%	15329175 / 15690845 / -2.3%	0.70 / 0.68 / +3.0%
tpcds_q44/duckdb:parquet	16325451 / 16838908 / -3.0%	22049103 / 22506318 / -2.0%	0.74 / 0.75 / -1.0%
tpcds_q45/duckdb:parquet	23203734 / 23363303 / -0.7%	30009198 / 29856512 / +0.5%	0.77 / 0.78 / -1.2%
tpcds_q46/duckdb:parquet	36164759 / 36352198 / -0.5%	54930609 / 46149967 / +19.0% 🔴	0.66 / 0.79 / -16.4%
tpcds_q47/duckdb:parquet	31386446 / 31318900 / +0.2%	37619658 / 38284197 / -1.7%	0.83 / 0.82 / +2.0%
tpcds_q48/duckdb:parquet	21155085 / 21128218 / +0.1%	28539264 / 29006725 / -1.6%	0.74 / 0.73 / +1.8%
tpcds_q49/duckdb:parquet	18935652 / 19033859 / -0.5%	28804263 / 33027666 / -12.8% 🟢	0.66 / 0.58 / +14.1%
tpcds_q50/duckdb:parquet	17475834 / 17541651 / -0.4%	26901935 / 24950228 / +7.8%	0.65 / 0.70 / -7.6%
tpcds_q51/duckdb:parquet	54159257 / 54534982 / -0.7%	66271659 / 60762842 / +9.1%	0.82 / 0.90 / -8.9%
tpcds_q52/duckdb:parquet	8487783 / 8617348 / -1.5%	14957849 / 15277501 / -2.1%	0.57 / 0.56 / +0.6%
tpcds_q53/duckdb:parquet	11520036 / 11586580 / -0.6%	17320939 / 17219187 / +0.6%	0.67 / 0.67 / -1.2%
tpcds_q54/duckdb:parquet	20806554 / 20554375 / +1.2%	29471760 / 30649710 / -3.8%	0.71 / 0.67 / +5.3%
tpcds_q55/duckdb:parquet	8506224 / 8681486 / -2.0%	14686829 / 15190256 / -3.3%	0.58 / 0.57 / +1.3%
tpcds_q56/duckdb:parquet	16299902 / 16309579 / -0.1%	23975015 / 24409573 / -1.8%	0.68 / 0.67 / +1.8%
tpcds_q57/duckdb:parquet	29138820 / 28845280 / +1.0%	34284489 / 34937430 / -1.9%	0.85 / 0.83 / +2.9%
tpcds_q58/duckdb:parquet	18239442 / 18607370 / -2.0%	25914824 / 26152069 / -0.9%	0.70 / 0.71 / -1.1%
tpcds_q59/duckdb:parquet	20267104 / 20077837 / +0.9%	24918514 / 25470945 / -2.2%	0.81 / 0.79 / +3.2%
tpcds_q60/duckdb:parquet	16827028 / 16884211 / -0.3%	24260879 / 23971839 / +1.2%	0.69 / 0.70 / -1.5%
tpcds_q61/duckdb:parquet	21311326 / 21639634 / -1.5%	28681837 / 28688626 / -0.0%	0.74 / 0.75 / -1.5%
tpcds_q62/duckdb:parquet	10607770 / 10809150 / -1.9%	14520587 / 14698152 / -1.2%	0.73 / 0.74 / -0.7%
tpcds_q63/duckdb:parquet	10874746 / 11099305 / -2.0%	16135967 / 16807479 / -4.0%	0.67 / 0.66 / +2.1%
tpcds_q64/duckdb:parquet	53168644 / 52833690 / +0.6%	69514350 / 66820634 / +4.0%	0.76 / 0.79 / -3.3%
tpcds_q65/duckdb:parquet	14657665 / 14596652 / +0.4%	21226778 / 21497391 / -1.3%	0.69 / 0.68 / +1.7%
tpcds_q66/duckdb:parquet	24952589 / 24962650 / -0.0%	32821696 / 31757887 / +3.3%	0.76 / 0.79 / -3.3%
tpcds_q67/duckdb:parquet	78195140 / 77745968 / +0.6%	86278732 / 89199103 / -3.3%	0.91 / 0.87 / +4.0%
tpcds_q68/duckdb:parquet	29196817 / 29562186 / -1.2%	41761199 / 41740802 / +0.0%	0.70 / 0.71 / -1.3%
tpcds_q69/duckdb:parquet	28765558 / 28962898 / -0.7%	40407899 / 42744441 / -5.5%	0.71 / 0.68 / +5.1%
tpcds_q70/duckdb:parquet	16219902 / 16148340 / +0.4%	28486623 / 23257856 / +22.5% 🔴	0.57 / 0.69 / -18.0%
tpcds_q71/duckdb:parquet	14777940 / 16570585 / -10.8% 🟢	20808778 / 20876298 / -0.3%	0.71 / 0.79 / -10.5%
tpcds_q72/duckdb:parquet	84619205 / 81704532 / +3.6%	87899522 / 87436320 / +0.5%	0.96 / 0.93 / +3.0%
tpcds_q73/duckdb:parquet	13419188 / 13483092 / -0.5%	19306199 / 19470886 / -0.8%	0.70 / 0.69 / +0.4%
tpcds_q74/duckdb:parquet	100155802 / 98793368 / +1.4%	109361313 / 109345501 / +0.0%	0.92 / 0.90 / +1.4%
tpcds_q75/duckdb:parquet	40000935 / 40638312 / -1.6%	51931176 / 51339537 / +1.2%	0.77 / 0.79 / -2.7%
tpcds_q76/duckdb:parquet	13323240 / 13442120 / -0.9%	20542752 / 20351158 / +0.9%	0.65 / 0.66 / -1.8%
tpcds_q77/duckdb:parquet	17016028 / 17266738 / -1.5%	25644747 / 25276607 / +1.5%	0.66 / 0.68 / -2.9%
tpcds_q78/duckdb:parquet	48758991 / 48405042 / +0.7%	53869637 / 54232246 / -0.7%	0.91 / 0.89 / +1.4%
tpcds_q79/duckdb:parquet	20344986 / 20626622 / -1.4%	28876985 / 28847903 / +0.1%	0.70 / 0.72 / -1.5%
tpcds_q80/duckdb:parquet	31509024 / 31859476 / -1.1%	41094720 / 47525814 / -13.5% 🟢	0.77 / 0.67 / +14.4%
tpcds_q81/duckdb:parquet	31039470 / 29727906 / +4.4%	39792510 / 39990892 / -0.5%	0.78 / 0.74 / +4.9%
tpcds_q82/duckdb:parquet	13823868 / 12630153 / +9.5%	18329591 / 20238865 / -9.4%	0.75 / 0.62 / +20.9%
tpcds_q83/duckdb:parquet	15535904 / 15757197 / -1.4%	20174343 / 20679858 / -2.4%	0.77 / 0.76 / +1.1%
tpcds_q84/duckdb:parquet	17399272 / 17741381 / -1.9%	23892062 / 23608168 / +1.2%	0.73 / 0.75 / -3.1%
tpcds_q85/duckdb:parquet	34633933 / 34886406 / -0.7%	45020998 / 45720962 / -1.5%	0.77 / 0.76 / +0.8%
tpcds_q86/duckdb:parquet	10817694 / 11291065 / -4.2%	15957929 / 16169701 / -1.3%	0.68 / 0.70 / -2.9%
tpcds_q87/duckdb:parquet	28134944 / 28358278 / -0.8%	31923726 / 33036709 / -3.4%	0.88 / 0.86 / +2.7%
tpcds_q88/duckdb:parquet	27018408 / 28753658 / -6.0%	35417000 / 31810051 / +11.3% 🔴	0.76 / 0.90 / -15.6%
tpcds_q89/duckdb:parquet	12776922 / 12601467 / +1.4%	22740864 / 22185854 / +2.5%	0.56 / 0.57 / -1.1%
tpcds_q90/duckdb:parquet	6806880 / 7101130 / -4.1%	11170934 / 12842270 / -13.0% 🟢	0.61 / 0.55 / +10.2%
tpcds_q91/duckdb:parquet	20838842 / 20904176 / -0.3%	32302049 / 29200096 / +10.6% 🔴	0.65 / 0.72 / -9.9%
tpcds_q92/duckdb:parquet	11426829 / 11578854 / -1.3%	18845397 / 18488841 / +1.9%	0.61 / 0.63 / -3.2%
tpcds_q93/duckdb:parquet	21618680 / 21377452 / +1.1%	29148646 / 28989379 / +0.5%	0.74 / 0.74 / +0.6%
tpcds_q94/duckdb:parquet	16121088 / 16104489 / +0.1%	24696591 / 29528972 / -16.4% 🟢	0.65 / 0.55 / +19.7%
tpcds_q95/duckdb:parquet	90122798 / 90561656 / -0.5%	96824458 / 98426635 / -1.6%	0.93 / 0.92 / +1.2%
tpcds_q96/duckdb:parquet	6950095 / 6934048 / +0.2%	10816858 / 10907704 / -0.8%	0.64 / 0.64 / +1.1%
tpcds_q97/duckdb:parquet	26034072 / 26051244 / -0.1%	31802438 / 32084120 / -0.9%	0.82 / 0.81 / +0.8%
tpcds_q98/duckdb:parquet	14831136 / 15181722 / -2.3%	22551474 / 22038191 / +2.3%	0.66 / 0.69 / -4.5%
tpcds_q99/duckdb:parquet	17356292 / 17421644 / -0.4%	20883022 / 21183201 / -1.4%	0.83 / 0.82 / +1.1%

No file size changes detected.

github-actions · 2026-09-10T16:23:07Z

Benchmarks: Appian on NVME 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.020x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact	53286725 / 52443684 / +1.6%	76272942 / 72225827 / +5.6%	0.70 / 0.73 / -3.8%
appian_q02/datafusion:vortex-compact	234202181 / 233958772 / +0.1%	273026008 / 262272253 / +4.1%	0.86 / 0.89 / -3.8%
appian_q03/datafusion:vortex-compact	146777999 / 147623552 / -0.6%	189570697 / 181910900 / +4.2%	0.77 / 0.81 / -4.6%
appian_q04/datafusion:vortex-compact	9862181696 / 9872870682 / -0.1%	9834571137 / 9769249682 / +0.7%	1.00 / 1.01 / -0.8%
appian_q05/datafusion:vortex-compact	135903504 / 135462656 / +0.3%	171485427 / 164309305 / +4.4%	0.79 / 0.82 / -3.9%
appian_q06/datafusion:vortex-compact	143371497 / 143296779 / +0.1%	163373006 / 166298500 / -1.8%	0.88 / 0.86 / +1.8%
appian_q07/datafusion:vortex-compact	167491796 / 164971315 / +1.5%	200645468 / 198252171 / +1.2%	0.83 / 0.83 / +0.3%
appian_q08/datafusion:vortex-compact	564398726 / 561232606 / +0.6%	602854610 / 591837451 / +1.9%	0.94 / 0.95 / -1.3%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	73110675 / 72308766 / +1.1%	95365219 / 92383953 / +3.2%	0.77 / 0.78 / -2.1%
appian_q02/datafusion:parquet	306810845 / 303707162 / +1.0%	339051358 / 331127410 / +2.4%	0.90 / 0.92 / -1.3%
appian_q03/datafusion:parquet	189266807 / 187235982 / +1.1%	231537389 / 224594887 / +3.1%	0.82 / 0.83 / -1.9%
appian_q04/datafusion:parquet	9941978477 / 9944369518 / -0.0%	9838914474 / 9777325308 / +0.6%	1.01 / 1.02 / -0.6%
appian_q05/datafusion:parquet	193156038 / 193872997 / -0.4%	220213247 / 217640034 / +1.2%	0.88 / 0.89 / -1.5%
appian_q06/datafusion:parquet	167857869 / 167381156 / +0.3%	192281295 / 191467036 / +0.4%	0.87 / 0.87 / -0.1%
appian_q07/datafusion:parquet	205255678 / 207568372 / -1.1%	242277304 / 240772042 / +0.6%	0.85 / 0.86 / -1.7%
appian_q08/datafusion:parquet	662468448 / 661710268 / +0.1%	694386040 / 674458461 / +3.0%	0.95 / 0.98 / -2.8%

duckdb / vortex-compact / ns (0.990x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact	91405594 / 90323488 / +1.2%	105194128 / 107267550 / -1.9%	0.87 / 0.84 / +3.2%
appian_q02/duckdb:vortex-compact	211684184 / 215643380 / -1.8%	235894885 / 234935166 / +0.4%	0.90 / 0.92 / -2.2%
appian_q03/duckdb:vortex-compact	121917433 / 122120826 / -0.2%	138492554 / 137963784 / +0.4%	0.88 / 0.89 / -0.5%
appian_q04/duckdb:vortex-compact	562751195 / 535442387 / +5.1%	572157771 / 557733140 / +2.6%	0.98 / 0.96 / +2.5%
appian_q05/duckdb:vortex-compact	124161444 / 135390480 / -8.3%	158868467 / 153458732 / +3.5%	0.78 / 0.88 / -11.4%
appian_q06/duckdb:vortex-compact	403711752 / 400799982 / +0.7%	411075682 / 393014311 / +4.6%	0.98 / 1.02 / -3.7%
appian_q07/duckdb:vortex-compact	136510546 / 139265163 / -2.0%	164042695 / 165814490 / -1.1%	0.83 / 0.84 / -0.9%
appian_q08/duckdb:vortex-compact	435098977 / 445495680 / -2.3%	482401286 / 463531819 / +4.1%	0.90 / 0.96 / -6.2%

duckdb / parquet / ns (0.986x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	99581068 / 100211178 / -0.6%	121686571 / 122571238 / -0.7%	0.82 / 0.82 / +0.1%
appian_q02/duckdb:parquet	196893089 / 198562564 / -0.8%	208353761 / 212590166 / -2.0%	0.94 / 0.93 / +1.2%
appian_q03/duckdb:parquet	125496761 / 125539423 / -0.0%	152176094 / 146029044 / +4.2%	0.82 / 0.86 / -4.1%
appian_q04/duckdb:parquet	457181082 / 442214957 / +3.4%	469584850 / 414211200 / +13.4% 🔴	0.97 / 1.07 / -8.8%
appian_q05/duckdb:parquet	142243090 / 145953889 / -2.5%	165547748 / 167059559 / -0.9%	0.86 / 0.87 / -1.7%
appian_q06/duckdb:parquet	245923614 / 279043696 / -11.9% 🟢	272985810 / 309284941 / -11.7% 🟢	0.90 / 0.90 / -0.2%
appian_q07/duckdb:parquet	154647959 / 154350739 / +0.2%	168461961 / 182983431 / -7.9%	0.92 / 0.84 / +8.8%
appian_q08/duckdb:parquet	385660712 / 378509359 / +1.9%	387896966 / 426806073 / -9.1%	0.99 / 0.89 / +12.1%

No file size changes detected.

github-actions · 2026-09-10T16:23:35Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.988x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	8976571 / 8979715 / -0.0%	9421205 / 9482775 / -0.6%	0.95 / 0.95 / +0.6%
statpopgen_q01/duckdb:vortex-file-compressed	10461402 / 10572110 / -1.0%	14643287 / 14644501 / -0.0%	0.71 / 0.72 / -1.0%
statpopgen_q02/duckdb:vortex-file-compressed	379038723 / 379181454 / -0.0%	395705415 / 396764835 / -0.3%	0.96 / 0.96 / +0.2%
statpopgen_q03/duckdb:vortex-file-compressed	886964796 / 894013462 / -0.8%	897639145 / 900197426 / -0.3%	0.99 / 0.99 / -0.5%
statpopgen_q04/duckdb:vortex-file-compressed	895646354 / 893589090 / +0.2%	903863485 / 891822341 / +1.4%	0.99 / 1.00 / -1.1%
statpopgen_q05/duckdb:vortex-file-compressed	421897916 / 422927446 / -0.2%	439481960 / 434907076 / +1.1%	0.96 / 0.97 / -1.3%
statpopgen_q06/duckdb:vortex-file-compressed	1166854996 / 1169369520 / -0.2%	1177848426 / 1170423263 / +0.6%	0.99 / 1.00 / -0.8%
statpopgen_q07/duckdb:vortex-file-compressed	184423909 / 187476020 / -1.6%	196859217 / 212362211 / -7.3%	0.94 / 0.88 / +6.1%
statpopgen_q08/duckdb:vortex-file-compressed	203189352 / 200349413 / +1.4%	230118184 / 209744088 / +9.7%	0.88 / 0.96 / -7.6%
statpopgen_q09/duckdb:vortex-file-compressed	712241836 / 703107480 / +1.3%	732531060 / 766983186 / -4.5%	0.97 / 0.92 / +6.1%
statpopgen_q10/duckdb:vortex-file-compressed	2037179748 / 1996975962 / +2.0%	1980259524 / 1965994273 / +0.7%	1.03 / 1.02 / +1.3%

duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	9077182 / 9024043 / +0.6%	9386513 / 9415030 / -0.3%	0.97 / 0.96 / +0.9%
statpopgen_q01/duckdb:vortex-compact	10220036 / 10316668 / -0.9%	14233612 / 14173977 / +0.4%	0.72 / 0.73 / -1.4%
statpopgen_q02/duckdb:vortex-compact	396800175 / 391638798 / +1.3%	410997243 / 403125285 / +2.0%	0.97 / 0.97 / -0.6%
statpopgen_q03/duckdb:vortex-compact	910255518 / 909463300 / +0.1%	917456897 / 910462918 / +0.8%	0.99 / 1.00 / -0.7%
statpopgen_q04/duckdb:vortex-compact	917751685 / 904747392 / +1.4%	921180037 / 908558668 / +1.4%	1.00 / 1.00 / +0.0%
statpopgen_q05/duckdb:vortex-compact	444249480 / 439566447 / +1.1%	451268328 / 447239315 / +0.9%	0.98 / 0.98 / +0.2%
statpopgen_q06/duckdb:vortex-compact	1184710456 / 1182411444 / +0.2%	1184456471 / 1182847454 / +0.1%	1.00 / 1.00 / +0.1%
statpopgen_q07/duckdb:vortex-compact	314839271 / 310437292 / +1.4%	331297375 / 327167326 / +1.3%	0.95 / 0.95 / +0.2%
statpopgen_q08/duckdb:vortex-compact	329106018 / 329130390 / -0.0%	347232216 / 342215888 / +1.5%	0.95 / 0.96 / -1.5%
statpopgen_q09/duckdb:vortex-compact	731445656 / 718419616 / +1.8%	739133724 / 727985001 / +1.5%	0.99 / 0.99 / +0.3%
statpopgen_q10/duckdb:vortex-compact	2016647041 / 2012658456 / +0.2%	1991076586 / 1979495494 / +0.6%	1.01 / 1.02 / -0.4%

duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	248164304 / 248411829 / -0.1%	245829964 / 246568551 / -0.3%	1.01 / 1.01 / +0.2%
statpopgen_q01/duckdb:parquet	307063912 / 305048054 / +0.7%	309999975 / 308171965 / +0.6%	0.99 / 0.99 / +0.1%
statpopgen_q02/duckdb:parquet	548956947 / 556179037 / -1.3%	561092567 / 560647665 / +0.1%	0.98 / 0.99 / -1.4%
statpopgen_q03/duckdb:parquet	819980410 / 858851708 / -4.5%	862233360 / 851108871 / +1.3%	0.95 / 1.01 / -5.8%
statpopgen_q04/duckdb:parquet	839305896 / 878857296 / -4.5%	829117060 / 904726113 / -8.4%	1.01 / 0.97 / +4.2%
statpopgen_q05/duckdb:parquet	577901404 / 601734950 / -4.0%	583851881 / 611016600 / -4.4%	0.99 / 0.98 / +0.5%
statpopgen_q06/duckdb:parquet	731754880 / 728488662 / +0.4%	728954308 / 697373757 / +4.5%	1.00 / 1.04 / -3.9%
statpopgen_q07/duckdb:parquet	612089554 / 613859974 / -0.3%	658842425 / 720025880 / -8.5%	0.93 / 0.85 / +9.0%
statpopgen_q08/duckdb:parquet	624969180 / 620958744 / +0.6%	682890079 / 720960846 / -5.3%	0.92 / 0.86 / +6.3%
statpopgen_q09/duckdb:parquet	845415570 / 809144577 / +4.5%	866186569 / 817800758 / +5.9%	0.98 / 0.99 / -1.4%
statpopgen_q10/duckdb:parquet	1404364912 / 1465541032 / -4.2%	1316516254 / 1232648577 / +6.8%	1.07 / 1.19 / -10.3%

No file size changes detected.

github-actions · 2026-09-10T16:23:48Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 1.010x ➖
Parquet (geomean): hot 1.008x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1236802 / 1243191 / -0.5%	20295918 / 20874007 / -2.8%	0.06 / 0.06 / +2.3%
clickbench_q01/datafusion:vortex-file-compressed	6887132 / 6976986 / -1.3%	34209254 / 33818214 / +1.2%	0.20 / 0.21 / -2.4%
clickbench_q02/datafusion:vortex-file-compressed	12910674 / 13148246 / -1.8%	42555672 / 36738463 / +15.8% 🔴	0.30 / 0.36 / -15.2%
clickbench_q03/datafusion:vortex-file-compressed	12957742 / 12851998 / +0.8%	50671255 / 51811288 / -2.2%	0.26 / 0.25 / +3.1%
clickbench_q04/datafusion:vortex-file-compressed	59336883 / 58956222 / +0.6%	90419899 / 90156404 / +0.3%	0.66 / 0.65 / +0.4%
clickbench_q05/datafusion:vortex-file-compressed	76715412 / 78907730 / -2.8%	114717115 / 113313759 / +1.2%	0.67 / 0.70 / -4.0%
clickbench_q06/datafusion:vortex-file-compressed	1220246 / 1253762 / -2.7%	20836959 / 20177436 / +3.3%	0.06 / 0.06 / -5.8%
clickbench_q07/datafusion:vortex-file-compressed	13350377 / 13564107 / -1.6%	40157096 / 39252839 / +2.3%	0.33 / 0.35 / -3.8%
clickbench_q08/datafusion:vortex-file-compressed	80945232 / 81435279 / -0.6%	116540435 / 122948447 / -5.2%	0.69 / 0.66 / +4.9%
clickbench_q09/datafusion:vortex-file-compressed	175068786 / 174834170 / +0.1%	211358222 / 199574498 / +5.9%	0.83 / 0.88 / -5.4%
clickbench_q10/datafusion:vortex-file-compressed	40753808 / 41315072 / -1.4%	70350461 / 68116241 / +3.3%	0.58 / 0.61 / -4.5%
clickbench_q11/datafusion:vortex-file-compressed	53583002 / 53777240 / -0.4%	80122622 / 78990147 / +1.4%	0.67 / 0.68 / -1.8%
clickbench_q12/datafusion:vortex-file-compressed	76254434 / 74711444 / +2.1%	119089966 / 113782006 / +4.7%	0.64 / 0.66 / -2.5%
clickbench_q13/datafusion:vortex-file-compressed	124117233 / 124134486 / -0.0%	177280330 / 173964636 / +1.9%	0.70 / 0.71 / -1.9%
clickbench_q14/datafusion:vortex-file-compressed	86801618 / 87633599 / -0.9%	122980033 / 117130329 / +5.0%	0.71 / 0.75 / -5.7%
clickbench_q15/datafusion:vortex-file-compressed	62128812 / 63572990 / -2.3%	94495034 / 97763589 / -3.3%	0.66 / 0.65 / +1.1%
clickbench_q16/datafusion:vortex-file-compressed	158744318 / 154334448 / +2.9%	201385316 / 197596963 / +1.9%	0.79 / 0.78 / +0.9%
clickbench_q17/datafusion:vortex-file-compressed	156533234 / 153350107 / +2.1%	210791661 / 206505058 / +2.1%	0.74 / 0.74 / -0.0%
clickbench_q18/datafusion:vortex-file-compressed	302981814 / 304230124 / -0.4%	366379306 / 374304078 / -2.1%	0.83 / 0.81 / +1.7%
clickbench_q19/datafusion:vortex-file-compressed	9094989 / 8251780 / +10.2% 🔴	45184403 / 45906727 / -1.6%	0.20 / 0.18 / +12.0%
clickbench_q20/datafusion:vortex-file-compressed	68345972 / 67497938 / +1.3%	237140157 / 229927441 / +3.1%	0.29 / 0.29 / -1.8%
clickbench_q21/datafusion:vortex-file-compressed	98077332 / 99391726 / -1.3%	266933336 / 266821490 / +0.0%	0.37 / 0.37 / -1.4%
clickbench_q22/datafusion:vortex-file-compressed	119898496 / 121193084 / -1.1%	339940671 / 341585161 / -0.5%	0.35 / 0.35 / -0.6%
clickbench_q23/datafusion:vortex-file-compressed	389901210 / 367047774 / +6.2%	676279389 / 590562050 / +14.5% 🔴	0.58 / 0.62 / -7.2%
clickbench_q24/datafusion:vortex-file-compressed	20613756 / 21351072 / -3.5%	62258565 / 61219888 / +1.7%	0.33 / 0.35 / -5.1%
clickbench_q25/datafusion:vortex-file-compressed	26583708 / 26741582 / -0.6%	61692723 / 60416733 / +2.1%	0.43 / 0.44 / -2.6%
clickbench_q26/datafusion:vortex-file-compressed	21758827 / 21433830 / +1.5%	62221898 / 61332078 / +1.5%	0.35 / 0.35 / +0.1%
clickbench_q27/datafusion:vortex-file-compressed	101335194 / 101750792 / -0.4%	245395361 / 244078117 / +0.5%	0.41 / 0.42 / -0.9%
clickbench_q28/datafusion:vortex-file-compressed	567089111 / 573163810 / -1.1%	619461184 / 613204724 / +1.0%	0.92 / 0.93 / -2.1%
clickbench_q29/datafusion:vortex-file-compressed	25179632 / 24092833 / +4.5%	50564207 / 50392940 / +0.3%	0.50 / 0.48 / +4.2%
clickbench_q30/datafusion:vortex-file-compressed	86773758 / 88140740 / -1.6%	120056531 / 120069108 / -0.0%	0.72 / 0.73 / -1.5%
clickbench_q31/datafusion:vortex-file-compressed	82738808 / 83222362 / -0.6%	148191799 / 147516604 / +0.5%	0.56 / 0.56 / -1.0%
clickbench_q32/datafusion:vortex-file-compressed	301596595 / 297927711 / +1.2%	372065227 / 372529729 / -0.1%	0.81 / 0.80 / +1.4%
clickbench_q33/datafusion:vortex-file-compressed	338554378 / 336356262 / +0.7%	413694432 / 414009863 / -0.1%	0.82 / 0.81 / +0.7%
clickbench_q34/datafusion:vortex-file-compressed	337770277 / 342160723 / -1.3%	414303264 / 409073110 / +1.3%	0.82 / 0.84 / -2.5%
clickbench_q35/datafusion:vortex-file-compressed	57481844 / 56325133 / +2.1%	90519066 / 86298344 / +4.9%	0.64 / 0.65 / -2.7%
clickbench_q36/datafusion:vortex-file-compressed	37719294 / 37695388 / +0.1%	66741824 / 66071238 / +1.0%	0.57 / 0.57 / -0.9%
clickbench_q37/datafusion:vortex-file-compressed	22475372 / 22331992 / +0.6%	48339785 / 46506997 / +3.9%	0.46 / 0.48 / -3.2%
clickbench_q38/datafusion:vortex-file-compressed	12621466 / 12329254 / +2.4%	39287640 / 38967532 / +0.8%	0.32 / 0.32 / +1.5%
clickbench_q39/datafusion:vortex-file-compressed	78914772 / 78939155 / -0.0%	109813446 / 110923697 / -1.0%	0.72 / 0.71 / +1.0%
clickbench_q40/datafusion:vortex-file-compressed	11250414 / 11454506 / -1.8%	37272404 / 36537763 / +2.0%	0.30 / 0.31 / -3.7%
clickbench_q41/datafusion:vortex-file-compressed	11083472 / 10559954 / +5.0%	35599808 / 34815069 / +2.3%	0.31 / 0.30 / +2.6%
clickbench_q42/datafusion:vortex-file-compressed	11374807 / 11289967 / +0.8%	35956177 / 36169405 / -0.6%	0.32 / 0.31 / +1.3%

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact	1228640 / `1233142` / -0.4%	20506770 / 20136831 / +1.8%	0.06 / 0.06 / -2.2%
clickbench_q01/datafusion:vortex-compact	7277775 / 7348732 / -1.0%	34515521 / 31675397 / +9.0%	0.21 / 0.23 / -9.1%
clickbench_q02/datafusion:vortex-compact	20322632 / 20132601 / +0.9%	42701628 / 43385369 / -1.6%	0.48 / 0.46 / +2.6%
clickbench_q03/datafusion:vortex-compact	14173069 / 13820358 / +2.6%	40426505 / 38898996 / +3.9%	0.35 / 0.36 / -1.3%
clickbench_q04/datafusion:vortex-compact	56360809 / 56852540 / -0.9%	85095877 / 84696190 / +0.5%	0.66 / 0.67 / -1.3%
clickbench_q05/datafusion:vortex-compact	82364626 / 84055774 / -2.0%	114509343 / 113930111 / +0.5%	0.72 / 0.74 / -2.5%
clickbench_q06/datafusion:vortex-compact	1266234 / 1242070 / +1.9%	19978697 / 19503562 / +2.4%	0.06 / 0.06 / -0.5%
clickbench_q07/datafusion:vortex-compact	12418403 / 12136494 / +2.3%	34344534 / 36258698 / -5.3%	0.36 / 0.33 / +8.0%
clickbench_q08/datafusion:vortex-compact	87073730 / 87923946 / -1.0%	116924201 / 113725924 / +2.8%	0.74 / 0.77 / -3.7%
clickbench_q09/datafusion:vortex-compact	197442132 / 192258762 / +2.7%	219938263 / 216451430 / +1.6%	0.90 / 0.89 / +1.1%
clickbench_q10/datafusion:vortex-compact	43624812 / 43050506 / +1.3%	68926131 / 70397176 / -2.1%	0.63 / 0.61 / +3.5%
clickbench_q11/datafusion:vortex-compact	55726720 / 56885252 / -2.0%	80106058 / 82950868 / -3.4%	0.70 / 0.69 / +1.4%
clickbench_q12/datafusion:vortex-compact	85986470 / 84234939 / +2.1%	117260638 / 118553143 / -1.1%	0.73 / 0.71 / +3.2%
clickbench_q13/datafusion:vortex-compact	134182410 / 137314113 / -2.3%	174274672 / 178069515 / -2.1%	0.77 / 0.77 / -0.2%
clickbench_q14/datafusion:vortex-compact	93345580 / 93019212 / +0.4%	127123161 / 128353923 / -1.0%	0.73 / 0.72 / +1.3%
clickbench_q15/datafusion:vortex-compact	62861690 / 62782638 / +0.1%	97546745 / 90658820 / +7.6%	0.64 / 0.69 / -6.9%
clickbench_q16/datafusion:vortex-compact	162686867 / 165695814 / -1.8%	211833687 / 204555292 / +3.6%	0.77 / 0.81 / -5.2%
clickbench_q17/datafusion:vortex-compact	166989504 / 162382458 / +2.8%	215039126 / 210080240 / +2.4%	0.78 / 0.77 / +0.5%
clickbench_q18/datafusion:vortex-compact	301305406 / 303384546 / -0.7%	356696502 / 354650633 / +0.6%	0.84 / 0.86 / -1.3%
clickbench_q19/datafusion:vortex-compact	10403220 / 11541202 / -9.9%	36742232 / 37043893 / -0.8%	0.28 / 0.31 / -9.1%
clickbench_q20/datafusion:vortex-compact	75326058 / 74212936 / +1.5%	191164744 / 189802264 / +0.7%	0.39 / 0.39 / +0.8%
clickbench_q21/datafusion:vortex-compact	119273794 / 117448974 / +1.6%	227106679 / 224613439 / +1.1%	0.53 / 0.52 / +0.4%
clickbench_q22/datafusion:vortex-compact	185626461 / 184442056 / +0.6%	272703965 / 269670583 / +1.1%	0.68 / 0.68 / -0.5%
clickbench_q23/datafusion:vortex-compact	564514386 / 536559753 / +5.2%	664775687 / 640931445 / +3.7%	0.85 / 0.84 / +1.4%
clickbench_q24/datafusion:vortex-compact	28110216 / 28570158 / -1.6%	58668102 / 56708480 / +3.5%	0.48 / 0.50 / -4.9%
clickbench_q25/datafusion:vortex-compact	35644980 / 35500622 / +0.4%	63023699 / 64632062 / -2.5%	0.57 / 0.55 / +3.0%
clickbench_q26/datafusion:vortex-compact	29531668 / 27997460 / +5.5%	58273790 / 60468425 / -3.6%	0.51 / 0.46 / +9.5%
clickbench_q27/datafusion:vortex-compact	102630050 / 104170979 / -1.5%	209957920 / 205858419 / +2.0%	0.49 / 0.51 / -3.4%
clickbench_q28/datafusion:vortex-compact	577811875 / 576227670 / +0.3%	629011340 / 618691227 / +1.7%	0.92 / 0.93 / -1.4%
clickbench_q29/datafusion:vortex-compact	30609262 / 30429890 / +0.6%	55525479 / 53896974 / +3.0%	0.55 / 0.56 / -2.4%
clickbench_q30/datafusion:vortex-compact	94538566 / 93676760 / +0.9%	125562718 / 118748714 / +5.7%	0.75 / 0.79 / -4.6%
clickbench_q31/datafusion:vortex-compact	101997166 / 99050350 / +3.0%	148204074 / 147333109 / +0.6%	0.69 / 0.67 / +2.4%
clickbench_q32/datafusion:vortex-compact	301893476 / 295311128 / +2.2%	365856743 / 368978972 / -0.8%	0.83 / 0.80 / +3.1%
clickbench_q33/datafusion:vortex-compact	344921805 / 340794270 / +1.2%	404457159 / 403658785 / +0.2%	0.85 / 0.84 / +1.0%
clickbench_q34/datafusion:vortex-compact	337088252 / 340645282 / -1.0%	401393532 / 424749647 / -5.5%	0.84 / 0.80 / +4.7%
clickbench_q35/datafusion:vortex-compact	61195876 / 62536125 / -2.1%	93301329 / 90981099 / +2.6%	0.66 / 0.69 / -4.6%
clickbench_q36/datafusion:vortex-compact	38096202 / 38086234 / +0.0%	65846862 / 64925256 / +1.4%	0.58 / 0.59 / -1.4%
clickbench_q37/datafusion:vortex-compact	23037020 / 22854766 / +0.8%	47133621 / 45768353 / +3.0%	0.49 / 0.50 / -2.1%
clickbench_q38/datafusion:vortex-compact	12845123 / 12390806 / +3.7%	40474571 / 38812786 / +4.3%	0.32 / 0.32 / -0.6%
clickbench_q39/datafusion:vortex-compact	79275868 / 79469172 / -0.2%	109597651 / 107743723 / +1.7%	0.72 / 0.74 / -1.9%
clickbench_q40/datafusion:vortex-compact	12410192 / 12554248 / -1.1%	37193988 / 35017363 / +6.2%	0.33 / 0.36 / -6.9%
clickbench_q41/datafusion:vortex-compact	12926370 / 13004511 / -0.6%	36829153 / 35787387 / +2.9%	0.35 / 0.36 / -3.4%
clickbench_q42/datafusion:vortex-compact	11051936 / 11186518 / -1.2%	34928307 / 33981386 / +2.8%	0.32 / 0.33 / -3.9%

datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1243270 / 1257518 / -1.1%	49265534 / 46874260 / +5.1%	0.03 / 0.03 / -5.9%
clickbench_q01/datafusion:parquet	15862679 / 15724920 / +0.9%	69027379 / 65709885 / +5.0%	0.23 / 0.24 / -4.0%
clickbench_q02/datafusion:parquet	18684417 / 18507574 / +1.0%	82395864 / 79245040 / +4.0%	0.23 / 0.23 / -2.9%
clickbench_q03/datafusion:parquet	16935454 / 16478013 / +2.8%	81677447 / 78387919 / +4.2%	0.21 / 0.21 / -1.4%
clickbench_q04/datafusion:parquet	62499957 / 61336272 / +1.9%	128751197 / 123880092 / +3.9%	0.49 / 0.50 / -2.0%
clickbench_q05/datafusion:parquet	87012342 / 86482437 / +0.6%	155210727 / 151725449 / +2.3%	0.56 / 0.57 / -1.6%
clickbench_q06/datafusion:parquet	1296946 / 1262210 / +2.8%	48675316 / 47685309 / +2.1%	0.03 / 0.03 / +0.7%
clickbench_q07/datafusion:parquet	17082225 / 16828414 / +1.5%	69272093 / 67812787 / +2.2%	0.25 / 0.25 / -0.6%
clickbench_q08/datafusion:parquet	85045620 / 86865429 / -2.1%	160380944 / 153985544 / +4.2%	0.53 / 0.56 / -6.0%
clickbench_q09/datafusion:parquet	183595914 / 182669010 / +0.5%	259443399 / 259268821 / +0.1%	0.71 / 0.70 / +0.4%
clickbench_q10/datafusion:parquet	36268065 / 34533602 / +5.0%	97253989 / 99638896 / -2.4%	0.37 / 0.35 / +7.6%
clickbench_q11/datafusion:parquet	42215768 / 43306306 / -2.5%	107064451 / 106797691 / +0.2%	0.39 / 0.41 / -2.8%
clickbench_q12/datafusion:parquet	94803492 / 93566414 / +1.3%	158237632 / 154845548 / +2.2%	0.60 / 0.60 / -0.8%
clickbench_q13/datafusion:parquet	143659771 / 142773650 / +0.6%	219041426 / 216588819 / +1.1%	0.66 / 0.66 / -0.5%
clickbench_q14/datafusion:parquet	99831918 / 100275896 / -0.4%	171533613 / 166196493 / +3.2%	0.58 / 0.60 / -3.5%
clickbench_q15/datafusion:parquet	70563610 / 69838270 / +1.0%	127686220 / 135563914 / -5.8%	0.55 / 0.52 / +7.3%
clickbench_q16/datafusion:parquet	154111289 / 154081876 / +0.0%	231147784 / 224002816 / +3.2%	0.67 / 0.69 / -3.1%
clickbench_q17/datafusion:parquet	154448069 / 152815014 / +1.1%	229368418 / 230620955 / -0.5%	0.67 / 0.66 / +1.6%
clickbench_q18/datafusion:parquet	310309300 / 313542168 / -1.0%	406284028 / 409404181 / -0.8%	0.76 / 0.77 / -0.3%
clickbench_q19/datafusion:parquet	19468249 / 19472438 / -0.0%	75954644 / 75497480 / +0.6%	0.26 / 0.26 / -0.6%
clickbench_q20/datafusion:parquet	168032714 / 169095132 / -0.6%	278079930 / 276265906 / +0.7%	0.60 / 0.61 / -1.3%
clickbench_q21/datafusion:parquet	164418988 / 164083788 / +0.2%	285829211 / 284860013 / +0.3%	0.58 / 0.58 / -0.1%
clickbench_q22/datafusion:parquet	248640360 / 246202835 / +1.0%	412791542 / 412620780 / +0.0%	0.60 / 0.60 / +0.9%
clickbench_q23/datafusion:parquet	952224763 / 953158650 / -0.1%	1169366097 / 1146579577 / +2.0%	0.81 / 0.83 / -2.0%
clickbench_q24/datafusion:parquet	29479250 / 29596272 / -0.4%	86314406 / 86491340 / -0.2%	0.34 / 0.34 / -0.2%
clickbench_q25/datafusion:parquet	35900700 / 35316224 / +1.7%	98818916 / 97466306 / +1.4%	0.36 / 0.36 / +0.3%
clickbench_q26/datafusion:parquet	30690851 / 30306076 / +1.3%	88465978 / 86762546 / +2.0%	0.35 / 0.35 / -0.7%
clickbench_q27/datafusion:parquet	182106900 / 181163650 / +0.5%	273207846 / 271863970 / +0.5%	0.67 / 0.67 / +0.0%
clickbench_q28/datafusion:parquet	624262046 / 617821494 / +1.0%	693095255 / 692393903 / +0.1%	0.90 / 0.89 / +0.9%
clickbench_q29/datafusion:parquet	29143717 / 28891166 / +0.9%	92351056 / 92370491 / -0.0%	0.32 / 0.31 / +0.9%
clickbench_q30/datafusion:parquet	89234000 / 88794216 / +0.5%	164279897 / 164994834 / -0.4%	0.54 / 0.54 / +0.9%
clickbench_q31/datafusion:parquet	99760226 / 98863684 / +0.9%	185862022 / 186577949 / -0.4%	0.54 / 0.53 / +1.3%
clickbench_q32/datafusion:parquet	309522998 / 310164659 / -0.2%	410546176 / 417532224 / -1.7%	0.75 / 0.74 / +1.5%
clickbench_q33/datafusion:parquet	365705359 / 367294620 / -0.4%	455218375 / 452649653 / +0.6%	0.80 / 0.81 / -1.0%
clickbench_q34/datafusion:parquet	370808498 / 368243512 / +0.7%	459962889 / 449251434 / +2.4%	0.81 / 0.82 / -1.6%
clickbench_q35/datafusion:parquet	64645879 / 62394600 / +3.6%	125162123 / 126037053 / -0.7%	0.52 / 0.50 / +4.3%
clickbench_q36/datafusion:parquet	73012932 / 73013041 / -0.0%	133876372 / 132619744 / +0.9%	0.55 / 0.55 / -0.9%
clickbench_q37/datafusion:parquet	35250424 / 35283903 / -0.1%	90888922 / 90573134 / +0.3%	0.39 / 0.39 / -0.4%
clickbench_q38/datafusion:parquet	46817128 / 47041273 / -0.5%	105824826 / 104946261 / +0.8%	0.44 / 0.45 / -1.3%
clickbench_q39/datafusion:parquet	142811188 / 142193172 / +0.4%	206120301 / 205178573 / +0.5%	0.69 / 0.69 / -0.0%
clickbench_q40/datafusion:parquet	19983838 / 19954505 / +0.1%	76323629 / 75075128 / +1.7%	0.26 / 0.27 / -1.5%
clickbench_q41/datafusion:parquet	18675589 / 18743084 / -0.4%	76863418 / 75822400 / +1.4%	0.24 / 0.25 / -1.7%
clickbench_q42/datafusion:parquet	19251927 / 19148228 / +0.5%	75517956 / 73629969 / +2.6%	0.25 / 0.26 / -2.0%

duckdb / vortex-file-compressed / ns (1.013x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1625511 / 1575776 / +3.2%	25202916 / 24576643 / +2.5%	0.06 / 0.06 / +0.6%
clickbench_q01/duckdb:vortex-file-compressed	13504233 / 14857187 / -9.1%	29254772 / 31337939 / -6.6%	0.46 / 0.47 / -2.6%
clickbench_q02/duckdb:vortex-file-compressed	15302957 / 13776428 / +11.1% 🔴	32068418 / 30090782 / +6.6%	0.48 / 0.46 / +4.2%
clickbench_q03/duckdb:vortex-file-compressed	19543564 / 17963988 / +8.8%	42893229 / 42574771 / +0.7%	0.46 / 0.42 / +8.0%
clickbench_q04/duckdb:vortex-file-compressed	69769272 / 69078642 / +1.0%	99134263 / 99327484 / -0.2%	0.70 / 0.70 / +1.2%
clickbench_q05/duckdb:vortex-file-compressed	69023734 / 69105824 / -0.1%	90397357 / 92760068 / -2.5%	0.76 / 0.74 / +2.5%
clickbench_q06/duckdb:vortex-file-compressed	1818360 / 1921094 / -5.3%	29062041 / 26533553 / +9.5%	0.06 / 0.07 / -13.6%
clickbench_q07/duckdb:vortex-file-compressed	13977498 / 14168752 / -1.3%	30684432 / 32680965 / -6.1%	0.46 / 0.43 / +5.1%
clickbench_q08/duckdb:vortex-file-compressed	84290315 / 85233069 / -1.1%	121270509 / 117935061 / +2.8%	0.70 / 0.72 / -3.8%
clickbench_q09/duckdb:vortex-file-compressed	113562028 / 107456195 / +5.7%	144058560 / 150660522 / -4.4%	0.79 / 0.71 / +10.5%
clickbench_q10/duckdb:vortex-file-compressed	45562090 / 43062429 / +5.8%	73446381 / 71808883 / +2.3%	0.62 / 0.60 / +3.4%
clickbench_q11/duckdb:vortex-file-compressed	57898551 / 57251942 / +1.1%	84213127 / 84681393 / -0.6%	0.69 / 0.68 / +1.7%
clickbench_q12/duckdb:vortex-file-compressed	74277798 / 74197246 / +0.1%	106505731 / 105364869 / +1.1%	0.70 / 0.70 / -1.0%
clickbench_q13/duckdb:vortex-file-compressed	136547581 / 139043746 / -1.8%	178244947 / 176939996 / +0.7%	0.77 / 0.79 / -2.5%
clickbench_q14/duckdb:vortex-file-compressed	89559087 / 83608268 / +7.1%	115451524 / 113256037 / +1.9%	0.78 / 0.74 / +5.1%
clickbench_q15/duckdb:vortex-file-compressed	93101057 / 91422376 / +1.8%	125951570 / 128833243 / -2.2%	0.74 / 0.71 / +4.2%
clickbench_q16/duckdb:vortex-file-compressed	166040162 / 161846774 / +2.6%	208586722 / 215678027 / -3.3%	0.80 / 0.75 / +6.1%
clickbench_q17/duckdb:vortex-file-compressed	164656966 / 163460838 / +0.7%	206272284 / 201417362 / +2.4%	0.80 / 0.81 / -1.6%
clickbench_q18/duckdb:vortex-file-compressed	311537464 / 315122723 / -1.1%	366152384 / 377765740 / -3.1%	0.85 / 0.83 / +2.0%
clickbench_q19/duckdb:vortex-file-compressed	16660478 / 18072269 / -7.8%	37885922 / 36686217 / +3.3%	0.44 / 0.49 / -10.7%
clickbench_q20/duckdb:vortex-file-compressed	128837314 / 128826047 / +0.0%	197774975 / 202834682 / -2.5%	0.65 / 0.64 / +2.6%
clickbench_q21/duckdb:vortex-file-compressed	182947034 / 181944814 / +0.6%	299566449 / 294611812 / +1.7%	0.61 / 0.62 / -1.1%
clickbench_q22/duckdb:vortex-file-compressed	293155204 / 289767043 / +1.2%	472451582 / 469126759 / +0.7%	0.62 / 0.62 / +0.5%
clickbench_q23/duckdb:vortex-file-compressed	70016552 / 72172414 / -3.0%	117246718 / 106717540 / +9.9%	0.60 / 0.68 / -11.7%
clickbench_q24/duckdb:vortex-file-compressed	30691656 / 27545287 / +11.4% 🔴	42460399 / 42277288 / +0.4%	0.72 / 0.65 / +10.9%
clickbench_q25/duckdb:vortex-file-compressed	35616670 / 36588446 / -2.7%	53188749 / 52943814 / +0.5%	0.67 / 0.69 / -3.1%
clickbench_q26/duckdb:vortex-file-compressed	21539468 / 21096519 / +2.1%	33145768 / 36235426 / -8.5%	0.65 / 0.58 / +11.6%
clickbench_q27/duckdb:vortex-file-compressed	172010659 / 175028420 / -1.7%	268605126 / 254537799 / +5.5%	0.64 / 0.69 / -6.9%
clickbench_q28/duckdb:vortex-file-compressed	590250461 / 664117696 / -11.1% 🟢	683857854 / 693299856 / -1.4%	0.86 / 0.96 / -9.9%
clickbench_q29/duckdb:vortex-file-compressed	19348846 / 17779314 / +8.8%	40694686 / 39994595 / +1.8%	0.48 / 0.44 / +7.0%
clickbench_q30/duckdb:vortex-file-compressed	93220036 / 92782912 / +0.5%	137196408 / 122350494 / +12.1% 🔴	0.68 / 0.76 / -10.4%
clickbench_q31/duckdb:vortex-file-compressed	143850444 / 139454938 / +3.2%	189927754 / 205510978 / -7.6%	0.76 / 0.68 / +11.6%
clickbench_q32/duckdb:vortex-file-compressed	455713667 / 445759652 / +2.2%	496577644 / 489480518 / +1.4%	0.92 / 0.91 / +0.8%
clickbench_q33/duckdb:vortex-file-compressed	414107928 / 402254419 / +2.9%	507899672 / 502030632 / +1.2%	0.82 / 0.80 / +1.8%
clickbench_q34/duckdb:vortex-file-compressed	413547370 / 428482699 / -3.5%	526030023 / 552322936 / -4.8%	0.79 / 0.78 / +1.3%
clickbench_q35/duckdb:vortex-file-compressed	104185283 / 105372430 / -1.1%	134299793 / 136188064 / -1.4%	0.78 / 0.77 / +0.3%
clickbench_q36/duckdb:vortex-file-compressed	19330176 / 18052323 / +7.1%	34676305 / 34328492 / +1.0%	0.56 / 0.53 / +6.0%
clickbench_q37/duckdb:vortex-file-compressed	13503886 / 13201092 / +2.3%	30190032 / 28227485 / +7.0%	0.45 / 0.47 / -4.4%
clickbench_q38/duckdb:vortex-file-compressed	14792326 / 14437720 / +2.5%	32528793 / 28856373 / +12.7% 🔴	0.45 / 0.50 / -9.1%
clickbench_q39/duckdb:vortex-file-compressed	26944106 / 26355386 / +2.2%	42233384 / 42532294 / -0.7%	0.64 / 0.62 / +3.0%
clickbench_q40/duckdb:vortex-file-compressed	11978930 / 11930903 / +0.4%	27247367 / 31618258 / -13.8% 🟢	0.44 / 0.38 / +16.5%
clickbench_q41/duckdb:vortex-file-compressed	13790986 / 12281722 / +12.3% 🔴	27783839 / 28594701 / -2.8%	0.50 / 0.43 / +15.6%
clickbench_q42/duckdb:vortex-file-compressed	13188865 / 12644922 / +4.3%	30483718 / 28939422 / +5.3%	0.43 / 0.44 / -1.0%

duckdb / vortex-compact / ns (1.013x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact	1634370 / 1527660 / +7.0%	22167711 / 26360652 / -15.9% 🟢	0.07 / 0.06 / +27.2%
clickbench_q01/duckdb:vortex-compact	12453225 / 14483382 / -14.0% 🟢	27778286 / 31246167 / -11.1% 🟢	0.45 / 0.46 / -3.3%
clickbench_q02/duckdb:vortex-compact	19537216 / 20033532 / -2.5%	39465512 / 39331970 / +0.3%	0.50 / 0.51 / -2.8%
clickbench_q03/duckdb:vortex-compact	20056933 / 19853588 / +1.0%	43196028 / 41571589 / +3.9%	0.46 / 0.48 / -2.8%
clickbench_q04/duckdb:vortex-compact	72446814 / 72324176 / +0.2%	107549305 / 98837506 / +8.8%	0.67 / 0.73 / -7.9%
clickbench_q05/duckdb:vortex-compact	76453392 / 77013744 / -0.7%	100984987 / 96581612 / +4.6%	0.76 / 0.80 / -5.1%
clickbench_q06/duckdb:vortex-compact	1867179 / 1784310 / +4.6%	33386283 / 28709167 / +16.3% 🔴	0.06 / 0.06 / -10.0%
clickbench_q07/duckdb:vortex-compact	14592245 / 14319177 / +1.9%	33697128 / 30142289 / +11.8% 🔴	0.43 / 0.48 / -8.8%
clickbench_q08/duckdb:vortex-compact	96984594 / 94727145 / +2.4%	127871168 / 127254013 / +0.5%	0.76 / 0.74 / +1.9%
clickbench_q09/duckdb:vortex-compact	144488059 / 144412126 / +0.1%	179035000 / 195884230 / -8.6%	0.81 / 0.74 / +9.5%
clickbench_q10/duckdb:vortex-compact	52650746 / 52250672 / +0.8%	85119486 / 84806200 / +0.4%	0.62 / 0.62 / +0.4%
clickbench_q11/duckdb:vortex-compact	67808048 / 65436822 / +3.6%	101341055 / 108571382 / -6.7%	0.67 / 0.60 / +11.0%
clickbench_q12/duckdb:vortex-compact	90893185 / 85389257 / +6.4%	119537218 / 120140755 / -0.5%	0.76 / 0.71 / +7.0%
clickbench_q13/duckdb:vortex-compact	170005664 / 165610647 / +2.7%	203523518 / 202106144 / +0.7%	0.84 / 0.82 / +1.9%
clickbench_q14/duckdb:vortex-compact	99999382 / 99137457 / +0.9%	131675817 / 130278069 / +1.1%	0.76 / 0.76 / -0.2%
clickbench_q15/duckdb:vortex-compact	95905586 / 95674250 / +0.2%	132830364 / 128050930 / +3.7%	0.72 / 0.75 / -3.4%
clickbench_q16/duckdb:vortex-compact	178667036 / 176426525 / +1.3%	222130396 / 222386376 / -0.1%	0.80 / 0.79 / +1.4%
clickbench_q17/duckdb:vortex-compact	182760869 / 181879105 / +0.5%	216656827 / 220731294 / -1.8%	0.84 / 0.82 / +2.4%
clickbench_q18/duckdb:vortex-compact	325885173 / 321058942 / +1.5%	375116599 / 373055973 / +0.6%	0.87 / 0.86 / +0.9%
clickbench_q19/duckdb:vortex-compact	18398936 / 18240268 / +0.9%	38729206 / 39120675 / -1.0%	0.48 / 0.47 / +1.9%
clickbench_q20/duckdb:vortex-compact	114956550 / 111619241 / +3.0%	178271759 / 171053086 / +4.2%	0.64 / 0.65 / -1.2%
clickbench_q21/duckdb:vortex-compact	188368116 / 187642316 / +0.4%	321224569 / 314617735 / +2.1%	0.59 / 0.60 / -1.7%
clickbench_q22/duckdb:vortex-compact	389528768 / 388790866 / +0.2%	584826697 / 574511129 / +1.8%	0.67 / 0.68 / -1.6%
clickbench_q23/duckdb:vortex-compact	98995711 / 98525525 / +0.5%	134318985 / 130845978 / +2.7%	0.74 / 0.75 / -2.1%
clickbench_q24/duckdb:vortex-compact	31297839 / 29374674 / +6.5%	44254267 / 42969047 / +3.0%	0.71 / 0.68 / +3.5%
clickbench_q25/duckdb:vortex-compact	47843677 / 47689240 / +0.3%	64276507 / 68950098 / -6.8%	0.74 / 0.69 / +7.6%
clickbench_q26/duckdb:vortex-compact	23534094 / 24560092 / -4.2%	38653861 / 34064375 / +13.5% 🔴	0.61 / 0.72 / -15.6%
clickbench_q27/duckdb:vortex-compact	218043178 / 204571836 / +6.6%	316645070 / 315098717 / +0.5%	0.69 / 0.65 / +6.1%
clickbench_q28/duckdb:vortex-compact	595613634 / 584172465 / +2.0%	696756131 / 690383041 / +0.9%	0.85 / 0.85 / +1.0%
clickbench_q29/duckdb:vortex-compact	24178885 / 23513090 / +2.8%	48488614 / 45355571 / +6.9%	0.50 / 0.52 / -3.8%
clickbench_q30/duckdb:vortex-compact	114974452 / 113182611 / +1.6%	147568940 / 150359342 / -1.9%	0.78 / 0.75 / +3.5%
clickbench_q31/duckdb:vortex-compact	171782656 / 170777760 / +0.6%	248129159 / 240514572 / +3.2%	0.69 / 0.71 / -2.5%
clickbench_q32/duckdb:vortex-compact	472892508 / 463645369 / +2.0%	509323849 / 517841964 / -1.6%	0.93 / 0.90 / +3.7%
clickbench_q33/duckdb:vortex-compact	403106402 / 407505458 / -1.1%	525654326 / 499133453 / +5.3%	0.77 / 0.82 / -6.1%
clickbench_q34/duckdb:vortex-compact	419003311 / 421133140 / -0.5%	537666312 / 530360816 / +1.4%	0.78 / 0.79 / -1.9%
clickbench_q35/duckdb:vortex-compact	107853925 / 107099526 / +0.7%	135237575 / 137293473 / -1.5%	0.80 / 0.78 / +2.2%
clickbench_q36/duckdb:vortex-compact	17435480 / 17463110 / -0.2%	32671091 / 32828047 / -0.5%	0.53 / 0.53 / +0.3%
clickbench_q37/duckdb:vortex-compact	14172699 / 14914822 / -5.0%	30718745 / 27975004 / +9.8%	0.46 / 0.53 / -13.5%
clickbench_q38/duckdb:vortex-compact	15404766 / 13799346 / +11.6% 🔴	26476551 / 29521181 / -10.3% 🟢	0.58 / 0.47 / +24.5%
clickbench_q39/duckdb:vortex-compact	27866084 / 26781132 / +4.1%	44665891 / 46390713 / -3.7%	0.62 / 0.58 / +8.1%
clickbench_q40/duckdb:vortex-compact	13391682 / 13037961 / +2.7%	30491158 / 26860616 / +13.5% 🔴	0.44 / 0.49 / -9.5%
clickbench_q41/duckdb:vortex-compact	13671627 / 14579438 / -6.2%	31964067 / 30883760 / +3.5%	0.43 / 0.47 / -9.4%
clickbench_q42/duckdb:vortex-compact	13927089 / 12464154 / +11.7% 🔴	26309116 / 27433584 / -4.1%	0.53 / 0.45 / +16.5%

duckdb / parquet / ns (1.010x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	8057224 / 8733477 / -7.7%	22240771 / 21352784 / +4.2%	0.36 / 0.41 / -11.4%
clickbench_q01/duckdb:parquet	9987186 / 9582976 / +4.2%	22231024 / 18758684 / +18.5% 🔴	0.45 / 0.51 / -12.1%
clickbench_q02/duckdb:parquet	17734816 / 17382938 / +2.0%	30919608 / 31815640 / -2.8%	0.57 / 0.55 / +5.0%
clickbench_q03/duckdb:parquet	15967040 / 15427755 / +3.5%	49839817 / 53233974 / -6.4%	0.32 / 0.29 / +10.5%
clickbench_q04/duckdb:parquet	70587918 / 70532149 / +0.1%	96208713 / 93655288 / +2.7%	0.73 / 0.75 / -2.6%
clickbench_q05/duckdb:parquet	81633444 / 81302231 / +0.4%	115764384 / 120429863 / -3.9%	0.71 / 0.68 / +4.5%
clickbench_q06/duckdb:parquet	18173906 / 15150968 / +20.0% 🔴	22615737 / 25962074 / -12.9% 🟢	0.80 / 0.58 / +37.7%
clickbench_q07/duckdb:parquet	11529920 / 11319440 / +1.9%	21596979 / 22878221 / -5.6%	0.53 / 0.49 / +7.9%
clickbench_q08/duckdb:parquet	84081288 / 82973770 / +1.3%	123604106 / 125987363 / -1.9%	0.68 / 0.66 / +3.3%
clickbench_q09/duckdb:parquet	117992834 / 114825994 / +2.8%	157113937 / 153685138 / +2.2%	0.75 / 0.75 / +0.5%
clickbench_q10/duckdb:parquet	32893888 / 32377358 / +1.6%	68298091 / 67697619 / +0.9%	0.48 / 0.48 / +0.7%
clickbench_q11/duckdb:parquet	37227062 / 36777558 / +1.2%	77424628 / 78281012 / -1.1%	0.48 / 0.47 / +2.3%
clickbench_q12/duckdb:parquet	92675216 / 90437761 / +2.5%	132848950 / 127302654 / +4.4%	0.70 / 0.71 / -1.8%
clickbench_q13/duckdb:parquet	143919824 / 150070184 / -4.1%	212690385 / 206880296 / +2.8%	0.68 / 0.73 / -6.7%
clickbench_q14/duckdb:parquet	98925890 / 95436437 / +3.7%	145127577 / 141315262 / +2.7%	0.68 / 0.68 / +0.9%
clickbench_q15/duckdb:parquet	92710954 / 91825673 / +1.0%	118553440 / 120321257 / -1.5%	0.78 / 0.76 / +2.5%
clickbench_q16/duckdb:parquet	172809348 / 167915486 / +2.9%	228920763 / 219641273 / +4.2%	0.75 / 0.76 / -1.3%
clickbench_q17/duckdb:parquet	176968946 / 175875986 / +0.6%	234593323 / 231350032 / +1.4%	0.75 / 0.76 / -0.8%
clickbench_q18/duckdb:parquet	322980290 / 315963816 / +2.2%	396069358 / 395787494 / +0.1%	0.82 / 0.80 / +2.1%
clickbench_q19/duckdb:parquet	13697370 / 13356283 / +2.6%	38987839 / 42430865 / -8.1%	0.35 / 0.31 / +11.6%
clickbench_q20/duckdb:parquet	141225796 / 132292882 / +6.8%	242976303 / 248939521 / -2.4%	0.58 / 0.53 / +9.4%
clickbench_q21/duckdb:parquet	178287356 / 182631217 / -2.4%	328249735 / 321568085 / +2.1%	0.54 / 0.57 / -4.4%
clickbench_q22/duckdb:parquet	235752078 / 231480039 / +1.8%	406848068 / 416183415 / -2.2%	0.58 / 0.56 / +4.2%
clickbench_q23/duckdb:parquet	145827778 / 143702278 / +1.5%	162095742 / 164482482 / -1.5%	0.90 / 0.87 / +3.0%
clickbench_q24/duckdb:parquet	43505512 / 43468535 / +0.1%	61396298 / 62062342 / -1.1%	0.71 / 0.70 / +1.2%
clickbench_q25/duckdb:parquet	40949010 / 38875755 / +5.3%	88519161 / 89106901 / -0.7%	0.46 / 0.44 / +6.0%
clickbench_q26/duckdb:parquet	30200096 / 30290264 / -0.3%	47649393 / 46897180 / +1.6%	0.63 / 0.65 / -1.9%
clickbench_q27/duckdb:parquet	148852208 / 145211336 / +2.5%	258748895 / 254779247 / +1.6%	0.58 / 0.57 / +0.9%
clickbench_q28/duckdb:parquet	898286777 / 900779216 / -0.3%	1001183854 / 995131299 / +0.6%	0.90 / 0.91 / -0.9%
clickbench_q29/duckdb:parquet	17340444 / 16817382 / +3.1%	33011200 / 32093300 / +2.9%	0.53 / 0.52 / +0.2%
clickbench_q30/duckdb:parquet	91819004 / 92692997 / -0.9%	172271894 / 177299718 / -2.8%	0.53 / 0.52 / +1.9%
clickbench_q31/duckdb:parquet	142502480 / 144179368 / -1.2%	287143600 / 264172528 / +8.7%	0.50 / 0.55 / -9.1%
clickbench_q32/duckdb:parquet	440780108 / 442214518 / -0.3%	489369933 / 487992121 / +0.3%	0.90 / 0.91 / -0.6%
clickbench_q33/duckdb:parquet	448675601 / 435773118 / +3.0%	470135167 / 501906000 / -6.3%	0.95 / 0.87 / +9.9%
clickbench_q34/duckdb:parquet	441141889 / 453263632 / -2.7%	500623993 / 462578212 / +8.2%	0.88 / 0.98 / -10.1%
clickbench_q35/duckdb:parquet	101518302 / 101393077 / +0.1%	125456255 / 117370446 / +6.9%	0.81 / 0.86 / -6.3%
clickbench_q36/duckdb:parquet	31090526 / 31371456 / -0.9%	41787292 / 41446620 / +0.8%	0.74 / 0.76 / -1.7%
clickbench_q37/duckdb:parquet	23027162 / 23407894 / -1.6%	32798051 / 31723270 / +3.4%	0.70 / 0.74 / -4.9%
clickbench_q38/duckdb:parquet	23596758 / 24475215 / -3.6%	35319631 / 34181443 / +3.3%	0.67 / 0.72 / -6.7%
clickbench_q39/duckdb:parquet	56399799 / 56382775 / +0.0%	67269411 / 66191346 / +1.6%	0.84 / 0.85 / -1.6%
clickbench_q40/duckdb:parquet	12725502 / 12584279 / +1.1%	23337150 / 22401832 / +4.2%	0.55 / 0.56 / -2.9%
clickbench_q41/duckdb:parquet	12132530 / 12807372 / -5.3%	23672154 / 21866423 / +8.3%	0.51 / 0.59 / -12.5%
clickbench_q42/duckdb:parquet	14438734 / 14515372 / -0.5%	25680739 / 24918000 / +3.1%	0.56 / 0.58 / -3.5%

No file size changes detected.

github-actions · 2026-09-10T16:24:18Z

Benchmarks: FineWeb S3 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +15.6%
Engines: DataFusion No clear signal (+20.0%, environment too noisy confidence) · DuckDB No clear signal (+11.4%, environment too noisy confidence)
Vortex (geomean): hot 1.059x ➖ · cold 1.080x ➖
Parquet (geomean): hot 0.916x ➖ · cold 0.913x ➖
Shifts: Parquet (control) -8.4% · Median polish +0.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	64340080 / 41060010 / +56.7% 🔴	148255471 / 127533180 / +16.2%	0.43 / 0.32 / +34.8%
fineweb_q01/datafusion:vortex-file-compressed	375551038 / 383104315 / -2.0%	757927085 / 711010383 / +6.6%	0.50 / 0.54 / -8.0%
fineweb_q02/datafusion:vortex-file-compressed	385436784 / 369375646 / +4.3%	539233767 / 459178863 / +17.4%	0.71 / 0.80 / -11.1%
fineweb_q03/datafusion:vortex-file-compressed	462136589 / 487320332 / -5.2%	789371922 / 773082758 / +2.1%	0.59 / 0.63 / -7.1%
fineweb_q04/datafusion:vortex-file-compressed	407689696 / 718081092 / -43.2% 🟢	439973448 / 661551160 / -33.5% 🟢	0.93 / 1.09 / -14.6%
fineweb_q05/datafusion:vortex-file-compressed	610021834 / 500878660 / +21.8%	596642910 / 597125424 / -0.1%	1.02 / 0.84 / +21.9%
fineweb_q06/datafusion:vortex-file-compressed	686058718 / 829910226 / -17.3%	751963327 / 970594744 / -22.5%	0.91 / 0.86 / +6.7%
fineweb_q07/datafusion:vortex-file-compressed	478305440 / 495528156 / -3.5%	451668835 / 473089846 / -4.5%	1.06 / 1.05 / +1.1%
fineweb_q08/datafusion:vortex-file-compressed	217255539 / 185637916 / +17.0%	255190056 / 197203537 / +29.4%	0.85 / 0.94 / -9.6%

datafusion / vortex-compact / ns (1.063x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	53110956 / 50012304 / +6.2%	111555380 / 108431731 / +2.9%	0.48 / 0.46 / +3.2%
fineweb_q01/datafusion:vortex-compact	379284571 / 429737416 / -11.7%	857690587 / 676230129 / +26.8%	0.44 / 0.64 / -30.4%
fineweb_q02/datafusion:vortex-compact	369749176 / 412724815 / -10.4%	484785510 / 513155908 / -5.5%	0.76 / 0.80 / -5.2%
fineweb_q03/datafusion:vortex-compact	899532182 / 698121653 / +28.9%	892511456 / 755879813 / +18.1%	1.01 / 0.92 / +9.1%
fineweb_q04/datafusion:vortex-compact	501470580 / 472962672 / +6.0%	555241945 / 491105764 / +13.1%	0.90 / 0.96 / -6.2%
fineweb_q05/datafusion:vortex-compact	459255411 / 464314684 / -1.1%	508589006 / 483616945 / +5.2%	0.90 / 0.96 / -5.9%
fineweb_q06/datafusion:vortex-compact	680116133 / 654038268 / +4.0%	813590792 / 602512933 / +35.0% 🔴	0.84 / 1.09 / -23.0%
fineweb_q07/datafusion:vortex-compact	526746964 / 491638317 / +7.1%	488383059 / 519472433 / -6.0%	1.08 / 0.95 / +14.0%
fineweb_q08/datafusion:vortex-compact	214387558 / 155960384 / +37.5% 🔴	192352244 / 160495222 / +19.8%	1.11 / 0.97 / +14.7%

datafusion / parquet / ns (0.858x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	425905504 / 486632854 / -12.5%	780974140 / 782533532 / -0.2%	0.55 / 0.62 / -12.3%
fineweb_q01/datafusion:parquet	776611824 / 972925799 / -20.2%	772329540 / 764449988 / +1.0%	1.01 / 1.27 / -21.0%
fineweb_q02/datafusion:parquet	825665992 / 1119370332 / -26.2%	725386999 / 913728335 / -20.6%	1.14 / 1.23 / -7.1%
fineweb_q03/datafusion:parquet	742869198 / 850805602 / -12.7%	761836267 / 966578786 / -21.2%	0.98 / 0.88 / +10.8%
fineweb_q04/datafusion:parquet	755029792 / 911996068 / -17.2%	791716636 / 950881177 / -16.7%	0.95 / 0.96 / -0.6%
fineweb_q05/datafusion:parquet	814636400 / 799934640 / +1.8%	682438683 / 1184124293 / -42.4% 🟢	1.19 / 0.68 / +76.7%
fineweb_q06/datafusion:parquet	716826012 / 825058367 / -13.1%	739833121 / 793833801 / -6.8%	0.97 / 1.04 / -6.8%
fineweb_q07/datafusion:parquet	719475262 / 809398368 / -11.1%	777713267 / 1018286841 / -23.6%	0.93 / 0.79 / +16.4%
fineweb_q08/datafusion:parquet	716386179 / 831081925 / -13.8%	840416748 / 1064972482 / -21.1%	0.85 / 0.78 / +9.2%

duckdb / vortex-file-compressed / ns (1.072x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	55226033 / 56537692 / -2.3%	48829187 / 69863065 / -30.1% 🟢	1.13 / 0.81 / +39.8%
fineweb_q01/duckdb:vortex-file-compressed	599401666 / 414760236 / +44.5% 🔴	492968324 / 461280813 / +6.9%	1.22 / 0.90 / +35.2%
fineweb_q02/duckdb:vortex-file-compressed	870601483 / 581866844 / +49.6% 🔴	696249288 / 619372301 / +12.4%	1.25 / 0.94 / +33.1%
fineweb_q03/duckdb:vortex-file-compressed	971847492 / 1060397255 / -8.4%	1391036231 / 1090903268 / +27.5%	0.70 / 0.97 / -28.1%
fineweb_q04/duckdb:vortex-file-compressed	983834799 / 990697266 / -0.7%	1107308693 / 991832322 / +11.6%	0.89 / 1.00 / -11.0%
fineweb_q05/duckdb:vortex-file-compressed	887779612 / 955543286 / -7.1%	1018108751 / 1019231461 / -0.1%	0.87 / 0.94 / -7.0%
fineweb_q06/duckdb:vortex-file-compressed	1219225867 / 1235367386 / -1.3%	1198706681 / 1242331029 / -3.5%	1.02 / 0.99 / +2.3%
fineweb_q07/duckdb:vortex-file-compressed	971790400 / 974100128 / -0.2%	1191945979 / 1011828260 / +17.8%	0.82 / 0.96 / -15.3%
fineweb_q08/duckdb:vortex-file-compressed	422771550 / 396757936 / +6.6%	483489924 / 482901663 / +0.1%	0.87 / 0.82 / +6.4%

duckdb / vortex-compact / ns (1.104x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	71947804 / 69237402 / +3.9%	68953324 / 64908025 / +6.2%	1.04 / 1.07 / -2.2%
fineweb_q01/duckdb:vortex-compact	370742642 / 401777825 / -7.7%	505109984 / 424024651 / +19.1%	0.73 / 0.95 / -22.5%
fineweb_q02/duckdb:vortex-compact	559191348 / 555197361 / +0.7%	576332047 / 578181075 / -0.3%	0.97 / 0.96 / +1.0%
fineweb_q03/duckdb:vortex-compact	2948401852 / 1154611646 / +155.4% 🔴	6386368165 / 1221345194 / +422.9% 🔴	0.46 / 0.95 / -51.2%
fineweb_q04/duckdb:vortex-compact	1111827594 / 1085155530 / +2.5%	1103379406 / 1081654887 / +2.0%	1.01 / 1.00 / +0.4%
fineweb_q05/duckdb:vortex-compact	1008262369 / 959977582 / +5.0%	1130250788 / 1202307886 / -6.0%	0.89 / 0.80 / +11.7%
fineweb_q06/duckdb:vortex-compact	1118646836 / 1086228276 / +3.0%	1213015558 / 1109921999 / +9.3%	0.92 / 0.98 / -5.8%
fineweb_q07/duckdb:vortex-compact	966817796 / 1192210427 / -18.9%	982034517 / 1581942939 / -37.9% 🟢	0.98 / 0.75 / +30.6%
fineweb_q08/duckdb:vortex-compact	370552670 / 336766248 / +10.0%	438440184 / 400089664 / +9.6%	0.85 / 0.84 / +0.4%

duckdb / parquet / ns (0.977x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	488195800 / 491826292 / -0.7%	537980020 / 546261249 / -1.5%	0.91 / 0.90 / +0.8%
fineweb_q01/duckdb:parquet	579108462 / 710397976 / -18.5%	577570693 / 587492647 / -1.7%	1.00 / 1.21 / -17.1%
fineweb_q02/duckdb:parquet	600093600 / 594158388 / +1.0%	579897825 / 530117431 / +9.4%	1.03 / 1.12 / -7.7%
fineweb_q03/duckdb:parquet	1331558071 / 1399309668 / -4.8%	1320083655 / 1339347771 / -1.4%	1.01 / 1.04 / -3.5%
fineweb_q04/duckdb:parquet	748082114 / 742175679 / +0.8%	773283523 / 820016303 / -5.7%	0.97 / 0.91 / +6.9%
fineweb_q05/duckdb:parquet	873335674 / 900927752 / -3.1%	895458558 / 864520555 / +3.6%	0.98 / 1.04 / -6.4%
fineweb_q06/duckdb:parquet	1692937564 / 1581924608 / +7.0%	1764187708 / 1615609657 / +9.2%	0.96 / 0.98 / -2.0%
fineweb_q07/duckdb:parquet	1016518788 / 1013816807 / +0.3%	1102076701 / 999625108 / +10.2%	0.92 / 1.01 / -9.1%
fineweb_q08/duckdb:parquet	490310868 / 494449358 / -0.8%	484328968 / 523462398 / -7.5%	1.01 / 0.94 / +7.2%

github-actions · 2026-09-10T16:24:35Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.999x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.991x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	16724355 / 16559954 / +1.0%	46309503 / 50703229 / -8.7%	0.36 / 0.33 / +10.6%
tpch_q02/datafusion:vortex-file-compressed	17555645 / 17504308 / +0.3%	38183784 / 39378938 / -3.0%	0.46 / 0.44 / +3.4%
tpch_q03/datafusion:vortex-file-compressed	19406709 / 19690143 / -1.4%	51082479 / 52838676 / -3.3%	0.38 / 0.37 / +1.9%
tpch_q04/datafusion:vortex-file-compressed	10301538 / 10528702 / -2.2%	32257479 / 37181036 / -13.2% 🟢	0.32 / 0.28 / +12.8%
tpch_q05/datafusion:vortex-file-compressed	36731068 / 37299446 / -1.5%	67992837 / 65851658 / +3.3%	0.54 / 0.57 / -4.6%
tpch_q06/datafusion:vortex-file-compressed	6523452 / 6104826 / +6.9%	29324931 / 29091329 / +0.8%	0.22 / 0.21 / +6.0%
tpch_q07/datafusion:vortex-file-compressed	52467432 / 51531336 / +1.8%	82223339 / 83009228 / -0.9%	0.64 / 0.62 / +2.8%
tpch_q08/datafusion:vortex-file-compressed	51832056 / 52000911 / -0.3%	83768261 / 81008031 / +3.4%	0.62 / 0.64 / -3.6%
tpch_q09/datafusion:vortex-file-compressed	49469154 / 49172521 / +0.6%	76116310 / 79176878 / -3.9%	0.65 / 0.62 / +4.6%
tpch_q10/datafusion:vortex-file-compressed	16878597 / 17326486 / -2.6%	48813066 / 49801998 / -2.0%	0.35 / 0.35 / -0.6%
tpch_q11/datafusion:vortex-file-compressed	15334604 / 15382205 / -0.3%	34910516 / 34940952 / -0.1%	0.44 / 0.44 / -0.2%
tpch_q12/datafusion:vortex-file-compressed	23539320 / 23501787 / +0.2%	47370016 / 46950713 / +0.9%	0.50 / 0.50 / -0.7%
tpch_q13/datafusion:vortex-file-compressed	19910952 / 20280981 / -1.8%	40475406 / 40050243 / +1.1%	0.49 / 0.51 / -2.9%
tpch_q14/datafusion:vortex-file-compressed	15046581 / 15026862 / +0.1%	40094658 / 42522833 / -5.7%	0.38 / 0.35 / +6.2%
tpch_q15/datafusion:vortex-file-compressed	18663105 / 18803710 / -0.7%	47029640 / 46077075 / +2.1%	0.40 / 0.41 / -2.8%
tpch_q16/datafusion:vortex-file-compressed	18702298 / 18502840 / +1.1%	39830202 / 38463524 / +3.6%	0.47 / 0.48 / -2.4%
tpch_q17/datafusion:vortex-file-compressed	27967727 / 27627440 / +1.2%	58560487 / 56836335 / +3.0%	0.48 / 0.49 / -1.7%
tpch_q18/datafusion:vortex-file-compressed	37049087 / 36629788 / +1.1%	58952801 / 58581851 / +0.6%	0.63 / 0.63 / +0.5%
tpch_q19/datafusion:vortex-file-compressed	14243202 / 14127237 / +0.8%	38691383 / 40870501 / -5.3%	0.37 / 0.35 / +6.5%
tpch_q20/datafusion:vortex-file-compressed	20916161 / 20947492 / -0.1%	44754116 / 46342820 / -3.4%	0.47 / 0.45 / +3.4%
tpch_q21/datafusion:vortex-file-compressed	39481920 / 38960542 / +1.3%	66209945 / 67934818 / -2.5%	0.60 / 0.57 / +4.0%
tpch_q22/datafusion:vortex-file-compressed	11129811 / 11111105 / +0.2%	32314127 / 32001157 / +1.0%	0.34 / 0.35 / -0.8%

datafusion / vortex-compact / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	17886052 / 17958661 / -0.4%	44793197 / 44595996 / +0.4%	0.40 / 0.40 / -0.8%
tpch_q02/datafusion:vortex-compact	20004413 / 19511801 / +2.5%	38226983 / 37211205 / +2.7%	0.52 / 0.52 / -0.2%
tpch_q03/datafusion:vortex-compact	20331604 / 20171082 / +0.8%	47705202 / 49100758 / -2.8%	0.43 / 0.41 / +3.7%
tpch_q04/datafusion:vortex-compact	11637251 / 11594212 / +0.4%	31986834 / 32576735 / -1.8%	0.36 / 0.36 / +2.2%
tpch_q05/datafusion:vortex-compact	38133208 / 37545597 / +1.6%	65434252 / 63552783 / +3.0%	0.58 / 0.59 / -1.4%
tpch_q06/datafusion:vortex-compact	7059675 / 6659545 / +6.0%	29514146 / 32111985 / -8.1%	0.24 / 0.21 / +15.3%
tpch_q07/datafusion:vortex-compact	52653824 / 52204479 / +0.9%	81085672 / 81579357 / -0.6%	0.65 / 0.64 / +1.5%
tpch_q08/datafusion:vortex-compact	52704919 / 53262161 / -1.0%	82529758 / 80543839 / +2.5%	0.64 / 0.66 / -3.4%
tpch_q09/datafusion:vortex-compact	51340650 / 50977552 / +0.7%	82893774 / 78991964 / +4.9%	0.62 / 0.65 / -4.0%
tpch_q10/datafusion:vortex-compact	18561908 / 18775738 / -1.1%	48775909 / 48065915 / +1.5%	0.38 / 0.39 / -2.6%
tpch_q11/datafusion:vortex-compact	16112317 / 15973436 / +0.9%	35703561 / 34273730 / +4.2%	0.45 / 0.47 / -3.2%
tpch_q12/datafusion:vortex-compact	24524390 / 23940875 / +2.4%	47417938 / 45804967 / +3.5%	0.52 / 0.52 / -1.0%
tpch_q13/datafusion:vortex-compact	21229752 / 20832854 / +1.9%	39018635 / 39523268 / -1.3%	0.54 / 0.53 / +3.2%
tpch_q14/datafusion:vortex-compact	16211646 / 16130084 / +0.5%	42401869 / 39827408 / +6.5%	0.38 / 0.40 / -5.6%
tpch_q15/datafusion:vortex-compact	20095783 / 20222582 / -0.6%	48344868 / 45052098 / +7.3%	0.42 / 0.45 / -7.4%
tpch_q16/datafusion:vortex-compact	18602053 / 18815766 / -1.1%	39344852 / 38325383 / +2.7%	0.47 / 0.49 / -3.7%
tpch_q17/datafusion:vortex-compact	28915876 / 28607929 / +1.1%	59554918 / 57936412 / +2.8%	0.49 / 0.49 / -1.7%
tpch_q18/datafusion:vortex-compact	38269311 / 38304997 / -0.1%	57953656 / 58165625 / -0.4%	0.66 / 0.66 / +0.3%
tpch_q19/datafusion:vortex-compact	18668220 / 18433615 / +1.3%	45913815 / 46871379 / -2.0%	0.41 / 0.39 / +3.4%
tpch_q20/datafusion:vortex-compact	22147876 / 22035327 / +0.5%	45362250 / 45338208 / +0.1%	0.49 / 0.49 / +0.5%
tpch_q21/datafusion:vortex-compact	42055359 / 41791737 / +0.6%	67715373 / 68446024 / -1.1%	0.62 / 0.61 / +1.7%
tpch_q22/datafusion:vortex-compact	11767001 / 11501421 / +2.3%	32880835 / 31723901 / +3.6%	0.36 / 0.36 / -1.3%

datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	67308725 / 66922217 / +0.6%	85961585 / 88521685 / -2.9%	0.78 / 0.76 / +3.6%
tpch_q02/datafusion:parquet	52971639 / 52298435 / +1.3%	72916046 / 74312366 / -1.9%	0.73 / 0.70 / +3.2%
tpch_q03/datafusion:parquet	73261250 / 71914313 / +1.9%	102264096 / 100560730 / +1.7%	0.72 / 0.72 / +0.2%
tpch_q04/datafusion:parquet	39863434 / 39811813 / +0.1%	60659948 / 65337442 / -7.2%	0.66 / 0.61 / +7.9%
tpch_q05/datafusion:parquet	88406446 / 88198405 / +0.2%	116722796 / 122239852 / -4.5%	0.76 / 0.72 / +5.0%
tpch_q06/datafusion:parquet	28281799 / 27844678 / +1.6%	47877837 / 49302327 / -2.9%	0.59 / 0.56 / +4.6%
tpch_q07/datafusion:parquet	95046456 / 93945384 / +1.2%	124960391 / 124279642 / +0.5%	0.76 / 0.76 / +0.6%
tpch_q08/datafusion:parquet	97668258 / 96471311 / +1.2%	128268115 / 127124516 / +0.9%	0.76 / 0.76 / +0.3%
tpch_q09/datafusion:parquet	114248786 / 112625936 / +1.4%	147706481 / 150212991 / -1.7%	0.77 / 0.75 / +3.2%
tpch_q10/datafusion:parquet	79738532 / 79032443 / +0.9%	112446416 / 115472790 / -2.6%	0.71 / 0.68 / +3.6%
tpch_q11/datafusion:parquet	39545602 / 39054522 / +1.3%	65193428 / 64544893 / +1.0%	0.61 / 0.61 / +0.3%
tpch_q12/datafusion:parquet	61658641 / 62217042 / -0.9%	88876678 / 90562242 / -1.9%	0.69 / 0.69 / +1.0%
tpch_q13/datafusion:parquet	160295752 / 158966293 / +0.8%	182649218 / 184472552 / -1.0%	0.88 / 0.86 / +1.8%
tpch_q14/datafusion:parquet	39663427 / 39502419 / +0.4%	67511619 / 73952007 / -8.7%	0.59 / 0.53 / +10.0%
tpch_q15/datafusion:parquet	46571484 / 45936084 / +1.4%	68895941 / 72931416 / -5.5%	0.68 / 0.63 / +7.3%
tpch_q16/datafusion:parquet	38418574 / 38613388 / -0.5%	59359843 / 59060527 / +0.5%	0.65 / 0.65 / -1.0%
tpch_q17/datafusion:parquet	116512317 / 116411850 / +0.1%	142990694 / 143462983 / -0.3%	0.81 / 0.81 / +0.4%
tpch_q18/datafusion:parquet	115262833 / 115270795 / -0.0%	137536656 / 141633871 / -2.9%	0.84 / 0.81 / +3.0%
tpch_q19/datafusion:parquet	50983244 / 49923040 / +2.1%	77322448 / 81144630 / -4.7%	0.66 / 0.62 / +7.2%
tpch_q20/datafusion:parquet	58459970 / 58660254 / -0.3%	85437928 / 87264974 / -2.1%	0.68 / 0.67 / +1.8%
tpch_q21/datafusion:parquet	98558881 / 98308352 / +0.3%	123574128 / 121062246 / +2.1%	0.80 / 0.81 / -1.8%
tpch_q22/datafusion:parquet	41292590 / 41902180 / -1.5%	61097870 / 62779792 / -2.7%	0.68 / 0.67 / +1.3%

duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	12349169 / 11555645 / +6.9%	23370359 / 23095752 / +1.2%	0.53 / 0.50 / +5.6%
tpch_q02/duckdb:vortex-file-compressed	17570112 / 17725920 / -0.9%	26012978 / 26258392 / -0.9%	0.68 / 0.68 / +0.1%
tpch_q03/duckdb:vortex-file-compressed	18274859 / 19101298 / -4.3%	34591393 / 35327101 / -2.1%	0.53 / 0.54 / -2.3%
tpch_q04/duckdb:vortex-file-compressed	16414621 / 16888068 / -2.8%	28323832 / 29654469 / -4.5%	0.58 / 0.57 / +1.8%
tpch_q05/duckdb:vortex-file-compressed	22311739 / 22406769 / -0.4%	34532713 / 35631256 / -3.1%	0.65 / 0.63 / +2.7%
tpch_q06/duckdb:vortex-file-compressed	5697270 / 5624864 / +1.3%	14512955 / 14997897 / -3.2%	0.39 / 0.38 / +4.7%
tpch_q07/duckdb:vortex-file-compressed	20572928 / 20953234 / -1.8%	44756405 / 36450345 / +22.8% 🔴	0.46 / 0.57 / -20.0%
tpch_q08/duckdb:vortex-file-compressed	23687844 / 23814278 / -0.5%	38805358 / 39647191 / -2.1%	0.61 / 0.60 / +1.6%
tpch_q09/duckdb:vortex-file-compressed	29375711 / 29718796 / -1.2%	54774081 / 50224682 / +9.1%	0.54 / 0.59 / -9.4%
tpch_q10/duckdb:vortex-file-compressed	28967845 / 29589976 / -2.1%	47620021 / 49843804 / -4.5%	0.61 / 0.59 / +2.5%
tpch_q11/duckdb:vortex-file-compressed	8350453 / 8114358 / +2.9%	18780017 / 15979109 / +17.5% 🔴	0.44 / 0.51 / -12.4%
tpch_q12/duckdb:vortex-file-compressed	16029256 / 16769854 / -4.4%	27328150 / 30723930 / -11.1% 🟢	0.59 / 0.55 / +7.5%
tpch_q13/duckdb:vortex-file-compressed	22990497 / 22714714 / +1.2%	40770156 / 38877306 / +4.9%	0.56 / 0.58 / -3.5%
tpch_q14/duckdb:vortex-file-compressed	13520971 / 13183512 / +2.6%	25370928 / 23959539 / +5.9%	0.53 / 0.55 / -3.1%
tpch_q15/duckdb:vortex-file-compressed	10248932 / 9617360 / +6.6%	20527052 / 18566098 / +10.6% 🔴	0.50 / 0.52 / -3.6%
tpch_q16/duckdb:vortex-file-compressed	18490512 / 18685313 / -1.0%	24398417 / 23473747 / +3.9%	0.76 / 0.80 / -4.8%
tpch_q17/duckdb:vortex-file-compressed	15563844 / 15660569 / -0.6%	30577791 / 30852866 / -0.9%	0.51 / 0.51 / +0.3%
tpch_q18/duckdb:vortex-file-compressed	26810068 / 25831282 / +3.8%	33722995 / 37530163 / -10.1% 🟢	0.80 / 0.69 / +15.5%
tpch_q19/duckdb:vortex-file-compressed	23879605 / 23032774 / +3.7%	39993970 / 42068400 / -4.9%	0.60 / 0.55 / +9.1%
tpch_q20/duckdb:vortex-file-compressed	17415484 / 17824946 / -2.3%	37925768 / 34819805 / +8.9%	0.46 / 0.51 / -10.3%
tpch_q21/duckdb:vortex-file-compressed	65710650 / 65741129 / -0.0%	81941998 / 81903442 / +0.0%	0.80 / 0.80 / -0.1%
tpch_q22/duckdb:vortex-file-compressed	14475338 / 12123388 / +19.4% 🔴	20736604 / 21086370 / -1.7%	0.70 / 0.57 / +21.4%

duckdb / vortex-compact / ns (1.001x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	11919703 / 14449330 / -17.5% 🟢	23043017 / 28589614 / -19.4% 🟢	0.52 / 0.51 / +2.3%
tpch_q02/duckdb:vortex-compact	20155259 / 20011100 / +0.7%	28822252 / 28618068 / +0.7%	0.70 / 0.70 / +0.0%
tpch_q03/duckdb:vortex-compact	21729808 / 19062766 / +14.0% 🔴	32976393 / 37170971 / -11.3% 🟢	0.66 / 0.51 / +28.5%
tpch_q04/duckdb:vortex-compact	19022354 / 18549156 / +2.6%	32889723 / 30732341 / +7.0%	0.58 / 0.60 / -4.2%
tpch_q05/duckdb:vortex-compact	22848243 / 22493339 / +1.6%	40984265 / 37991425 / +7.9%	0.56 / 0.59 / -5.8%
tpch_q06/duckdb:vortex-compact	6249101 / 6150611 / +1.6%	16127563 / 17826163 / -9.5%	0.39 / 0.35 / +12.3%
tpch_q07/duckdb:vortex-compact	22231138 / 21994156 / +1.1%	40848237 / 44003599 / -7.2%	0.54 / 0.50 / +8.9%
tpch_q08/duckdb:vortex-compact	25622306 / 26724426 / -4.1%	40511943 / 40699109 / -0.5%	0.63 / 0.66 / -3.7%
tpch_q09/duckdb:vortex-compact	30336331 / 31470832 / -3.6%	47815268 / 50551732 / -5.4%	0.63 / 0.62 / +1.9%
tpch_q10/duckdb:vortex-compact	32729282 / 30900525 / +5.9%	53892471 / 48108225 / +12.0% 🔴	0.61 / 0.64 / -5.4%
tpch_q11/duckdb:vortex-compact	9457766 / 9147778 / +3.4%	17165439 / 17095076 / +0.4%	0.55 / 0.54 / +3.0%
tpch_q12/duckdb:vortex-compact	17814457 / 18140589 / -1.8%	28867587 / 30593080 / -5.6%	0.62 / 0.59 / +4.1%
tpch_q13/duckdb:vortex-compact	23364403 / 23067941 / +1.3%	41621797 / 38574955 / +7.9%	0.56 / 0.60 / -6.1%
tpch_q14/duckdb:vortex-compact	14235407 / 14353662 / -0.8%	26735321 / 27798159 / -3.8%	0.53 / 0.52 / +3.1%
tpch_q15/duckdb:vortex-compact	10576940 / 10746525 / -1.6%	24569313 / 25587842 / -4.0%	0.43 / 0.42 / +2.5%
tpch_q16/duckdb:vortex-compact	20171445 / 20353405 / -0.9%	26497651 / 25740194 / +2.9%	0.76 / 0.79 / -3.7%
tpch_q17/duckdb:vortex-compact	16869511 / 17095127 / -1.3%	34293973 / 30432293 / +12.7% 🔴	0.49 / 0.56 / -12.4%
tpch_q18/duckdb:vortex-compact	26673114 / 26217266 / +1.7%	36361713 / 41539886 / -12.5% 🟢	0.73 / 0.63 / +16.2%
tpch_q19/duckdb:vortex-compact	24770708 / 24206812 / +2.3%	37364209 / 36396379 / +2.7%	0.66 / 0.67 / -0.3%
tpch_q20/duckdb:vortex-compact	19445572 / 19169644 / +1.4%	35235737 / 35022688 / +0.6%	0.55 / 0.55 / +0.8%
tpch_q21/duckdb:vortex-compact	68968319 / 69890781 / -1.3%	84064679 / 84732637 / -0.8%	0.82 / 0.82 / -0.5%
tpch_q22/duckdb:vortex-compact	12666531 / 12667833 / -0.0%	21746146 / 21667259 / +0.4%	0.58 / 0.58 / -0.4%

duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	60060701 / 59983685 / +0.1%	66392148 / 66713958 / -0.5%	0.90 / 0.90 / +0.6%
tpch_q02/duckdb:parquet	34928305 / 34831219 / +0.3%	44064632 / 43022250 / +2.4%	0.79 / 0.81 / -2.1%
tpch_q03/duckdb:parquet	62255974 / 62201424 / +0.1%	74076153 / 74008373 / +0.1%	0.84 / 0.84 / -0.0%
tpch_q04/duckdb:parquet	43596438 / 43051138 / +1.3%	55474447 / 55247723 / +0.4%	0.79 / 0.78 / +0.9%
tpch_q05/duckdb:parquet	61304411 / 61073014 / +0.4%	72740291 / 72919218 / -0.2%	0.84 / 0.84 / +0.6%
tpch_q06/duckdb:parquet	20357105 / 19993351 / +1.8%	24529440 / 24946973 / -1.7%	0.83 / 0.80 / +3.6%
tpch_q07/duckdb:parquet	60933174 / 63075906 / -3.4%	72092116 / 71507100 / +0.8%	0.85 / 0.88 / -4.2%
tpch_q08/duckdb:parquet	73643937 / 73093826 / +0.8%	85612148 / 87359756 / -2.0%	0.86 / 0.84 / +2.8%
tpch_q09/duckdb:parquet	114208653 / 113994794 / +0.2%	127820072 / 127480075 / +0.3%	0.89 / 0.89 / -0.1%
tpch_q10/duckdb:parquet	108586907 / 107830696 / +0.7%	121594035 / 121289991 / +0.3%	0.89 / 0.89 / +0.4%
tpch_q11/duckdb:parquet	20261234 / 19924492 / +1.7%	24145514 / 23477009 / +2.8%	0.84 / 0.85 / -1.1%
tpch_q12/duckdb:parquet	41807744 / 41263504 / +1.3%	49791219 / 48833976 / +2.0%	0.84 / 0.84 / -0.6%
tpch_q13/duckdb:parquet	240451415 / 238973334 / +0.6%	247234990 / 247480613 / -0.1%	0.97 / 0.97 / +0.7%
tpch_q14/duckdb:parquet	43657856 / 43449985 / +0.5%	52525600 / 52196777 / +0.6%	0.83 / 0.83 / -0.2%
tpch_q15/duckdb:parquet	25015462 / 24819078 / +0.8%	33747335 / 31390690 / +7.5%	0.74 / 0.79 / -6.2%
tpch_q16/duckdb:parquet	`5032693` / 50415843 / -0.2%	57196113 / 58525200 / -2.3%	0.88 / 0.86 / +2.1%
tpch_q17/duckdb:parquet	47453503 / 44427338 / +6.8%	56193760 / 54286024 / +3.5%	0.84 / 0.82 / +3.2%
tpch_q18/duckdb:parquet	90564636 / 89588225 / +1.1%	97734670 / 102802789 / -4.9%	0.93 / 0.87 / +6.3%
tpch_q19/duckdb:parquet	61340737 / 60911036 / +0.7%	71613610 / 70385474 / +1.7%	0.86 / 0.87 / -1.0%
tpch_q20/duckdb:parquet	58995569 / 58868616 / +0.2%	71093892 / 71039407 / +0.1%	0.83 / 0.83 / +0.1%
tpch_q21/duckdb:parquet	137555363 / 136870641 / +0.5%	149061665 / 148042916 / +0.7%	0.92 / 0.92 / -0.2%
tpch_q22/duckdb:parquet	50850132 / 50369691 / +1.0%	58188837 / 59151798 / -1.6%	0.87 / 0.85 / +2.6%

No file size changes detected.

github-actions · 2026-09-10T16:24:48Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	92476307 / 94472588 / -2.1%	155732820 / 164613164 / -5.4%	0.59 / 0.57 / +3.5%
tpch_q02/datafusion:vortex-file-compressed	65508030 / 65124689 / +0.6%	93681050 / 92469105 / +1.3%	0.70 / 0.70 / -0.7%
tpch_q03/datafusion:vortex-file-compressed	66163990 / 66449686 / -0.4%	111669451 / 114316604 / -2.3%	0.59 / 0.58 / +1.9%
tpch_q04/datafusion:vortex-file-compressed	36474634 / 35861616 / +1.7%	69347240 / 67275878 / +3.1%	0.53 / 0.53 / -1.3%
tpch_q05/datafusion:vortex-file-compressed	118797466 / 118125457 / +0.6%	168159912 / 178310710 / -5.7%	0.71 / 0.66 / +6.6%
tpch_q06/datafusion:vortex-file-compressed	14496049 / 15142949 / -4.3%	69032036 / 70846998 / -2.6%	0.21 / 0.21 / -1.8%
tpch_q07/datafusion:vortex-file-compressed	140766170 / 139907871 / +0.6%	187902746 / 195031518 / -3.7%	0.75 / 0.72 / +4.4%
tpch_q08/datafusion:vortex-file-compressed	143800704 / 143776963 / +0.0%	221415572 / 204778049 / +8.1%	0.65 / 0.70 / -7.5%
tpch_q09/datafusion:vortex-file-compressed	185600245 / 197190989 / -5.9%	250100832 / 243450428 / +2.7%	0.74 / 0.81 / -8.4%
tpch_q10/datafusion:vortex-file-compressed	75527519 / 75460048 / +0.1%	127166209 / 126318887 / +0.7%	0.59 / 0.60 / -0.6%
tpch_q11/datafusion:vortex-file-compressed	43940570 / 42995131 / +2.2%	65604643 / 66029701 / -0.6%	0.67 / 0.65 / +2.9%
tpch_q12/datafusion:vortex-file-compressed	47354947 / 46756705 / +1.3%	90297270 / 90200288 / +0.1%	0.52 / 0.52 / +1.2%
tpch_q13/datafusion:vortex-file-compressed	46507667 / 47494159 / -2.1%	79280171 / 76404958 / +3.8%	0.59 / 0.62 / -5.6%
tpch_q14/datafusion:vortex-file-compressed	24627156 / 25060533 / -1.7%	91683471 / 97414963 / -5.9%	0.27 / 0.26 / +4.4%
tpch_q15/datafusion:vortex-file-compressed	37352126 / 37691686 / -0.9%	100045051 / 97896832 / +2.2%	0.37 / 0.39 / -3.0%
tpch_q16/datafusion:vortex-file-compressed	37714503 / 37733985 / -0.1%	65844988 / 64402844 / +2.2%	0.57 / 0.59 / -2.2%
tpch_q17/datafusion:vortex-file-compressed	178287247 / 179706554 / -0.8%	226930081 / 226533730 / +0.2%	0.79 / 0.79 / -1.0%
tpch_q18/datafusion:vortex-file-compressed	200435954 / 203705891 / -1.6%	249902832 / 258298549 / -3.3%	0.80 / 0.79 / +1.7%
tpch_q19/datafusion:vortex-file-compressed	38785102 / 39194138 / -1.0%	89962552 / 91997800 / -2.2%	0.43 / 0.43 / +1.2%
tpch_q20/datafusion:vortex-file-compressed	62293627 / 62853602 / -0.9%	128045331 / 115137598 / +11.2% 🔴	0.49 / 0.55 / -10.9%
tpch_q21/datafusion:vortex-file-compressed	182266950 / 181524991 / +0.4%	235975802 / 231905898 / +1.8%	0.77 / 0.78 / -1.3%
tpch_q22/datafusion:vortex-file-compressed	25634477 / 26030821 / -1.5%	53509706 / 53405520 / +0.2%	0.48 / 0.49 / -1.7%

datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	96793951 / 95780918 / +1.1%	150461113 / 142910943 / +5.3%	0.64 / 0.67 / -4.0%
tpch_q02/datafusion:vortex-compact	64919129 / 65506803 / -0.9%	89812860 / 93440270 / -3.9%	0.72 / 0.70 / +3.1%
tpch_q03/datafusion:vortex-compact	67674538 / 66872150 / +1.2%	112358366 / 107114406 / +4.9%	0.60 / 0.62 / -3.5%
tpch_q04/datafusion:vortex-compact	42231405 / 42627685 / -0.9%	80776084 / 83802325 / -3.6%	0.52 / 0.51 / +2.8%
tpch_q05/datafusion:vortex-compact	117695210 / 118575626 / -0.7%	161613961 / 167288016 / -3.4%	0.73 / 0.71 / +2.7%
tpch_q06/datafusion:vortex-compact	18430198 / 17895216 / +3.0%	58746448 / 60243882 / -2.5%	0.31 / 0.30 / +5.6%
tpch_q07/datafusion:vortex-compact	143940246 / 144027072 / -0.1%	182158636 / 179113383 / +1.7%	0.79 / 0.80 / -1.7%
tpch_q08/datafusion:vortex-compact	146904897 / 147894706 / -0.7%	200284002 / 190807470 / +5.0%	0.73 / 0.78 / -5.4%
tpch_q09/datafusion:vortex-compact	196151775 / 188884628 / +3.8%	260862097 / 248565598 / +4.9%	0.75 / 0.76 / -1.0%
tpch_q10/datafusion:vortex-compact	79525315 / 79096861 / +0.5%	122105428 / 126305488 / -3.3%	0.65 / 0.63 / +4.0%
tpch_q11/datafusion:vortex-compact	43453898 / 43901120 / -1.0%	66269895 / 64822780 / +2.2%	0.66 / 0.68 / -3.2%
tpch_q12/datafusion:vortex-compact	58879867 / 59489761 / -1.0%	96052496 / 90456684 / +6.2%	0.61 / 0.66 / -6.8%
tpch_q13/datafusion:vortex-compact	54256220 / 54314877 / -0.1%	77846950 / 77777389 / +0.1%	0.70 / 0.70 / -0.2%
tpch_q14/datafusion:vortex-compact	27455842 / 27935248 / -1.7%	95187237 / 94478130 / +0.8%	0.29 / 0.30 / -2.4%
tpch_q15/datafusion:vortex-compact	44688227 / 44456910 / +0.5%	98747131 / 97676011 / +1.1%	0.45 / 0.46 / -0.6%
tpch_q16/datafusion:vortex-compact	40972979 / 41140532 / -0.4%	61630458 / 66728966 / -7.6%	0.66 / 0.62 / +7.8%
tpch_q17/datafusion:vortex-compact	176953573 / 173346213 / +2.1%	219740732 / 231742828 / -5.2%	0.81 / 0.75 / +7.7%
tpch_q18/datafusion:vortex-compact	203091335 / 208663707 / -2.7%	247509398 / 255160940 / -3.0%	0.82 / 0.82 / +0.3%
tpch_q19/datafusion:vortex-compact	61303654 / 61747888 / -0.7%	97531576 / 101837992 / -4.2%	0.63 / 0.61 / +3.7%
tpch_q20/datafusion:vortex-compact	65655838 / 66193686 / -0.8%	118229259 / 118410456 / -0.2%	0.56 / 0.56 / -0.7%
tpch_q21/datafusion:vortex-compact	191960031 / 190516697 / +0.8%	241734223 / 236053072 / +2.4%	0.79 / 0.81 / -1.6%
tpch_q22/datafusion:vortex-compact	27056806 / 27182405 / -0.5%	53372635 / 56044190 / -4.8%	0.51 / 0.49 / +4.5%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	82763754 / 83373893 / -0.7%	135810419 / 134263915 / +1.2%	0.61 / 0.62 / -1.9%
tpch_q02/datafusion:parquet	135061106 / 134360239 / +0.5%	159948695 / 163456173 / -2.1%	0.84 / 0.82 / +2.7%
tpch_q03/datafusion:parquet	125110768 / 123980360 / +0.9%	191552281 / 205108482 / -6.6%	0.65 / 0.60 / +8.1%
tpch_q04/datafusion:parquet	53513683 / 52697018 / +1.5%	104185635 / 104194037 / -0.0%	0.51 / 0.51 / +1.6%
tpch_q05/datafusion:parquet	163654384 / 164086340 / -0.3%	249762794 / 237922202 / +5.0%	0.66 / 0.69 / -5.0%
tpch_q06/datafusion:parquet	31794445 / 31917388 / -0.4%	87311520 / 84062598 / +3.9%	0.36 / 0.38 / -4.1%
tpch_q07/datafusion:parquet	217224258 / 213434423 / +1.8%	292971011 / 295903752 / -1.0%	0.74 / 0.72 / +2.8%
tpch_q08/datafusion:parquet	211241644 / 209919859 / +0.6%	284080695 / 290325811 / -2.2%	0.74 / 0.72 / +2.8%
tpch_q09/datafusion:parquet	281823293 / 284351834 / -0.9%	365137796 / 358700891 / +1.8%	0.77 / 0.79 / -2.6%
tpch_q10/datafusion:parquet	306187332 / 306020000 / +0.1%	374864955 / 367117982 / +2.1%	0.82 / 0.83 / -2.0%
tpch_q11/datafusion:parquet	97109320 / 96909895 / +0.2%	116849418 / 119938545 / -2.6%	0.83 / 0.81 / +2.9%
tpch_q12/datafusion:parquet	78369491 / 78011425 / +0.5%	128749058 / 129926376 / -0.9%	0.61 / 0.60 / +1.4%
tpch_q13/datafusion:parquet	195451395 / 195591072 / -0.1%	224413476 / 228837217 / -1.9%	0.87 / 0.85 / +1.9%
tpch_q14/datafusion:parquet	75650548 / 74932597 / +1.0%	171381686 / 176130076 / -2.7%	0.44 / 0.43 / +3.8%
tpch_q15/datafusion:parquet	77098726 / 78591094 / -1.9%	135420652 / 133918758 / +1.1%	0.57 / 0.59 / -3.0%
tpch_q16/datafusion:parquet	83076635 / 84237987 / -1.4%	105846458 / 110355092 / -4.1%	0.78 / 0.76 / +2.8%
tpch_q17/datafusion:parquet	203464127 / 204798548 / -0.7%	257965546 / 265742012 / -2.9%	0.79 / 0.77 / +2.3%
tpch_q18/datafusion:parquet	264983253 / 262149324 / +1.1%	316882009 / 318134612 / -0.4%	0.84 / 0.82 / +1.5%
tpch_q19/datafusion:parquet	97793929 / 97046907 / +0.8%	171699231 / 171494352 / +0.1%	0.57 / 0.57 / +0.6%
tpch_q20/datafusion:parquet	152210547 / 153632947 / -0.9%	217871533 / 219953333 / -0.9%	0.70 / 0.70 / +0.0%
tpch_q21/datafusion:parquet	225973936 / 228905553 / -1.3%	305756152 / 303027316 / +0.9%	0.74 / 0.76 / -2.2%
tpch_q22/datafusion:parquet	160505397 / 161558506 / -0.7%	181243046 / 181298731 / -0.0%	0.89 / 0.89 / -0.6%

duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	54945539 / 54738445 / +0.4%	91455124 / 95261664 / -4.0%	0.60 / 0.57 / +4.6%
tpch_q02/duckdb:vortex-file-compressed	32831403 / 32669882 / +0.5%	47795428 / 48715557 / -1.9%	0.69 / 0.67 / +2.4%
tpch_q03/duckdb:vortex-file-compressed	58708382 / 58180660 / +0.9%	99970060 / 98186877 / +1.8%	0.59 / 0.59 / -0.9%
tpch_q04/duckdb:vortex-file-compressed	79075707 / 80609997 / -1.9%	109955415 / 114155313 / -3.7%	0.72 / 0.71 / +1.8%
tpch_q05/duckdb:vortex-file-compressed	64312350 / 63931749 / +0.6%	107103105 / 107116139 / -0.0%	0.60 / 0.60 / +0.6%
tpch_q06/duckdb:vortex-file-compressed	22160268 / 20770533 / +6.7%	61593372 / 58560843 / +5.2%	0.36 / 0.35 / +1.4%
tpch_q07/duckdb:vortex-file-compressed	60565050 / 61758258 / -1.9%	115678181 / 111006115 / +4.2%	0.52 / 0.56 / -5.9%
tpch_q08/duckdb:vortex-file-compressed	83283526 / 88088602 / -5.5%	135391606 / 136939082 / -1.1%	0.62 / 0.64 / -4.4%
tpch_q09/duckdb:vortex-file-compressed	170732160 / 171152136 / -0.2%	225924166 / 230182664 / -1.9%	0.76 / 0.74 / +1.6%
tpch_q10/duckdb:vortex-file-compressed	114761690 / 116846481 / -1.8%	178426380 / 185270228 / -3.7%	0.64 / 0.63 / +2.0%
tpch_q11/duckdb:vortex-file-compressed	17657842 / 18065214 / -2.3%	32686925 / 40297039 / -18.9% 🟢	0.54 / 0.45 / +20.5%
tpch_q12/duckdb:vortex-file-compressed	54165947 / 55247500 / -2.0%	86714359 / 91602258 / -5.3%	0.62 / 0.60 / +3.6%
tpch_q13/duckdb:vortex-file-compressed	91461238 / 92404530 / -1.0%	131523130 / 126361950 / +4.1%	0.70 / 0.73 / -4.9%
tpch_q14/duckdb:vortex-file-compressed	29730572 / 30348763 / -2.0%	76421055 / 73443013 / +4.1%	0.39 / 0.41 / -5.9%
tpch_q15/duckdb:vortex-file-compressed	39420170 / 36960960 / +6.7%	82741251 / 78586150 / +5.3%	0.48 / 0.47 / +1.3%
tpch_q16/duckdb:vortex-file-compressed	42781667 / 42928178 / -0.3%	53413075 / 55552161 / -3.9%	0.80 / 0.77 / +3.6%
tpch_q17/duckdb:vortex-file-compressed	80409478 / 64007409 / +25.6% 🔴	160116595 / 136237564 / +17.5% 🔴	0.50 / 0.47 / +6.9%
tpch_q18/duckdb:vortex-file-compressed	138575270 / 135160240 / +2.5%	152723119 / 153274824 / -0.4%	0.91 / 0.88 / +2.9%
tpch_q19/duckdb:vortex-file-compressed	43642715 / 44553690 / -2.0%	98173826 / 104285257 / -5.9%	0.44 / 0.43 / +4.1%
tpch_q20/duckdb:vortex-file-compressed	60326279 / 58893274 / +2.4%	113385867 / 106458510 / +6.5%	0.53 / 0.55 / -3.8%
tpch_q21/duckdb:vortex-file-compressed	242244033 / 244199083 / -0.8%	273125410 / 283486230 / -3.7%	0.89 / 0.86 / +3.0%
tpch_q22/duckdb:vortex-file-compressed	39957975 / 39829306 / +0.3%	54733334 / 53874695 / +1.6%	0.73 / 0.74 / -1.3%

duckdb / vortex-compact / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	70931461 / 69998484 / +1.3%	100660401 / 102641575 / -1.9%	0.70 / 0.68 / +3.3%
tpch_q02/duckdb:vortex-compact	35561466 / 35220572 / +1.0%	50458315 / 48810636 / +3.4%	0.70 / 0.72 / -2.3%
tpch_q03/duckdb:vortex-compact	61784255 / 62585064 / -1.3%	102563260 / 99267525 / +3.3%	0.60 / 0.63 / -4.5%
tpch_q04/duckdb:vortex-compact	88552740 / 87938816 / +0.7%	113174919 / 112277739 / +0.8%	0.78 / 0.78 / -0.1%
tpch_q05/duckdb:vortex-compact	69478500 / 69154420 / +0.5%	111292825 / 110751796 / +0.5%	0.62 / 0.62 / -0.0%
tpch_q06/duckdb:vortex-compact	26035248 / 26255990 / -0.8%	57953036 / 55822565 / +3.8%	0.45 / 0.47 / -4.5%
tpch_q07/duckdb:vortex-compact	71814148 / 72019779 / -0.3%	122991474 / 123567242 / -0.5%	0.58 / 0.58 / +0.2%
tpch_q08/duckdb:vortex-compact	90477598 / 91338708 / -0.9%	144165012 / 144917181 / -0.5%	0.63 / 0.63 / -0.4%
tpch_q09/duckdb:vortex-compact	171958481 / 174787094 / -1.6%	237329524 / 232364105 / +2.1%	0.72 / 0.75 / -3.7%
tpch_q10/duckdb:vortex-compact	119973818 / 121129386 / -1.0%	173725137 / 177521913 / -2.1%	0.69 / 0.68 / +1.2%
tpch_q11/duckdb:vortex-compact	18902750 / 19465433 / -2.9%	37774230 / 38050862 / -0.7%	0.50 / 0.51 / -2.2%
tpch_q12/duckdb:vortex-compact	70301232 / 71056322 / -1.1%	99876667 / 100209450 / -0.3%	0.70 / 0.71 / -0.7%
tpch_q13/duckdb:vortex-compact	99873318 / 98465247 / +1.4%	131642380 / 136302519 / -3.4%	0.76 / 0.72 / +5.0%
tpch_q14/duckdb:vortex-compact	34575971 / 33841589 / +2.2%	69729244 / 68498546 / +1.8%	0.50 / 0.49 / +0.4%
tpch_q15/duckdb:vortex-compact	46167118 / 43005227 / +7.4%	102539539 / 88727864 / +15.6% 🔴	0.45 / 0.48 / -7.1%
tpch_q16/duckdb:vortex-compact	44473953 / 45051321 / -1.3%	53997879 / 54971661 / -1.8%	0.82 / 0.82 / +0.5%
tpch_q17/duckdb:vortex-compact	64455240 / 63844773 / +1.0%	117118409 / 113195630 / +3.5%	0.55 / 0.56 / -2.4%
tpch_q18/duckdb:vortex-compact	144944712 / 142473908 / +1.7%	158966968 / 168833548 / -5.8%	0.91 / 0.84 / +8.0%
tpch_q19/duckdb:vortex-compact	47017315 / 49736920 / -5.5%	86561905 / 98385441 / -12.0% 🟢	0.54 / 0.51 / +7.4%
tpch_q20/duckdb:vortex-compact	68515512 / 68309727 / +0.3%	117175520 / 118100233 / -0.8%	0.58 / 0.58 / +1.1%
tpch_q21/duckdb:vortex-compact	262279141 / 260313748 / +0.8%	285723280 / 282424822 / +1.2%	0.92 / 0.92 / -0.4%
tpch_q22/duckdb:vortex-compact	43732933 / 41691991 / +4.9%	59255568 / 62452462 / -5.1%	0.74 / 0.67 / +10.6%

duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	71074046 / 70347364 / +1.0%	100686738 / 87573012 / +15.0% 🔴	0.71 / 0.80 / -12.1%
tpch_q02/duckdb:parquet	71279937 / 71242809 / +0.1%	82508706 / 81621733 / +1.1%	0.86 / 0.87 / -1.0%
tpch_q03/duckdb:parquet	116397891 / 112949571 / +3.1%	157850993 / 155495206 / +1.5%	0.74 / 0.73 / +1.5%
tpch_q04/duckdb:parquet	75199920 / 74878968 / +0.4%	98791157 / 103176249 / -4.3%	0.76 / 0.73 / +4.9%
tpch_q05/duckdb:parquet	126640726 / 127325259 / -0.5%	166528363 / 178629974 / -6.8%	0.76 / 0.71 / +6.7%
tpch_q06/duckdb:parquet	35084054 / 34828782 / +0.7%	50323552 / 48560742 / +3.6%	0.70 / 0.72 / -2.8%
tpch_q07/duckdb:parquet	91232660 / 89601235 / +1.8%	131450610 / 129198974 / +1.7%	0.69 / 0.69 / +0.1%
tpch_q08/duckdb:parquet	144359908 / 143429053 / +0.6%	188025251 / 185369680 / +1.4%	0.77 / 0.77 / -0.8%
tpch_q09/duckdb:parquet	223033360 / 224790474 / -0.8%	262110016 / 265895180 / -1.4%	0.85 / 0.85 / +0.7%
tpch_q10/duckdb:parquet	472382566 / 471164850 / +0.3%	528295913 / 510046808 / +3.6%	0.89 / 0.92 / -3.2%
tpch_q11/duckdb:parquet	31245139 / 30768747 / +1.5%	38091814 / 37319436 / +2.1%	0.82 / 0.82 / -0.5%
tpch_q12/duckdb:parquet	74813386 / 74566234 / +0.3%	93399454 / 93715494 / -0.3%	0.80 / 0.80 / +0.7%
tpch_q13/duckdb:parquet	316440219 / 315805670 / +0.2%	330882735 / 332272303 / -0.4%	0.96 / 0.95 / +0.6%
tpch_q14/duckdb:parquet	104391728 / 106196019 / -1.7%	134305549 / 133584485 / +0.5%	0.78 / 0.79 / -2.2%
tpch_q15/duckdb:parquet	44333200 / 44541056 / -0.5%	73777296 / 67086405 / +10.0%	0.60 / 0.66 / -9.5%
tpch_q16/duckdb:parquet	115358924 / 114369938 / +0.9%	125308739 / 123145165 / +1.8%	0.92 / 0.93 / -0.9%
tpch_q17/duckdb:parquet	74049324 / 73450880 / +0.8%	105577033 / 103510153 / +2.0%	0.70 / 0.71 / -1.2%
tpch_q18/duckdb:parquet	190002120 / 192774267 / -1.4%	167707609 / 189894667 / -11.7% 🟢	1.13 / 1.02 / +11.6%
tpch_q19/duckdb:parquet	162922899 / 161848128 / +0.7%	195221768 / 192863983 / +1.2%	0.83 / 0.84 / -0.6%
tpch_q20/duckdb:parquet	129626641 / 127858548 / +1.4%	164213328 / 163238324 / +0.6%	0.79 / 0.78 / +0.8%
tpch_q21/duckdb:parquet	270123478 / 275606085 / -2.0%	292611498 / 289568038 / +1.1%	0.92 / 0.95 / -3.0%
tpch_q22/duckdb:parquet	261396025 / 260299591 / +0.4%	271935033 / 270916679 / +0.4%	0.96 / 0.96 / +0.0%

No file size changes detected.

github-actions · 2026-09-10T16:26:29Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-1.4%, environment too noisy confidence)
Vortex (geomean): hot 0.985x ➖ · cold 1.021x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.066x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	209755746 / 199142730 / +5.3%	704255483 / 597682062 / +17.8% 🔴	0.30 / 0.33 / -10.6%
clickbench-sorted_q24/datafusion:vortex-file-compressed	13105047 / 13091698 / +0.1%	50908105 / 48183230 / +5.7%	0.26 / 0.27 / -5.3%
clickbench-sorted_q26/datafusion:vortex-file-compressed	13959798 / 14623038 / -4.5%	51391924 / 53246413 / -3.5%	0.27 / 0.27 / -1.1%
clickbench-sorted_q36/datafusion:vortex-file-compressed	29261335 / 29302166 / -0.1%	67585387 / 68111872 / -0.8%	0.43 / 0.43 / +0.6%
clickbench-sorted_q37/datafusion:vortex-file-compressed	24495824 / 24611382 / -0.5%	64848669 / 56851103 / +14.1% 🔴	0.38 / 0.43 / -12.7%
clickbench-sorted_q38/datafusion:vortex-file-compressed	35668710 / 36166994 / -1.4%	71312104 / 71059402 / +0.4%	0.50 / 0.51 / -1.7%
clickbench-sorted_q39/datafusion:vortex-file-compressed	89510064 / 87344532 / +2.5%	122057934 / 114362565 / +6.7%	0.73 / 0.76 / -4.0%
clickbench-sorted_q40/datafusion:vortex-file-compressed	16931212 / 16160698 / +4.8%	52195263 / 43916147 / +18.9% 🔴	0.32 / 0.37 / -11.9%
clickbench-sorted_q41/datafusion:vortex-file-compressed	15244434 / 15833189 / -3.7%	49830570 / 44826260 / +11.2% 🔴	0.31 / 0.35 / -13.4%
clickbench-sorted_q42/datafusion:vortex-file-compressed	13454883 / 13354050 / +0.8%	42468568 / 38646457 / +9.9%	0.32 / 0.35 / -8.3%

datafusion / vortex-compact / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact	199787543 / 191474907 / +4.3%	468468936 / 445825607 / +5.1%	0.43 / 0.43 / -0.7%
clickbench-sorted_q24/datafusion:vortex-compact	22808900 / 22658190 / +0.7%	53359848 / 51091554 / +4.4%	0.43 / 0.44 / -3.6%
clickbench-sorted_q26/datafusion:vortex-compact	23763343 / 22398328 / +6.1%	50700315 / 53418057 / -5.1%	0.47 / 0.42 / +11.8%
clickbench-sorted_q36/datafusion:vortex-compact	25387887 / 25521646 / -0.5%	70636227 / 66473136 / +6.3%	0.36 / 0.38 / -6.4%
clickbench-sorted_q37/datafusion:vortex-compact	21455787 / 22134210 / -3.1%	67820682 / 66020585 / +2.7%	0.32 / 0.34 / -5.6%
clickbench-sorted_q38/datafusion:vortex-compact	20772999 / 21343097 / -2.7%	66398788 / 61337932 / +8.3%	0.31 / 0.35 / -10.1%
clickbench-sorted_q39/datafusion:vortex-compact	45257410 / 44882801 / +0.8%	`8402704` / 81017954 / +3.7%	0.54 / 0.55 / -2.8%
clickbench-sorted_q40/datafusion:vortex-compact	14509096 / 15577744 / -6.9%	44558977 / 42948495 / +3.7%	0.33 / 0.36 / -10.2%
clickbench-sorted_q41/datafusion:vortex-compact	14585406 / 14178722 / +2.9%	44232913 / 43219391 / +2.3%	0.33 / 0.33 / +0.5%
clickbench-sorted_q42/datafusion:vortex-compact	10985110 / 10627572 / +3.4%	36961248 / 34067365 / +8.5%	0.30 / 0.31 / -4.7%

datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	769328054 / 751427049 / +2.4%	951512465 / 955024633 / -0.4%	0.81 / 0.79 / +2.8%
clickbench-sorted_q24/datafusion:parquet	9331385 / 9293516 / +0.4%	72623333 / 73053216 / -0.6%	0.13 / 0.13 / +1.0%
clickbench-sorted_q26/datafusion:parquet	9175329 / 9031460 / +1.6%	74352915 / 74311729 / +0.1%	0.12 / 0.12 / +1.5%
clickbench-sorted_q36/datafusion:parquet	93751532 / 93603110 / +0.2%	171854981 / 167430698 / +2.6%	0.55 / 0.56 / -2.4%
clickbench-sorted_q37/datafusion:parquet	64710004 / 64082960 / +1.0%	133591971 / 131153995 / +1.9%	0.48 / 0.49 / -0.9%
clickbench-sorted_q38/datafusion:parquet	87812350 / 87381249 / +0.5%	168664383 / 155709588 / +8.3%	0.52 / 0.56 / -7.2%
clickbench-sorted_q39/datafusion:parquet	159813789 / 159489019 / +0.2%	238144488 / 229372761 / +3.8%	0.67 / 0.70 / -3.5%
clickbench-sorted_q40/datafusion:parquet	45033825 / 44126666 / +2.1%	120038801 / 109378651 / +9.7%	0.38 / 0.40 / -7.0%
clickbench-sorted_q41/datafusion:parquet	42238158 / 41462998 / +1.9%	114710802 / 107994360 / +6.2%	0.37 / 0.38 / -4.1%
clickbench-sorted_q42/datafusion:parquet	26337676 / 26082227 / +1.0%	88506206 / 87002226 / +1.7%	0.30 / 0.30 / -0.7%

duckdb / vortex-file-compressed / ns (0.947x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	70262776 / 71333576 / -1.5%	95715036 / 101909352 / -6.1%	0.73 / 0.70 / +4.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed	20185886 / 24216480 / -16.6% 🟢	27045263 / 34660936 / -22.0% 🟢	0.75 / 0.70 / +6.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed	12998048 / 17341866 / -25.0% 🟢	25502474 / 29513997 / -13.6% 🟢	0.51 / 0.59 / -13.3%
clickbench-sorted_q36/duckdb:vortex-file-compressed	44876725 / 44513632 / +0.8%	77497550 / 75316606 / +2.9%	0.58 / 0.59 / -2.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed	36208013 / 38888164 / -6.9%	63193307 / 62964493 / +0.4%	0.57 / 0.62 / -7.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed	51478715 / 50321728 / +2.3%	78784315 / 74026246 / +6.4%	0.65 / 0.68 / -3.9%
clickbench-sorted_q39/duckdb:vortex-file-compressed	110978755 / 113466865 / -2.2%	143434855 / 142606047 / +0.6%	0.77 / 0.80 / -2.8%
clickbench-sorted_q40/duckdb:vortex-file-compressed	21924953 / 21634310 / +1.3%	40986866 / 38924227 / +5.3%	0.53 / 0.56 / -3.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed	21303982 / 21740666 / -2.0%	42838761 / 42028676 / +1.9%	0.50 / 0.52 / -3.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed	18652862 / 18436620 / +1.2%	34299707 / 34768722 / -1.3%	0.54 / 0.53 / +2.6%

duckdb / vortex-compact / ns (0.988x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact	71295546 / 70946457 / +0.5%	97840024 / 92189934 / +6.1%	0.73 / 0.77 / -5.3%
clickbench-sorted_q24/duckdb:vortex-compact	21200070 / 21754726 / -2.5%	33715285 / 33309331 / +1.2%	0.63 / 0.65 / -3.7%
clickbench-sorted_q26/duckdb:vortex-compact	15243270 / 17038647 / -10.5% 🟢	26858528 / 32371254 / -17.0% 🟢	0.57 / 0.53 / +7.8%
clickbench-sorted_q36/duckdb:vortex-compact	40030995 / 37995278 / +5.4%	78270303 / 75088956 / +4.2%	0.51 / 0.51 / +1.1%
clickbench-sorted_q37/duckdb:vortex-compact	32197654 / 33610750 / -4.2%	68126945 / 73743325 / -7.6%	0.47 / 0.46 / +3.7%
clickbench-sorted_q38/duckdb:vortex-compact	34083556 / 34969701 / -2.5%	73157587 / 69601587 / +5.1%	0.47 / 0.50 / -7.3%
clickbench-sorted_q39/duckdb:vortex-compact	64509970 / 64750598 / -0.4%	109477272 / 102009883 / +7.3%	0.59 / 0.63 / -7.2%
clickbench-sorted_q40/duckdb:vortex-compact	19841399 / 19587666 / +1.3%	41390836 / 40774996 / +1.5%	0.48 / 0.48 / -0.2%
clickbench-sorted_q41/duckdb:vortex-compact	19990827 / 19504034 / +2.5%	43234248 / 41169530 / +5.0%	0.46 / 0.47 / -2.4%
clickbench-sorted_q42/duckdb:vortex-compact	15227354 / 15340813 / -0.7%	30909198 / 32479997 / -4.8%	0.49 / 0.47 / +4.3%

duckdb / parquet / ns (0.981x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	127521986 / 127770155 / -0.2%	147631329 / 140539666 / +5.0%	0.86 / 0.91 / -5.0%
clickbench-sorted_q24/duckdb:parquet	18066148 / 20789450 / -13.1% 🟢	27744621 / 32582799 / -14.8% 🟢	0.65 / 0.64 / +2.1%
clickbench-sorted_q26/duckdb:parquet	13292266 / 13492484 / -1.5%	24434528 / 24223360 / +0.9%	0.54 / 0.56 / -2.3%
clickbench-sorted_q36/duckdb:parquet	47576740 / 46014278 / +3.4%	68391471 / 61391476 / +11.4% 🔴	0.70 / 0.75 / -7.2%
clickbench-sorted_q37/duckdb:parquet	31324400 / 32579098 / -3.9%	54349185 / 45808019 / +18.6% 🔴	0.58 / 0.71 / -19.0%
clickbench-sorted_q38/duckdb:parquet	42677042 / 41374102 / +3.1%	62793696 / 54320561 / +15.6% 🔴	0.68 / 0.76 / -10.8%
clickbench-sorted_q39/duckdb:parquet	73208132 / 74751492 / -2.1%	97920703 / 87590895 / +11.8% 🔴	0.75 / 0.85 / -12.4%
clickbench-sorted_q40/duckdb:parquet	17353252 / 16957418 / +2.3%	46284626 / 36339109 / +27.4% 🔴	0.37 / 0.47 / -19.7%
clickbench-sorted_q41/duckdb:parquet	15956948 / 17419116 / -8.4%	46858049 / 35387862 / +32.4% 🔴	0.34 / 0.49 / -30.8%
clickbench-sorted_q42/duckdb:parquet	11683598 / 11443224 / +2.1%	23535814 / 23386959 / +0.6%	0.50 / 0.49 / +1.5%

File Size Changes (200 files changed, +0.0% overall, 88↑ 112↓)

File	Scale	Format	Base	HEAD	Change	%
hits_001.vortex	1.0	vortex-file-compressed	190.24 MB	194.55 MB	+4.31 MB	+2.3%
hits_076.vortex	1.0	vortex-compact	124.31 MB	126.07 MB	+1.76 MB	+1.4%
hits_097.vortex	1.0	vortex-file-compressed	191.76 MB	194.23 MB	+2.48 MB	+1.3%
hits_086.vortex	1.0	vortex-file-compressed	191.14 MB	193.43 MB	+2.29 MB	+1.2%
hits_001.vortex	1.0	vortex-compact	138.95 MB	140.47 MB	+1.53 MB	+1.1%
hits_039.vortex	1.0	vortex-compact	124.83 MB	126.19 MB	+1.36 MB	+1.1%
hits_023.vortex	1.0	vortex-file-compressed	194.22 MB	196.13 MB	+1.91 MB	+1.0%
hits_027.vortex	1.0	vortex-compact	138.02 MB	139.35 MB	+1.33 MB	+1.0%
hits_024.vortex	1.0	vortex-compact	123.84 MB	125.02 MB	+1.18 MB	+1.0%
hits_087.vortex	1.0	vortex-file-compressed	158.69 MB	160.14 MB	+1.45 MB	+0.9%
hits_038.vortex	1.0	vortex-compact	138.29 MB	139.52 MB	+1.23 MB	+0.9%
hits_064.vortex	1.0	vortex-compact	138.84 MB	140.01 MB	+1.17 MB	+0.8%
hits_057.vortex	1.0	vortex-file-compressed	158.80 MB	159.97 MB	+1.17 MB	+0.7%
hits_010.vortex	1.0	vortex-file-compressed	168.09 MB	169.29 MB	+1.20 MB	+0.7%
hits_000.vortex	1.0	vortex-compact	98.81 MB	99.49 MB	+704.50 KB	+0.7%
hits_074.vortex	1.0	vortex-compact	152.17 MB	153.22 MB	+1.06 MB	+0.7%
hits_063.vortex	1.0	vortex-compact	98.28 MB	98.89 MB	+627.16 KB	+0.6%
hits_059.vortex	1.0	vortex-compact	152.24 MB	153.14 MB	+915.36 KB	+0.6%
hits_059.vortex	1.0	vortex-file-compressed	197.35 MB	198.30 MB	+976.87 KB	+0.5%
hits_043.vortex	1.0	vortex-compact	94.21 MB	94.64 MB	+442.48 KB	+0.5%
hits_088.vortex	1.0	vortex-compact	133.51 MB	134.05 MB	+554.58 KB	+0.4%
hits_006.vortex	1.0	vortex-compact	95.81 MB	96.17 MB	+371.66 KB	+0.4%
hits_082.vortex	1.0	vortex-file-compressed	138.61 MB	139.12 MB	+530.64 KB	+0.4%
hits_007.vortex	1.0	vortex-file-compressed	198.56 MB	199.28 MB	+737.54 KB	+0.4%
hits_000.vortex	1.0	vortex-file-compressed	130.67 MB	131.09 MB	+437.00 KB	+0.3%
hits_084.vortex	1.0	vortex-compact	110.66 MB	111.01 MB	+361.66 KB	+0.3%
hits_041.vortex	1.0	vortex-compact	97.97 MB	98.27 MB	+310.77 KB	+0.3%
hits_095.vortex	1.0	vortex-file-compressed	153.47 MB	153.94 MB	+486.52 KB	+0.3%
hits_037.vortex	1.0	vortex-compact	132.52 MB	132.92 MB	+402.63 KB	+0.3%
hits_089.vortex	1.0	vortex-compact	98.71 MB	98.99 MB	+287.16 KB	+0.3%
hits_016.vortex	1.0	vortex-file-compressed	179.20 MB	179.68 MB	+496.09 KB	+0.3%
hits_051.vortex	1.0	vortex-file-compressed	171.79 MB	172.24 MB	+465.67 KB	+0.3%
hits_092.vortex	1.0	vortex-file-compressed	198.85 MB	199.32 MB	+476.20 KB	+0.2%
hits_033.vortex	1.0	vortex-compact	153.30 MB	153.65 MB	+354.52 KB	+0.2%
hits_061.vortex	1.0	vortex-compact	124.54 MB	124.79 MB	+255.45 KB	+0.2%
hits_089.vortex	1.0	vortex-file-compressed	130.47 MB	130.71 MB	+244.66 KB	+0.2%
hits_084.vortex	1.0	vortex-file-compressed	153.53 MB	153.80 MB	+278.34 KB	+0.2%
hits_081.vortex	1.0	vortex-compact	153.43 MB	153.69 MB	+261.61 KB	+0.2%
hits_004.vortex	1.0	vortex-file-compressed	130.55 MB	130.76 MB	+221.72 KB	+0.2%
hits_014.vortex	1.0	vortex-file-compressed	171.37 MB	171.65 MB	+287.84 KB	+0.2%
hits_012.vortex	1.0	vortex-compact	139.27 MB	139.47 MB	+207.34 KB	+0.1%
hits_066.vortex	1.0	vortex-compact	117.58 MB	117.74 MB	+161.21 KB	+0.1%
hits_093.vortex	1.0	vortex-compact	98.81 MB	98.94 MB	+134.67 KB	+0.1%
hits_053.vortex	1.0	vortex-file-compressed	188.73 MB	188.95 MB	+227.38 KB	+0.1%
hits_007.vortex	1.0	vortex-compact	153.56 MB	153.71 MB	+150.85 KB	+0.1%
hits_087.vortex	1.0	vortex-compact	125.50 MB	125.62 MB	+120.88 KB	+0.1%
hits_064.vortex	1.0	vortex-file-compressed	189.83 MB	190.00 MB	+171.89 KB	+0.1%
hits_045.vortex	1.0	vortex-file-compressed	138.66 MB	138.77 MB	+114.64 KB	+0.1%
hits_026.vortex	1.0	vortex-compact	98.61 MB	98.69 MB	+78.15 KB	+0.1%
hits_060.vortex	1.0	vortex-compact	141.17 MB	141.26 MB	+97.30 KB	+0.1%
hits_019.vortex	1.0	vortex-compact	106.18 MB	106.25 MB	+70.30 KB	+0.1%
hits_086.vortex	1.0	vortex-compact	140.68 MB	140.77 MB	+92.57 KB	+0.1%
hits_034.vortex	1.0	vortex-compact	133.29 MB	133.38 MB	+85.16 KB	+0.1%
hits_018.vortex	1.0	vortex-file-compressed	198.93 MB	199.05 MB	+125.92 KB	+0.1%
hits_070.vortex	1.0	vortex-compact	153.51 MB	153.60 MB	+90.68 KB	+0.1%
hits_077.vortex	1.0	vortex-file-compressed	171.64 MB	171.73 MB	+91.39 KB	+0.1%
hits_097.vortex	1.0	vortex-compact	141.32 MB	141.39 MB	+73.00 KB	+0.1%
hits_067.vortex	1.0	vortex-file-compressed	130.74 MB	130.81 MB	+66.52 KB	+0.0%
hits_032.vortex	1.0	vortex-file-compressed	153.59 MB	153.66 MB	+74.95 KB	+0.0%
hits_038.vortex	1.0	vortex-file-compressed	188.98 MB	189.06 MB	+85.52 KB	+0.0%
hits_040.vortex	1.0	vortex-compact	109.96 MB	110.00 MB	+47.41 KB	+0.0%
hits_058.vortex	1.0	vortex-compact	111.04 MB	111.07 MB	+34.77 KB	+0.0%
hits_003.vortex	1.0	vortex-file-compressed	135.76 MB	135.80 MB	+42.25 KB	+0.0%
hits_034.vortex	1.0	vortex-file-compressed	180.89 MB	180.95 MB	+54.09 KB	+0.0%
hits_023.vortex	1.0	vortex-compact	142.69 MB	142.73 MB	+41.42 KB	+0.0%
hits_002.vortex	1.0	vortex-compact	124.13 MB	124.17 MB	+35.88 KB	+0.0%
hits_024.vortex	1.0	vortex-file-compressed	159.46 MB	159.51 MB	+45.97 KB	+0.0%
hits_009.vortex	1.0	vortex-file-compressed	100.58 MB	100.60 MB	+21.14 KB	+0.0%
hits_005.vortex	1.0	vortex-compact	116.27 MB	116.30 MB	+24.15 KB	+0.0%
hits_052.vortex	1.0	vortex-file-compressed	130.05 MB	130.07 MB	+21.98 KB	+0.0%
hits_094.vortex	1.0	vortex-compact	110.75 MB	110.77 MB	+17.72 KB	+0.0%
hits_021.vortex	1.0	vortex-file-compressed	153.51 MB	153.53 MB	+20.55 KB	+0.0%
hits_068.vortex	1.0	vortex-compact	112.54 MB	112.55 MB	+14.21 KB	+0.0%
hits_058.vortex	1.0	vortex-file-compressed	154.14 MB	154.16 MB	+19.33 KB	+0.0%
hits_035.vortex	1.0	vortex-compact	75.93 MB	75.94 MB	+7.86 KB	+0.0%
hits_011.vortex	1.0	vortex-compact	152.81 MB	152.82 MB	+10.20 KB	+0.0%
hits_047.vortex	1.0	vortex-compact	110.46 MB	110.47 MB	+5.73 KB	+0.0%
hits_073.vortex	1.0	vortex-compact	134.16 MB	134.17 MB	+5.48 KB	+0.0%
hits_090.vortex	1.0	vortex-compact	141.21 MB	141.22 MB	+5.50 KB	+0.0%
hits_025.vortex	1.0	vortex-file-compressed	171.08 MB	171.09 MB	+6.43 KB	+0.0%
hits_078.vortex	1.0	vortex-file-compressed	129.97 MB	129.97 MB	+3.68 KB	+0.0%
hits_009.vortex	1.0	vortex-compact	75.20 MB	75.21 MB	+1.75 KB	+0.0%
hits_017.vortex	1.0	vortex-file-compressed	145.83 MB	145.83 MB	+2.49 KB	+0.0%
hits_044.vortex	1.0	vortex-file-compressed	199.36 MB	199.36 MB	+2.54 KB	+0.0%
hits_091.vortex	1.0	vortex-compact	112.37 MB	112.37 MB	+1.27 KB	+0.0%
hits_010.vortex	1.0	vortex-compact	123.23 MB	123.23 MB	+600 B	+0.0%
hits_072.vortex	1.0	vortex-compact	75.55 MB	75.55 MB	+232 B	+0.0%
hits_095.vortex	1.0	vortex-compact	110.60 MB	110.60 MB	+152 B	+0.0%
hits_052.vortex	1.0	vortex-compact	98.67 MB	98.67 MB	1.66 KB	-0.0%
hits_029.vortex	1.0	vortex-compact	153.34 MB	153.34 MB	3.63 KB	-0.0%
hits_026.vortex	1.0	vortex-file-compressed	130.51 MB	130.50 MB	7.18 KB	-0.0%
hits_063.vortex	1.0	vortex-file-compressed	130.90 MB	130.90 MB	7.32 KB	-0.0%
hits_099.vortex	1.0	vortex-compact	133.38 MB	133.37 MB	8.52 KB	-0.0%
hits_071.vortex	1.0	vortex-compact	106.18 MB	106.17 MB	10.17 KB	-0.0%
hits_099.vortex	1.0	vortex-file-compressed	170.48 MB	170.47 MB	17.12 KB	-0.0%
hits_021.vortex	1.0	vortex-compact	110.62 MB	110.61 MB	11.37 KB	-0.0%
hits_091.vortex	1.0	vortex-file-compressed	146.08 MB	146.07 MB	17.19 KB	-0.0%
hits_049.vortex	1.0	vortex-file-compressed	190.51 MB	190.48 MB	23.20 KB	-0.0%
hits_032.vortex	1.0	vortex-compact	110.60 MB	110.59 MB	13.81 KB	-0.0%
hits_055.vortex	1.0	vortex-file-compressed	199.00 MB	198.97 MB	25.08 KB	-0.0%
hits_056.vortex	1.0	vortex-compact	100.86 MB	100.85 MB	13.55 KB	-0.0%
hits_002.vortex	1.0	vortex-file-compressed	160.03 MB	160.01 MB	23.13 KB	-0.0%
hits_028.vortex	1.0	vortex-compact	115.76 MB	115.74 MB	17.56 KB	-0.0%
hits_025.vortex	1.0	vortex-compact	133.68 MB	133.66 MB	20.77 KB	-0.0%
hits_042.vortex	1.0	vortex-file-compressed	201.07 MB	201.04 MB	32.51 KB	-0.0%
hits_070.vortex	1.0	vortex-file-compressed	199.26 MB	199.23 MB	34.59 KB	-0.0%
hits_042.vortex	1.0	vortex-compact	136.23 MB	136.21 MB	25.48 KB	-0.0%
hits_057.vortex	1.0	vortex-compact	111.87 MB	111.84 MB	22.69 KB	-0.0%
hits_049.vortex	1.0	vortex-compact	140.50 MB	140.47 MB	29.69 KB	-0.0%
hits_035.vortex	1.0	vortex-file-compressed	102.25 MB	102.23 MB	22.25 KB	-0.0%
hits_003.vortex	1.0	vortex-compact	104.51 MB	104.49 MB	24.05 KB	-0.0%
hits_055.vortex	1.0	vortex-compact	153.33 MB	153.29 MB	36.63 KB	-0.0%
hits_060.vortex	1.0	vortex-file-compressed	192.00 MB	191.95 MB	46.33 KB	-0.0%
hits_065.vortex	1.0	vortex-compact	124.39 MB	124.36 MB	30.04 KB	-0.0%
hits_006.vortex	1.0	vortex-file-compressed	125.68 MB	125.64 MB	35.84 KB	-0.0%
hits_069.vortex	1.0	vortex-file-compressed	141.63 MB	141.59 MB	41.98 KB	-0.0%
hits_020.vortex	1.0	vortex-file-compressed	159.30 MB	159.25 MB	48.43 KB	-0.0%
hits_098.vortex	1.0	vortex-file-compressed	136.66 MB	136.61 MB	47.90 KB	-0.0%
hits_065.vortex	1.0	vortex-file-compressed	160.92 MB	160.86 MB	61.23 KB	-0.0%
hits_076.vortex	1.0	vortex-file-compressed	160.03 MB	159.97 MB	61.61 KB	-0.0%
hits_073.vortex	1.0	vortex-file-compressed	171.91 MB	171.84 MB	67.07 KB	-0.0%
hits_062.vortex	1.0	vortex-compact	132.63 MB	132.58 MB	58.09 KB	-0.0%
hits_015.vortex	1.0	vortex-file-compressed	130.25 MB	130.19 MB	57.10 KB	-0.0%
hits_036.vortex	1.0	vortex-compact	133.37 MB	133.31 MB	58.58 KB	-0.0%
hits_046.vortex	1.0	vortex-compact	74.96 MB	74.93 MB	33.59 KB	-0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.03 MB	130.97 MB	62.20 KB	-0.0%
hits_066.vortex	1.0	vortex-file-compressed	162.33 MB	162.25 MB	81.00 KB	-0.0%
hits_047.vortex	1.0	vortex-file-compressed	153.56 MB	153.48 MB	80.48 KB	-0.1%
hits_092.vortex	1.0	vortex-compact	153.44 MB	153.36 MB	80.75 KB	-0.1%
hits_037.vortex	1.0	vortex-file-compressed	176.50 MB	176.41 MB	93.60 KB	-0.1%
hits_083.vortex	1.0	vortex-file-compressed	156.09 MB	156.01 MB	86.23 KB	-0.1%
hits_068.vortex	1.0	vortex-file-compressed	159.74 MB	159.65 MB	89.13 KB	-0.1%
hits_079.vortex	1.0	vortex-file-compressed	179.96 MB	179.85 MB	103.13 KB	-0.1%
hits_019.vortex	1.0	vortex-file-compressed	139.59 MB	139.50 MB	87.24 KB	-0.1%
hits_074.vortex	1.0	vortex-file-compressed	198.67 MB	198.54 MB	125.59 KB	-0.1%
hits_048.vortex	1.0	vortex-file-compressed	198.83 MB	198.71 MB	126.15 KB	-0.1%
hits_014.vortex	1.0	vortex-compact	134.12 MB	134.03 MB	85.11 KB	-0.1%
hits_016.vortex	1.0	vortex-compact	127.43 MB	127.35 MB	81.12 KB	-0.1%
hits_045.vortex	1.0	vortex-compact	106.22 MB	106.14 MB	74.63 KB	-0.1%
hits_083.vortex	1.0	vortex-compact	110.02 MB	109.94 MB	81.09 KB	-0.1%
hits_043.vortex	1.0	vortex-file-compressed	125.85 MB	125.75 MB	97.52 KB	-0.1%
hits_013.vortex	1.0	vortex-file-compressed	160.23 MB	160.10 MB	124.20 KB	-0.1%
hits_054.vortex	1.0	vortex-file-compressed	146.19 MB	146.08 MB	119.28 KB	-0.1%
hits_020.vortex	1.0	vortex-compact	111.71 MB	111.62 MB	93.37 KB	-0.1%
hits_096.vortex	1.0	vortex-compact	153.17 MB	153.04 MB	136.49 KB	-0.1%
hits_080.vortex	1.0	vortex-file-compressed	126.23 MB	126.11 MB	121.36 KB	-0.1%
hits_005.vortex	1.0	vortex-file-compressed	166.52 MB	166.34 MB	190.69 KB	-0.1%
hits_072.vortex	1.0	vortex-file-compressed	101.75 MB	101.63 MB	116.84 KB	-0.1%
hits_093.vortex	1.0	vortex-file-compressed	130.86 MB	130.71 MB	154.97 KB	-0.1%
hits_041.vortex	1.0	vortex-file-compressed	130.38 MB	130.22 MB	156.01 KB	-0.1%
hits_028.vortex	1.0	vortex-file-compressed	150.94 MB	150.76 MB	184.27 KB	-0.1%
hits_081.vortex	1.0	vortex-file-compressed	199.57 MB	199.33 MB	244.66 KB	-0.1%
hits_027.vortex	1.0	vortex-file-compressed	189.00 MB	188.76 MB	244.49 KB	-0.1%
hits_054.vortex	1.0	vortex-compact	112.14 MB	111.99 MB	152.54 KB	-0.1%
hits_069.vortex	1.0	vortex-compact	99.64 MB	99.50 MB	142.08 KB	-0.1%
hits_085.vortex	1.0	vortex-file-compressed	199.21 MB	198.93 MB	289.12 KB	-0.1%
hits_031.vortex	1.0	vortex-file-compressed	159.17 MB	158.94 MB	236.47 KB	-0.1%
hits_061.vortex	1.0	vortex-file-compressed	159.99 MB	159.71 MB	282.32 KB	-0.2%
hits_050.vortex	1.0	vortex-file-compressed	159.10 MB	158.82 MB	286.76 KB	-0.2%
hits_040.vortex	1.0	vortex-file-compressed	142.28 MB	142.02 MB	270.27 KB	-0.2%
hits_044.vortex	1.0	vortex-compact	153.71 MB	153.42 MB	297.95 KB	-0.2%
hits_094.vortex	1.0	vortex-file-compressed	158.24 MB	157.94 MB	311.11 KB	-0.2%
hits_008.vortex	1.0	vortex-file-compressed	139.02 MB	138.73 MB	295.05 KB	-0.2%
hits_085.vortex	1.0	vortex-compact	153.56 MB	153.24 MB	326.40 KB	-0.2%
hits_046.vortex	1.0	vortex-file-compressed	100.72 MB	100.49 MB	225.98 KB	-0.2%
hits_079.vortex	1.0	vortex-compact	128.25 MB	127.94 MB	319.60 KB	-0.2%
hits_036.vortex	1.0	vortex-file-compressed	171.26 MB	170.84 MB	436.01 KB	-0.2%
hits_077.vortex	1.0	vortex-compact	134.34 MB	134.00 MB	352.45 KB	-0.3%
hits_050.vortex	1.0	vortex-compact	125.46 MB	125.12 MB	342.22 KB	-0.3%
hits_011.vortex	1.0	vortex-file-compressed	199.18 MB	198.61 MB	591.16 KB	-0.3%
hits_051.vortex	1.0	vortex-compact	134.30 MB	133.86 MB	453.89 KB	-0.3%
hits_053.vortex	1.0	vortex-compact	139.03 MB	138.54 MB	502.02 KB	-0.4%
hits_004.vortex	1.0	vortex-compact	98.43 MB	98.08 MB	355.95 KB	-0.4%
hits_008.vortex	1.0	vortex-compact	106.21 MB	105.82 MB	398.80 KB	-0.4%
hits_039.vortex	1.0	vortex-file-compressed	160.77 MB	160.15 MB	634.20 KB	-0.4%
hits_088.vortex	1.0	vortex-file-compressed	171.84 MB	171.14 MB	711.24 KB	-0.4%
hits_029.vortex	1.0	vortex-file-compressed	199.12 MB	198.31 MB	824.27 KB	-0.4%
hits_017.vortex	1.0	vortex-compact	112.17 MB	111.70 MB	481.84 KB	-0.4%
hits_022.vortex	1.0	vortex-compact	153.05 MB	152.40 MB	664.72 KB	-0.4%
hits_031.vortex	1.0	vortex-compact	111.71 MB	111.21 MB	508.86 KB	-0.4%
hits_078.vortex	1.0	vortex-compact	97.91 MB	97.45 MB	473.83 KB	-0.5%
hits_082.vortex	1.0	vortex-compact	106.26 MB	105.73 MB	535.23 KB	-0.5%
hits_056.vortex	1.0	vortex-file-compressed	135.19 MB	134.50 MB	701.44 KB	-0.5%
hits_062.vortex	1.0	vortex-file-compressed	170.79 MB	169.92 MB	893.62 KB	-0.5%
hits_096.vortex	1.0	vortex-file-compressed	198.70 MB	197.64 MB	1.05 MB	-0.5%
hits_015.vortex	1.0	vortex-compact	97.88 MB	97.35 MB	545.73 KB	-0.5%
hits_071.vortex	1.0	vortex-file-compressed	139.51 MB	138.72 MB	804.27 KB	-0.6%
hits_018.vortex	1.0	vortex-compact	153.75 MB	152.83 MB	944.70 KB	-0.6%
hits_098.vortex	1.0	vortex-compact	104.22 MB	103.55 MB	688.91 KB	-0.6%
hits_048.vortex	1.0	vortex-compact	153.44 MB	152.43 MB	1.01 MB	-0.7%
hits_022.vortex	1.0	vortex-file-compressed	198.35 MB	197.00 MB	1.35 MB	-0.7%
hits_033.vortex	1.0	vortex-file-compressed	199.95 MB	198.33 MB	1.62 MB	-0.8%
hits_067.vortex	1.0	vortex-compact	98.40 MB	97.53 MB	884.22 KB	-0.9%
hits_075.vortex	1.0	vortex-compact	139.02 MB	137.80 MB	1.22 MB	-0.9%
hits_012.vortex	1.0	vortex-file-compressed	191.91 MB	190.01 MB	1.90 MB	-1.0%
hits_090.vortex	1.0	vortex-file-compressed	193.70 MB	191.74 MB	1.97 MB	-1.0%
hits_075.vortex	1.0	vortex-file-compressed	190.54 MB	188.42 MB	2.11 MB	-1.1%
hits_030.vortex	1.0	vortex-compact	99.29 MB	98.04 MB	1.25 MB	-1.3%
hits_080.vortex	1.0	vortex-compact	96.39 MB	95.00 MB	1.40 MB	-1.4%
hits_013.vortex	1.0	vortex-compact	126.36 MB	124.34 MB	2.03 MB	-1.6%

Totals:

vortex-compact: 11.93 GB → 11.93 GB (+0.0%)
vortex-file-compressed: 15.88 GB → 15.88 GB (+0.0%)

Revert the pull-request side of the previous commit. Lance stays on the post-merge `develop` benchmark only, which already passes `--formats arrow-ipc,parquet,lance,vortex`; the PR `Compression` matrix is left as it was so it does not grow. `pr-bench-compress.yml`, `pr-bench-runner.yml` and `develop-bench.yml` are back to their original contents, and `compress-split.py` keeps its original default format list. What remains is the storage-version fix plus docs. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01TkDpMmCYNaj43ENFUyDULe

github-actions · 2026-09-10T16:28:25Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.6%
Engines: DataFusion No clear signal (+8.3%, environment too noisy confidence) · DuckDB No clear signal (+4.9%, environment too noisy confidence)
Vortex (geomean): hot 1.076x ➖ · cold 1.108x ➖
Parquet (geomean): hot 1.010x ➖ · cold 1.023x ➖
Shifts: Parquet (control) +1.0% · Median polish +5.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.034x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	236549987 / 210960966 / +12.1%	915933503 / 722706942 / +26.7%	0.26 / 0.29 / -11.5%
tpch_q02/datafusion:vortex-file-compressed	319149156 / 360357770 / -11.4%	722970989 / 674716730 / +7.2%	0.44 / 0.53 / -17.3%
tpch_q03/datafusion:vortex-file-compressed	320891121 / 314275163 / +2.1%	1251737259 / 980830386 / +27.6%	0.26 / 0.32 / -20.0%
tpch_q04/datafusion:vortex-file-compressed	152376456 / 203657573 / -25.2%	338807552 / 702898475 / -51.8% 🟢	0.45 / 0.29 / +55.2%
tpch_q05/datafusion:vortex-file-compressed	371653855 / 349248171 / +6.4%	560375775 / 603593427 / -7.2%	0.66 / 0.58 / +14.6%
tpch_q06/datafusion:vortex-file-compressed	254110594 / 242691211 / +4.7%	385895257 / 401498211 / -3.9%	0.66 / 0.60 / +8.9%
tpch_q07/datafusion:vortex-file-compressed	365740325 / 339459752 / +7.7%	515162821 / 499148876 / +3.2%	0.71 / 0.68 / +4.4%
tpch_q08/datafusion:vortex-file-compressed	623311921 / 431461830 / +44.5% 🔴	821226736 / 559863221 / +46.7% 🔴	0.76 / 0.77 / -1.5%
tpch_q09/datafusion:vortex-file-compressed	456496879 / 453094185 / +0.8%	440474648 / 653137525 / -32.6% 🟢	1.04 / 0.69 / +49.4%
tpch_q10/datafusion:vortex-file-compressed	313405846 / 317716124 / -1.4%	459487266 / 502173507 / -8.5%	0.68 / 0.63 / +7.8%
tpch_q11/datafusion:vortex-file-compressed	305227122 / 273498437 / +11.6%	425096504 / 413833421 / +2.7%	0.72 / 0.66 / +8.6%
tpch_q12/datafusion:vortex-file-compressed	333821600 / 530761712 / -37.1% 🟢	842230114 / 641723980 / +31.2% 🔴	0.40 / 0.83 / -52.1%
tpch_q13/datafusion:vortex-file-compressed	138919695 / 107685070 / +29.0%	497286732 / 327446239 / +51.9% 🔴	0.28 / 0.33 / -15.1%
tpch_q14/datafusion:vortex-file-compressed	181572305 / 167325480 / +8.5%	313671815 / 278174455 / +12.8%	0.58 / 0.60 / -3.8%
tpch_q15/datafusion:vortex-file-compressed	297963838 / 285656431 / +4.3%	446051175 / 488344120 / -8.7%	0.67 / 0.58 / +14.2%
tpch_q16/datafusion:vortex-file-compressed	176336909 / 159324918 / +10.7%	275680373 / 351784082 / -21.6%	0.64 / 0.45 / +41.2%
tpch_q17/datafusion:vortex-file-compressed	279877854 / 323115420 / -13.4%	439365928 / 564731377 / -22.2%	0.64 / 0.57 / +11.3%
tpch_q18/datafusion:vortex-file-compressed	275063486 / 246370102 / +11.6%	555641786 / 410565195 / +35.3% 🔴	0.50 / 0.60 / -17.5%
tpch_q19/datafusion:vortex-file-compressed	348351075 / 336599879 / +3.5%	485103189 / 560958335 / -13.5%	0.72 / 0.60 / +19.7%
tpch_q20/datafusion:vortex-file-compressed	333810606 / 307377333 / +8.6%	430007769 / 453530921 / -5.2%	0.78 / 0.68 / +14.5%
tpch_q21/datafusion:vortex-file-compressed	467253945 / 444742366 / +5.1%	611420255 / 599641345 / +2.0%	0.76 / 0.74 / +3.0%
tpch_q22/datafusion:vortex-file-compressed	195248980 / 159443203 / +22.5%	362539057 / 305128284 / +18.8%	0.54 / 0.52 / +3.1%

datafusion / vortex-compact / ns (1.132x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	242148655 / 215723475 / +12.2%	738583288 / 633386404 / +16.6%	0.33 / 0.34 / -3.7%
tpch_q02/datafusion:vortex-compact	340615228 / 307441819 / +10.8%	680603523 / 559452949 / +21.7%	0.50 / 0.55 / -8.9%
tpch_q03/datafusion:vortex-compact	430337525 / 306568416 / +40.4% 🔴	1136608620 / 640087325 / +77.6% 🔴	0.38 / 0.48 / -20.9%
tpch_q04/datafusion:vortex-compact	200261259 / 154316447 / +29.8%	520580868 / 352711057 / +47.6% 🔴	0.38 / 0.44 / -12.1%
tpch_q05/datafusion:vortex-compact	386769146 / 350737598 / +10.3%	604680296 / 468438016 / +29.1%	0.64 / 0.75 / -14.6%
tpch_q06/datafusion:vortex-compact	278158846 / 281788633 / -1.3%	404771829 / 391998807 / +3.3%	0.69 / 0.72 / -4.4%
tpch_q07/datafusion:vortex-compact	454292662 / 331597679 / +37.0% 🔴	583708864 / 512742655 / +13.8%	0.78 / 0.65 / +20.3%
tpch_q08/datafusion:vortex-compact	713759824 / 384690598 / +85.5% 🔴	799133625 / 563057935 / +41.9% 🔴	0.89 / 0.68 / +30.7%
tpch_q09/datafusion:vortex-compact	291202232 / 419716699 / -30.6% 🟢	414155939 / 454956650 / -9.0%	0.70 / 0.92 / -23.8%
tpch_q10/datafusion:vortex-compact	403381486 / 314419477 / +28.3%	497383892 / 516045442 / -3.6%	0.81 / 0.61 / +33.1%
tpch_q11/datafusion:vortex-compact	284442939 / 302151377 / -5.9%	594636519 / 397799134 / +49.5% 🔴	0.48 / 0.76 / -37.0%
tpch_q12/datafusion:vortex-compact	291591506 / 361838670 / -19.4%	570605154 / 527184265 / +8.2%	0.51 / 0.69 / -25.5%
tpch_q13/datafusion:vortex-compact	126607129 / 97770626 / +29.5%	440403120 / 337613178 / +30.4% 🔴	0.29 / 0.29 / -0.7%
tpch_q14/datafusion:vortex-compact	183987537 / 163800569 / +12.3%	311327124 / 283132221 / +10.0%	0.59 / 0.58 / +2.2%
tpch_q15/datafusion:vortex-compact	318927822 / 290930156 / +9.6%	513071365 / 476756109 / +7.6%	0.62 / 0.61 / +1.9%
tpch_q16/datafusion:vortex-compact	135783230 / 153102421 / -11.3%	294368421 / 255986002 / +15.0%	0.46 / 0.60 / -22.9%
tpch_q17/datafusion:vortex-compact	627393732 / 378419904 / +65.8% 🔴	1312054567 / 469411594 / +179.5% 🔴	0.48 / 0.81 / -40.7%
tpch_q18/datafusion:vortex-compact	251328622 / 232207859 / +8.2%	386139883 / 434564613 / -11.1%	0.65 / 0.53 / +21.8%
tpch_q19/datafusion:vortex-compact	493030899 / 397389353 / +24.1%	588801408 / 526744619 / +11.8%	0.84 / 0.75 / +11.0%
tpch_q20/datafusion:vortex-compact	269322462 / 258703417 / +4.1%	381188724 / 392968906 / -3.0%	0.71 / 0.66 / +7.3%
tpch_q21/datafusion:vortex-compact	475780276 / 544978386 / -12.7%	621868460 / 805606036 / -22.8%	0.77 / 0.68 / +13.1%
tpch_q22/datafusion:vortex-compact	165496421 / 129766957 / +27.5%	377353141 / 295121438 / +27.9%	0.44 / 0.44 / -0.3%

datafusion / parquet / ns (0.999x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	166330123 / 167821477 / -0.9%	610160981 / 407825707 / +49.6% 🔴	0.27 / 0.41 / -33.8%
tpch_q02/datafusion:parquet	255612120 / 256002737 / -0.2%	534861039 / 443034518 / +20.7%	0.48 / 0.58 / -17.3%
tpch_q03/datafusion:parquet	278196340 / 272740827 / +2.0%	847800309 / 937475913 / -9.6%	0.33 / 0.29 / +12.8%
tpch_q04/datafusion:parquet	152505988 / 142880254 / +6.7%	415630203 / 344817647 / +20.5%	0.37 / 0.41 / -11.4%
tpch_q05/datafusion:parquet	341526995 / 398408402 / -14.3%	454796251 / 514066986 / -11.5%	0.75 / 0.78 / -3.1%
tpch_q06/datafusion:parquet	133439703 / 125968854 / +5.9%	298368925 / 238219913 / +25.2%	0.45 / 0.53 / -15.4%
tpch_q07/datafusion:parquet	344816801 / 361892692 / -4.7%	447356238 / 493056478 / -9.3%	0.77 / 0.73 / +5.0%
tpch_q08/datafusion:parquet	406154731 / 420538994 / -3.4%	538913425 / 525327645 / +2.6%	0.75 / 0.80 / -5.9%
tpch_q09/datafusion:parquet	438396026 / 414829564 / +5.7%	670625062 / 586884379 / +14.3%	0.65 / 0.71 / -7.5%
tpch_q10/datafusion:parquet	377413891 / 555601698 / -32.1% 🟢	661234903 / 506546598 / +30.5% 🔴	0.57 / 1.10 / -48.0%
tpch_q11/datafusion:parquet	278811628 / 277704364 / +0.4%	469486455 / 457860212 / +2.5%	0.59 / 0.61 / -2.1%
tpch_q12/datafusion:parquet	192007831 / 228956299 / -16.1%	419454420 / 423390049 / -0.9%	0.46 / 0.54 / -15.4%
tpch_q13/datafusion:parquet	396288365 / 398777084 / -0.6%	650350614 / 585657114 / +11.0%	0.61 / 0.68 / -10.5%
tpch_q14/datafusion:parquet	168718015 / 157429237 / +7.2%	275799322 / 269651216 / +2.3%	0.61 / 0.58 / +4.8%
tpch_q15/datafusion:parquet	332487268 / 269452071 / +23.4%	458272989 / 425458471 / +7.7%	0.73 / 0.63 / +14.6%
tpch_q16/datafusion:parquet	122425261 / 106809054 / +14.6%	329349363 / 327412888 / +0.6%	0.37 / 0.33 / +13.9%
tpch_q17/datafusion:parquet	314049377 / 308491234 / +1.8%	426499825 / 501316415 / -14.9%	0.74 / 0.62 / +19.7%
tpch_q18/datafusion:parquet	405636268 / 416604463 / -2.6%	505194824 / 518257181 / -2.5%	0.80 / 0.80 / -0.1%
tpch_q19/datafusion:parquet	184294083 / 179444308 / +2.7%	284101325 / 302069847 / -5.9%	0.65 / 0.59 / +9.2%
tpch_q20/datafusion:parquet	254340237 / 282093224 / -9.8%	390113280 / 466460890 / -16.4%	0.65 / 0.60 / +7.8%
tpch_q21/datafusion:parquet	346837253 / 299462987 / +15.8%	460968526 / 409963904 / +12.4%	0.75 / 0.73 / +3.0%
tpch_q22/datafusion:parquet	172755538 / 152689927 / +13.1%	330129294 / 305619095 / +8.0%	0.52 / 0.50 / +4.7%

duckdb / vortex-file-compressed / ns (1.069x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	203286265 / 197298255 / +3.0%	351947700 / 244122386 / +44.2% 🔴	0.58 / 0.81 / -28.5%
tpch_q02/duckdb:vortex-file-compressed	444190492 / 400816568 / +10.8%	624931690 / 488420324 / +27.9%	0.71 / 0.82 / -13.4%
tpch_q03/duckdb:vortex-file-compressed	455965852 / 402303652 / +13.3%	485821342 / 463647212 / +4.8%	0.94 / 0.87 / +8.2%
tpch_q04/duckdb:vortex-file-compressed	279837076 / 264085104 / +6.0%	308196867 / 377939128 / -18.5%	0.91 / 0.70 / +29.9%
tpch_q05/duckdb:vortex-file-compressed	462506367 / 370948358 / +24.7%	443307323 / 403887275 / +9.8%	1.04 / 0.92 / +13.6%
tpch_q06/duckdb:vortex-file-compressed	316726448 / 271069843 / +16.8%	271667541 / 270189548 / +0.5%	1.17 / 1.00 / +16.2%
tpch_q07/duckdb:vortex-file-compressed	441453334 / 387817658 / +13.8%	767505528 / 415706116 / +84.6% 🔴	0.58 / 0.93 / -38.3%
tpch_q08/duckdb:vortex-file-compressed	547220903 / 590028332 / -7.3%	598435275 / 687128300 / -12.9%	0.91 / 0.86 / +6.5%
tpch_q09/duckdb:vortex-file-compressed	467268191 / 436138307 / +7.1%	575815653 / 439428989 / +31.0% 🔴	0.81 / 0.99 / -18.2%
tpch_q10/duckdb:vortex-file-compressed	421031683 / 419844430 / +0.3%	496759437 / 515918816 / -3.7%	0.85 / 0.81 / +4.2%
tpch_q11/duckdb:vortex-file-compressed	162208345 / 140132600 / +15.8%	155803103 / 161483019 / -3.5%	1.04 / 0.87 / +20.0%
tpch_q12/duckdb:vortex-file-compressed	468583431 / 368211182 / +27.3%	511947407 / 445306148 / +15.0%	0.92 / 0.83 / +10.7%
tpch_q13/duckdb:vortex-file-compressed	288962586 / 294949100 / -2.0%	428428752 / 368325629 / +16.3%	0.67 / 0.80 / -15.8%
tpch_q14/duckdb:vortex-file-compressed	218829597 / 218525561 / +0.1%	270869179 / 281935139 / -3.9%	0.81 / 0.78 / +4.2%
tpch_q15/duckdb:vortex-file-compressed	148315158 / 139004253 / +6.7%	159214808 / 193969147 / -17.9%	0.93 / 0.72 / +30.0%
tpch_q16/duckdb:vortex-file-compressed	182480933 / 178197276 / +2.4%	214804590 / 190919582 / +12.5%	0.85 / 0.93 / -9.0%
tpch_q17/duckdb:vortex-file-compressed	365523661 / 374374311 / -2.4%	380281717 / 408166615 / -6.8%	0.96 / 0.92 / +4.8%
tpch_q18/duckdb:vortex-file-compressed	278475762 / 286322435 / -2.7%	301537980 / 339604550 / -11.2%	0.92 / 0.84 / +9.5%
tpch_q19/duckdb:vortex-file-compressed	329231179 / 332569036 / -1.0%	324668163 / 344980260 / -5.9%	1.01 / 0.96 / +5.2%
tpch_q20/duckdb:vortex-file-compressed	390550489 / 358590697 / +8.9%	427281396 / 430888794 / -0.8%	0.91 / 0.83 / +9.8%
tpch_q21/duckdb:vortex-file-compressed	742871167 / 638980619 / +16.3%	1073941148 / 642363499 / +67.2% 🔴	0.69 / 0.99 / -30.5%
tpch_q22/duckdb:vortex-file-compressed	137612819 / 136240107 / +1.0%	177051060 / 153841945 / +15.1%	0.78 / 0.89 / -12.2%

duckdb / vortex-compact / ns (1.072x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	209464398 / 216603056 / -3.3%	257804851 / 242474881 / +6.3%	0.81 / 0.89 / -9.0%
tpch_q02/duckdb:vortex-compact	356506306 / 364088054 / -2.1%	379652219 / 414463628 / -8.4%	0.94 / 0.88 / +6.9%
tpch_q03/duckdb:vortex-compact	476339438 / 404623119 / +17.7%	638833774 / 444617790 / +43.7% 🔴	0.75 / 0.91 / -18.1%
tpch_q04/duckdb:vortex-compact	328664044 / 219392261 / +49.8% 🔴	585049230 / 272597217 / +114.6% 🔴	0.56 / 0.80 / -30.2%
tpch_q05/duckdb:vortex-compact	382912453 / 383567947 / -0.2%	386839109 / 371306906 / +4.2%	0.99 / 1.03 / -4.2%
tpch_q06/duckdb:vortex-compact	267494404 / 290964374 / -8.1%	283631495 / 293041297 / -3.2%	0.94 / 0.99 / -5.0%
tpch_q07/duckdb:vortex-compact	424207069 / 416862140 / +1.8%	466028860 / 585803335 / -20.4%	0.91 / 0.71 / +27.9%
tpch_q08/duckdb:vortex-compact	565107607 / 504123957 / +12.1%	707984510 / 557648113 / +27.0%	0.80 / 0.90 / -11.7%
tpch_q09/duckdb:vortex-compact	447846595 / 420835272 / +6.4%	448397533 / 447278852 / +0.3%	1.00 / 0.94 / +6.2%
tpch_q10/duckdb:vortex-compact	501825345 / 444374001 / +12.9%	543023299 / 470870018 / +15.3%	0.92 / 0.94 / -2.1%
tpch_q11/duckdb:vortex-compact	165118349 / 150391120 / +9.8%	208243892 / 162726550 / +28.0%	0.79 / 0.92 / -14.2%
tpch_q12/duckdb:vortex-compact	454803389 / 427395066 / +6.4%	516721786 / 467866181 / +10.4%	0.88 / 0.91 / -3.6%
tpch_q13/duckdb:vortex-compact	268933115 / 218696212 / +23.0%	381870757 / 268475644 / +42.2% 🔴	0.70 / 0.81 / -13.5%
tpch_q14/duckdb:vortex-compact	247868496 / 233734273 / +6.0%	272368498 / 255370959 / +6.7%	0.91 / 0.92 / -0.6%
tpch_q15/duckdb:vortex-compact	138040490 / 139912861 / -1.3%	201514802 / 245476351 / -17.9%	0.69 / 0.57 / +20.2%
tpch_q16/duckdb:vortex-compact	170376441 / 172140399 / -1.0%	235960630 / 206027171 / +14.5%	0.72 / 0.84 / -13.6%
tpch_q17/duckdb:vortex-compact	379487068 / 394578084 / -3.8%	809048325 / 381533543 / +112.1% 🔴	0.47 / 1.03 / -54.6%
tpch_q18/duckdb:vortex-compact	312757612 / 270118266 / +15.8%	328203560 / 287837546 / +14.0%	0.95 / 0.94 / +1.5%
tpch_q19/duckdb:vortex-compact	365464377 / 342769080 / +6.6%	350645752 / 402704985 / -12.9%	1.04 / 0.85 / +22.5%
tpch_q20/duckdb:vortex-compact	372392576 / 362586343 / +2.7%	489660136 / 389834206 / +25.6%	0.76 / 0.93 / -18.2%
tpch_q21/duckdb:vortex-compact	534242479 / 522981571 / +2.2%	586644892 / 596959711 / -1.7%	0.91 / 0.88 / +3.9%
tpch_q22/duckdb:vortex-compact	122020165 / 103318896 / +18.1%	135468896 / 117505002 / +15.3%	0.90 / 0.88 / +2.4%

duckdb / parquet / ns (1.020x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	294245008 / 283827339 / +3.7%	273958653 / 289886434 / -5.5%	1.07 / 0.98 / +9.7%
tpch_q02/duckdb:parquet	661571392 / 613012477 / +7.9%	678054879 / 758571769 / -10.6%	0.98 / 0.81 / +20.7%
tpch_q03/duckdb:parquet	754431540 / 765515106 / -1.4%	1079543141 / 1378411689 / -21.7%	0.70 / 0.56 / +25.8%
tpch_q04/duckdb:parquet	449683222 / 432985781 / +3.9%	570338343 / 531733191 / +7.3%	0.79 / 0.81 / -3.2%
tpch_q05/duckdb:parquet	909234269 / 867333232 / +4.8%	876591836 / 795399369 / +10.2%	1.04 / 1.09 / -4.9%
tpch_q06/duckdb:parquet	302166476 / 282024445 / +7.1%	321359793 / 267325480 / +20.2%	0.94 / 1.05 / -10.9%
tpch_q07/duckdb:parquet	805295288 / 857031899 / -6.0%	918189019 / 1249027868 / -26.5%	0.88 / 0.69 / +27.8%
tpch_q08/duckdb:parquet	1029749175 / 1051761287 / -2.1%	1012088517 / 1148549038 / -11.9%	1.02 / 0.92 / +11.1%
tpch_q09/duckdb:parquet	907356483 / 981148683 / -7.5%	1002096189 / 962745482 / +4.1%	0.91 / 1.02 / -11.2%
tpch_q10/duckdb:parquet	936029789 / 941126333 / -0.5%	891240408 / 856483090 / +4.1%	1.05 / 1.10 / -4.4%
tpch_q11/duckdb:parquet	410853755 / 429365883 / -4.3%	385207334 / 529705972 / -27.3%	1.07 / 0.81 / +31.6%
tpch_q12/duckdb:parquet	596742515 / 492364597 / +21.2%	602516695 / 611301391 / -1.4%	0.99 / 0.81 / +23.0%
tpch_q13/duckdb:parquet	752603997 / 774335643 / -2.8%	897719090 / 891814950 / +0.7%	0.84 / 0.87 / -3.4%
tpch_q14/duckdb:parquet	476228547 / 483915414 / -1.6%	579651902 / 480691605 / +20.6%	0.82 / 1.01 / -18.4%
tpch_q15/duckdb:parquet	361277991 / 340360139 / +6.1%	348976804 / 378684084 / -7.8%	1.04 / 0.90 / +15.2%
tpch_q16/duckdb:parquet	484526004 / 478940856 / +1.2%	541129705 / 452653084 / +19.5%	0.90 / 1.06 / -15.4%
tpch_q17/duckdb:parquet	471162706 / 456999232 / +3.1%	413213303 / 419438230 / -1.5%	1.14 / 1.09 / +4.7%
tpch_q18/duckdb:parquet	608918227 / 569339932 / +7.0%	558305304 / 563036638 / -0.8%	1.09 / 1.01 / +7.9%
tpch_q19/duckdb:parquet	562461942 / 516394787 / +8.9%	675661042 / 583847489 / +15.7%	0.83 / 0.88 / -5.9%
tpch_q20/duckdb:parquet	767941488 / 776703303 / -1.1%	796719585 / 768879281 / +3.6%	0.96 / 1.01 / -4.6%
tpch_q21/duckdb:parquet	684245933 / 695252173 / -1.6%	761698287 / 637185759 / +19.5%	0.90 / 1.09 / -17.7%
tpch_q22/duckdb:parquet	388221505 / 381115616 / +1.9%	388347916 / 379919926 / +2.2%	1.00 / 1.00 / -0.3%

joseph-isaacs · 2026-09-10T16:33:15Z

Rust (btrblocks golden corpus) is red on 81d974e. This is not this PR — develop itself is red, so every open PR will hit it. Recording the diagnosis because it needs an owner other than me.

Reproduced on plain develop

I checked out origin/develop at 9f5856a in a clean worktree, with nothing from this PR, and ran the job's own command:

$ cargo test -p vortex-btrblocks --test golden
failures:
    golden_onpair
test result: FAILED. 1 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out

snapshot assertion for 'onpair__string_fsst_structured' failed in line 130

Identical to CI. Re-running the job will not help: it is a deterministic snapshot mismatch, not flake, so I have not spent a re-run on it.

What changed

    1     1 │ input: utf8, len=16384, nbytes=653785
    2       │-root: vortex.onpair(utf8, len=16384) nbytes=139354
    3       │-  metadata: dict_bytes_len: 11550
    4       │-  dict_offsets: vortex.primitive(u16, len=1588) nbytes=3176
          2 │+root: vortex.onpair(utf8, len=16384) nbytes=139746
          3 │+  metadata: dict_bytes_len: 11866
          4 │+  dict_offsets: vortex.primitive(u16, len=1626) nbytes=3252
    6       │-  codes: fastlanes.bitpacked(u16, len=64202) nbytes=88704
          6 │+  codes: fastlanes.bitpacked(u16, len=63845) nbytes=88704

Two commits on develop combine badly:

Commit	Effect
`d461efb` #9806 `perf(onpair): speed up compression with onpair 0.2.1 and row training`	Changed `encodings/onpair/src/compress.rs`, altering onpair's output. Touched no snapshot.
`9f5856a` #9710 `Remove the unstable encodings feature`	Created `vortex-btrblocks/tests/snapshots/golden__onpair__string_fsst_structured.snap` (+19 lines) and restructured `tests/golden.rs` and the `ci.yml` golden steps.

The snapshot #9710 committed holds the pre-#9806 onpair output — dict_bytes_len: 11550, codes len=64202 — which is exactly the - side above. Each PR was green on its own branch; together they are not. A semantic merge conflict that landed.

Why it is not this PR

This PR is three files: benchmarks/lance-bench/src/compress.rs (one-line Lance storage version), benchmarks/compress-bench/README.md, and a help string in scripts/compress-split.py. Nothing in vortex-btrblocks or encodings/onpair, and no compilation path to either — lance-bench is a leaf benchmark crate with no reverse dependencies besides the optional one in random-access-bench.

The timing corroborates it: my first head 98736325 passed this check at 16:05, and the only failure on that run was an unrelated Python (windows-x64) runner loss. #9710 merged at 17:24 BST, between my two pushes. PR builds run refs/pull/9832/merge, so develop moved underneath the PR.

Proposed fix, for whoever owns #9806 / #9710

Regenerate the snapshot against current onpair:

cargo insta test -p vortex-btrblocks --test golden --accept

I have not pushed that here. It belongs on develop rather than inside an unrelated benchmark PR, and accepting a golden snapshot is exactly the change that should be confirmed by the author of the compression change — the new numbers need to be someone's intended onpair output, not just whatever the compressor now emits. Worth noting the new dictionary is slightly larger (11550 to 11866 bytes) while the code stream shortens (64202 to 63845), which is consistent with #9806's row-training change and not obviously a regression, but that is a judgement for its author.

Happy to apply it here instead if a maintainer would rather unblock this PR directly.

Generated by Claude Code

github-actions · 2026-09-10T16:39:30Z

Benchmarks: Compression 📖

Commits: PR 98736325 vs base 56bf0a7d

vortex / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
compress time/Arade	861301186 / 891209162 / -3.4%
compress time/Bimbo	3917160681 / 3938806951 / -0.5%
compress time/CMSprovider	2927069682 / 3053235544 / -4.1%
compress time/Euro2016	339051015 / 346359404 / -2.1%
compress time/Food	312950146 / 318977468 / -1.9%
compress time/HashTags	583011574 / 594045267 / -1.9%
compress time/TPC-H l_comment canonical	783809486 / 793380490 / -1.2%
compress time/TPC-H l_comment chunked	787596352 / 796479629 / -1.1%
compress time/taxi	430114251 / 441431893 / -2.6%
compress time/wide table cols=100 chunks=1 rows=1000	7301954 / 7183116 / +1.7%
compress time/wide table cols=100 chunks=50 rows=1000	7233251 / 7168236 / +0.9%
compress time/wide table cols=1000 chunks=1 rows=1000	74375426 / 71430800 / +4.1%
compress time/wide table cols=1000 chunks=50 rows=1000	70462521 / 71065029 / -0.8%
compress time/wide table cols=10000 chunks=1 rows=1000	788446635 / 793318441 / -0.6%
compress time/wide table cols=10000 chunks=50 rows=1000	796167825 / 785570165 / +1.3%
decompress time/Arade	11155400 / 11282708 / -1.1%
decompress time/Bimbo	59799083 / 58786634 / +1.7%
decompress time/CMSprovider	28223013 / 29462737 / -4.2%
decompress time/Euro2016	8520018 / 8498218 / +0.3%
decompress time/Food	3465737 / 3842306 / -9.8%
decompress time/HashTags	71447873 / 73364666 / -2.6%
decompress time/TPC-H l_comment canonical	22836346 / 22573086 / +1.2%
decompress time/TPC-H l_comment chunked	23121754 / 22094580 / +4.6%
decompress time/taxi	8173449 / 8378642 / -2.4%
decompress time/wide table cols=100 chunks=1 rows=1000	2042877 / 2034964 / +0.4%
decompress time/wide table cols=100 chunks=50 rows=1000	2028846 / 2052655 / -1.2%
decompress time/wide table cols=1000 chunks=1 rows=1000	19866237 / 19749972 / +0.6%
decompress time/wide table cols=1000 chunks=50 rows=1000	19524246 / 19610410 / -0.4%
decompress time/wide table cols=10000 chunks=1 rows=1000	227873667 / 231509886 / -1.6%
decompress time/wide table cols=10000 chunks=50 rows=1000	228785386 / 229007454 / -0.1%

vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
vortex-file-compressed size/Arade	143228524 / 143228524 / +0.0%
vortex-file-compressed size/Bimbo	461549220 / 461549220 / +0.0%
vortex-file-compressed size/CMSprovider	413497540 / 413497540 / +0.0%
vortex-file-compressed size/Euro2016	156998596 / 156998596 / +0.0%
vortex-file-compressed size/Food	38051264 / 38051264 / +0.0%
vortex-file-compressed size/HashTags	177162308 / 177162308 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical	163461648 / 163461648 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked	163461648 / 163461648 / +0.0%
vortex-file-compressed size/taxi	51369148 / 51369148 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	932704 / 932704 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	932704 / 932704 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9309904 / 9309904 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9309904 / 9309904 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	93117904 / 93117904 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	93117904 / 93117904 / +0.0%

vortex / vortex-file-compressed / ratio (1.096x ➖, 14↑ 21↓)

name	ratio (PR / base / %diff)
vortex:lance ratio compress time/Arade	0.919261256 / 0.113143589 / +712.5% 🔴
vortex:lance ratio compress time/Bimbo	1.32455066 / 1.71918832 / -23.0% 🟢
vortex:lance ratio compress time/CMSprovider	0.825261517 / 0.253528684 / +225.5% 🔴
vortex:lance ratio compress time/Euro2016	0.297069423 / 0.268517563 / +10.6% 🔴
vortex:lance ratio compress time/Food	0.633847434 / 0.346772002 / +82.8% 🔴
vortex:lance ratio compress time/HashTags	0.515916506 / 0.62501784 / -17.5% 🟢
vortex:lance ratio compress time/TPC-H l_comment canonical	0.557565954 / 0.24719103 / +125.6% 🔴
vortex:lance ratio compress time/TPC-H l_comment chunked	0.564965586 / 0.248379372 / +127.5% 🔴
vortex:lance ratio compress time/taxi	1.54498958 / 1.88276938 / -17.9% 🟢
vortex:lance ratio compress time/wide table cols=100 chunks=1 rows=1000	1.63200967 / 1.66055771 / -1.7%
vortex:lance ratio compress time/wide table cols=100 chunks=50 rows=1000	1.61463884 / 1.65965235 / -2.7%
vortex:lance ratio compress time/wide table cols=1000 chunks=1 rows=1000	0.65617018 / 0.646760923 / +1.5%
vortex:lance ratio compress time/wide table cols=1000 chunks=50 rows=1000	0.625381178 / 0.637591664 / -1.9%
vortex:lance ratio compress time/wide table cols=10000 chunks=1 rows=1000	0.094666423 / 0.0956606069 / -1.0%
vortex:lance ratio compress time/wide table cols=10000 chunks=50 rows=1000	0.0956123633 / 0.0945394694 / +1.1%
vortex:lance ratio decompress time/Arade	0.378362652 / 0.776287094 / -51.3% 🟢
vortex:lance ratio decompress time/Bimbo	0.332165352 / 0.70664171 / -53.0% 🟢
vortex:lance ratio decompress time/CMSprovider	0.305027359 / 0.618186161 / -50.7% 🟢
vortex:lance ratio decompress time/Euro2016	0.166882762 / 0.854405343 / -80.5% 🟢
vortex:lance ratio decompress time/Food	0.298161 / 0.386591592 / -22.9% 🟢
vortex:lance ratio decompress time/HashTags	1.10477826 / 4.1307859 / -73.3% 🟢
vortex:lance ratio decompress time/TPC-H l_comment canonical	0.552276872 / 1.60646378 / -65.6% 🟢
vortex:lance ratio decompress time/TPC-H l_comment chunked	0.574919808 / 1.52462876 / -62.3% 🟢
vortex:lance ratio decompress time/taxi	0.408871018 / 0.650773113 / -37.2% 🟢
vortex:lance ratio decompress time/wide table cols=100 chunks=1 rows=1000	0.40813013 / 0.466781648 / -12.6% 🟢
vortex:lance ratio decompress time/wide table cols=100 chunks=50 rows=1000	0.400949229 / 0.459316164 / -12.7% 🟢
vortex:lance ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.208592626 / 0.213512786 / -2.3%
vortex:lance ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.202541347 / 0.206266578 / -1.8%
vortex:lance ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.0364718487 / 0.0357338232 / +2.1%
vortex:lance ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.0366585702 / 0.0355427293 / +3.1%
vortex:lance size/Arade	0.431414903 / 0.301715193 / +43.0% 🔴
vortex:lance size/Bimbo	0.459331162 / 0.148134854 / +210.1% 🔴
vortex:lance size/CMSprovider	0.435434318 / 0.194230296 / +124.2% 🔴
vortex:lance size/Euro2016	0.754902745 / 0.483190103 / +56.2% 🔴
vortex:lance size/Food	0.588850185 / 0.137444137 / +328.4% 🔴
vortex:lance size/HashTags	0.584654974 / 0.241730667 / +141.9% 🔴
vortex:lance size/TPC-H l_comment canonical	0.503584947 / 0.191145291 / +163.5% 🔴
vortex:lance size/TPC-H l_comment chunked	0.502912456 / 0.191145291 / +163.1% 🔴
vortex:lance size/taxi	0.275958688 / 0.109091396 / +153.0% 🔴
vortex:lance size/wide table cols=100 chunks=1 rows=1000	1.07895781 / 0.571806919 / +88.7% 🔴
vortex:lance size/wide table cols=100 chunks=50 rows=1000	1.07895781 / 0.571806919 / +88.7% 🔴
vortex:lance size/wide table cols=1000 chunks=1 rows=1000	1.07641342 / 0.570617493 / +88.6% 🔴
vortex:lance size/wide table cols=1000 chunks=50 rows=1000	1.07641342 / 0.570617493 / +88.6% 🔴
vortex:lance size/wide table cols=10000 chunks=1 rows=1000	1.07634047 / 0.570666608 / +88.6% 🔴
vortex:lance size/wide table cols=10000 chunks=50 rows=1000	1.07634047 / 0.570666608 / +88.6% 🔴
vortex:parquet-zstd ratio compress time/Arade	0.381148417 / 0.395850688 / -3.7%
vortex:parquet-zstd ratio compress time/Bimbo	0.332415283 / 0.332945193 / -0.2%
vortex:parquet-zstd ratio compress time/CMSprovider	0.457331351 / 0.478333765 / -4.4%
vortex:parquet-zstd ratio compress time/Euro2016	0.313575705 / 0.320123097 / -2.0%
vortex:parquet-zstd ratio compress time/Food	0.423041977 / 0.430239774 / -1.7%
vortex:parquet-zstd ratio compress time/HashTags	0.317447246 / 0.324569616 / -2.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0.298413102 / 0.300626241 / -0.7%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0.29918677 / 0.302250507 / -1.0%
vortex:parquet-zstd ratio compress time/taxi	0.3943735 / 0.404876708 / -2.6%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1.84084483 / 1.82359475 / +0.9%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	1.84222911 / 1.83356401 / +0.5%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1.67106123 / 1.60372259 / +4.2%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1.58584219 / 1.59694021 / -0.7%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1.7182338 / 1.73417229 / -0.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1.73009694 / 1.7137359 / +1.0%
vortex:parquet-zstd ratio decompress time/Arade	0.0200476693 / 0.020230396 / -0.9%
vortex:parquet-zstd ratio decompress time/Bimbo	0.0374791718 / 0.0367268786 / +2.0%
vortex:parquet-zstd ratio decompress time/CMSprovider	0.0206756908 / 0.0216227051 / -4.4%
vortex:parquet-zstd ratio decompress time/Euro2016	0.0255496084 / 0.0255180906 / +0.1%
vortex:parquet-zstd ratio decompress time/Food	0.0203900339 / 0.0225265495 / -9.5%
vortex:parquet-zstd ratio decompress time/HashTags	0.138299804 / 0.141968112 / -2.6%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0.0460347671 / 0.0452790487 / +1.7%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0.0465607484 / 0.0442778374 / +5.2%
vortex:parquet-zstd ratio decompress time/taxi	0.0376024994 / 0.0385614099 / -2.5%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	1.00438505 / 0.984036565 / +2.1%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	0.985747123 / 0.997839676 / -1.2%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.853078388 / 0.83775877 / +1.8%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.850806635 / 0.840889316 / +1.2%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.947225255 / 0.954395875 / -0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.949815978 / 0.953571213 / -0.4%
vortex:parquet-zstd size/Arade	0.555118588 / 0.555118588 / -0.0%
vortex:parquet-zstd size/Bimbo	1.20033411 / 1.20033411 / -0.0%
vortex:parquet-zstd size/CMSprovider	1.09713665 / 1.09713665 / -0.0%
vortex:parquet-zstd size/Euro2016	1.2766288 / 1.2766288 / -0.0%
vortex:parquet-zstd size/Food	1.06587666 / 1.06587666 / -0.0%
vortex:parquet-zstd size/HashTags	1.32708244 / 1.32708244 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical	1.03222699 / 1.03222699 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked	1.03222699 / 1.03222699 / -0.0%
vortex:parquet-zstd size/taxi	0.929192663 / 0.929192663 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	1.00032175 / 1.00032175 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	1.00032175 / 1.00032175 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0.998487774 / 0.998487774 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0.998487774 / 0.998487774 / +0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0.998690476 / 0.998690476 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0.998690476 / 0.998690476 / -0.0%

vortex / parquet / ns (0.998x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade	2259752755 / 2251377069 / +0.4%
parquet_rs-zstd compress time/Bimbo	11783936792 / 11830196179 / -0.4%
parquet_rs-zstd compress time/CMSprovider	6400325888 / 6383065066 / +0.3%
parquet_rs-zstd compress time/Euro2016	1081241338 / 1081956934 / -0.1%
parquet_rs-zstd compress time/Food	739761449 / 741394653 / -0.2%
parquet_rs-zstd compress time/HashTags	1836562079 / 1830255324 / +0.3%
parquet_rs-zstd compress time/TPC-H l_comment canonical	2626592070 / 2639092608 / -0.5%
parquet_rs-zstd compress time/TPC-H l_comment chunked	2632457153 / 2635163911 / -0.1%
parquet_rs-zstd compress time/taxi	1090626655 / 1090287202 / +0.0%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	3966632 / 3938987 / +0.7%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	3926358 / 3909455 / +0.4%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	44507900 / 44540621 / -0.1%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	44432240 / 44500745 / -0.2%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	458870402 / 457462297 / +0.3%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	460186830 / 458396281 / +0.4%
parquet_rs-zstd decompress time/Arade	556443735 / 557710685 / -0.2%
parquet_rs-zstd decompress time/Bimbo	1595528398 / 1600643348 / -0.3%
parquet_rs-zstd decompress time/CMSprovider	1365033614 / 1362583306 / +0.2%
parquet_rs-zstd decompress time/Euro2016	333469612 / 333027190 / +0.1%
parquet_rs-zstd decompress time/Food	169972106 / 170567889 / -0.3%
parquet_rs-zstd decompress time/HashTags	516615865 / 516768626 / -0.0%
parquet_rs-zstd decompress time/TPC-H l_comment canonical	496067373 / 498532691 / -0.5%
parquet_rs-zstd decompress time/TPC-H l_comment chunked	496593264 / 498998626 / -0.5%
parquet_rs-zstd decompress time/taxi	217364514 / 217280489 / +0.0%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2033958 / 2067976 / -1.6%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	`2058181` / 2057099 / +0.1%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	23287704 / 23574772 / -1.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	22947924 / 23321036 / -1.6%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	240569670 / 242572178 / -0.8%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	240873381 / 240157684 / +0.3%

vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
parquet size/Arade	258014282 / 258014282 / +0.0%
parquet size/Bimbo	384517292 / 384517292 / +0.0%
parquet size/CMSprovider	376887911 / 376887911 / +0.0%
parquet size/Euro2016	122979049 / 122979049 / +0.0%
parquet size/Food	35699500 / 35699500 / +0.0%
parquet size/HashTags	133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical	158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked	158358238 / 158358238 / +0.0%
parquet size/taxi	55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004 / 93240004 / +0.0%

vortex / lance / ns (1.104x ❌, 6↑ 14↓)

name	ns (PR / base / %diff)
lance compress time/Arade	936949295 / 7876797733 / -88.1% 🟢
lance compress time/Bimbo	2957350599 / 2291085216 / +29.1% 🔴
lance compress time/CMSprovider	3546838939 / 12042958988 / -70.5% 🟢
lance compress time/Euro2016	1141319130 / 1289894786 / -11.5% 🟢
lance compress time/Food	493731029 / 919847814 / -46.3% 🟢
lance compress time/HashTags	1130050245 / 950445298 / +18.9% 🔴
lance compress time/TPC-H l_comment canonical	1405769990 / 3209584470 / -56.2% 🟢
lance compress time/TPC-H l_comment chunked	1394060755 / 3206706032 / -56.5% 🟢
lance compress time/taxi	278392978 / 234458823 / +18.7% 🔴
lance compress time/wide table cols=100 chunks=1 rows=1000	4474210 / 4325725 / +3.4%
lance compress time/wide table cols=100 chunks=50 rows=1000	4479795 / 4319119 / +3.7%
lance compress time/wide table cols=1000 chunks=1 rows=1000	113347769 / 110443902 / +2.6%
lance compress time/wide table cols=1000 chunks=50 rows=1000	112671317 / 111458529 / +1.1%
lance compress time/wide table cols=10000 chunks=1 rows=1000	8328683077 / 8293052562 / +0.4%
lance compress time/wide table cols=10000 chunks=50 rows=1000	8327038441 / 8309441235 / +0.2%
lance decompress time/Arade	29483354 / 14534195 / +102.9% 🔴
lance decompress time/Bimbo	180028057 / 83191571 / +116.4% 🔴
lance decompress time/CMSprovider	92526169 / 47659975 / +94.1% 🔴
lance decompress time/Euro2016	51053913 / 9946354 / +413.3% 🔴
lance decompress time/Food	11623710 / 9938928 / +17.0% 🔴
lance decompress time/HashTags	64671686 / 17760462 / +264.1% 🔴
lance decompress time/TPC-H l_comment canonical	41349452 / 14051413 / +194.3% 🔴
lance decompress time/TPC-H l_comment chunked	40217355 / 14491777 / +177.5% 🔴
lance decompress time/taxi	19990287 / 12874905 / +55.3% 🔴
lance decompress time/wide table cols=100 chunks=1 rows=1000	5005455 / 4359563 / +14.8% 🔴
lance decompress time/wide table cols=100 chunks=50 rows=1000	5060107 / 4468937 / +13.2% 🔴
lance decompress time/wide table cols=1000 chunks=1 rows=1000	95239402 / 92500184 / +3.0%
lance decompress time/wide table cols=1000 chunks=50 rows=1000	96396347 / 95073134 / +1.4%
lance decompress time/wide table cols=10000 chunks=1 rows=1000	6247933003 / 6478732628 / -3.6%
lance decompress time/wide table cols=10000 chunks=50 rows=1000	6240979526 / 6443158940 / -3.1%

vortex / lance / bytes (0.457x ✅, 15↑ 0↓)

name	bytes (PR / base / %diff)
lance size/Arade	331997163 / 474714325 / -30.1% 🟢
lance size/Bimbo	1004828887 / 3115736833 / -67.7% 🟢
lance size/CMSprovider	949620925 / 2128903413 / -55.4% 🟢
lance size/Euro2016	207971950 / 324920968 / -36.0% 🟢
lance size/Food	64619601 / 276848943 / -76.7% 🟢
lance size/HashTags	303020270 / 732891323 / -58.7% 🟢
lance size/TPC-H l_comment canonical	324595977 / 855169631 / -62.0% 🟢
lance size/TPC-H l_comment chunked	325030025 / 855169631 / -62.0% 🟢
lance size/taxi	186147964 / 470881754 / -60.5% 🟢
lance size/wide table cols=100 chunks=1 rows=1000	864449 / 1631152 / -47.0% 🟢
lance size/wide table cols=100 chunks=50 rows=1000	864449 / 1631152 / -47.0% 🟢
lance size/wide table cols=1000 chunks=1 rows=1000	8649004 / 16315490 / -47.0% 🟢
lance size/wide table cols=1000 chunks=50 rows=1000	8649004 / 16315490 / -47.0% 🟢
lance size/wide table cols=10000 chunks=1 rows=1000	86513428 / 163173914 / -47.0% 🟢
lance size/wide table cols=10000 chunks=50 rows=1000	86513428 / 163173914 / -47.0% 🟢

vortex / arrow-ipc / ns (1.003x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
arrow-ipc compress time/Arade	99450807 / 99842666 / -0.4%
arrow-ipc compress time/Bimbo	621364776 / 631777898 / -1.6%
arrow-ipc compress time/CMSprovider	383657308 / 386105677 / -0.6%
arrow-ipc compress time/Euro2016	38443910 / 38734116 / -0.7%
arrow-ipc compress time/Food	33827536 / 34336922 / -1.5%
arrow-ipc compress time/HashTags	78773325 / 78930043 / -0.2%
arrow-ipc compress time/TPC-H l_comment canonical	496104978 / 497752682 / -0.3%
arrow-ipc compress time/TPC-H l_comment chunked	501342355 / 501906454 / -0.1%
arrow-ipc compress time/taxi	74646844 / 74615144 / +0.0%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000	203754 / 205087 / -0.6%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000	202905 / 203198 / -0.1%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000	2260533 / 2285900 / -1.1%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000	2230071 / 2231526 / -0.1%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000	25513511 / 25584743 / -0.3%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000	25507553 / 25675262 / -0.7%
arrow-ipc decompress time/Arade	181022220 / 181806197 / -0.4%
arrow-ipc decompress time/Bimbo	426643588 / 409095645 / +4.3%
arrow-ipc decompress time/CMSprovider	582046492 / 583510141 / -0.3%
arrow-ipc decompress time/Euro2016	74888136 / 74657180 / +0.3%
arrow-ipc decompress time/Food	58518364 / 58427706 / +0.2%
arrow-ipc decompress time/HashTags	142799855 / 142566247 / +0.2%
arrow-ipc decompress time/TPC-H l_comment canonical	535265892 / 533659809 / +0.3%
arrow-ipc decompress time/TPC-H l_comment chunked	534296722 / 534135888 / +0.0%
arrow-ipc decompress time/taxi	48155512 / 48710618 / -1.1%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000	319921 / 318802 / +0.4%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000	321924 / 320235 / +0.5%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000	3702038 / 3505872 / +5.6%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000	3501907 / 3449423 / +1.5%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000	36059413 / 35348855 / +2.0%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000	36180132 / 35097729 / +3.1%

vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
arrow-ipc size/Arade	691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo	3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider	2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016	360582666 / 360582666 / +0.0%
arrow-ipc size/Food	255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags	704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical	4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked	4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi	482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000	125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000	125752506 / 125752506 / +0.0%

github-actions · 2026-09-10T16:39:44Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -16.5%
Engines: DataFusion No clear signal (-18.1%, environment too noisy confidence) · DuckDB No clear signal (-15.0%, environment too noisy confidence)
Vortex (geomean): hot 0.945x ➖ · cold 0.937x ➖
Parquet (geomean): hot 1.133x ➖ · cold 1.067x ➖
Shifts: Parquet (control) +13.3% · Median polish +2.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.951x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	439220664 / 305847058 / +43.6% 🔴	1088164365 / 956738117 / +13.7%	0.40 / 0.32 / +26.3%
tpch_q02/datafusion:vortex-compact	477012228 / 477454341 / -0.1%	1116994591 / 958648006 / +16.5%	0.43 / 0.50 / -14.3%
tpch_q03/datafusion:vortex-compact	465140221 / 427871540 / +8.7%	1465763777 / 1600561109 / -8.4%	0.32 / 0.27 / +18.7%
tpch_q04/datafusion:vortex-compact	222560705 / 291362832 / -23.6%	639069815 / 577624739 / +10.6%	0.35 / 0.50 / -31.0%
tpch_q05/datafusion:vortex-compact	632656058 / 617123980 / +2.5%	887997190 / 930352562 / -4.6%	0.71 / 0.66 / +7.4%
tpch_q06/datafusion:vortex-compact	402695759 / 445925879 / -9.7%	551540804 / 542940386 / +1.6%	0.73 / 0.82 / -11.1%
tpch_q07/datafusion:vortex-compact	513971288 / 778125203 / -33.9% 🟢	867063835 / 1057670590 / -18.0%	0.59 / 0.74 / -19.4%
tpch_q08/datafusion:vortex-compact	874453849 / 894681496 / -2.3%	1091755487 / 1101573379 / -0.9%	0.80 / 0.81 / -1.4%
tpch_q09/datafusion:vortex-compact	712747393 / 750683415 / -5.1%	1003907601 / 1141286370 / -12.0%	0.71 / 0.66 / +7.9%
tpch_q10/datafusion:vortex-compact	621114433 / 580263135 / +7.0%	948629327 / 955873227 / -0.8%	0.65 / 0.61 / +7.9%
tpch_q11/datafusion:vortex-compact	310533059 / 320023609 / -3.0%	558331719 / 607688542 / -8.1%	0.56 / 0.53 / +5.6%
tpch_q12/datafusion:vortex-compact	484285552 / 464367449 / +4.3%	777793313 / 651035205 / +19.5%	0.62 / 0.71 / -12.7%
tpch_q13/datafusion:vortex-compact	238069383 / 331768533 / -28.2%	613573505 / 546143282 / +12.3%	0.39 / 0.61 / -36.1%
tpch_q14/datafusion:vortex-compact	356760588 / 370983056 / -3.8%	418331808 / 495077724 / -15.5%	0.85 / 0.75 / +13.8%
tpch_q15/datafusion:vortex-compact	541370377 / 659612679 / -17.9%	745510977 / 997622766 / -25.3%	0.73 / 0.66 / +9.8%
tpch_q16/datafusion:vortex-compact	262574132 / 255751120 / +2.7%	460108973 / 489424339 / -6.0%	0.57 / 0.52 / +9.2%
tpch_q17/datafusion:vortex-compact	738027100 / 702859519 / +5.0%	902079806 / 922699059 / -2.2%	0.82 / 0.76 / +7.4%
tpch_q18/datafusion:vortex-compact	568020800 / 578386295 / -1.8%	599409412 / 791385258 / -24.3%	0.95 / 0.73 / +29.7%
tpch_q19/datafusion:vortex-compact	578517629 / 529221878 / +9.3%	641209380 / 757769850 / -15.4%	0.90 / 0.70 / +29.2%
tpch_q20/datafusion:vortex-compact	586292241 / 892416556 / -34.3% 🟢	656056345 / 1058695522 / -38.0% 🟢	0.89 / 0.84 / +6.0%
tpch_q21/datafusion:vortex-compact	723430228 / 755594699 / -4.3%	909713619 / 899337986 / +1.2%	0.80 / 0.84 / -5.3%
tpch_q22/datafusion:vortex-compact	315758518 / 289189217 / +9.2%	674123613 / 569841596 / +18.3%	0.47 / 0.51 / -7.7%

datafusion / parquet / ns (1.161x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	358367147 / 392792789 / -8.8%	988527380 / 795518647 / +24.3%	0.36 / 0.49 / -26.6%
tpch_q02/datafusion:parquet	702980278 / 483193864 / +45.5% 🔴	1157481014 / 1155817941 / +0.1%	0.61 / 0.42 / +45.3%
tpch_q03/datafusion:parquet	698748116 / 680846692 / +2.6%	1562402865 / 1187627647 / +31.6% 🔴	0.45 / 0.57 / -22.0%
tpch_q04/datafusion:parquet	603421359 / 485394285 / +24.3%	849243069 / 605994909 / +40.1% 🔴	0.71 / 0.80 / -11.3%
tpch_q05/datafusion:parquet	844026099 / 696096781 / +21.3%	940723406 / 780002419 / +20.6%	0.90 / 0.89 / +0.5%
tpch_q06/datafusion:parquet	221067725 / 215869080 / +2.4%	365255431 / 450937854 / -19.0%	0.61 / 0.48 / +26.4%
tpch_q07/datafusion:parquet	739227953 / 705063006 / +4.8%	880070944 / 806529302 / +9.1%	0.84 / 0.87 / -3.9%
tpch_q08/datafusion:parquet	907501116 / 875443096 / +3.7%	1133165523 / 1027748000 / +10.3%	0.80 / 0.85 / -6.0%
tpch_q09/datafusion:parquet	1140418172 / 949313186 / +20.1%	1482947376 / 1218154940 / +21.7%	0.77 / 0.78 / -1.3%
tpch_q10/datafusion:parquet	3716519939 / 1660393811 / +123.8% 🔴	3626788065 / 2154360510 / +68.3% 🔴	1.02 / 0.77 / +33.0%
tpch_q11/datafusion:parquet	454307726 / 410131014 / +10.8%	769991492 / 548479174 / +40.4% 🔴	0.59 / 0.75 / -21.1%
tpch_q12/datafusion:parquet	804947926 / 442771003 / +81.8% 🔴	844556596 / 563169334 / +50.0% 🔴	0.95 / 0.79 / +21.2%
tpch_q13/datafusion:parquet	496544463 / 459839809 / +8.0%	1048163367 / 748869157 / +40.0% 🔴	0.47 / 0.61 / -22.9%
tpch_q14/datafusion:parquet	470491348 / 418133222 / +12.5%	815158238 / 591286351 / +37.9% 🔴	0.58 / 0.71 / -18.4%
tpch_q15/datafusion:parquet	890611001 / 889311904 / +0.1%	1098495252 / 1012770551 / +8.5%	0.81 / 0.88 / -7.7%
tpch_q16/datafusion:parquet	277136382 / 244570082 / +13.3%	592744934 / 438318863 / +35.2% 🔴	0.47 / 0.56 / -16.2%
tpch_q17/datafusion:parquet	734612382 / 824134204 / -10.9%	721393435 / 920929403 / -21.7%	1.02 / 0.89 / +13.8%
tpch_q18/datafusion:parquet	1087350053 / 964252766 / +12.8%	1357726847 / 1033070566 / +31.4% 🔴	0.80 / 0.93 / -14.2%
tpch_q19/datafusion:parquet	517974449 / 451853675 / +14.6%	714878354 / 540931694 / +32.2% 🔴	0.72 / 0.84 / -13.3%
tpch_q20/datafusion:parquet	785780192 / 747779436 / +5.1%	1330719521 / 913781845 / +45.6% 🔴	0.59 / 0.82 / -27.8%
tpch_q21/datafusion:parquet	1226344587 / 977304109 / +25.5%	1574794182 / 1174137876 / +34.1% 🔴	0.78 / 0.83 / -6.4%
tpch_q22/datafusion:parquet	613385208 / 597941430 / +2.6%	1045282948 / 1034662263 / +1.0%	0.59 / 0.58 / +1.5%

duckdb / vortex-compact / ns (0.940x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	969232139 / 929616956 / +4.3%	1211546916 / 2153464906 / -43.7% 🟢	0.80 / 0.43 / +85.3%
tpch_q02/duckdb:vortex-compact	505248364 / 535648879 / -5.7%	758038709 / 779178498 / -2.7%	0.67 / 0.69 / -3.0%
tpch_q03/duckdb:vortex-compact	1103799113 / 1229061692 / -10.2%	1629925844 / 2014997195 / -19.1%	0.68 / 0.61 / +11.0%
tpch_q04/duckdb:vortex-compact	756663114 / 724079554 / +4.5%	931065544 / 1100882353 / -15.4%	0.81 / 0.66 / +23.6%
tpch_q05/duckdb:vortex-compact	1050156473 / 1407620040 / -25.4%	1315244815 / 1485000346 / -11.4%	0.80 / 0.95 / -15.8%
tpch_q06/duckdb:vortex-compact	1129160303 / 1096638312 / +3.0%	1130613877 / 1128393461 / +0.2%	1.00 / 0.97 / +2.8%
tpch_q07/duckdb:vortex-compact	1426082247 / 1484466653 / -3.9%	1408166213 / 1519590521 / -7.3%	1.01 / 0.98 / +3.7%
tpch_q08/duckdb:vortex-compact	1366096210 / 1428841588 / -4.4%	1489943930 / 1557044208 / -4.3%	0.92 / 0.92 / -0.1%
tpch_q09/duckdb:vortex-compact	1717569552 / 1852392775 / -7.3%	1867873122 / 2024233009 / -7.7%	0.92 / 0.92 / +0.5%
tpch_q10/duckdb:vortex-compact	1353480131 / 1350478888 / +0.2%	1661418898 / 1792860029 / -7.3%	0.81 / 0.75 / +8.2%
tpch_q11/duckdb:vortex-compact	440606798 / 488763824 / -9.9%	596419956 / 586707270 / +1.7%	0.74 / 0.83 / -11.3%
tpch_q12/duckdb:vortex-compact	2067537191 / 2068981714 / -0.1%	2058524559 / 2621947304 / -21.5%	1.00 / 0.79 / +27.3%
tpch_q13/duckdb:vortex-compact	1095452604 / 1143211726 / -4.2%	1568849540 / 1545794667 / +1.5%	0.70 / 0.74 / -5.6%
tpch_q14/duckdb:vortex-compact	981545461 / 1211721591 / -19.0%	1034902499 / 958154214 / +8.0%	0.95 / 1.26 / -25.0%
tpch_q15/duckdb:vortex-compact	917296214 / 978739084 / -6.3%	1042654324 / 1153525955 / -9.6%	0.88 / 0.85 / +3.7%
tpch_q16/duckdb:vortex-compact	230715145 / 243786740 / -5.4%	237571768 / 337646119 / -29.6%	0.97 / 0.72 / +34.5%
tpch_q17/duckdb:vortex-compact	1429661652 / 1640868134 / -12.9%	1555460711 / 1464337677 / +6.2%	0.92 / 1.12 / -18.0%
tpch_q18/duckdb:vortex-compact	1100189747 / 1208237326 / -8.9%	1252520111 / 1193068699 / +5.0%	0.88 / 1.01 / -13.3%
tpch_q19/duckdb:vortex-compact	1033725286 / 1004646309 / +2.9%	1485598353 / 1157809801 / +28.3%	0.70 / 0.87 / -19.8%
tpch_q20/duckdb:vortex-compact	1687818907 / 1777281590 / -5.0%	1917161241 / 1986517105 / -3.5%	0.88 / 0.89 / -1.6%
tpch_q21/duckdb:vortex-compact	2216947170 / 2708943190 / -18.2%	2319813445 / 2580039205 / -10.1%	0.96 / 1.05 / -9.0%
tpch_q22/duckdb:vortex-compact	304592983 / 284451300 / +7.1%	500271760 / 485084080 / +3.1%	0.61 / 0.59 / +3.8%

duckdb / parquet / ns (1.105x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	383084465 / 422295270 / -9.3%	417250273 / 650767654 / -35.9% 🟢	0.92 / 0.65 / +41.5%
tpch_q02/duckdb:parquet	849784808 / 847129727 / +0.3%	1271700590 / 1667816312 / -23.8%	0.67 / 0.51 / +31.6%
tpch_q03/duckdb:parquet	1150148429 / 1131160512 / +1.7%	1444258460 / 1619098629 / -10.8%	0.80 / 0.70 / +14.0%
tpch_q04/duckdb:parquet	992549504 / 692044255 / +43.4% 🔴	720495701 / 696513818 / +3.4%	1.38 / 0.99 / +38.6%
tpch_q05/duckdb:parquet	1569408489 / 1236078769 / +27.0%	1326648524 / 1697034840 / -21.8%	1.18 / 0.73 / +62.4%
tpch_q06/duckdb:parquet	515872329 / 366745111 / +40.7% 🔴	389291668 / 403923364 / -3.6%	1.33 / 0.91 / +45.9%
tpch_q07/duckdb:parquet	1361624655 / 1117235153 / +21.9%	974796175 / 2259900192 / -56.9% 🟢	1.40 / 0.49 / +182.5%
tpch_q08/duckdb:parquet	1512317903 / 1520500315 / -0.5%	1946186384 / 2923621307 / -33.4% 🟢	0.78 / 0.52 / +49.4%
tpch_q09/duckdb:parquet	1557813336 / 1428698604 / +9.0%	1512861382 / 1893008731 / -20.1%	1.03 / 0.75 / +36.4%
tpch_q10/duckdb:parquet	2403399313 / 2343148627 / +2.6%	3324041370 / 4816800591 / -31.0% 🟢	0.72 / 0.49 / +48.6%
tpch_q11/duckdb:parquet	553531070 / 514039429 / +7.7%	638382029 / 547997072 / +16.5%	0.87 / 0.94 / -7.6%
tpch_q12/duckdb:parquet	998161902 / 660153516 / +51.2% 🔴	1211973848 / 928985206 / +30.5% 🔴	0.82 / 0.71 / +15.9%
tpch_q13/duckdb:parquet	904823357 / 1012710119 / -10.7%	1512156226 / 1431880441 / +5.6%	0.60 / 0.71 / -15.4%
tpch_q14/duckdb:parquet	771659300 / 731244435 / +5.5%	783293349 / 824429141 / -5.0%	0.99 / 0.89 / +11.1%
tpch_q15/duckdb:parquet	715771338 / 627471960 / +14.1%	785638556 / 569090628 / +38.1% 🔴	0.91 / 1.10 / -17.4%
tpch_q16/duckdb:parquet	687593549 / 638536652 / +7.7%	1100983694 / 609240913 / +80.7% 🔴	0.62 / 1.05 / -40.4%
tpch_q17/duckdb:parquet	692410063 / 692085806 / +0.0%	670530848 / 705004002 / -4.9%	1.03 / 0.98 / +5.2%
tpch_q18/duckdb:parquet	1050202860 / 881619634 / +19.1%	1268076571 / 828962977 / +53.0% 🔴	0.83 / 1.06 / -22.1%
tpch_q19/duckdb:parquet	772766406 / 754131857 / +2.5%	835844743 / 1141979745 / -26.8%	0.92 / 0.66 / +40.0%
tpch_q20/duckdb:parquet	1302383727 / 1289602445 / +1.0%	1184881897 / 1496645981 / -20.8%	1.10 / 0.86 / +27.6%
tpch_q21/duckdb:parquet	1183178977 / 959231344 / +23.3%	1131100557 / 1000344821 / +13.1%	1.05 / 0.96 / +9.1%
tpch_q22/duckdb:parquet	802313000 / 819330657 / -2.1%	1035044500 / 1027441838 / +0.7%	0.78 / 0.80 / -2.8%

github-actions · 2026-09-10T16:52:32Z

Benchmarks: Random Access 📖

Commits: PR 98736325 vs base 56bf0a7d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.9%
Engines: random-access No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): hot 0.995x ➖
Parquet (geomean): hot 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.896x ✅, 7↑ 1↓)

name	ns (PR / base / %diff)
random-access/arrow-tokio-local-disk	67108 / 71484 / -6.1%
random-access/arrow-tokio-local-disk-footer	160923 / 166534 / -3.4%
random-access/feature-vectors/correlated/arrow-tokio-local-disk	2121913 / 2558443 / -17.1% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer	1942250 / 3487284 / -44.3% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk	32185644 / 56102175 / -42.6% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer	56259947 / 32730680 / +71.9% 🔴
random-access/nested-lists/correlated/arrow-tokio-local-disk	56525 / 67670 / -16.5% 🟢
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer	100787 / 106537 / -5.4%
random-access/nested-lists/uniform/arrow-tokio-local-disk	1074208 / 1172429 / -8.4%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer	1135893 / 1206010 / -5.8%
random-access/nested-structs/correlated/arrow-tokio-local-disk	50247 / 58654 / -14.3% 🟢
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer	91785 / 97903 / -6.2%
random-access/nested-structs/uniform/arrow-tokio-local-disk	823383 / 1033290 / -20.3% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer	887912 / 1027751 / -13.6% 🟢
random-access/taxi/correlated/arrow-tokio-local-disk	114722 / 121654 / -5.7%
random-access/taxi/correlated/arrow-tokio-local-disk-footer	213599 / 216621 / -1.4%
random-access/taxi/uniform/arrow-tokio-local-disk	2829927 / 2901970 / -2.5%
random-access/taxi/uniform/arrow-tokio-local-disk-footer	2960474 / 3042312 / -2.7%

random-access / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	245722 / 250301 / -1.8%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	1234048 / 1221895 / +1.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	1513290 / 1499248 / +0.9%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	2656318 / 2726841 / -2.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk	211288 / 217079 / -2.7%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	373143 / 372044 / +0.3%
random-access/nested-lists/uniform/vortex-tokio-local-disk	848088 / 798585 / +6.2%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	1059759 / 1087370 / -2.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk	258312 / 276649 / -6.6%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	522074 / 524604 / -0.5%
random-access/nested-structs/uniform/vortex-tokio-local-disk	646049 / 625380 / +3.3%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	955111 / 916600 / +4.2%
random-access/taxi/correlated/vortex-tokio-local-disk	710355 / 730081 / -2.7%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1455516 / 1484303 / -1.9%
random-access/taxi/uniform/vortex-tokio-local-disk	2598258 / 2544984 / +2.1%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	3917407 / 3860404 / +1.5%
random-access/vortex-tokio-local-disk	507649 / 530350 / -4.3%
random-access/vortex-tokio-local-disk-footer	1117679 / 1138030 / -1.8%

random-access / parquet / ns (1.004x ➖, 0↑ 1↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	109370965552 / 104061356432 / +5.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	109077866113 / 104463049335 / +4.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk	121341309342 / 103682897479 / +17.0% 🔴
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	104329805018 / 104718592947 / -0.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk	133987335 / 132826593 / +0.9%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	131083721 / 134102206 / -2.3%
random-access/nested-lists/uniform/parquet-tokio-local-disk	134094788 / 130643010 / +2.6%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	130964210 / 130702369 / +0.2%
random-access/nested-structs/correlated/parquet-tokio-local-disk	7974678 / 7962848 / +0.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	7574655 / 8166005 / -7.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk	7384131 / 7762370 / -4.9%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	7471038 / 8271168 / -9.7%
random-access/parquet-tokio-local-disk	118872375 / 118583615 / +0.2%
random-access/parquet-tokio-local-disk-footer	119092382 / 120352952 / -1.0%
random-access/taxi/correlated/parquet-tokio-local-disk	178317917 / 177929575 / +0.2%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	183177565 / 180326821 / +1.6%
random-access/taxi/uniform/parquet-tokio-local-disk	191897790 / 187158488 / +2.5%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	192471776 / 192316674 / +0.1%

random-access / lance / ns (1.000x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	288610 / 286179 / +0.8%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1229581 / 1269690 / -3.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1016201 / 1036894 / -2.0%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	2008704 / 2029924 / -1.0%
random-access/lance-tokio-local-disk	533199 / 527691 / +1.0%
random-access/lance-tokio-local-disk-footer	1430476 / 1409449 / +1.5%
random-access/nested-lists/correlated/lance-tokio-local-disk	158719 / 156831 / +1.2%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	720437 / 707866 / +1.8%
random-access/nested-lists/uniform/lance-tokio-local-disk	825927 / 832742 / -0.8%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1407236 / 1409673 / -0.2%
random-access/nested-structs/correlated/lance-tokio-local-disk	269014 / 267877 / +0.4%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	641866 / 638513 / +0.5%
random-access/nested-structs/uniform/lance-tokio-local-disk	2350042 / 2297866 / +2.3%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2663585 / 2739414 / -2.8%
random-access/taxi/correlated/lance-tokio-local-disk	736762 / 742966 / -0.8%
random-access/taxi/correlated/lance-tokio-local-disk-footer	1976863 / 1931771 / +2.3%
random-access/taxi/uniform/lance-tokio-local-disk	8057941 / 8069245 / -0.1%
random-access/taxi/uniform/lance-tokio-local-disk-footer	8949931 / 9008169 / -0.6%

2.2 is the newest stable Lance storage version. `is_unstable` is `self >= Next`, and the variant order is `Legacy < V2_0 < V2_1 < Stable < V2_2 < Next < V2_3`, so 2.2 sits below the unstable boundary. lance-file maps it to `ConcreteFileVersion::V2_2` for writing and resolves `(2, 2)` back to it when reading, and `is_structural = version >= V2_1` still holds, so the compressive encodings stay on. Named explicitly rather than through `LanceFileVersion::Stable`, which resolves to `default()` — that is 2.1, the default version for new datasets, not the newest stable version. `convert.rs` and `random_access.rs` are left at 2.1 so the SQL and random-access suites keep writing the data they already write. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01TkDpMmCYNaj43ENFUyDULe

…ession-benchmarks-sgwcnd

The code comment carried the `is_unstable` variant-order proof and the 2.0 history, which belong in the commit message and the pull request, not next to the line. What a reader of `compress.rs` needs is the two non-obvious facts: 2.1 and above is where structural encoding applies the compressive encodings, and `LanceFileVersion::Stable` is not a way to ask for the newest stable version. The README loses the same 2.0 history, which describes a bug no longer present in the code. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01TkDpMmCYNaj43ENFUyDULe

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 10, 2026 — with Claude

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 10, 2026

joseph-isaacs added changelog/ci action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Sep 10, 2026 — with Claude

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 10, 2026

joseph-isaacs changed the title ~~bench: enable Lance compression across the compression benchmarks~~ bench: write Lance at storage version 2.1 in the compression benchmark Sep 10, 2026

Merge branch 'develop' into claude/lance-compression-benchmarks-sgwcnd

9311013

joseph-isaacs changed the title ~~bench: write Lance at storage version 2.1 in the compression benchmark~~ bench: write Lance at storage version 2.2 in the compression benchmark Sep 11, 2026

claude added 2 commits September 11, 2026 09:37

Merge remote-tracking branch 'origin/develop' into claude/lance-compr…

ff21d83

…ession-benchmarks-sgwcnd

Uh oh!

Conversation

joseph-isaacs commented Sep 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Why 2.2 is named explicitly

What 2.2 writes locally

Benchmark result

Two consistency checks

Times move too, and that is the point

Changes

CI status

Checks

Uh oh!

github-actions Bot commented Sep 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

codspeed-hq Bot commented Sep 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will degrade performance by 13.06%

Performance Changes

Footnotes

Uh oh!

joseph-isaacs commented Sep 10, 2026

Uh oh!

github-actions Bot commented Sep 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: String Encoding 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: Appian on NVME 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

joseph-isaacs commented Sep 10, 2026

Reproduced on plain develop

What changed

Why it is not this PR

Proposed fix, for whoever owns #9806 / #9710

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: Compression 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: TPC-H SF=10 on S3 📖

Uh oh!

github-actions Bot commented Sep 10, 2026

Benchmarks: Random Access 📖

Uh oh!

Reviewers

joseph-isaacs commented Sep 10, 2026 •

edited

Loading

github-actions Bot commented Sep 10, 2026 •

edited

Loading

codspeed-hq Bot commented Sep 10, 2026 •

edited

Loading

github-actions Bot commented Sep 10, 2026 •

edited

Loading