perf: batch fragmented CASE branch execution - #9820
19 benchmarks regressed
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 27 improved benchmarks
❌ 19 regressed benchmarks
✅ 2147 untouched benchmarks
🆕 12 new benchmarks
⏩ 218 skipped benchmarks1
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | case_when_nary_10_conditions[1000] |
285 µs | 404.6 µs | -29.55% |
| ❌ | Simulation | random_i8[0.5] |
67.9 µs | 93.3 µs | -27.25% |
| ❌ | Simulation | take_filter_primitive_nullable_slice_mask_random_indices[4096, 1000] |
100.9 µs | 131 µs | -22.99% |
| ❌ | Simulation | case_when_nary_equality_lookup[1000] |
246.4 µs | 317.3 µs | -22.34% |
| ❌ | Simulation | filter_list_primitive_short[Sparse] |
132.2 µs | 168.9 µs | -21.74% |
| ❌ | Simulation | filter_list_primitive_wide[Sparse] |
133.3 µs | 169.2 µs | -21.23% |
| ❌ | Simulation | take_filter_primitive_nullable_slice_mask_random_indices[16384, 1000] |
119.5 µs | 150.9 µs | -20.85% |
| ❌ | Simulation | filter_list_primitive_short[Clustered] |
134.2 µs | 168.6 µs | -20.4% |
| ❌ | Simulation | case_when_nary_3_conditions[1000] |
174.9 µs | 219.2 µs | -20.23% |
| ❌ | Simulation | case_when_nary_early_dominant[1000] |
174.8 µs | 216.1 µs | -19.1% |
| ❌ | Simulation | filter_list_primitive_short[Prefix] |
137.8 µs | 169.8 µs | -18.87% |
| ❌ | Simulation | filter_list_primitive_wide[Clustered] |
137.6 µs | 169.4 µs | -18.79% |
| ❌ | Simulation | case_when_nary_equality_lookup[10000] |
390.2 µs | 480 µs | -18.71% |
| ❌ | Simulation | filter_list_primitive_wide[Prefix] |
138 µs | 169.3 µs | -18.48% |
| ❌ | Simulation | filter_powerlaw_by_random[10000] |
32.3 µs | 37.9 µs | -14.66% |
| ❌ | Simulation | take_filter_primitive_slice_mask_sequential_indices[16384, 1000] |
53.7 µs | 61.5 µs | -12.69% |
| ❌ | Simulation | filter_ultra_sparse[250000] |
74.3 µs | 84.7 µs | -12.3% |
| ❌ | WallTime | mul_u32_nonnull_avx512 |
5.6 µs | 6.3 µs | -12.13% |
| ❌ | Simulation | case_when_without_else[10000] |
211.7 µs | 237.8 µs | -10.99% |
| ⚡ | Simulation | density_sweep_single_slice[0.9999] |
84.2 µs | 27.3 µs | ×3.1 |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ngates/batched-case-execution (2ae4de6) with develop (9d1b103)
Footnotes
-
218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩