Skip to content

DataFusion: Push down decimals with some explicit coercion#7919

Open
AdamGS wants to merge 2 commits into
developfrom
adamg/df-decimal
Open

DataFusion: Push down decimals with some explicit coercion#7919
AdamGS wants to merge 2 commits into
developfrom
adamg/df-decimal

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 14, 2026

Summary

Allow some version of pushing down work and casts on decimals to overcome the difference in semantics between DataFusion and Vortex.

The underlying issue here is that DataFusion is happy handling different decimals in one expression, while Vortex isn't. To overcome that, we make sure to inject some cast expressions when they are required.

@AdamGS AdamGS added ext/datafusion Relates to the DataFusion integration changelog/chore A trivial change action/benchmark-sql Trigger SQL benchmarks to run on this PR labels May 14, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 14, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6324341 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 6324341 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 6324341 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.020x ➖


datafusion / vortex-file-compressed (1.020x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 125003679 126054626 0.99
polarsignals_q01/datafusion:vortex-file-compressed 284147572 304444597 0.93
polarsignals_q02/datafusion:vortex-file-compressed 25802604 23987775 1.08
polarsignals_q03/datafusion:vortex-file-compressed 284967679 285874539 1.00
polarsignals_q04/datafusion:vortex-file-compressed 12670469 12247420 1.03
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17859051 16063707 1.11
polarsignals_q06/datafusion:vortex-file-compressed 20163949 18834821 1.07
polarsignals_q07/datafusion:vortex-file-compressed 15179511 15191284 1.00
polarsignals_q08/datafusion:vortex-file-compressed 419145352 427028913 0.98
polarsignals_q09/datafusion:vortex-file-compressed 12458560 12256193 1.02

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 1.040x ➖
Parquet (geomean): 1.056x ➖
Shifts: Parquet (control) +5.6% · Median polish +2.4%


datafusion / vortex-file-compressed (1.028x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5828441 5156972 1.13
fineweb_q01/datafusion:vortex-file-compressed 21625887 19705098 1.10
fineweb_q02/datafusion:vortex-file-compressed 22510487 22832781 0.99
fineweb_q03/datafusion:vortex-file-compressed 79294787 84696754 0.94
fineweb_q04/datafusion:vortex-file-compressed 230592827 229275306 1.01
fineweb_q05/datafusion:vortex-file-compressed 210502157 216450737 0.97
fineweb_q06/datafusion:vortex-file-compressed 54583256 51108022 1.07
fineweb_q07/datafusion:vortex-file-compressed 57740171 57480992 1.00
fineweb_q08/datafusion:vortex-file-compressed 22563524 21220327 1.06
datafusion / vortex-compact (1.062x ➖, 0↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6353005 5562316 1.14
fineweb_q01/datafusion:vortex-compact 🚨 140606366 126069609 1.12
fineweb_q02/datafusion:vortex-compact 137152123 131221042 1.05
fineweb_q03/datafusion:vortex-compact 1069421625 1013429116 1.06
fineweb_q04/datafusion:vortex-compact 1125910324 1106722702 1.02
fineweb_q05/datafusion:vortex-compact 982852606 957870627 1.03
fineweb_q06/datafusion:vortex-compact 545180328 520344522 1.05
fineweb_q07/datafusion:vortex-compact 564559433 540872721 1.04
fineweb_q08/datafusion:vortex-compact 18413144 17247872 1.07
datafusion / parquet (1.058x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7037095 5956943 1.18
fineweb_q01/datafusion:parquet 295611725 288726861 1.02
fineweb_q02/datafusion:parquet 293959224 287621855 1.02
fineweb_q03/datafusion:parquet 299362082 278477834 1.07
fineweb_q04/datafusion:parquet 308647341 294363788 1.05
fineweb_q05/datafusion:parquet 307948330 293268420 1.05
fineweb_q06/datafusion:parquet 294613697 282893865 1.04
fineweb_q07/datafusion:parquet 295300977 281462299 1.05
fineweb_q08/datafusion:parquet 287907101 276410658 1.04
duckdb / vortex-file-compressed (1.038x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3525047 3207796 1.10
fineweb_q01/duckdb:vortex-file-compressed 22380373 21939860 1.02
fineweb_q02/duckdb:vortex-file-compressed 🚨 25145649 22132098 1.14
fineweb_q03/duckdb:vortex-file-compressed 150915714 151242749 1.00
fineweb_q04/duckdb:vortex-file-compressed 218767926 218576774 1.00
fineweb_q05/duckdb:vortex-file-compressed 207980514 208961902 1.00
fineweb_q06/duckdb:vortex-file-compressed 53277171 50741227 1.05
fineweb_q07/duckdb:vortex-file-compressed 54513625 53346786 1.02
fineweb_q08/duckdb:vortex-file-compressed 22701043 22053618 1.03
duckdb / vortex-compact (1.034x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4323772 3761580 1.15
fineweb_q01/duckdb:vortex-compact 103000244 100720718 1.02
fineweb_q02/duckdb:vortex-compact 116052222 114281918 1.02
fineweb_q03/duckdb:vortex-compact 874256156 866669943 1.01
fineweb_q04/duckdb:vortex-compact 924930305 895243890 1.03
fineweb_q05/duckdb:vortex-compact 819206391 801972064 1.02
fineweb_q06/duckdb:vortex-compact 468618952 462387748 1.01
fineweb_q07/duckdb:vortex-compact 491829514 476699555 1.03
fineweb_q08/duckdb:vortex-compact 19741963 19454067 1.01
duckdb / parquet (1.053x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32458628 31869283 1.02
fineweb_q01/duckdb:parquet 86817036 82026698 1.06
fineweb_q02/duckdb:parquet 89494783 83735043 1.07
fineweb_q03/duckdb:parquet 313976883 310179034 1.01
fineweb_q04/duckdb:parquet 449136017 439376292 1.02
fineweb_q05/duckdb:parquet 418981294 410001040 1.02
fineweb_q06/duckdb:parquet 202740942 197351720 1.03
fineweb_q07/duckdb:parquet 213415716 207440907 1.03
fineweb_q08/duckdb:parquet 🚨 35277518 28524618 1.24
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +14.2% +9.7% +4.1% +53.3% ➖ noise
0 datafusion:vortex-file-compressed +13.0% +9.7% +3.0% +55.3% ➖ noise
0 duckdb:vortex-compact +14.9% +9.7% +4.8% +76.1% ➖ noise
0 duckdb:vortex-file-compressed +9.9% +9.7% +0.2% +87.7% ➖ noise
1 datafusion:vortex-compact +11.5% +4.1% +7.1% +12.5% ➖ noise
1 datafusion:vortex-file-compressed +9.7% +4.1% +5.4% +19.5% ➖ noise
1 duckdb:vortex-compact +2.3% +4.1% -1.8% +15.5% ➖ noise
1 duckdb:vortex-file-compressed +2.0% +4.1% -2.0% +65.4% ➖ noise
2 datafusion:vortex-compact +4.5% +4.5% +0.0% +13.3% ➖ noise
2 datafusion:vortex-file-compressed -1.4% +4.5% -5.7% +12.5% ➖ noise
2 duckdb:vortex-compact +1.5% +4.5% -2.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +13.6% +4.5% +8.7% +12.8% ➖ noise
3 datafusion:vortex-compact +5.5% +4.3% +1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -6.4% +4.3% -10.3% +25.5% ➖ noise
3 duckdb:vortex-compact +0.9% +4.3% -3.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.2% +4.3% -4.3% +33.9% ➖ noise
4 datafusion:vortex-compact +1.7% +3.5% -1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +3.5% -2.9% +10.0% ➖ noise
4 duckdb:vortex-compact +3.3% +3.5% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.1% +3.5% -3.3% +10.0% ➖ noise
5 datafusion:vortex-compact +2.6% +3.6% -0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.7% +3.6% -6.1% +10.0% ➖ noise
5 duckdb:vortex-compact +2.1% +3.6% -1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.5% +3.6% -3.9% +10.0% ➖ noise
6 datafusion:vortex-compact +4.8% +3.4% +1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.8% +3.4% +3.3% +10.0% ➖ noise
6 duckdb:vortex-compact +1.3% +3.4% -2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +5.0% +3.4% +1.5% +10.0% ➖ noise
7 datafusion:vortex-compact +4.4% +3.9% +0.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.5% +3.9% -3.3% +10.3% ➖ noise
7 duckdb:vortex-compact +3.2% +3.9% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.2% +3.9% -1.6% +14.8% ➖ noise
8 datafusion:vortex-compact +6.8% +13.5% -5.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +6.3% +13.5% -6.3% +10.0% ➖ noise
8 duckdb:vortex-compact +1.5% +13.5% -10.6% +12.5% ➖ noise
8 duckdb:vortex-file-compressed +2.9% +13.5% -9.3% +11.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.9%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.4%


datafusion / vortex-file-compressed (0.984x ➖, 5↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53929479 50349961 1.07
tpch_q02/datafusion:vortex-file-compressed 23105276 22028287 1.05
tpch_q03/datafusion:vortex-file-compressed 31659877 28928747 1.09
tpch_q04/datafusion:vortex-file-compressed 22510954 20984310 1.07
tpch_q05/datafusion:vortex-file-compressed 53251145 54860987 0.97
tpch_q06/datafusion:vortex-file-compressed 14177600 15210672 0.93
tpch_q07/datafusion:vortex-file-compressed 59843256 58370522 1.03
tpch_q08/datafusion:vortex-file-compressed 43964040 42126482 1.04
tpch_q09/datafusion:vortex-file-compressed 🚀 55769605 62000921 0.90
tpch_q10/datafusion:vortex-file-compressed 🚀 44741400 52963189 0.84
tpch_q11/datafusion:vortex-file-compressed 🚨 18093607 16301584 1.11
tpch_q12/datafusion:vortex-file-compressed 27598822 26246940 1.05
tpch_q13/datafusion:vortex-file-compressed 🚀 26414985 31077711 0.85
tpch_q14/datafusion:vortex-file-compressed 19268614 18045063 1.07
tpch_q15/datafusion:vortex-file-compressed 🚀 28161333 31668135 0.89
tpch_q16/datafusion:vortex-file-compressed 21134110 21880269 0.97
tpch_q17/datafusion:vortex-file-compressed 71246991 72334345 0.98
tpch_q18/datafusion:vortex-file-compressed 90902928 88679623 1.03
tpch_q19/datafusion:vortex-file-compressed 🚀 23324093 26977346 0.86
tpch_q20/datafusion:vortex-file-compressed 32788104 32223148 1.02
tpch_q21/datafusion:vortex-file-compressed 79634768 86475244 0.92
tpch_q22/datafusion:vortex-file-compressed 13536173 13837274 0.98
datafusion / vortex-compact (1.005x ➖, 1↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61222112 63425767 0.97
tpch_q02/datafusion:vortex-compact 26842291 29644904 0.91
tpch_q03/datafusion:vortex-compact 32888899 33244723 0.99
tpch_q04/datafusion:vortex-compact 25950678 26326168 0.99
tpch_q05/datafusion:vortex-compact 56663863 55152336 1.03
tpch_q06/datafusion:vortex-compact 🚨 17022604 15210714 1.12
tpch_q07/datafusion:vortex-compact 64530166 62885049 1.03
tpch_q08/datafusion:vortex-compact 48217540 47132997 1.02
tpch_q09/datafusion:vortex-compact 60816983 58954975 1.03
tpch_q10/datafusion:vortex-compact 50542775 48703865 1.04
tpch_q11/datafusion:vortex-compact 17856283 17190829 1.04
tpch_q12/datafusion:vortex-compact 34464836 35235036 0.98
tpch_q13/datafusion:vortex-compact 33156512 31805171 1.04
tpch_q14/datafusion:vortex-compact 🚀 21555965 26323726 0.82
tpch_q15/datafusion:vortex-compact 35378588 33236116 1.06
tpch_q16/datafusion:vortex-compact 25758678 27070325 0.95
tpch_q17/datafusion:vortex-compact 75491897 72197957 1.05
tpch_q18/datafusion:vortex-compact 92605101 91735548 1.01
tpch_q19/datafusion:vortex-compact 33679826 31670532 1.06
tpch_q20/datafusion:vortex-compact 36761578 36413899 1.01
tpch_q21/datafusion:vortex-compact 84089075 81428642 1.03
tpch_q22/datafusion:vortex-compact 13182778 13271167 0.99
datafusion / parquet (1.016x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 110471969 94672709 1.17
tpch_q02/datafusion:parquet 65137546 61358138 1.06
tpch_q03/datafusion:parquet 74018923 74851295 0.99
tpch_q04/datafusion:parquet 45791997 45394380 1.01
tpch_q05/datafusion:parquet 97915750 93286317 1.05
tpch_q06/datafusion:parquet 38258190 42144931 0.91
tpch_q07/datafusion:parquet 109308943 107560685 1.02
tpch_q08/datafusion:parquet 98636294 97297769 1.01
tpch_q09/datafusion:parquet 134301757 130081936 1.03
tpch_q10/datafusion:parquet 114666853 112614479 1.02
tpch_q11/datafusion:parquet 43641382 41703845 1.05
tpch_q12/datafusion:parquet 81447125 86358572 0.94
tpch_q13/datafusion:parquet 200898901 199046288 1.01
tpch_q14/datafusion:parquet 44047827 47441436 0.93
tpch_q15/datafusion:parquet 59964992 60384506 0.99
tpch_q16/datafusion:parquet 41695100 40398484 1.03
tpch_q17/datafusion:parquet 143131585 143479841 1.00
tpch_q18/datafusion:parquet 175564799 168115483 1.04
tpch_q19/datafusion:parquet 77133039 74671301 1.03
tpch_q20/datafusion:parquet 71958979 67590852 1.06
tpch_q21/datafusion:parquet 137060693 135980659 1.01
tpch_q22/datafusion:parquet 33127848 32611373 1.02
datafusion / arrow (0.897x ✅, 11↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 54877874 72943364 0.75
tpch_q02/datafusion:arrow 🚀 19805204 22980944 0.86
tpch_q03/datafusion:arrow 🚀 33867234 44866847 0.75
tpch_q04/datafusion:arrow 🚀 27298663 36538290 0.75
tpch_q05/datafusion:arrow 🚀 81617109 97930837 0.83
tpch_q06/datafusion:arrow 🚀 23487704 28222748 0.83
tpch_q07/datafusion:arrow 🚀 109160738 132904761 0.82
tpch_q08/datafusion:arrow 🚀 46993985 71704765 0.66
tpch_q09/datafusion:arrow 🚀 69651188 87956625 0.79
tpch_q10/datafusion:arrow 🚀 50654312 62082718 0.82
tpch_q11/datafusion:arrow 9727363 10629422 0.92
tpch_q12/datafusion:arrow 55523745 58335773 0.95
tpch_q13/datafusion:arrow 48380065 48217338 1.00
tpch_q14/datafusion:arrow 23081427 21547810 1.07
tpch_q15/datafusion:arrow 🚨 46916789 42558527 1.10
tpch_q16/datafusion:arrow 19922194 18699348 1.07
tpch_q17/datafusion:arrow 🚨 76484307 67278714 1.14
tpch_q18/datafusion:arrow 145590413 156962799 0.93
tpch_q19/datafusion:arrow 40302281 39864610 1.01
tpch_q20/datafusion:arrow 🚀 39728598 44736281 0.89
tpch_q21/datafusion:arrow 163592768 167467569 0.98
tpch_q22/datafusion:arrow 19577796 19339969 1.01
duckdb / vortex-file-compressed (0.978x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32212546 32929863 0.98
tpch_q02/duckdb:vortex-file-compressed 25190326 25122877 1.00
tpch_q03/duckdb:vortex-file-compressed 30102443 31387388 0.96
tpch_q04/duckdb:vortex-file-compressed 31725692 32215708 0.98
tpch_q05/duckdb:vortex-file-compressed 34194112 34992253 0.98
tpch_q06/duckdb:vortex-file-compressed 10692233 11507860 0.93
tpch_q07/duckdb:vortex-file-compressed 37350545 41057064 0.91
tpch_q08/duckdb:vortex-file-compressed 39698559 41418629 0.96
tpch_q09/duckdb:vortex-file-compressed 75419292 82969226 0.91
tpch_q10/duckdb:vortex-file-compressed 🚀 36033080 42113946 0.86
tpch_q11/duckdb:vortex-file-compressed 14557636 15527718 0.94
tpch_q12/duckdb:vortex-file-compressed 22006389 21941066 1.00
tpch_q13/duckdb:vortex-file-compressed 37095510 37507918 0.99
tpch_q14/duckdb:vortex-file-compressed 22421313 22273330 1.01
tpch_q15/duckdb:vortex-file-compressed 17510284 18017575 0.97
tpch_q16/duckdb:vortex-file-compressed 30570062 29602061 1.03
tpch_q17/duckdb:vortex-file-compressed 26034223 25659443 1.01
tpch_q18/duckdb:vortex-file-compressed 53285240 51847858 1.03
tpch_q19/duckdb:vortex-file-compressed 31612891 30548533 1.03
tpch_q20/duckdb:vortex-file-compressed 36507369 36740076 0.99
tpch_q21/duckdb:vortex-file-compressed 114932177 116846490 0.98
tpch_q22/duckdb:vortex-file-compressed 19102197 17626250 1.08
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38898637 40088655 0.97
tpch_q02/duckdb:vortex-compact 38051988 36417775 1.04
tpch_q03/duckdb:vortex-compact 33949157 35186724 0.96
tpch_q04/duckdb:vortex-compact 36488370 35186842 1.04
tpch_q05/duckdb:vortex-compact 39273288 40355214 0.97
tpch_q06/duckdb:vortex-compact 14787491 15032356 0.98
tpch_q07/duckdb:vortex-compact 44956948 45822866 0.98
tpch_q08/duckdb:vortex-compact 47784574 47620585 1.00
tpch_q09/duckdb:vortex-compact 88508413 90720255 0.98
tpch_q10/duckdb:vortex-compact 40560030 41158093 0.99
tpch_q11/duckdb:vortex-compact 21159982 20816374 1.02
tpch_q12/duckdb:vortex-compact 36468429 35481249 1.03
tpch_q13/duckdb:vortex-compact 45952370 45987574 1.00
tpch_q14/duckdb:vortex-compact 30871364 28943831 1.07
tpch_q15/duckdb:vortex-compact 20785217 20443757 1.02
tpch_q16/duckdb:vortex-compact 35871463 36842864 0.97
tpch_q17/duckdb:vortex-compact 32244226 30784516 1.05
tpch_q18/duckdb:vortex-compact 52454214 51301321 1.02
tpch_q19/duckdb:vortex-compact 37402553 36485574 1.03
tpch_q20/duckdb:vortex-compact 45276914 42777009 1.06
tpch_q21/duckdb:vortex-compact 119688836 118224697 1.01
tpch_q22/duckdb:vortex-compact 21343002 19859645 1.07
duckdb / parquet (0.990x ➖, 1↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 102735387 78624285 1.31
tpch_q02/duckdb:parquet 40181438 40200230 1.00
tpch_q03/duckdb:parquet 70829995 71117428 1.00
tpch_q04/duckdb:parquet 47372463 48542555 0.98
tpch_q05/duckdb:parquet 67344790 66335498 1.02
tpch_q06/duckdb:parquet 21299820 20931598 1.02
tpch_q07/duckdb:parquet 69201087 69991284 0.99
tpch_q08/duckdb:parquet 82197766 85101888 0.97
tpch_q09/duckdb:parquet 138330407 153474528 0.90
tpch_q10/duckdb:parquet 126527594 137546778 0.92
tpch_q11/duckdb:parquet 22083282 23669273 0.93
tpch_q12/duckdb:parquet 46391447 46349365 1.00
tpch_q13/duckdb:parquet 264457159 286013174 0.92
tpch_q14/duckdb:parquet 50537183 53147127 0.95
tpch_q15/duckdb:parquet 24995068 24429226 1.02
tpch_q16/duckdb:parquet 57731075 63241184 0.91
tpch_q17/duckdb:parquet 🚨 56892199 49882654 1.14
tpch_q18/duckdb:parquet 114812273 120615789 0.95
tpch_q19/duckdb:parquet 🚀 72128259 80635599 0.89
tpch_q20/duckdb:parquet 76006881 71209104 1.07
tpch_q21/duckdb:parquet 172591870 176468620 0.98
tpch_q22/duckdb:parquet 53472437 53795670 0.99
duckdb / duckdb (0.974x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16615112 16159150 1.03
tpch_q02/duckdb:duckdb 13968455 14287633 0.98
tpch_q03/duckdb:duckdb 20908146 21973612 0.95
tpch_q04/duckdb:duckdb 🚀 19500734 21697453 0.90
tpch_q05/duckdb:duckdb 21366273 20892792 1.02
tpch_q06/duckdb:duckdb 5611329 5447297 1.03
tpch_q07/duckdb:duckdb 24254545 26293710 0.92
tpch_q08/duckdb:duckdb 22287653 24471516 0.91
tpch_q09/duckdb:duckdb 63511164 60123835 1.06
tpch_q10/duckdb:duckdb 47141198 47228005 1.00
tpch_q11/duckdb:duckdb 6413772 6295600 1.02
tpch_q12/duckdb:duckdb 14963797 14794889 1.01
tpch_q13/duckdb:duckdb 39573827 43843061 0.90
tpch_q14/duckdb:duckdb 18093463 17682644 1.02
tpch_q15/duckdb:duckdb 11954530 12139063 0.98
tpch_q16/duckdb:duckdb 24253053 26219580 0.92
tpch_q17/duckdb:duckdb 14402043 15621215 0.92
tpch_q18/duckdb:duckdb 40445463 39231311 1.03
tpch_q19/duckdb:duckdb 29327141 31370493 0.93
tpch_q20/duckdb:duckdb 24009288 24194788 0.99
tpch_q21/duckdb:duckdb 60963968 62818779 0.97
tpch_q22/duckdb:duckdb 25295003 26662600 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -24.8% +23.5% -39.1% +18.9% ✅ faster
1 datafusion:vortex-compact -3.5% +23.5% -21.8% +17.8% ✅ faster
1 datafusion:vortex-file-compressed +7.1% +23.5% -13.3% +17.6% ➖ noise
1 duckdb:duckdb +2.8% +23.5% -16.7% +17.0% ✅ faster
1 duckdb:vortex-compact -3.0% +23.5% -21.4% +17.8% ✅ faster
1 duckdb:vortex-file-compressed -2.2% +23.5% -20.8% +20.1% ✅ faster
2 datafusion:arrow -13.8% +3.0% -16.3% +15.7% ✅ faster
2 datafusion:vortex-compact -9.5% +3.0% -12.1% +15.7% ➖ noise
2 datafusion:vortex-file-compressed +4.9% +3.0% +1.8% +15.7% ➖ noise
2 duckdb:duckdb -2.2% +3.0% -5.1% +15.7% ➖ noise
2 duckdb:vortex-compact +4.5% +3.0% +1.4% +15.7% ➖ noise
2 duckdb:vortex-file-compressed +0.3% +3.0% -2.7% +15.7% ➖ noise
3 datafusion:arrow -24.5% -0.8% -23.9% +15.7% ✅ faster
3 datafusion:vortex-compact -1.1% -0.8% -0.3% +15.7% ➖ noise
3 datafusion:vortex-file-compressed +9.4% -0.8% +10.3% +15.7% ➖ noise
3 duckdb:duckdb -4.8% -0.8% -4.1% +15.7% ➖ noise
3 duckdb:vortex-compact -3.5% -0.8% -2.8% +15.7% ➖ noise
3 duckdb:vortex-file-compressed -4.1% -0.8% -3.4% +25.2% ➖ noise
4 datafusion:arrow -25.3% -0.8% -24.7% +15.7% ✅ faster
4 datafusion:vortex-compact -1.4% -0.8% -0.7% +15.7% ➖ noise
4 datafusion:vortex-file-compressed +7.3% -0.8% +8.1% +15.7% ➖ noise
4 duckdb:duckdb -10.1% -0.8% -9.4% +15.7% ➖ noise
4 duckdb:vortex-compact +3.7% -0.8% +4.5% +15.7% ➖ noise
4 duckdb:vortex-file-compressed -1.5% -0.8% -0.7% +17.4% ➖ noise
5 datafusion:arrow -16.7% +3.2% -19.3% +15.7% ✅ faster
5 datafusion:vortex-compact +2.7% +3.2% -0.5% +15.7% ➖ noise
5 datafusion:vortex-file-compressed -2.9% +3.2% -6.0% +17.6% ➖ noise
5 duckdb:duckdb +2.3% +3.2% -0.9% +15.7% ➖ noise
5 duckdb:vortex-compact -2.7% +3.2% -5.7% +15.7% ➖ noise
5 duckdb:vortex-file-compressed -2.3% +3.2% -5.3% +15.7% ➖ noise
6 datafusion:arrow -16.8% -3.9% -13.4% +15.7% ➖ noise
6 datafusion:vortex-compact +11.9% -3.9% +16.4% +17.3% ➖ noise
6 datafusion:vortex-file-compressed -6.8% -3.9% -3.0% +19.2% ➖ noise
6 duckdb:duckdb +3.0% -3.9% +7.2% +17.1% ➖ noise
6 duckdb:vortex-compact -1.6% -3.9% +2.4% +18.1% ➖ noise
6 duckdb:vortex-file-compressed -7.1% -3.9% -3.3% +25.5% ➖ noise
7 datafusion:arrow -17.9% +0.2% -18.1% +15.7% ✅ faster
7 datafusion:vortex-compact +2.6% +0.2% +2.4% +15.7% ➖ noise
7 datafusion:vortex-file-compressed +2.5% +0.2% +2.3% +15.9% ➖ noise
7 duckdb:duckdb -7.8% +0.2% -8.0% +15.7% ➖ noise
7 duckdb:vortex-compact -1.9% +0.2% -2.1% +15.7% ➖ noise
7 duckdb:vortex-file-compressed -9.0% +0.2% -9.2% +15.7% ➖ noise
8 datafusion:arrow -34.5% -1.0% -33.8% +15.7% ✅ faster
8 datafusion:vortex-compact +2.3% -1.0% +3.4% +15.7% ➖ noise
8 datafusion:vortex-file-compressed +4.4% -1.0% +5.5% +15.7% ➖ noise
8 duckdb:duckdb -8.9% -1.0% -8.0% +15.7% ➖ noise
8 duckdb:vortex-compact +0.3% -1.0% +1.4% +15.7% ➖ noise
8 duckdb:vortex-file-compressed -4.2% -1.0% -3.1% +15.7% ➖ noise
9 datafusion:arrow -20.8% -3.5% -17.9% +15.7% ✅ faster
9 datafusion:vortex-compact +3.2% -3.5% +6.9% +15.7% ➖ noise
9 datafusion:vortex-file-compressed -10.1% -3.5% -6.8% +17.5% ➖ noise
9 duckdb:duckdb +5.6% -3.5% +9.5% +15.7% ➖ noise
9 duckdb:vortex-compact -2.4% -3.5% +1.1% +15.7% ➖ noise
9 duckdb:vortex-file-compressed -9.1% -3.5% -5.8% +15.7% ➖ noise
10 datafusion:arrow -18.4% -3.2% -15.7% +15.7% ✅ faster
10 datafusion:vortex-compact +3.8% -3.2% +7.2% +15.7% ➖ noise
10 datafusion:vortex-file-compressed -15.5% -3.2% -12.7% +16.2% ➖ noise
10 duckdb:duckdb -0.2% -3.2% +3.1% +15.7% ➖ noise
10 duckdb:vortex-compact -1.5% -3.2% +1.8% +15.7% ➖ noise
10 duckdb:vortex-file-compressed -14.4% -3.2% -11.6% +15.7% ➖ noise
11 datafusion:arrow -8.5% -1.2% -7.4% +15.7% ➖ noise
11 datafusion:vortex-compact +3.9% -1.2% +5.1% +15.7% ➖ noise
11 datafusion:vortex-file-compressed +11.0% -1.2% +12.3% +15.7% ➖ noise
11 duckdb:duckdb +1.9% -1.2% +3.1% +15.7% ➖ noise
11 duckdb:vortex-compact +1.7% -1.2% +2.9% +15.7% ➖ noise
11 duckdb:vortex-file-compressed -6.2% -1.2% -5.1% +15.7% ➖ noise
12 datafusion:arrow -4.8% -2.8% -2.0% +22.2% ➖ noise
12 datafusion:vortex-compact -2.2% -2.8% +0.7% +15.7% ➖ noise
12 datafusion:vortex-file-compressed +5.2% -2.8% +8.2% +15.9% ➖ noise
12 duckdb:duckdb +1.1% -2.8% +4.1% +15.7% ➖ noise
12 duckdb:vortex-compact +2.8% -2.8% +5.8% +15.7% ➖ noise
12 duckdb:vortex-file-compressed +0.3% -2.8% +3.2% +15.7% ➖ noise
13 datafusion:arrow +0.3% -3.4% +3.9% +15.7% ➖ noise
13 datafusion:vortex-compact +4.2% -3.4% +7.9% +15.7% ➖ noise
13 datafusion:vortex-file-compressed -15.0% -3.4% -12.0% +15.7% ➖ noise
13 duckdb:duckdb -9.7% -3.4% -6.6% +15.7% ➖ noise
13 duckdb:vortex-compact -0.1% -3.4% +3.4% +15.7% ➖ noise
13 duckdb:vortex-file-compressed -1.1% -3.4% +2.4% +15.9% ➖ noise
14 datafusion:arrow +7.1% -6.0% +14.0% +15.7% ➖ noise
14 datafusion:vortex-compact -18.1% -6.0% -12.8% +17.7% ➖ noise
14 datafusion:vortex-file-compressed +6.8% -6.0% +13.6% +15.7% ➖ noise
14 duckdb:duckdb +2.3% -6.0% +8.9% +16.4% ➖ noise
14 duckdb:vortex-compact +6.7% -6.0% +13.5% +15.7% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -6.0% +7.1% +25.1% ➖ noise
15 datafusion:arrow +10.2% +0.8% +9.4% +15.7% ➖ noise
15 datafusion:vortex-compact +6.4% +0.8% +5.6% +15.7% ➖ noise
15 datafusion:vortex-file-compressed -11.1% +0.8% -11.8% +18.5% ➖ noise
15 duckdb:duckdb -1.5% +0.8% -2.3% +15.7% ➖ noise
15 duckdb:vortex-compact +1.7% +0.8% +0.9% +16.9% ➖ noise
15 duckdb:vortex-file-compressed -2.8% +0.8% -3.6% +15.7% ➖ noise
16 datafusion:arrow +6.5% -2.9% +9.8% +15.7% ➖ noise
16 datafusion:vortex-compact -4.8% -2.9% -2.0% +15.7% ➖ noise
16 datafusion:vortex-file-compressed -3.4% -2.9% -0.5% +15.7% ➖ noise
16 duckdb:duckdb -7.5% -2.9% -4.7% +15.7% ➖ noise
16 duckdb:vortex-compact -2.6% -2.9% +0.3% +15.7% ➖ noise
16 duckdb:vortex-file-compressed +3.3% -2.9% +6.4% +15.7% ➖ noise
17 datafusion:arrow +13.7% +6.7% +6.6% +15.7% ➖ noise
17 datafusion:vortex-compact +4.6% +6.7% -2.0% +15.7% ➖ noise
17 datafusion:vortex-file-compressed -1.5% +6.7% -7.7% +18.3% ➖ noise
17 duckdb:duckdb -7.8% +6.7% -13.6% +15.7% ✅ faster
17 duckdb:vortex-compact +4.7% +6.7% -1.8% +16.0% ➖ noise
17 duckdb:vortex-file-compressed +1.5% +6.7% -4.9% +15.7% ➖ noise
18 datafusion:arrow -7.2% -0.3% -7.0% +15.7% ➖ noise
18 datafusion:vortex-compact +0.9% -0.3% +1.2% +15.7% ➖ noise
18 datafusion:vortex-file-compressed +2.5% -0.3% +2.8% +18.0% ➖ noise
18 duckdb:duckdb +3.1% -0.3% +3.4% +15.7% ➖ noise
18 duckdb:vortex-compact +2.2% -0.3% +2.6% +15.7% ➖ noise
18 duckdb:vortex-file-compressed +2.8% -0.3% +3.1% +15.7% ➖ noise
19 datafusion:arrow +1.1% -3.9% +5.2% +15.7% ➖ noise
19 datafusion:vortex-compact +6.3% -3.9% +10.6% +15.7% ➖ noise
19 datafusion:vortex-file-compressed -13.5% -3.9% -10.1% +15.7% ➖ noise
19 duckdb:duckdb -6.5% -3.9% -2.7% +15.7% ➖ noise
19 duckdb:vortex-compact +2.5% -3.9% +6.6% +15.7% ➖ noise
19 duckdb:vortex-file-compressed +3.5% -3.9% +7.7% +23.3% ➖ noise
20 datafusion:arrow -11.2% +6.6% -16.7% +15.7% ✅ faster
20 datafusion:vortex-compact +1.0% +6.6% -5.3% +15.7% ➖ noise
20 datafusion:vortex-file-compressed +1.8% +6.6% -4.5% +16.7% ➖ noise
20 duckdb:duckdb -0.8% +6.6% -6.9% +15.7% ➖ noise
20 duckdb:vortex-compact +5.8% +6.6% -0.7% +15.7% ➖ noise
20 duckdb:vortex-file-compressed -0.6% +6.6% -6.8% +20.0% ➖ noise
21 datafusion:arrow -2.3% -0.7% -1.6% +15.7% ➖ noise
21 datafusion:vortex-compact +3.3% -0.7% +4.0% +15.7% ➖ noise
21 datafusion:vortex-file-compressed -7.9% -0.7% -7.2% +15.7% ➖ noise
21 duckdb:duckdb -3.0% -0.7% -2.3% +15.7% ➖ noise
21 duckdb:vortex-compact +1.2% -0.7% +2.0% +15.7% ➖ noise
21 duckdb:vortex-file-compressed -1.6% -0.7% -0.9% +17.9% ➖ noise
22 datafusion:arrow +1.2% +0.5% +0.7% +15.7% ➖ noise
22 datafusion:vortex-compact -0.7% +0.5% -1.1% +15.7% ➖ noise
22 datafusion:vortex-file-compressed -2.2% +0.5% -2.6% +15.7% ➖ noise
22 duckdb:duckdb -5.1% +0.5% -5.6% +15.7% ➖ noise
22 duckdb:vortex-compact +7.5% +0.5% +6.9% +15.7% ➖ noise
22 duckdb:vortex-file-compressed +8.4% +0.5% +7.8% +15.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish -1.5%


datafusion / vortex-file-compressed (0.974x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25838196 25535489 1.01
tpcds_q02/datafusion:vortex-file-compressed 46199910 47131784 0.98
tpcds_q03/datafusion:vortex-file-compressed 15179758 15500645 0.98
tpcds_q04/datafusion:vortex-file-compressed 264349297 257728382 1.03
tpcds_q05/datafusion:vortex-file-compressed 43367061 42305068 1.03
tpcds_q06/datafusion:vortex-file-compressed 58777425 60558598 0.97
tpcds_q07/datafusion:vortex-file-compressed 40780059 41105286 0.99
tpcds_q08/datafusion:vortex-file-compressed 28115479 29576503 0.95
tpcds_q09/datafusion:vortex-file-compressed 44138082 44103242 1.00
tpcds_q10/datafusion:vortex-file-compressed 38290417 38134376 1.00
tpcds_q11/datafusion:vortex-file-compressed 127870564 127067595 1.01
tpcds_q12/datafusion:vortex-file-compressed 19993108 21098866 0.95
tpcds_q13/datafusion:vortex-file-compressed 43491856 44960291 0.97
tpcds_q14/datafusion:vortex-file-compressed 169929727 171396847 0.99
tpcds_q15/datafusion:vortex-file-compressed 27625479 28793244 0.96
tpcds_q16/datafusion:vortex-file-compressed 27898371 28726037 0.97
tpcds_q17/datafusion:vortex-file-compressed 62073168 61503251 1.01
tpcds_q18/datafusion:vortex-file-compressed 69051196 69844763 0.99
tpcds_q19/datafusion:vortex-file-compressed 22090173 21615180 1.02
tpcds_q20/datafusion:vortex-file-compressed 21130297 22029776 0.96
tpcds_q21/datafusion:vortex-file-compressed 34201519 34365517 1.00
tpcds_q22/datafusion:vortex-file-compressed 🚀 112718902 153553571 0.73
tpcds_q23/datafusion:vortex-file-compressed 148345493 150039652 0.99
tpcds_q24/datafusion:vortex-file-compressed 83330727 81726467 1.02
tpcds_q25/datafusion:vortex-file-compressed 64371191 66109879 0.97
tpcds_q26/datafusion:vortex-file-compressed 33018562 34677506 0.95
tpcds_q27/datafusion:vortex-file-compressed 104207068 105638962 0.99
tpcds_q28/datafusion:vortex-file-compressed 39944660 39958377 1.00
tpcds_q29/datafusion:vortex-file-compressed 60899106 63576009 0.96
tpcds_q30/datafusion:vortex-file-compressed 22777319 24239297 0.94
tpcds_q31/datafusion:vortex-file-compressed 72454361 74644596 0.97
tpcds_q32/datafusion:vortex-file-compressed 20363397 20947891 0.97
tpcds_q33/datafusion:vortex-file-compressed 28858427 29368660 0.98
tpcds_q34/datafusion:vortex-file-compressed 23954228 25207221 0.95
tpcds_q35/datafusion:vortex-file-compressed 44127704 44535496 0.99
tpcds_q36/datafusion:vortex-file-compressed 56310555 58272488 0.97
tpcds_q37/datafusion:vortex-file-compressed 26421455 26293702 1.00
tpcds_q38/datafusion:vortex-file-compressed 42644649 44276994 0.96
tpcds_q39/datafusion:vortex-file-compressed 105136118 108139344 0.97
tpcds_q40/datafusion:vortex-file-compressed 32367615 33156718 0.98
tpcds_q41/datafusion:vortex-file-compressed 15703198 16044752 0.98
tpcds_q42/datafusion:vortex-file-compressed 13992553 14588987 0.96
tpcds_q43/datafusion:vortex-file-compressed 18451104 18843059 0.98
tpcds_q44/datafusion:vortex-file-compressed 32242888 33747958 0.96
tpcds_q45/datafusion:vortex-file-compressed 27377696 27064116 1.01
tpcds_q46/datafusion:vortex-file-compressed 33814540 34349644 0.98
tpcds_q47/datafusion:vortex-file-compressed 129557846 132782021 0.98
tpcds_q48/datafusion:vortex-file-compressed 38127328 38220834 1.00
tpcds_q49/datafusion:vortex-file-compressed 58674066 58380646 1.01
tpcds_q50/datafusion:vortex-file-compressed 38432524 39016970 0.99
tpcds_q51/datafusion:vortex-file-compressed 87919111 88780645 0.99
tpcds_q52/datafusion:vortex-file-compressed 14108188 14629872 0.96
tpcds_q53/datafusion:vortex-file-compressed 21416954 21789643 0.98
tpcds_q54/datafusion:vortex-file-compressed 35576422 35228807 1.01
tpcds_q55/datafusion:vortex-file-compressed 15115678 13942095 1.08
tpcds_q56/datafusion:vortex-file-compressed 28843031 29849151 0.97
tpcds_q57/datafusion:vortex-file-compressed 103577187 109125236 0.95
tpcds_q58/datafusion:vortex-file-compressed 52640086 51977669 1.01
tpcds_q59/datafusion:vortex-file-compressed 56084577 57331094 0.98
tpcds_q60/datafusion:vortex-file-compressed 29119052 29926464 0.97
tpcds_q61/datafusion:vortex-file-compressed 39637047 41063443 0.97
tpcds_q62/datafusion:vortex-file-compressed 24428320 24915015 0.98
tpcds_q63/datafusion:vortex-file-compressed 21159289 22177062 0.95
tpcds_q64/datafusion:vortex-file-compressed 406524976 410843507 0.99
tpcds_q65/datafusion:vortex-file-compressed 39698394 40638370 0.98
tpcds_q66/datafusion:vortex-file-compressed 69885954 74957825 0.93
tpcds_q67/datafusion:vortex-file-compressed 148443620 147192270 1.01
tpcds_q68/datafusion:vortex-file-compressed 32034846 33411032 0.96
tpcds_q69/datafusion:vortex-file-compressed 35853262 38431735 0.93
tpcds_q70/datafusion:vortex-file-compressed 84482156 86710085 0.97
tpcds_q71/datafusion:vortex-file-compressed 23159794 22919526 1.01
tpcds_q72/datafusion:vortex-file-compressed 2084388466 2177982987 0.96
tpcds_q73/datafusion:vortex-file-compressed 22639049 23937781 0.95
tpcds_q74/datafusion:vortex-file-compressed 79649560 76825432 1.04
tpcds_q75/datafusion:vortex-file-compressed 105155498 108982741 0.96
tpcds_q76/datafusion:vortex-file-compressed 22958696 24191558 0.95
tpcds_q77/datafusion:vortex-file-compressed 39206292 41546632 0.94
tpcds_q78/datafusion:vortex-file-compressed 122145075 125130176 0.98
tpcds_q79/datafusion:vortex-file-compressed 31220122 29123541 1.07
tpcds_q80/datafusion:vortex-file-compressed 90539417 94973069 0.95
tpcds_q81/datafusion:vortex-file-compressed 23483708 24686371 0.95
tpcds_q82/datafusion:vortex-file-compressed 27250381 27301703 1.00
tpcds_q83/datafusion:vortex-file-compressed 34552867 35200032 0.98
tpcds_q84/datafusion:vortex-file-compressed 13203342 13682025 0.97
tpcds_q85/datafusion:vortex-file-compressed 95195762 98951193 0.96
tpcds_q86/datafusion:vortex-file-compressed 16149524 16944594 0.95
tpcds_q87/datafusion:vortex-file-compressed 43179708 45609082 0.95
tpcds_q88/datafusion:vortex-file-compressed 56105925 57177368 0.98
tpcds_q89/datafusion:vortex-file-compressed 24129336 25506723 0.95
tpcds_q90/datafusion:vortex-file-compressed 15526069 15646947 0.99
tpcds_q91/datafusion:vortex-file-compressed 17834162 19129231 0.93
tpcds_q92/datafusion:vortex-file-compressed 18417564 18862897 0.98
tpcds_q93/datafusion:vortex-file-compressed 32602972 34784488 0.94
tpcds_q94/datafusion:vortex-file-compressed 23491986 25872240 0.91
tpcds_q95/datafusion:vortex-file-compressed 60862817 64823020 0.94
tpcds_q96/datafusion:vortex-file-compressed 13511051 14126880 0.96
tpcds_q97/datafusion:vortex-file-compressed 31154907 33736093 0.92
tpcds_q98/datafusion:vortex-file-compressed 23758889 24278054 0.98
tpcds_q99/datafusion:vortex-file-compressed 32482215 32500759 1.00
datafusion / vortex-compact (0.970x ➖, 3↑ 3↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 24617448 28838683 0.85
tpcds_q02/datafusion:vortex-compact 53214362 54806466 0.97
tpcds_q03/datafusion:vortex-compact 19538454 19421037 1.01
tpcds_q04/datafusion:vortex-compact 282671395 295392516 0.96
tpcds_q05/datafusion:vortex-compact 47387527 48208524 0.98
tpcds_q06/datafusion:vortex-compact 62150205 61054523 1.02
tpcds_q07/datafusion:vortex-compact 52652535 52604558 1.00
tpcds_q08/datafusion:vortex-compact 35291845 36525025 0.97
tpcds_q09/datafusion:vortex-compact 61124826 63842634 0.96
tpcds_q10/datafusion:vortex-compact 49970280 50513650 0.99
tpcds_q11/datafusion:vortex-compact 146958228 156493194 0.94
tpcds_q12/datafusion:vortex-compact 25009446 26738268 0.94
tpcds_q13/datafusion:vortex-compact 🚨 109723272 95013597 1.15
tpcds_q14/datafusion:vortex-compact 193431336 198682276 0.97
tpcds_q15/datafusion:vortex-compact 30953993 31711391 0.98
tpcds_q16/datafusion:vortex-compact 33192307 33204784 1.00
tpcds_q17/datafusion:vortex-compact 75964343 74216083 1.02
tpcds_q18/datafusion:vortex-compact 77505997 80783912 0.96
tpcds_q19/datafusion:vortex-compact 29229868 30205505 0.97
tpcds_q20/datafusion:vortex-compact 26972767 27394942 0.98
tpcds_q21/datafusion:vortex-compact 40650935 41497848 0.98
tpcds_q22/datafusion:vortex-compact 120356024 129761750 0.93
tpcds_q23/datafusion:vortex-compact 159081591 173635820 0.92
tpcds_q24/datafusion:vortex-compact 100885887 98537945 1.02
tpcds_q25/datafusion:vortex-compact 76906160 85299498 0.90
tpcds_q26/datafusion:vortex-compact 42473901 46410662 0.92
tpcds_q27/datafusion:vortex-compact 125206064 127700549 0.98
tpcds_q28/datafusion:vortex-compact 77581103 79193915 0.98
tpcds_q29/datafusion:vortex-compact 76217020 75619768 1.01
tpcds_q30/datafusion:vortex-compact 26122685 28561722 0.91
tpcds_q31/datafusion:vortex-compact 96504295 98585070 0.98
tpcds_q32/datafusion:vortex-compact 24561824 26296085 0.93
tpcds_q33/datafusion:vortex-compact 36852589 36494575 1.01
tpcds_q34/datafusion:vortex-compact 32974960 33155721 0.99
tpcds_q35/datafusion:vortex-compact 50640460 53565474 0.95
tpcds_q36/datafusion:vortex-compact 76504729 78053364 0.98
tpcds_q37/datafusion:vortex-compact 40069472 41783858 0.96
tpcds_q38/datafusion:vortex-compact 50360029 53731947 0.94
tpcds_q39/datafusion:vortex-compact 115283708 114225404 1.01
tpcds_q40/datafusion:vortex-compact 36684142 39370863 0.93
tpcds_q41/datafusion:vortex-compact 18179949 19649941 0.93
tpcds_q42/datafusion:vortex-compact 18401708 18639702 0.99
tpcds_q43/datafusion:vortex-compact 24461643 25452793 0.96
tpcds_q44/datafusion:vortex-compact 48819973 48943753 1.00
tpcds_q45/datafusion:vortex-compact 33043886 32180191 1.03
tpcds_q46/datafusion:vortex-compact 43738606 46429553 0.94
tpcds_q47/datafusion:vortex-compact 147579823 153980470 0.96
tpcds_q48/datafusion:vortex-compact 74032127 70649158 1.05
tpcds_q49/datafusion:vortex-compact 69039855 69986631 0.99
tpcds_q50/datafusion:vortex-compact 46152400 47476874 0.97
tpcds_q51/datafusion:vortex-compact 94990029 97991946 0.97
tpcds_q52/datafusion:vortex-compact 18657855 18846295 0.99
tpcds_q53/datafusion:vortex-compact 27739448 28560469 0.97
tpcds_q54/datafusion:vortex-compact 41820958 43187732 0.97
tpcds_q55/datafusion:vortex-compact 17966951 18454008 0.97
tpcds_q56/datafusion:vortex-compact 35488651 37029367 0.96
tpcds_q57/datafusion:vortex-compact 111785775 117836038 0.95
tpcds_q58/datafusion:vortex-compact 63543602 63783547 1.00
tpcds_q59/datafusion:vortex-compact 69082438 70943124 0.97
tpcds_q60/datafusion:vortex-compact 35828289 36119730 0.99
tpcds_q61/datafusion:vortex-compact 54464178 55172269 0.99
tpcds_q62/datafusion:vortex-compact 28263662 29715189 0.95
tpcds_q63/datafusion:vortex-compact 28050035 29167480 0.96
tpcds_q64/datafusion:vortex-compact 445937070 464110215 0.96
tpcds_q65/datafusion:vortex-compact 52939522 54694584 0.97
tpcds_q66/datafusion:vortex-compact 76128894 81535975 0.93
tpcds_q67/datafusion:vortex-compact 151646798 160761179 0.94
tpcds_q68/datafusion:vortex-compact 44619561 44823494 1.00
tpcds_q69/datafusion:vortex-compact 46558723 48008271 0.97
tpcds_q70/datafusion:vortex-compact 97505421 100261410 0.97
tpcds_q71/datafusion:vortex-compact 30105458 31150454 0.97
tpcds_q72/datafusion:vortex-compact 2142913949 2212153796 0.97
tpcds_q73/datafusion:vortex-compact 31032166 31615265 0.98
tpcds_q74/datafusion:vortex-compact 95539387 95831085 1.00
tpcds_q75/datafusion:vortex-compact 126272159 132272512 0.95
tpcds_q76/datafusion:vortex-compact 32656377 32216015 1.01
tpcds_q77/datafusion:vortex-compact 49715373 52738023 0.94
tpcds_q78/datafusion:vortex-compact 136603533 141246920 0.97
tpcds_q79/datafusion:vortex-compact 37503397 38900474 0.96
tpcds_q80/datafusion:vortex-compact 102904686 107288896 0.96
tpcds_q81/datafusion:vortex-compact 🚨 31138038 27768451 1.12
tpcds_q82/datafusion:vortex-compact 42485267 41643945 1.02
tpcds_q83/datafusion:vortex-compact 33050510 36385442 0.91
tpcds_q84/datafusion:vortex-compact 14645509 15789566 0.93
tpcds_q85/datafusion:vortex-compact 126459387 134046098 0.94
tpcds_q86/datafusion:vortex-compact 🚨 20948847 18865132 1.11
tpcds_q87/datafusion:vortex-compact 50743660 53598656 0.95
tpcds_q88/datafusion:vortex-compact 74438871 77193370 0.96
tpcds_q89/datafusion:vortex-compact 33981653 31232280 1.09
tpcds_q90/datafusion:vortex-compact 15141138 16020133 0.95
tpcds_q91/datafusion:vortex-compact 31989210 33805911 0.95
tpcds_q92/datafusion:vortex-compact 23642770 25405804 0.93
tpcds_q93/datafusion:vortex-compact 38658424 38748771 1.00
tpcds_q94/datafusion:vortex-compact 🚀 25253747 29259887 0.86
tpcds_q95/datafusion:vortex-compact 65511613 67477166 0.97
tpcds_q96/datafusion:vortex-compact 17463042 17843125 0.98
tpcds_q97/datafusion:vortex-compact 37106111 38734369 0.96
tpcds_q98/datafusion:vortex-compact 29438792 31137389 0.95
tpcds_q99/datafusion:vortex-compact 🚀 29784295 36032816 0.83
datafusion / parquet (0.978x ➖, 3↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29858617 28972009 1.03
tpcds_q02/datafusion:parquet 40672501 43747529 0.93
tpcds_q03/datafusion:parquet 12857493 13348415 0.96
tpcds_q04/datafusion:parquet 257499397 265883738 0.97
tpcds_q05/datafusion:parquet 39428221 41001051 0.96
tpcds_q06/datafusion:parquet 57699759 58696078 0.98
tpcds_q07/datafusion:parquet 76029371 76700783 0.99
tpcds_q08/datafusion:parquet 26304256 25613776 1.03
tpcds_q09/datafusion:parquet 44020452 43553566 1.01
tpcds_q10/datafusion:parquet 67274241 69395751 0.97
tpcds_q11/datafusion:parquet 149283702 150083685 0.99
tpcds_q12/datafusion:parquet 17726522 16560346 1.07
tpcds_q13/datafusion:parquet 74076609 74988725 0.99
tpcds_q14/datafusion:parquet 155238609 161271532 0.96
tpcds_q15/datafusion:parquet 20527420 22374315 0.92
tpcds_q16/datafusion:parquet 🚀 22888886 25768333 0.89
tpcds_q17/datafusion:parquet 60841211 64897933 0.94
tpcds_q18/datafusion:parquet 110983482 115813334 0.96
tpcds_q19/datafusion:parquet 21590814 22437328 0.96
tpcds_q20/datafusion:parquet 15798252 16043882 0.98
tpcds_q21/datafusion:parquet 17832774 19177096 0.93
tpcds_q22/datafusion:parquet 🚀 136395989 161124844 0.85
tpcds_q23/datafusion:parquet 144714197 145283916 1.00
tpcds_q24/datafusion:parquet 90465882 90096290 1.00
tpcds_q25/datafusion:parquet 63052282 64749879 0.97
tpcds_q26/datafusion:parquet 64543200 65984984 0.98
tpcds_q27/datafusion:parquet 141679859 142751952 0.99
tpcds_q28/datafusion:parquet 43997083 44117264 1.00
tpcds_q29/datafusion:parquet 64212308 64456172 1.00
tpcds_q30/datafusion:parquet 33265500 34125195 0.97
tpcds_q31/datafusion:parquet 62059401 63442199 0.98
tpcds_q32/datafusion:parquet 18015778 18025655 1.00
tpcds_q33/datafusion:parquet 26475048 26379010 1.00
tpcds_q34/datafusion:parquet 20772592 21870636 0.95
tpcds_q35/datafusion:parquet 68319815 66979125 1.02
tpcds_q36/datafusion:parquet 55450522 56797211 0.98
tpcds_q37/datafusion:parquet 18196799 19164804 0.95
tpcds_q38/datafusion:parquet 39379310 39520789 1.00
tpcds_q39/datafusion:parquet 73171767 72425350 1.01
tpcds_q40/datafusion:parquet 23296780 23113706 1.01
tpcds_q41/datafusion:parquet 13209515 13247262 1.00
tpcds_q42/datafusion:parquet 11366133 11584740 0.98
tpcds_q43/datafusion:parquet 16615081 17056213 0.97
tpcds_q44/datafusion:parquet 31110562 31368324 0.99
tpcds_q45/datafusion:parquet 27065740 28168414 0.96
tpcds_q46/datafusion:parquet 31019419 31401328 0.99
tpcds_q47/datafusion:parquet 122725110 123739382 0.99
tpcds_q48/datafusion:parquet 67234327 68630636 0.98
tpcds_q49/datafusion:parquet 53258797 55019420 0.97
tpcds_q50/datafusion:parquet 42880659 43320873 0.99
tpcds_q51/datafusion:parquet 82853691 84727681 0.98
tpcds_q52/datafusion:parquet 11608906 12014237 0.97
tpcds_q53/datafusion:parquet 17768310 17694790 1.00
tpcds_q54/datafusion:parquet 33802830 33932597 1.00
tpcds_q55/datafusion:parquet 11029361 10924588 1.01
tpcds_q56/datafusion:parquet 25859091 28282589 0.91
tpcds_q57/datafusion:parquet 95809248 93445515 1.03
tpcds_q58/datafusion:parquet 49485625 50216084 0.99
tpcds_q59/datafusion:parquet 55603666 58312688 0.95
tpcds_q60/datafusion:parquet 26481421 26699480 0.99
tpcds_q61/datafusion:parquet 41069057 41937602 0.98
tpcds_q62/datafusion:parquet 21238443 20599815 1.03
tpcds_q63/datafusion:parquet 16982770 17349367 0.98
tpcds_q64/datafusion:parquet 501115370 503285150 1.00
tpcds_q65/datafusion:parquet 36506986 39005947 0.94
tpcds_q66/datafusion:parquet 71611201 69748217 1.03
tpcds_q67/datafusion:parquet 139426994 144798795 0.96
tpcds_q68/datafusion:parquet 31164104 31145226 1.00
tpcds_q69/datafusion:parquet 63167843 64430098 0.98
tpcds_q70/datafusion:parquet 84669971 85406425 0.99
tpcds_q71/datafusion:parquet 22799981 21581265 1.06
tpcds_q72/datafusion:parquet 593773114 610276147 0.97
tpcds_q73/datafusion:parquet 21519791 20718882 1.04
tpcds_q74/datafusion:parquet 82532572 82879466 1.00
tpcds_q75/datafusion:parquet 98969872 99340245 1.00
tpcds_q76/datafusion:parquet 30170130 29482167 1.02
tpcds_q77/datafusion:parquet 36444841 38220780 0.95
tpcds_q78/datafusion:parquet 109947431 114741143 0.96
tpcds_q79/datafusion:parquet 26457246 25876535 1.02
tpcds_q80/datafusion:parquet 76945380 78153209 0.98
tpcds_q81/datafusion:parquet 31259184 30908698 1.01
tpcds_q82/datafusion:parquet 18493926 19020678 0.97
tpcds_q83/datafusion:parquet 35616374 35891129 0.99
tpcds_q84/datafusion:parquet 38403420 38703133 0.99
tpcds_q85/datafusion:parquet 145118449 148903394 0.97
tpcds_q86/datafusion:parquet 15834078 16566344 0.96
tpcds_q87/datafusion:parquet 39800758 41652024 0.96
tpcds_q88/datafusion:parquet 57557962 58789767 0.98
tpcds_q89/datafusion:parquet 20640033 20854090 0.99
tpcds_q90/datafusion:parquet 13745366 14504750 0.95
tpcds_q91/datafusion:parquet 55476978 57554769 0.96
tpcds_q92/datafusion:parquet 18048823 18095020 1.00
tpcds_q93/datafusion:parquet 32069321 32094488 1.00
tpcds_q94/datafusion:parquet 19621481 21129435 0.93
tpcds_q95/datafusion:parquet 57664202 57870378 1.00
tpcds_q96/datafusion:parquet 11142765 12338079 0.90
tpcds_q97/datafusion:parquet 28902904 28970802 1.00
tpcds_q98/datafusion:parquet 21025616 21602606 0.97
tpcds_q99/datafusion:parquet 🚀 26580522 34252746 0.78
duckdb / vortex-file-compressed (0.994x ➖, 1↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21906271 21663957 1.01
tpcds_q02/duckdb:vortex-file-compressed 33479587 34556645 0.97
tpcds_q03/duckdb:vortex-file-compressed 31541522 30835062 1.02
tpcds_q04/duckdb:vortex-file-compressed 105371948 104652757 1.01
tpcds_q05/duckdb:vortex-file-compressed 35244631 38264414 0.92
tpcds_q06/duckdb:vortex-file-compressed 31967451 31625972 1.01
tpcds_q07/duckdb:vortex-file-compressed 19589386 19476037 1.01
tpcds_q08/duckdb:vortex-file-compressed 28326530 27315811 1.04
tpcds_q09/duckdb:vortex-file-compressed 36589703 37000197 0.99
tpcds_q10/duckdb:vortex-file-compressed 39289793 40458354 0.97
tpcds_q11/duckdb:vortex-file-compressed 60066985 61394518 0.98
tpcds_q12/duckdb:vortex-file-compressed 14140320 14901486 0.95
tpcds_q13/duckdb:vortex-file-compressed 33337043 32741374 1.02
tpcds_q14/duckdb:vortex-file-compressed 101682747 102533532 0.99
tpcds_q15/duckdb:vortex-file-compressed 25634585 25509359 1.00
tpcds_q16/duckdb:vortex-file-compressed 26850911 26493427 1.01
tpcds_q17/duckdb:vortex-file-compressed 44376883 42411781 1.05
tpcds_q18/duckdb:vortex-file-compressed 46442339 47433717 0.98
tpcds_q19/duckdb:vortex-file-compressed 32878598 33288569 0.99
tpcds_q20/duckdb:vortex-file-compressed 15037141 14584171 1.03
tpcds_q21/duckdb:vortex-file-compressed 16037458 17052618 0.94
tpcds_q22/duckdb:vortex-file-compressed 73082397 76449190 0.96
tpcds_q23/duckdb:vortex-file-compressed 105011669 108504551 0.97
tpcds_q24/duckdb:vortex-file-compressed 49735002 48788936 1.02
tpcds_q25/duckdb:vortex-file-compressed 48599079 48369103 1.00
tpcds_q26/duckdb:vortex-file-compressed 40095296 40387220 0.99
tpcds_q27/duckdb:vortex-file-compressed 47393636 49078570 0.97
tpcds_q28/duckdb:vortex-file-compressed 35289307 35559867 0.99
tpcds_q29/duckdb:vortex-file-compressed 40682711 41830387 0.97
tpcds_q30/duckdb:vortex-file-compressed 23264154 24335990 0.96
tpcds_q31/duckdb:vortex-file-compressed 35399792 35986849 0.98
tpcds_q32/duckdb:vortex-file-compressed 13459725 13891980 0.97
tpcds_q33/duckdb:vortex-file-compressed 23173437 23417741 0.99
tpcds_q34/duckdb:vortex-file-compressed 22903525 22729144 1.01
tpcds_q35/duckdb:vortex-file-compressed 63479888 64008421 0.99
tpcds_q36/duckdb:vortex-file-compressed 24662250 24676325 1.00
tpcds_q37/duckdb:vortex-file-compressed 14915028 15025989 0.99
tpcds_q38/duckdb:vortex-file-compressed 38116856 37233101 1.02
tpcds_q39/duckdb:vortex-file-compressed 33339343 36144603 0.92
tpcds_q40/duckdb:vortex-file-compressed 19377446 18702751 1.04
tpcds_q41/duckdb:vortex-file-compressed 12914922 13204539 0.98
tpcds_q42/duckdb:vortex-file-compressed 12332434 13290988 0.93
tpcds_q43/duckdb:vortex-file-compressed 22754622 21878776 1.04
tpcds_q44/duckdb:vortex-file-compressed 20659378 20918841 0.99
tpcds_q45/duckdb:vortex-file-compressed 27475433 30140529 0.91
tpcds_q46/duckdb:vortex-file-compressed 50912408 51498862 0.99
tpcds_q47/duckdb:vortex-file-compressed 46633894 45965693 1.01
tpcds_q48/duckdb:vortex-file-compressed 29877426 30613056 0.98
tpcds_q49/duckdb:vortex-file-compressed 32788746 35272845 0.93
tpcds_q50/duckdb:vortex-file-compressed 32962431 33300863 0.99
tpcds_q51/duckdb:vortex-file-compressed 96633155 96386587 1.00
tpcds_q52/duckdb:vortex-file-compressed 13371311 13149521 1.02
tpcds_q53/duckdb:vortex-file-compressed 22689158 22701670 1.00
tpcds_q54/duckdb:vortex-file-compressed 27282022 27068385 1.01
tpcds_q55/duckdb:vortex-file-compressed 12455873 12558754 0.99
tpcds_q56/duckdb:vortex-file-compressed 23107548 25048976 0.92
tpcds_q57/duckdb:vortex-file-compressed 39987913 40085897 1.00
tpcds_q58/duckdb:vortex-file-compressed 30941562 30397385 1.02
tpcds_q59/duckdb:vortex-file-compressed 66038389 66435171 0.99
tpcds_q60/duckdb:vortex-file-compressed 25943172 25752297 1.01
tpcds_q61/duckdb:vortex-file-compressed 30791199 30447228 1.01
tpcds_q62/duckdb:vortex-file-compressed 16798164 16428389 1.02
tpcds_q63/duckdb:vortex-file-compressed 20247487 20677127 0.98
tpcds_q64/duckdb:vortex-file-compressed 83000667 82742626 1.00
tpcds_q65/duckdb:vortex-file-compressed 21145778 20564634 1.03
tpcds_q66/duckdb:vortex-file-compressed 30420124 28985339 1.05
tpcds_q67/duckdb:vortex-file-compressed 137767439 140197653 0.98
tpcds_q68/duckdb:vortex-file-compressed 40216001 40208232 1.00
tpcds_q69/duckdb:vortex-file-compressed 41600087 40579190 1.03
tpcds_q70/duckdb:vortex-file-compressed 25813399 25175398 1.03
tpcds_q71/duckdb:vortex-file-compressed 21293098 20000796 1.06
tpcds_q72/duckdb:vortex-file-compressed 171531948 175640636 0.98
tpcds_q73/duckdb:vortex-file-compressed 23542075 22579194 1.04
tpcds_q74/duckdb:vortex-file-compressed 76326343 72069381 1.06
tpcds_q75/duckdb:vortex-file-compressed 57960638 55702085 1.04
tpcds_q76/duckdb:vortex-file-compressed 17727949 17762278 1.00
tpcds_q77/duckdb:vortex-file-compressed 25946064 26389766 0.98
tpcds_q78/duckdb:vortex-file-compressed 75781734 72758019 1.04
tpcds_q79/duckdb:vortex-file-compressed 32359400 32084829 1.01
tpcds_q80/duckdb:vortex-file-compressed 46599602 47634596 0.98
tpcds_q81/duckdb:vortex-file-compressed 27481353 25677714 1.07
tpcds_q82/duckdb:vortex-file-compressed 16009842 16178673 0.99
tpcds_q83/duckdb:vortex-file-compressed 23635030 23308619 1.01
tpcds_q84/duckdb:vortex-file-compressed 18997231 19532825 0.97
tpcds_q85/duckdb:vortex-file-compressed 44397792 44738452 0.99
tpcds_q86/duckdb:vortex-file-compressed 🚀 15553867 18262384 0.85
tpcds_q87/duckdb:vortex-file-compressed 40346545 40334719 1.00
tpcds_q88/duckdb:vortex-file-compressed 32187050 34128487 0.94
tpcds_q89/duckdb:vortex-file-compressed 22543154 22755608 0.99
tpcds_q90/duckdb:vortex-file-compressed 12431863 12170333 1.02
tpcds_q91/duckdb:vortex-file-compressed 30255708 30172052 1.00
tpcds_q92/duckdb:vortex-file-compressed 🚨 23287734 20763254 1.12
tpcds_q93/duckdb:vortex-file-compressed 25764641 27526687 0.94
tpcds_q94/duckdb:vortex-file-compressed 21706974 22922651 0.95
tpcds_q95/duckdb:vortex-file-compressed 🚨 152251707 136382451 1.12
tpcds_q96/duckdb:vortex-file-compressed 13245684 14421954 0.92
tpcds_q97/duckdb:vortex-file-compressed 37246000 38917952 0.96
tpcds_q98/duckdb:vortex-file-compressed 17496572 17746606 0.99
tpcds_q99/duckdb:vortex-file-compressed 27106239 26955087 1.01
duckdb / vortex-compact (0.983x ➖, 4↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23315203 23396796 1.00
tpcds_q02/duckdb:vortex-compact 🚀 31944722 42431529 0.75
tpcds_q03/duckdb:vortex-compact 55144059 56215229 0.98
tpcds_q04/duckdb:vortex-compact 118868018 129932210 0.91
tpcds_q05/duckdb:vortex-compact 51713597 51310637 1.01
tpcds_q06/duckdb:vortex-compact 39456498 42570882 0.93
tpcds_q07/duckdb:vortex-compact 33964299 33549590 1.01
tpcds_q08/duckdb:vortex-compact 44417960 44324853 1.00
tpcds_q09/duckdb:vortex-compact 59488190 56788807 1.05
tpcds_q10/duckdb:vortex-compact 60031671 59337005 1.01
tpcds_q11/duckdb:vortex-compact 70128640 72713650 0.96
tpcds_q12/duckdb:vortex-compact 21650214 22317077 0.97
tpcds_q13/duckdb:vortex-compact 58374653 59011660 0.99
tpcds_q14/duckdb:vortex-compact 129994672 127480205 1.02
tpcds_q15/duckdb:vortex-compact 30319252 30568982 0.99
tpcds_q16/duckdb:vortex-compact 29319176 29214676 1.00
tpcds_q17/duckdb:vortex-compact 54062616 56156633 0.96
tpcds_q18/duckdb:vortex-compact 58698073 56610875 1.04
tpcds_q19/duckdb:vortex-compact 50132015 51230480 0.98
tpcds_q20/duckdb:vortex-compact 19636393 20548079 0.96
tpcds_q21/duckdb:vortex-compact 18623746 20209811 0.92
tpcds_q22/duckdb:vortex-compact 75665481 78778582 0.96
tpcds_q23/duckdb:vortex-compact 129753872 120875529 1.07
tpcds_q24/duckdb:vortex-compact 59543753 61982654 0.96
tpcds_q25/duckdb:vortex-compact 77135110 84388115 0.91
tpcds_q26/duckdb:vortex-compact 52903706 50835450 1.04
tpcds_q27/duckdb:vortex-compact 68694821 68187293 1.01
tpcds_q28/duckdb:vortex-compact 86006095 85204063 1.01
tpcds_q29/duckdb:vortex-compact 51013123 55130503 0.93
tpcds_q30/duckdb:vortex-compact 28837378 28097092 1.03
tpcds_q31/duckdb:vortex-compact 45698771 43737905 1.04
tpcds_q32/duckdb:vortex-compact 21771679 21983671 0.99
tpcds_q33/duckdb:vortex-compact 35648482 35291724 1.01
tpcds_q34/duckdb:vortex-compact 38430334 37912457 1.01
tpcds_q35/duckdb:vortex-compact 78805339 80829750 0.97
tpcds_q36/duckdb:vortex-compact 40372210 41951657 0.96
tpcds_q37/duckdb:vortex-compact 23138511 23531569 0.98
tpcds_q38/duckdb:vortex-compact 49246306 45373322 1.09
tpcds_q39/duckdb:vortex-compact 36339067 37121347 0.98
tpcds_q40/duckdb:vortex-compact 23876521 26290703 0.91
tpcds_q41/duckdb:vortex-compact 14916640 15158180 0.98
tpcds_q42/duckdb:vortex-compact 21700766 21874720 0.99
tpcds_q43/duckdb:vortex-compact 🚀 33241496 37002086 0.90
tpcds_q44/duckdb:vortex-compact 🚀 27505861 31154343 0.88
tpcds_q45/duckdb:vortex-compact 37776470 37191326 1.02
tpcds_q46/duckdb:vortex-compact 71202564 68353831 1.04
tpcds_q47/duckdb:vortex-compact 62854581 62064277 1.01
tpcds_q48/duckdb:vortex-compact 52240827 51750078 1.01
tpcds_q49/duckdb:vortex-compact 54878278 53334591 1.03
tpcds_q50/duckdb:vortex-compact 45746871 46352744 0.99
tpcds_q51/duckdb:vortex-compact 105531425 106318028 0.99
tpcds_q52/duckdb:vortex-compact 21468260 22351192 0.96
tpcds_q53/duckdb:vortex-compact 39490823 37931218 1.04
tpcds_q54/duckdb:vortex-compact 40728381 39767559 1.02
tpcds_q55/duckdb:vortex-compact 22061575 22361917 0.99
tpcds_q56/duckdb:vortex-compact 34164102 35892973 0.95
tpcds_q57/duckdb:vortex-compact 43111742 43137778 1.00
tpcds_q58/duckdb:vortex-compact 43289962 44771335 0.97
tpcds_q59/duckdb:vortex-compact 88543635 90585830 0.98
tpcds_q60/duckdb:vortex-compact 37659829 37856463 0.99
tpcds_q61/duckdb:vortex-compact 60580946 63539485 0.95
tpcds_q62/duckdb:vortex-compact 26040674 26985328 0.96
tpcds_q63/duckdb:vortex-compact 37265850 36928225 1.01
tpcds_q64/duckdb:vortex-compact 115831821 121075297 0.96
tpcds_q65/duckdb:vortex-compact 32487439 31961293 1.02
tpcds_q66/duckdb:vortex-compact 38525690 39901823 0.97
tpcds_q67/duckdb:vortex-compact 150504055 154221311 0.98
tpcds_q68/duckdb:vortex-compact 63006825 61448959 1.03
tpcds_q69/duckdb:vortex-compact 61928350 61922530 1.00
tpcds_q70/duckdb:vortex-compact 36483915 37518342 0.97
tpcds_q71/duckdb:vortex-compact 32919087 34695808 0.95
tpcds_q72/duckdb:vortex-compact 193635597 193429095 1.00
tpcds_q73/duckdb:vortex-compact 38691126 37656073 1.03
tpcds_q74/duckdb:vortex-compact 82317369 80545725 1.02
tpcds_q75/duckdb:vortex-compact 69983693 72546848 0.96
tpcds_q76/duckdb:vortex-compact 34949751 34815401 1.00
tpcds_q77/duckdb:vortex-compact 42005218 43369310 0.97
tpcds_q78/duckdb:vortex-compact 90906745 90482316 1.00
tpcds_q79/duckdb:vortex-compact 51236698 52849399 0.97
tpcds_q80/duckdb:vortex-compact 81897827 79569884 1.03
tpcds_q81/duckdb:vortex-compact 32359434 32446822 1.00
tpcds_q82/duckdb:vortex-compact 24629986 25823241 0.95
tpcds_q83/duckdb:vortex-compact 31727970 31539539 1.01
tpcds_q84/duckdb:vortex-compact 26567417 27425404 0.97
tpcds_q85/duckdb:vortex-compact 57144077 57653022 0.99
tpcds_q86/duckdb:vortex-compact 23187396 24145836 0.96
tpcds_q87/duckdb:vortex-compact 48114700 50198213 0.96
tpcds_q88/duckdb:vortex-compact 38479894 38662215 1.00
tpcds_q89/duckdb:vortex-compact 36379386 36786395 0.99
tpcds_q90/duckdb:vortex-compact 14710685 15091706 0.97
tpcds_q91/duckdb:vortex-compact 49896057 51363749 0.97
tpcds_q92/duckdb:vortex-compact 50117973 52864326 0.95
tpcds_q93/duckdb:vortex-compact 31275343 31304792 1.00
tpcds_q94/duckdb:vortex-compact 31610228 31473932 1.00
tpcds_q95/duckdb:vortex-compact 159734872 159568053 1.00
tpcds_q96/duckdb:vortex-compact 17444377 17241837 1.01
tpcds_q97/duckdb:vortex-compact 44781090 46631127 0.96
tpcds_q98/duckdb:vortex-compact 28341883 28378688 1.00
tpcds_q99/duckdb:vortex-compact 🚀 34378232 39496780 0.87
duckdb / parquet (0.983x ➖, 3↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 27159182 28071252 0.97
tpcds_q02/duckdb:parquet 23841651 23186680 1.03
tpcds_q03/duckdb:parquet 11048972 11604013 0.95
tpcds_q04/duckdb:parquet 162546836 166663046 0.98
tpcds_q05/duckdb:parquet 29399085 30351555 0.97
tpcds_q06/duckdb:parquet 27787471 27505903 1.01
tpcds_q07/duckdb:parquet 22005874 21000157 1.05
tpcds_q08/duckdb:parquet 26974704 26938897 1.00
tpcds_q09/duckdb:parquet 39559569 39618694 1.00
tpcds_q10/duckdb:parquet 32725178 32953230 0.99
tpcds_q11/duckdb:parquet 90233683 90836424 0.99
tpcds_q12/duckdb:parquet 14646995 15037022 0.97
tpcds_q13/duckdb:parquet 32400218 32872339 0.99
tpcds_q14/duckdb:parquet 97534506 102158771 0.95
tpcds_q15/duckdb:parquet 30034319 29946995 1.00
tpcds_q16/duckdb:parquet 21823783 22214707 0.98
tpcds_q17/duckdb:parquet 37923380 38135283 0.99
tpcds_q18/duckdb:parquet 44666395 44427565 1.01
tpcds_q19/duckdb:parquet 28221596 30197453 0.93
tpcds_q20/duckdb:parquet 15142102 15332172 0.99
tpcds_q21/duckdb:parquet 10488184 10666786 0.98
tpcds_q22/duckdb:parquet 67468813 70403729 0.96
tpcds_q23/duckdb:parquet 78672395 80069528 0.98
tpcds_q24/duckdb:parquet 44408317 44871007 0.99
tpcds_q25/duckdb:parquet 32360365 32746131 0.99
tpcds_q26/duckdb:parquet 35739799 34974994 1.02
tpcds_q27/duckdb:parquet 46929217 49412733 0.95
tpcds_q28/duckdb:parquet 36895053 37529162 0.98
tpcds_q29/duckdb:parquet 35270025 36029465 0.98
tpcds_q30/duckdb:parquet 34444450 34585457 1.00
tpcds_q31/duckdb:parquet 23608858 23340860 1.01
tpcds_q32/duckdb:parquet 10554553 10953400 0.96
tpcds_q33/duckdb:parquet 21319781 19994844 1.07
tpcds_q34/duckdb:parquet 19736317 19684049 1.00
tpcds_q35/duckdb:parquet 57360249 57867420 0.99
tpcds_q36/duckdb:parquet 19672122 19519502 1.01
tpcds_q37/duckdb:parquet 11970212 12778872 0.94
tpcds_q38/duckdb:parquet 33155531 34358222 0.96
tpcds_q39/duckdb:parquet 27970077 29559343 0.95
tpcds_q40/duckdb:parquet 17250053 18034355 0.96
tpcds_q41/duckdb:parquet 7386196 7770234 0.95
tpcds_q42/duckdb:parquet 🚀 9075320 10420861 0.87
tpcds_q43/duckdb:parquet 15174573 15443723 0.98
tpcds_q44/duckdb:parquet 21354639 22825375 0.94
tpcds_q45/duckdb:parquet 26214930 25799277 1.02
tpcds_q46/duckdb:parquet 43231824 47062533 0.92
tpcds_q47/duckdb:parquet 44584668 43262886 1.03
tpcds_q48/duckdb:parquet 29273933 29136613 1.00
tpcds_q49/duckdb:parquet 23690537 23971891 0.99
tpcds_q50/duckdb:parquet 24911098 23877313 1.04
tpcds_q51/duckdb:parquet 93457793 93976251 0.99
tpcds_q52/duckdb:parquet 10306401 11170246 0.92
tpcds_q53/duckdb:parquet 14925320 15200481 0.98
tpcds_q54/duckdb:parquet 23996178 25520963 0.94
tpcds_q55/duckdb:parquet 🚀 9651117 10810750 0.89
tpcds_q56/duckdb:parquet 20134118 20918261 0.96
tpcds_q57/duckdb:parquet 33953798 34113382 1.00
tpcds_q58/duckdb:parquet 21606466 21996294 0.98
tpcds_q59/duckdb:parquet 35356968 35690864 0.99
tpcds_q60/duckdb:parquet 21610253 21576781 1.00
tpcds_q61/duckdb:parquet 30224235 29976291 1.01
tpcds_q62/duckdb:parquet 11893629 11304574 1.05
tpcds_q63/duckdb:parquet 14265721 13890242 1.03
tpcds_q64/duckdb:parquet 76084631 75119027 1.01
tpcds_q65/duckdb:parquet 20484012 19330348 1.06
tpcds_q66/duckdb:parquet 30711101 28903917 1.06
tpcds_q67/duckdb:parquet 134219189 134257941 1.00
tpcds_q68/duckdb:parquet 36146036 36119509 1.00
tpcds_q69/duckdb:parquet 35532325 36133578 0.98
tpcds_q70/duckdb:parquet 19052616 19069093 1.00
tpcds_q71/duckdb:parquet 20364630 20452791 1.00
tpcds_q72/duckdb:parquet 164642381 165100010 1.00
tpcds_q73/duckdb:parquet 16895010 17591843 0.96
tpcds_q74/duckdb:parquet 126649028 129894829 0.98
tpcds_q75/duckdb:parquet 52761957 52937812 1.00
tpcds_q76/duckdb:parquet 19087549 19465597 0.98
tpcds_q77/duckdb:parquet 21790194 23080688 0.94
tpcds_q78/duckdb:parquet 74636631 74541328 1.00
tpcds_q79/duckdb:parquet 26238587 26745199 0.98
tpcds_q80/duckdb:parquet 39463241 41070903 0.96
tpcds_q81/duckdb:parquet 29529546 31667080 0.93
tpcds_q82/duckdb:parquet 12947986 14005474 0.92
tpcds_q83/duckdb:parquet 15714977 16560423 0.95
tpcds_q84/duckdb:parquet 19198893 18151686 1.06
tpcds_q85/duckdb:parquet 37897310 38847818 0.98
tpcds_q86/duckdb:parquet 11808146 12793421 0.92
tpcds_q87/duckdb:parquet 37208565 35366242 1.05
tpcds_q88/duckdb:parquet 47774040 48141905 0.99
tpcds_q89/duckdb:parquet 15984103 16002924 1.00
tpcds_q90/duckdb:parquet 7128869 7528301 0.95
tpcds_q91/duckdb:parquet 21593886 23034645 0.94
tpcds_q92/duckdb:parquet 11070148 11775177 0.94
tpcds_q93/duckdb:parquet 28625426 28611944 1.00
tpcds_q94/duckdb:parquet 16540368 16302524 1.01
tpcds_q95/duckdb:parquet 🚀 126336404 141502999 0.89
tpcds_q96/duckdb:parquet 8375379 8375745 1.00
tpcds_q97/duckdb:parquet 35348319 34756714 1.02
tpcds_q98/duckdb:parquet 17257494 17369605 0.99
tpcds_q99/duckdb:parquet 20219484 19904616 1.02
duckdb / duckdb (0.990x ➖, 1↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20293978 19692360 1.03
tpcds_q02/duckdb:duckdb 18968762 18017255 1.05
tpcds_q03/duckdb:duckdb 8390913 8758726 0.96
tpcds_q04/duckdb:duckdb 178767419 169360227 1.06
tpcds_q05/duckdb:duckdb 19898403 19188878 1.04
tpcds_q06/duckdb:duckdb 22307134 22870658 0.98
tpcds_q07/duckdb:duckdb 37549030 35255629 1.07
tpcds_q08/duckdb:duckdb 119228637 121000275 0.99
tpcds_q09/duckdb:duckdb 19871325 20128855 0.99
tpcds_q10/duckdb:duckdb 23017213 23512447 0.98
tpcds_q11/duckdb:duckdb 85559619 83659426 1.02
tpcds_q12/duckdb:duckdb 10794115 11380024 0.95
tpcds_q13/duckdb:duckdb 23878043 24923234 0.96
tpcds_q14/duckdb:duckdb 91564700 90407814 1.01
tpcds_q15/duckdb:duckdb 23242844 24989181 0.93
tpcds_q16/duckdb:duckdb 17669061 17486627 1.01
tpcds_q17/duckdb:duckdb 22838562 22673615 1.01
tpcds_q18/duckdb:duckdb 44908825 43855649 1.02
tpcds_q19/duckdb:duckdb 16361273 16732560 0.98
tpcds_q20/duckdb:duckdb 11696251 12608106 0.93
tpcds_q21/duckdb:duckdb 6830464 7251667 0.94
tpcds_q22/duckdb:duckdb 59625412 62537715 0.95
tpcds_q23/duckdb:duckdb 80100275 79214109 1.01
tpcds_q24/duckdb:duckdb 23732311 24813272 0.96
tpcds_q25/duckdb:duckdb 🚀 16397468 18994883 0.86
tpcds_q26/duckdb:duckdb 24878667 26814771 0.93
tpcds_q27/duckdb:duckdb 38703151 40277900 0.96
tpcds_q28/duckdb:duckdb 21452216 21750025 0.99
tpcds_q29/duckdb:duckdb 21345617 20087197 1.06
tpcds_q30/duckdb:duckdb 🚨 29840993 26094438 1.14
tpcds_q31/duckdb:duckdb 48326514 49184573 0.98
tpcds_q32/duckdb:duckdb 7281749 7549691 0.96
tpcds_q33/duckdb:duckdb 12607622 12360149 1.02
tpcds_q34/duckdb:duckdb 15088030 14613938 1.03
tpcds_q35/duckdb:duckdb 32653041 33594999 0.97
tpcds_q36/duckdb:duckdb 70579367 70837705 1.00
tpcds_q37/duckdb:duckdb 7746203 7805461 0.99
tpcds_q38/duckdb:duckdb 29272358 30653705 0.95
tpcds_q39/duckdb:duckdb 24860183 24690838 1.01
tpcds_q40/duckdb:duckdb 12996242 13011573 1.00
tpcds_q41/duckdb:duckdb 7962276 8006672 0.99
tpcds_q42/duckdb:duckdb 6131992 6718027 0.91
tpcds_q43/duckdb:duckdb 11344256 10957541 1.04
tpcds_q44/duckdb:duckdb 13423483 13273773 1.01
tpcds_q45/duckdb:duckdb 17119059 16920460 1.01
tpcds_q46/duckdb:duckdb 35874098 35600697 1.01
tpcds_q47/duckdb:duckdb 38004963 40070472 0.95
tpcds_q48/duckdb:duckdb 23237932 23307051 1.00
tpcds_q49/duckdb:duckdb 17591213 17698907 0.99
tpcds_q50/duckdb:duckdb 13874841 14372152 0.97
tpcds_q51/duckdb:duckdb 89637491 90477635 0.99
tpcds_q52/duckdb:duckdb 7361447 7430785 0.99
tpcds_q53/duckdb:duckdb 12952741 13053677 0.99
tpcds_q54/duckdb:duckdb 15948835 16018167 1.00
tpcds_q55/duckdb:duckdb 6950658 7030000 0.99
tpcds_q56/duckdb:duckdb 13840394 13445372 1.03
tpcds_q57/duckdb:duckdb 32461437 30912031 1.05
tpcds_q58/duckdb:duckdb 12535063 13672432 0.92
tpcds_q59/duckdb:duckdb 35382387 35020197 1.01
tpcds_q60/duckdb:duckdb 14104414 14606947 0.97
tpcds_q61/duckdb:duckdb 14652055 14242533 1.03
tpcds_q62/duckdb:duckdb 9303907 9326753 1.00
tpcds_q63/duckdb:duckdb 12124290 12237643 0.99
tpcds_q64/duckdb:duckdb 52226292 53266332 0.98
tpcds_q65/duckdb:duckdb 32438095 34531744 0.94
tpcds_q66/duckdb:duckdb 25733170 25704918 1.00
tpcds_q67/duckdb:duckdb 128919861 129048402 1.00
tpcds_q68/duckdb:duckdb 25424888 24956300 1.02
tpcds_q69/duckdb:duckdb 25562206 25702252 0.99
tpcds_q70/duckdb:duckdb 14214532 14566833 0.98
tpcds_q71/duckdb:duckdb 12864648 12658033 1.02
tpcds_q72/duckdb:duckdb 42280976 43771415 0.97
tpcds_q73/duckdb:duckdb 10813567 11258557 0.96
tpcds_q74/duckdb:duckdb 141614014 146244177 0.97
tpcds_q75/duckdb:duckdb 42238410 41927156 1.01
tpcds_q76/duckdb:duckdb 12289711 12472204 0.99
tpcds_q77/duckdb:duckdb 12041404 12197605 0.99
tpcds_q78/duckdb:duckdb 63760377 64953940 0.98
tpcds_q79/duckdb:duckdb 18479699 19000402 0.97
tpcds_q80/duckdb:duckdb 26832871 27927899 0.96
tpcds_q81/duckdb:duckdb 37669145 38179795 0.99
tpcds_q82/duckdb:duckdb 8060162 7903921 1.02
tpcds_q83/duckdb:duckdb 9334601 9326885 1.00
tpcds_q84/duckdb:duckdb 12890153 12926639 1.00
tpcds_q85/duckdb:duckdb 24776212 23576354 1.05
tpcds_q86/duckdb:duckdb 10520039 10970591 0.96
tpcds_q87/duckdb:duckdb 32763059 34587617 0.95
tpcds_q88/duckdb:duckdb 26142352 25858761 1.01
tpcds_q89/duckdb:duckdb 14748469 14443445 1.02
tpcds_q90/duckdb:duckdb 5388637 5654824 0.95
tpcds_q91/duckdb:duckdb 12148418 13055130 0.93
tpcds_q92/duckdb:duckdb 9206280 8738614 1.05
tpcds_q93/duckdb:duckdb 22417769 22278194 1.01
tpcds_q94/duckdb:duckdb 13155031 12903766 1.02
tpcds_q95/duckdb:duckdb 115674387 108961080 1.06
tpcds_q96/duckdb:duckdb 4516365 4582377 0.99
tpcds_q97/duckdb:duckdb 29842989 31289383 0.95
tpcds_q98/duckdb:duckdb 13210977 14053909 0.94
tpcds_q99/duckdb:duckdb 16381635 16191342 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -14.6% -0.1% -14.5% +21.9% ➖ noise
1 datafusion:vortex-file-compressed +1.2% -0.1% +1.3% +19.8% ➖ noise
1 duckdb:duckdb +3.1% -0.1% +3.2% +24.8% ➖ noise
1 duckdb:vortex-compact -0.3% -0.1% -0.2% +23.9% ➖ noise
1 duckdb:vortex-file-compressed +1.1% -0.1% +1.3% +30.1% ➖ noise
2 datafusion:vortex-compact -2.9% -2.2% -0.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.0% -2.2% +0.3% +10.0% ➖ noise
2 duckdb:duckdb +5.3% -2.2% +7.7% +10.0% ➖ noise
2 duckdb:vortex-compact -24.7% -2.2% -23.0% +29.0% ✅ faster
2 duckdb:vortex-file-compressed -3.1% -2.2% -0.9% +28.4% ➖ noise
3 datafusion:vortex-compact +0.6% -4.2% +5.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -2.1% -4.2% +2.3% +10.0% ➖ noise
3 duckdb:duckdb -4.2% -4.2% +0.0% +14.3% ➖ noise
3 duckdb:vortex-compact -1.9% -4.2% +2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.3% -4.2% +6.8% +10.7% ➖ noise
4 datafusion:vortex-compact -4.3% -2.8% -1.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.6% -2.8% +5.5% +10.0% ➖ noise
4 duckdb:duckdb +5.6% -2.8% +8.6% +10.0% ➖ noise
4 duckdb:vortex-compact -8.5% -2.8% -5.9% +13.6% ➖ noise
4 duckdb:vortex-file-compressed +0.7% -2.8% +3.6% +11.2% ➖ noise
5 datafusion:vortex-compact -1.7% -3.5% +1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.5% -3.5% +6.2% +17.5% ➖ noise
5 duckdb:duckdb +3.7% -3.5% +7.4% +14.0% ➖ noise
5 duckdb:vortex-compact +0.8% -3.5% +4.4% +13.0% ➖ noise
5 duckdb:vortex-file-compressed -7.9% -3.5% -4.6% +10.0% ➖ noise
6 datafusion:vortex-compact +1.8% -0.3% +2.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.9% -0.3% -2.6% +10.0% ➖ noise
6 duckdb:duckdb -2.5% -0.3% -2.1% +14.1% ➖ noise
6 duckdb:vortex-compact -7.3% -0.3% -7.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.1% -0.3% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact +0.1% +1.9% -1.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.8% +1.9% -2.7% +10.0% ➖ noise
7 duckdb:duckdb +6.5% +1.9% +4.5% +17.8% ➖ noise
7 duckdb:vortex-compact +1.2% +1.9% -0.7% +12.9% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +1.9% -1.3% +14.3% ➖ noise
8 datafusion:vortex-compact -3.4% +1.4% -4.7% +17.5% ➖ noise
8 datafusion:vortex-file-compressed -4.9% +1.4% -6.3% +10.0% ➖ noise
8 duckdb:duckdb -1.5% +1.4% -2.8% +10.0% ➖ noise
8 duckdb:vortex-compact +0.2% +1.4% -1.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.7% +1.4% +2.3% +10.8% ➖ noise
9 datafusion:vortex-compact -4.3% +0.5% -4.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.1% +0.5% -0.4% +10.5% ➖ noise
9 duckdb:duckdb -1.3% +0.5% -1.7% +10.0% ➖ noise
9 duckdb:vortex-compact +4.8% +0.5% +4.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.1% +0.5% -1.6% +20.2% ➖ noise
10 datafusion:vortex-compact -1.1% -1.9% +0.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.4% -1.9% +2.3% +12.4% ➖ noise
10 duckdb:duckdb -2.1% -1.9% -0.2% +10.0% ➖ noise
10 duckdb:vortex-compact +1.2% -1.9% +3.1% +10.4% ➖ noise
10 duckdb:vortex-file-compressed -2.9% -1.9% -1.0% +10.0% ➖ noise
11 datafusion:vortex-compact -6.1% -0.6% -5.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise
11 duckdb:duckdb +2.3% -0.6% +2.9% +10.0% ➖ noise
11 duckdb:vortex-compact -3.6% -0.6% -3.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.2% -0.6% -1.6% +14.7% ➖ noise
12 datafusion:vortex-compact -6.5% +2.1% -8.4% +14.8% ➖ noise
12 datafusion:vortex-file-compressed -5.2% +2.1% -7.2% +20.4% ➖ noise
12 duckdb:duckdb -5.1% +2.1% -7.1% +14.5% ➖ noise
12 duckdb:vortex-compact -3.0% +2.1% -5.0% +18.1% ➖ noise
12 duckdb:vortex-file-compressed -5.1% +2.1% -7.1% +11.8% ➖ noise
13 datafusion:vortex-compact +15.5% -1.3% +17.0% +20.8% ➖ noise
13 datafusion:vortex-file-compressed -3.3% -1.3% -2.0% +13.2% ➖ noise
13 duckdb:duckdb -4.2% -1.3% -2.9% +10.0% ➖ noise
13 duckdb:vortex-compact -1.1% -1.3% +0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.8% -1.3% +3.2% +10.0% ➖ noise
14 datafusion:vortex-compact -2.6% -4.1% +1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.9% -4.1% +3.4% +10.0% ➖ noise
14 duckdb:duckdb +1.3% -4.1% +5.6% +10.0% ➖ noise
14 duckdb:vortex-compact +2.0% -4.1% +6.4% +12.1% ➖ noise
14 duckdb:vortex-file-compressed -0.8% -4.1% +3.4% +10.0% ➖ noise
15 datafusion:vortex-compact -2.4% -4.1% +1.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -4.1% -4.1% +0.0% +10.0% ➖ noise
15 duckdb:duckdb -7.0% -4.1% -3.0% +10.4% ➖ noise
15 duckdb:vortex-compact -0.8% -4.1% +3.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.5% -4.1% +4.8% +10.0% ➖ noise
16 datafusion:vortex-compact -0.0% -6.6% +7.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.9% -6.6% +4.0% +10.0% ➖ noise
16 duckdb:duckdb +1.0% -6.6% +8.2% +11.9% ➖ noise
16 duckdb:vortex-compact +0.4% -6.6% +7.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.3% -6.6% +8.5% +10.0% ➖ noise
17 datafusion:vortex-compact +2.4% -3.4% +6.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.9% -3.4% +4.5% +10.0% ➖ noise
17 duckdb:duckdb +0.7% -3.4% +4.3% +23.5% ➖ noise
17 duckdb:vortex-compact -3.7% -3.4% -0.3% +12.0% ➖ noise
17 duckdb:vortex-file-compressed +4.6% -3.4% +8.4% +10.0% ➖ noise
18 datafusion:vortex-compact -4.1% -1.8% -2.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.1% -1.8% +0.7% +10.6% ➖ noise
18 duckdb:duckdb +2.4% -1.8% +4.3% +10.0% ➖ noise
18 duckdb:vortex-compact +3.7% -1.8% +5.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.1% -1.8% -0.3% +13.0% ➖ noise
19 datafusion:vortex-compact -3.2% -5.2% +2.0% +14.0% ➖ noise
19 datafusion:vortex-file-compressed +2.2% -5.2% +7.8% +10.0% ➖ noise
19 duckdb:duckdb -2.2% -5.2% +3.1% +10.8% ➖ noise
19 duckdb:vortex-compact -2.1% -5.2% +3.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.2% -5.2% +4.2% +10.0% ➖ noise
20 datafusion:vortex-compact -1.5% -1.4% -0.2% +16.9% ➖ noise
20 datafusion:vortex-file-compressed -4.1% -1.4% -2.7% +10.0% ➖ noise
20 duckdb:duckdb -7.2% -1.4% -5.9% +13.3% ➖ noise
20 duckdb:vortex-compact -4.4% -1.4% -3.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +3.1% -1.4% +4.6% +10.8% ➖ noise
21 datafusion:vortex-compact -2.0% -4.4% +2.4% +12.8% ➖ noise
21 datafusion:vortex-file-compressed -0.5% -4.4% +4.1% +12.5% ➖ noise
21 duckdb:duckdb -5.8% -4.4% -1.5% +19.0% ➖ noise
21 duckdb:vortex-compact -7.8% -4.4% -3.6% +12.0% ➖ noise
21 duckdb:vortex-file-compressed -6.0% -4.4% -1.6% +13.5% ➖ noise
22 datafusion:vortex-compact -7.2% -9.9% +3.0% +28.0% ➖ noise
22 datafusion:vortex-file-compressed -26.6% -9.9% -18.5% +25.1% ➖ noise
22 duckdb:duckdb -4.7% -9.9% +5.9% +13.5% ➖ noise
22 duckdb:vortex-compact -4.0% -9.9% +6.6% +13.2% ➖ noise
22 duckdb:vortex-file-compressed -4.4% -9.9% +6.1% +14.0% ➖ noise
23 datafusion:vortex-compact -8.4% -1.1% -7.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -1.1% -1.1% -0.1% +10.0% ➖ noise
23 duckdb:duckdb +1.1% -1.1% +2.2% +10.8% ➖ noise
23 duckdb:vortex-compact +7.3% -1.1% +8.5% +13.7% ➖ noise
23 duckdb:vortex-file-compressed -3.2% -1.1% -2.2% +15.3% ➖ noise
24 datafusion:vortex-compact +2.4% -0.3% +2.7% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +2.0% -0.3% +2.3% +10.0% ➖ noise
24 duckdb:duckdb -4.4% -0.3% -4.1% +10.0% ➖ noise
24 duckdb:vortex-compact -3.9% -0.3% -3.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.9% -0.3% +2.3% +11.7% ➖ noise
25 datafusion:vortex-compact -9.8% -1.9% -8.1% +11.8% ➖ noise
25 datafusion:vortex-file-compressed -2.6% -1.9% -0.7% +10.0% ➖ noise
25 duckdb:duckdb -13.7% -1.9% -12.0% +14.3% ➖ noise
25 duckdb:vortex-compact -8.6% -1.9% -6.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +0.5% -1.9% +2.4% +10.0% ➖ noise
26 datafusion:vortex-compact -8.5% -0.0% -8.5% +10.2% ➖ noise
26 datafusion:vortex-file-compressed -4.8% -0.0% -4.8% +11.5% ➖ noise
26 duckdb:duckdb -7.2% -0.0% -7.2% +12.1% ➖ noise
26 duckdb:vortex-compact +4.1% -0.0% +4.1% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -0.7% -0.0% -0.7% +12.6% ➖ noise
27 datafusion:vortex-compact -2.0% -2.9% +1.0% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -1.4% -2.9% +1.6% +14.2% ➖ noise
27 duckdb:duckdb -3.9% -2.9% -1.0% +20.8% ➖ noise
27 duckdb:vortex-compact +0.7% -2.9% +3.8% +10.2% ➖ noise
27 duckdb:vortex-file-compressed -3.4% -2.9% -0.5% +14.2% ➖ noise
28 datafusion:vortex-compact -2.0% -1.0% -1.1% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.0% -1.0% +1.0% +10.0% ➖ noise
28 duckdb:duckdb -1.4% -1.0% -0.4% +10.0% ➖ noise
28 duckdb:vortex-compact +0.9% -1.0% +1.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.8% -1.0% +0.2% +10.0% ➖ noise
29 datafusion:vortex-compact +0.8% -1.2% +2.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.2% -1.2% -3.0% +10.0% ➖ noise
29 duckdb:duckdb +6.3% -1.2% +7.6% +10.0% ➖ noise
29 duckdb:vortex-compact -7.5% -1.2% -6.3% +13.4% ➖ noise
29 duckdb:vortex-file-compressed -2.7% -1.2% -1.5% +10.0% ➖ noise
30 datafusion:vortex-compact -8.5% -1.5% -7.2% +10.9% ➖ noise
30 datafusion:vortex-file-compressed -6.0% -1.5% -4.6% +10.0% ➖ noise
30 duckdb:duckdb +14.4% -1.5% +16.1% +10.0% 🚨 regression
30 duckdb:vortex-compact +2.6% -1.5% +4.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -4.4% -1.5% -3.0% +13.2% ➖ noise
31 datafusion:vortex-compact -2.1% -0.5% -1.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.9% -0.5% -2.4% +10.0% ➖ noise
31 duckdb:duckdb -1.7% -0.5% -1.2% +10.0% ➖ noise
31 duckdb:vortex-compact +4.5% -0.5% +5.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -1.6% -0.5% -1.1% +12.9% ➖ noise
32 datafusion:vortex-compact -6.6% -1.9% -4.8% +15.2% ➖ noise
32 datafusion:vortex-file-compressed -2.8% -1.9% -0.9% +10.0% ➖ noise
32 duckdb:duckdb -3.5% -1.9% -1.7% +13.9% ➖ noise
32 duckdb:vortex-compact -1.0% -1.9% +0.9% +11.1% ➖ noise
32 duckdb:vortex-file-compressed -3.1% -1.9% -1.3% +10.1% ➖ noise
33 datafusion:vortex-compact +1.0% +3.4% -2.4% +12.7% ➖ noise
33 datafusion:vortex-file-compressed -1.7% +3.4% -5.0% +10.0% ➖ noise
33 duckdb:duckdb +2.0% +3.4% -1.4% +10.0% ➖ noise
33 duckdb:vortex-compact +1.0% +3.4% -2.4% +14.6% ➖ noise
33 duckdb:vortex-file-compressed -1.0% +3.4% -4.3% +10.0% ➖ noise
34 datafusion:vortex-compact -0.5% -2.4% +1.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.0% -2.4% -2.6% +16.1% ➖ noise
34 duckdb:duckdb +3.2% -2.4% +5.8% +14.2% ➖ noise
34 duckdb:vortex-compact +1.4% -2.4% +3.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.8% -2.4% +3.3% +10.0% ➖ noise
35 datafusion:vortex-compact -5.5% +0.6% -6.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.9% +0.6% -1.5% +10.0% ➖ noise
35 duckdb:duckdb -2.8% +0.6% -3.3% +14.9% ➖ noise
35 duckdb:vortex-compact -2.5% +0.6% -3.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.8% +0.6% -1.4% +15.7% ➖ noise
36 datafusion:vortex-compact -2.0% -0.8% -1.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.4% -0.8% -2.6% +10.0% ➖ noise
36 duckdb:duckdb -0.4% -0.8% +0.4% +10.0% ➖ noise
36 duckdb:vortex-compact -3.8% -0.8% -3.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -0.1% -0.8% +0.8% +10.0% ➖ noise
37 datafusion:vortex-compact -4.1% -5.7% +1.7% +14.4% ➖ noise
37 datafusion:vortex-file-compressed +0.5% -5.7% +6.6% +10.0% ➖ noise
37 duckdb:duckdb -0.8% -5.7% +5.2% +13.5% ➖ noise
37 duckdb:vortex-compact -1.7% -5.7% +4.3% +17.7% ➖ noise
37 duckdb:vortex-file-compressed -0.7% -5.7% +5.3% +10.0% ➖ noise
38 datafusion:vortex-compact -6.3% -1.9% -4.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -3.7% -1.9% -1.8% +10.0% ➖ noise
38 duckdb:duckdb -4.5% -1.9% -2.6% +10.0% ➖ noise
38 duckdb:vortex-compact +8.5% -1.9% +10.7% +12.6% ➖ noise
38 duckdb:vortex-file-compressed +2.4% -1.9% +4.4% +12.1% ➖ noise
39 datafusion:vortex-compact +0.9% -2.2% +3.2% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -2.8% -2.2% -0.6% +10.2% ➖ noise
39 duckdb:duckdb +0.7% -2.2% +3.0% +28.1% ➖ noise
39 duckdb:vortex-compact -2.1% -2.2% +0.1% +19.6% ➖ noise
39 duckdb:vortex-file-compressed -7.8% -2.2% -5.7% +10.0% ➖ noise
40 datafusion:vortex-compact -6.8% -1.8% -5.1% +12.2% ➖ noise
40 datafusion:vortex-file-compressed -2.4% -1.8% -0.6% +10.0% ➖ noise
40 duckdb:duckdb -0.1% -1.8% +1.7% +15.5% ➖ noise
40 duckdb:vortex-compact -9.2% -1.8% -7.5% +18.1% ➖ noise
40 duckdb:vortex-file-compressed +3.6% -1.8% +5.5% +16.1% ➖ noise
41 datafusion:vortex-compact -7.5% -2.6% -5.0% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -2.1% -2.6% +0.5% +10.0% ➖ noise
41 duckdb:duckdb -0.6% -2.6% +2.1% +10.6% ➖ noise
41 duckdb:vortex-compact -1.6% -2.6% +1.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -2.2% -2.6% +0.5% +10.0% ➖ noise
42 datafusion:vortex-compact -1.3% -7.6% +6.8% +13.2% ➖ noise
42 datafusion:vortex-file-compressed -4.1% -7.6% +3.8% +11.4% ➖ noise
42 duckdb:duckdb -8.7% -7.6% -1.3% +19.7% ➖ noise
42 duckdb:vortex-compact -0.8% -7.6% +7.3% +11.7% ➖ noise
42 duckdb:vortex-file-compressed -7.2% -7.6% +0.4% +13.8% ➖ noise
43 datafusion:vortex-compact -3.9% -2.2% -1.8% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -2.1% -2.2% +0.1% +10.0% ➖ noise
43 duckdb:duckdb +3.5% -2.2% +5.8% +10.8% ➖ noise
43 duckdb:vortex-compact -10.2% -2.2% -8.2% +17.1% ➖ noise
43 duckdb:vortex-file-compressed +4.0% -2.2% +6.3% +10.4% ➖ noise
44 datafusion:vortex-compact -0.3% -3.7% +3.6% +10.1% ➖ noise
44 datafusion:vortex-file-compressed -4.5% -3.7% -0.8% +11.9% ➖ noise
44 duckdb:duckdb +1.1% -3.7% +5.0% +14.7% ➖ noise
44 duckdb:vortex-compact -11.7% -3.7% -8.3% +11.7% ➖ noise
44 duckdb:vortex-file-compressed -1.2% -3.7% +2.5% +10.0% ➖ noise
45 datafusion:vortex-compact +2.7% -1.2% +3.9% +11.9% ➖ noise
45 datafusion:vortex-file-compressed +1.2% -1.2% +2.4% +10.3% ➖ noise
45 duckdb:duckdb +1.2% -1.2% +2.4% +10.0% ➖ noise
45 duckdb:vortex-compact +1.6% -1.2% +2.8% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -8.8% -1.2% -7.7% +12.5% ➖ noise
46 datafusion:vortex-compact -5.8% -4.7% -1.1% +15.7% ➖ noise
46 datafusion:vortex-file-compressed -1.6% -4.7% +3.3% +10.0% ➖ noise
46 duckdb:duckdb +0.8% -4.7% +5.8% +10.0% ➖ noise
46 duckdb:vortex-compact +4.2% -4.7% +9.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -1.1% -4.7% +3.8% +10.0% ➖ noise
47 datafusion:vortex-compact -4.2% +1.1% -5.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -2.4% +1.1% -3.5% +10.0% ➖ noise
47 duckdb:duckdb -5.2% +1.1% -6.2% +10.0% ➖ noise
47 duckdb:vortex-compact +1.3% +1.1% +0.2% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.5% +1.1% +0.4% +10.0% ➖ noise
48 datafusion:vortex-compact +4.8% -0.8% +5.6% +14.9% ➖ noise
48 datafusion:vortex-file-compressed -0.2% -0.8% +0.5% +10.0% ➖ noise
48 duckdb:duckdb -0.3% -0.8% +0.5% +10.0% ➖ noise
48 duckdb:vortex-compact +0.9% -0.8% +1.8% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -2.4% -0.8% -1.6% +12.4% ➖ noise
49 datafusion:vortex-compact -1.4% -2.2% +0.9% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +0.5% -2.2% +2.8% +10.0% ➖ noise
49 duckdb:duckdb -0.6% -2.2% +1.6% +15.4% ➖ noise
49 duckdb:vortex-compact +2.9% -2.2% +5.2% +16.0% ➖ noise
49 duckdb:vortex-file-compressed -7.0% -2.2% -5.0% +28.4% ➖ noise
50 datafusion:vortex-compact -2.8% +1.6% -4.3% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -1.5% +1.6% -3.1% +10.0% ➖ noise
50 duckdb:duckdb -3.5% +1.6% -5.0% +10.7% ➖ noise
50 duckdb:vortex-compact -1.3% +1.6% -2.9% +10.8% ➖ noise
50 duckdb:vortex-file-compressed -1.0% +1.6% -2.6% +10.0% ➖ noise
51 datafusion:vortex-compact -3.1% -1.4% -1.7% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -1.0% -1.4% +0.4% +10.0% ➖ noise
51 duckdb:duckdb -0.9% -1.4% +0.5% +10.0% ➖ noise
51 duckdb:vortex-compact -0.7% -1.4% +0.7% +13.0% ➖ noise
51 duckdb:vortex-file-compressed +0.3% -1.4% +1.7% +12.7% ➖ noise
52 datafusion:vortex-compact -1.0% -5.6% +4.8% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -3.6% -5.6% +2.1% +14.3% ➖ noise
52 duckdb:duckdb -0.9% -5.6% +4.9% +13.1% ➖ noise
52 duckdb:vortex-compact -4.0% -5.6% +1.7% +10.4% ➖ noise
52 duckdb:vortex-file-compressed +1.7% -5.6% +7.7% +14.7% ➖ noise
53 datafusion:vortex-compact -2.9% -0.7% -2.2% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -1.7% -0.7% -1.0% +10.0% ➖ noise
53 duckdb:duckdb -0.8% -0.7% -0.1% +10.0% ➖ noise
53 duckdb:vortex-compact +4.1% -0.7% +4.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -0.1% -0.7% +0.7% +10.0% ➖ noise
54 datafusion:vortex-compact -3.2% -3.2% +0.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.0% -3.2% +4.3% +10.4% ➖ noise
54 duckdb:duckdb -0.4% -3.2% +2.9% +11.0% ➖ noise
54 duckdb:vortex-compact +2.4% -3.2% +5.8% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +0.8% -3.2% +4.1% +10.0% ➖ noise
55 datafusion:vortex-compact -2.6% -5.1% +2.6% +16.3% ➖ noise
55 datafusion:vortex-file-compressed +8.4% -5.1% +14.2% +11.9% 🚨 regression
55 duckdb:duckdb -1.1% -5.1% +4.1% +14.7% ➖ noise
55 duckdb:vortex-compact -1.3% -5.1% +3.9% +11.2% ➖ noise
55 duckdb:vortex-file-compressed -0.8% -5.1% +4.5% +11.1% ➖ noise
56 datafusion:vortex-compact -4.2% -6.2% +2.2% +11.7% ➖ noise
56 datafusion:vortex-file-compressed -3.4% -6.2% +3.0% +10.0% ➖ noise
56 duckdb:duckdb +2.9% -6.2% +9.7% +11.6% ➖ noise
56 duckdb:vortex-compact -4.8% -6.2% +1.5% +10.2% ➖ noise
56 duckdb:vortex-file-compressed -7.8% -6.2% -1.7% +16.7% ➖ noise
57 datafusion:vortex-compact -5.1% +1.0% -6.1% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -5.1% +1.0% -6.0% +10.0% ➖ noise
57 duckdb:duckdb +5.0% +1.0% +4.0% +15.1% ➖ noise
57 duckdb:vortex-compact -0.1% +1.0% -1.1% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -0.2% +1.0% -1.3% +10.0% ➖ noise
58 datafusion:vortex-compact -0.4% -1.6% +1.3% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +1.3% -1.6% +2.9% +10.0% ➖ noise
58 duckdb:duckdb -8.3% -1.6% -6.8% +12.6% ➖ noise
58 duckdb:vortex-compact -3.3% -1.6% -1.7% +21.9% ➖ noise
58 duckdb:vortex-file-compressed +1.8% -1.6% +3.5% +10.0% ➖ noise
59 datafusion:vortex-compact -2.6% -2.8% +0.2% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -2.2% -2.8% +0.7% +10.0% ➖ noise
59 duckdb:duckdb +1.0% -2.8% +4.0% +10.1% ➖ noise
59 duckdb:vortex-compact -2.3% -2.8% +0.6% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.6% -2.8% +2.3% +10.0% ➖ noise
60 datafusion:vortex-compact -0.8% -0.3% -0.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -2.7% -0.3% -2.4% +11.9% ➖ noise
60 duckdb:duckdb -3.4% -0.3% -3.1% +10.2% ➖ noise
60 duckdb:vortex-compact -0.5% -0.3% -0.2% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +0.7% -0.3% +1.1% +10.0% ➖ noise
61 datafusion:vortex-compact -1.3% -0.6% -0.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -3.5% -0.6% -2.9% +10.0% ➖ noise
61 duckdb:duckdb +2.9% -0.6% +3.5% +10.5% ➖ noise
61 duckdb:vortex-compact -4.7% -0.6% -4.0% +11.8% ➖ noise
61 duckdb:vortex-file-compressed +1.1% -0.6% +1.8% +16.5% ➖ noise
62 datafusion:vortex-compact -4.9% +4.2% -8.7% +25.7% ➖ noise
62 datafusion:vortex-file-compressed -2.0% +4.2% -5.9% +24.6% ➖ noise
62 duckdb:duckdb -0.2% +4.2% -4.2% +15.5% ➖ noise
62 duckdb:vortex-compact -3.5% +4.2% -7.3% +23.7% ➖ noise
62 duckdb:vortex-file-compressed +2.3% +4.2% -1.8% +20.5% ➖ noise
63 datafusion:vortex-compact -3.8% +0.3% -4.1% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -4.6% +0.3% -4.8% +18.7% ➖ noise
63 duckdb:duckdb -0.9% +0.3% -1.2% +10.0% ➖ noise
63 duckdb:vortex-compact +0.9% +0.3% +0.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -2.1% +0.3% -2.3% +10.0% ➖ noise
64 datafusion:vortex-compact -3.9% +0.4% -4.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -1.1% +0.4% -1.5% +10.0% ➖ noise
64 duckdb:duckdb -2.0% +0.4% -2.4% +10.0% ➖ noise
64 duckdb:vortex-compact -4.3% +0.4% -4.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +0.3% +0.4% -0.1% +10.7% ➖ noise
65 datafusion:vortex-compact -3.2% -0.4% -2.8% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -2.3% -0.4% -1.9% +12.5% ➖ noise
65 duckdb:duckdb -6.1% -0.4% -5.7% +13.3% ➖ noise
65 duckdb:vortex-compact +1.6% -0.4% +2.1% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.8% -0.4% +3.3% +10.7% ➖ noise
66 datafusion:vortex-compact -6.6% +4.4% -10.6% +14.5% ➖ noise
66 datafusion:vortex-file-compressed -6.8% +4.4% -10.7% +15.5% ➖ noise
66 duckdb:duckdb +0.1% +4.4% -4.2% +11.0% ➖ noise
66 duckdb:vortex-compact -3.4% +4.4% -7.6% +14.5% ➖ noise
66 duckdb:vortex-file-compressed +5.0% +4.4% +0.5% +13.8% ➖ noise
67 datafusion:vortex-compact -5.7% -1.9% -3.9% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +0.9% -1.9% +2.8% +10.0% ➖ noise
67 duckdb:duckdb -0.1% -1.9% +1.8% +10.0% ➖ noise
67 duckdb:vortex-compact -2.4% -1.9% -0.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.7% -1.9% +0.2% +10.0% ➖ noise
68 datafusion:vortex-compact -0.5% +0.1% -0.5% +15.6% ➖ noise
68 datafusion:vortex-file-compressed -4.1% +0.1% -4.2% +11.0% ➖ noise
68 duckdb:duckdb +1.9% +0.1% +1.8% +10.5% ➖ noise
68 duckdb:vortex-compact +2.5% +0.1% +2.5% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.0% +0.1% -0.0% +13.1% ➖ noise
69 datafusion:vortex-compact -3.0% -1.8% -1.2% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -6.7% -1.8% -5.0% +10.0% ➖ noise
69 duckdb:duckdb -0.5% -1.8% +1.3% +11.6% ➖ noise
69 duckdb:vortex-compact +0.0% -1.8% +1.9% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +2.5% -1.8% +4.4% +10.0% ➖ noise
70 datafusion:vortex-compact -2.7% -0.5% -2.3% +11.1% ➖ noise
70 datafusion:vortex-file-compressed -2.6% -0.5% -2.1% +10.0% ➖ noise
70 duckdb:duckdb -2.4% -0.5% -2.0% +12.6% ➖ noise
70 duckdb:vortex-compact -2.8% -0.5% -2.3% +15.5% ➖ noise
70 duckdb:vortex-file-compressed +2.5% -0.5% +3.0% +10.0% ➖ noise
71 datafusion:vortex-compact -3.4% +2.6% -5.8% +15.6% ➖ noise
71 datafusion:vortex-file-compressed +1.0% +2.6% -1.5% +12.3% ➖ noise
71 duckdb:duckdb +1.6% +2.6% -0.9% +15.7% ➖ noise
71 duckdb:vortex-compact -5.1% +2.6% -7.5% +11.9% ➖ noise
71 duckdb:vortex-file-compressed +6.5% +2.6% +3.8% +11.3% ➖ noise
72 datafusion:vortex-compact -3.1% -1.5% -1.7% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -4.3% -1.5% -2.8% +10.0% ➖ noise
72 duckdb:duckdb -3.4% -1.5% -1.9% +10.0% ➖ noise
72 duckdb:vortex-compact +0.1% -1.5% +1.6% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.3% -1.5% -0.9% +10.0% ➖ noise
73 datafusion:vortex-compact -1.8% -0.1% -1.7% +14.2% ➖ noise
73 datafusion:vortex-file-compressed -5.4% -0.1% -5.3% +21.6% ➖ noise
73 duckdb:duckdb -4.0% -0.1% -3.8% +15.7% ➖ noise
73 duckdb:vortex-compact +2.7% -0.1% +2.9% +14.4% ➖ noise
73 duckdb:vortex-file-compressed +4.3% -0.1% +4.4% +13.3% ➖ noise
74 datafusion:vortex-compact -0.3% -1.5% +1.2% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +3.7% -1.5% +5.2% +10.0% ➖ noise
74 duckdb:duckdb -3.2% -1.5% -1.7% +10.0% ➖ noise
74 duckdb:vortex-compact +2.2% -1.5% +3.7% +28.4% ➖ noise
74 duckdb:vortex-file-compressed +5.9% -1.5% +7.5% +27.9% ➖ noise
75 datafusion:vortex-compact -4.5% -0.4% -4.2% +12.2% ➖ noise
75 datafusion:vortex-file-compressed -3.5% -0.4% -3.2% +10.0% ➖ noise
75 duckdb:duckdb +0.7% -0.4% +1.1% +10.0% ➖ noise
75 duckdb:vortex-compact -3.5% -0.4% -3.2% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +4.1% -0.4% +4.4% +10.0% ➖ noise
76 datafusion:vortex-compact +1.4% +0.2% +1.2% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -5.1% +0.2% -5.3% +25.3% ➖ noise
76 duckdb:duckdb -1.5% +0.2% -1.6% +12.8% ➖ noise
76 duckdb:vortex-compact +0.4% +0.2% +0.2% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -0.2% +0.2% -0.4% +22.5% ➖ noise
77 datafusion:vortex-compact -5.7% -5.1% -0.6% +15.0% ➖ noise
77 datafusion:vortex-file-compressed -5.6% -5.1% -0.5% +14.6% ➖ noise
77 duckdb:duckdb -1.3% -5.1% +4.0% +18.3% ➖ noise
77 duckdb:vortex-compact -3.1% -5.1% +2.1% +12.2% ➖ noise
77 duckdb:vortex-file-compressed -1.7% -5.1% +3.6% +20.6% ➖ noise
78 datafusion:vortex-compact -3.3% -2.0% -1.3% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -2.4% -2.0% -0.3% +10.0% ➖ noise
78 duckdb:duckdb -1.8% -2.0% +0.2% +10.0% ➖ noise
78 duckdb:vortex-compact +0.5% -2.0% +2.6% +11.7% ➖ noise
78 duckdb:vortex-file-compressed +4.2% -2.0% +6.3% +10.0% ➖ noise
79 datafusion:vortex-compact -3.6% +0.2% -3.7% +13.9% ➖ noise
79 datafusion:vortex-file-compressed +7.2% +0.2% +7.0% +12.7% ➖ noise
79 duckdb:duckdb -2.7% +0.2% -2.9% +10.0% ➖ noise
79 duckdb:vortex-compact -3.1% +0.2% -3.2% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +0.9% +0.2% +0.7% +10.0% ➖ noise
80 datafusion:vortex-compact -4.1% -2.7% -1.4% +10.1% ➖ noise
80 datafusion:vortex-file-compressed -4.7% -2.7% -2.0% +10.0% ➖ noise
80 duckdb:duckdb -3.9% -2.7% -1.2% +16.9% ➖ noise
80 duckdb:vortex-compact +2.9% -2.7% +5.8% +14.0% ➖ noise
80 duckdb:vortex-file-compressed -2.2% -2.7% +0.6% +17.8% ➖ noise
81 datafusion:vortex-compact +12.1% -2.9% +15.5% +21.9% ➖ noise
81 datafusion:vortex-file-compressed -4.9% -2.9% -2.0% +10.0% ➖ noise
81 duckdb:duckdb -1.3% -2.9% +1.6% +10.0% ➖ noise
81 duckdb:vortex-compact -0.3% -2.9% +2.7% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +7.0% -2.9% +10.2% +10.7% ➖ noise
82 datafusion:vortex-compact +2.0% -5.2% +7.6% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.2% -5.2% +5.3% +10.0% ➖ noise
82 duckdb:duckdb +2.0% -5.2% +7.6% +13.6% ➖ noise
82 duckdb:vortex-compact -4.6% -5.2% +0.6% +11.7% ➖ noise
82 duckdb:vortex-file-compressed -1.0% -5.2% +4.4% +10.4% ➖ noise
83 datafusion:vortex-compact -9.2% -3.0% -6.4% +13.7% ➖ noise
83 datafusion:vortex-file-compressed -1.8% -3.0% +1.2% +14.0% ➖ noise
83 duckdb:duckdb +0.1% -3.0% +3.1% +12.2% ➖ noise
83 duckdb:vortex-compact +0.6% -3.0% +3.7% +26.4% ➖ noise
83 duckdb:vortex-file-compressed +1.4% -3.0% +4.5% +10.0% ➖ noise
84 datafusion:vortex-compact -7.2% +2.4% -9.5% +10.0% ✅ faster
84 datafusion:vortex-file-compressed -3.5% +2.4% -5.8% +25.5% ➖ noise
84 duckdb:duckdb -0.3% +2.4% -2.7% +12.0% ➖ noise
84 duckdb:vortex-compact -3.1% +2.4% -5.4% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -2.7% +2.4% -5.1% +10.0% ➖ noise
85 datafusion:vortex-compact -5.7% -2.5% -3.2% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -3.8% -2.5% -1.3% +10.0% ➖ noise
85 duckdb:duckdb +5.1% -2.5% +7.8% +10.0% ➖ noise
85 duckdb:vortex-compact -0.9% -2.5% +1.7% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -0.8% -2.5% +1.8% +10.0% ➖ noise
86 datafusion:vortex-compact +11.0% -6.1% +18.2% +21.1% ➖ noise
86 datafusion:vortex-file-compressed -4.7% -6.1% +1.5% +14.6% ➖ noise
86 duckdb:duckdb -4.1% -6.1% +2.1% +11.3% ➖ noise
86 duckdb:vortex-compact -4.0% -6.1% +2.2% +14.7% ➖ noise
86 duckdb:vortex-file-compressed -14.8% -6.1% -9.3% +15.7% ➖ noise
87 datafusion:vortex-compact -5.3% +0.3% -5.6% +10.5% ➖ noise
87 datafusion:vortex-file-compressed -5.3% +0.3% -5.6% +10.0% ➖ noise
87 duckdb:duckdb -5.3% +0.3% -5.5% +11.7% ➖ noise
87 duckdb:vortex-compact -4.2% +0.3% -4.4% +13.8% ➖ noise
87 duckdb:vortex-file-compressed +0.0% +0.3% -0.2% +12.7% ➖ noise
88 datafusion:vortex-compact -3.6% -1.4% -2.2% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.9% -1.4% -0.4% +10.0% ➖ noise
88 duckdb:duckdb +1.1% -1.4% +2.6% +19.0% ➖ noise
88 duckdb:vortex-compact -0.5% -1.4% +1.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -5.7% -1.4% -4.3% +10.0% ➖ noise
89 datafusion:vortex-compact +8.8% -0.6% +9.4% +12.9% ➖ noise
89 datafusion:vortex-file-compressed -5.4% -0.6% -4.9% +13.1% ➖ noise
89 duckdb:duckdb +2.1% -0.6% +2.7% +11.1% ➖ noise
89 duckdb:vortex-compact -1.1% -0.6% -0.5% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -0.9% -0.6% -0.4% +14.4% ➖ noise
90 datafusion:vortex-compact -5.5% -5.3% -0.2% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -0.8% -5.3% +4.7% +10.0% ➖ noise
90 duckdb:duckdb -4.7% -5.3% +0.6% +14.9% ➖ noise
90 duckdb:vortex-compact -2.5% -5.3% +2.9% +10.5% ➖ noise
90 duckdb:vortex-file-compressed +2.1% -5.3% +7.8% +10.0% ➖ noise
91 datafusion:vortex-compact -5.4% -4.9% -0.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -6.8% -4.9% -1.9% +10.0% ➖ noise
91 duckdb:duckdb -6.9% -4.9% -2.1% +13.0% ➖ noise
91 duckdb:vortex-compact -2.9% -4.9% +2.2% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +0.3% -4.9% +5.5% +10.0% ➖ noise
92 datafusion:vortex-compact -6.9% -3.2% -3.9% +11.3% ➖ noise
92 datafusion:vortex-file-compressed -2.4% -3.2% +0.8% +10.3% ➖ noise
92 duckdb:duckdb +5.4% -3.2% +8.8% +15.6% ➖ noise
92 duckdb:vortex-compact -5.2% -3.2% -2.1% +20.0% ➖ noise
92 duckdb:vortex-file-compressed +12.2% -3.2% +15.8% +11.5% 🚨 regression
93 datafusion:vortex-compact -0.2% -0.0% -0.2% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -6.3% -0.0% -6.3% +10.0% ➖ noise
93 duckdb:duckdb +0.6% -0.0% +0.6% +10.0% ➖ noise
93 duckdb:vortex-compact -0.1% -0.0% -0.1% +10.8% ➖ noise
93 duckdb:vortex-file-compressed -6.4% -0.0% -6.4% +14.0% ➖ noise
94 datafusion:vortex-compact -13.7% -2.9% -11.1% +12.5% ➖ noise
94 datafusion:vortex-file-compressed -9.2% -2.9% -6.5% +13.0% ➖ noise
94 duckdb:duckdb +1.9% -2.9% +5.0% +10.0% ➖ noise
94 duckdb:vortex-compact +0.4% -2.9% +3.5% +10.0% ➖ noise
94 duckdb:vortex-file-compressed -5.3% -2.9% -2.4% +13.2% ➖ noise
95 datafusion:vortex-compact -2.9% -5.7% +2.9% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -6.1% -5.7% -0.5% +11.9% ➖ noise
95 duckdb:duckdb +6.2% -5.7% +12.6% +18.8% ➖ noise
95 duckdb:vortex-compact +0.1% -5.7% +6.1% +18.8% ➖ noise
95 duckdb:vortex-file-compressed +11.6% -5.7% +18.4% +14.6% 🚨 regression
96 datafusion:vortex-compact -2.1% -5.0% +3.0% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -4.4% -5.0% +0.6% +10.0% ➖ noise
96 duckdb:duckdb -1.4% -5.0% +3.7% +17.4% ➖ noise
96 duckdb:vortex-compact +1.2% -5.0% +6.5% +10.5% ➖ noise
96 duckdb:vortex-file-compressed -8.2% -5.0% -3.4% +14.9% ➖ noise
97 datafusion:vortex-compact -4.2% +0.7% -4.9% +10.6% ➖ noise
97 datafusion:vortex-file-compressed -7.7% +0.7% -8.3% +10.5% ➖ noise
97 duckdb:duckdb -4.6% +0.7% -5.3% +10.8% ➖ noise
97 duckdb:vortex-compact -4.0% +0.7% -4.7% +11.4% ➖ noise
97 duckdb:vortex-file-compressed -4.3% +0.7% -5.0% +19.8% ➖ noise
98 datafusion:vortex-compact -5.5% -1.7% -3.9% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -2.1% -1.7% -0.5% +10.0% ➖ noise
98 duckdb:duckdb -6.0% -1.7% -4.4% +13.8% ➖ noise
98 duckdb:vortex-compact -0.1% -1.7% +1.6% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -1.4% -1.7% +0.3% +10.0% ➖ noise
99 datafusion:vortex-compact -17.3% -11.2% -6.9% +20.2% ➖ noise
99 datafusion:vortex-file-compressed -0.1% -11.2% +12.6% +17.3% ➖ noise
99 duckdb:duckdb +1.2% -11.2% +14.0% +14.4% ➖ noise
99 duckdb:vortex-compact -13.0% -11.2% -2.0% +22.5% ➖ noise
99 duckdb:vortex-file-compressed +0.6% -11.2% +13.3% +18.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Vortex (geomean): 1.046x ➖
Parquet (geomean): 1.043x ➖
Shifts: Parquet (control) +4.3% · Median polish +3.0%


datafusion / vortex-file-compressed (1.062x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 34251861 34657283 0.99
fineweb_q01/datafusion:vortex-file-compressed 529861807 509958963 1.04
fineweb_q02/datafusion:vortex-file-compressed 🚨 594814952 450099832 1.32
fineweb_q03/datafusion:vortex-file-compressed 1517298946 1412613414 1.07
fineweb_q04/datafusion:vortex-file-compressed 1384489338 1359918509 1.02
fineweb_q05/datafusion:vortex-file-compressed 1414268331 1354106531 1.04
fineweb_q06/datafusion:vortex-file-compressed 1514495702 1442194569 1.05
fineweb_q07/datafusion:vortex-file-compressed 1405572619 1356920872 1.04
fineweb_q08/datafusion:vortex-file-compressed 515938588 504366104 1.02
datafusion / vortex-compact (0.996x ➖, 1↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 36709027 58361252 0.63
fineweb_q01/datafusion:vortex-compact 575929808 470120659 1.23
fineweb_q02/datafusion:vortex-compact 🚨 766517920 585085896 1.31
fineweb_q03/datafusion:vortex-compact 1506143138 1498529779 1.01
fineweb_q04/datafusion:vortex-compact 1749915428 1745871705 1.00
fineweb_q05/datafusion:vortex-compact 1437701028 1444028586 1.00
fineweb_q06/datafusion:vortex-compact 1293134213 1338147595 0.97
fineweb_q07/datafusion:vortex-compact 1152034885 1167033205 0.99
fineweb_q08/datafusion:vortex-compact 365809979 365692483 1.00
datafusion / parquet (1.064x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1304523410 1054257137 1.24
fineweb_q01/datafusion:parquet 1805908767 1742236890 1.04
fineweb_q02/datafusion:parquet 1933010866 2136523346 0.90
fineweb_q03/datafusion:parquet 1948328094 1899423540 1.03
fineweb_q04/datafusion:parquet 1919311204 2002238540 0.96
fineweb_q05/datafusion:parquet 2022748435 1762938539 1.15
fineweb_q06/datafusion:parquet 2108495765 1803024425 1.17
fineweb_q07/datafusion:parquet 1905644578 1807724779 1.05
fineweb_q08/datafusion:parquet 1823085237 1679450959 1.09
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 78061608 74545863 1.05
fineweb_q01/duckdb:vortex-file-compressed 549501028 562295424 0.98
fineweb_q02/duckdb:vortex-file-compressed 472061599 540851621 0.87
fineweb_q03/duckdb:vortex-file-compressed 1504782801 1461398785 1.03
fineweb_q04/duckdb:vortex-file-compressed 1499867989 1482542744 1.01
fineweb_q05/duckdb:vortex-file-compressed 1516650467 1523920947 1.00
fineweb_q06/duckdb:vortex-file-compressed 1711419495 1647070982 1.04
fineweb_q07/duckdb:vortex-file-compressed 1586717517 1406626558 1.13
fineweb_q08/duckdb:vortex-file-compressed 715643642 603395628 1.19
duckdb / vortex-compact (1.101x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 119499828 72389859 1.65
fineweb_q01/duckdb:vortex-compact 510798391 519097790 0.98
fineweb_q02/duckdb:vortex-compact 646302870 613924617 1.05
fineweb_q03/duckdb:vortex-compact 1696252650 1678093869 1.01
fineweb_q04/duckdb:vortex-compact 1822323115 1733946096 1.05
fineweb_q05/duckdb:vortex-compact 1503187113 1592246134 0.94
fineweb_q06/duckdb:vortex-compact 1561743103 1484142960 1.05
fineweb_q07/duckdb:vortex-compact 1353686899 1310730102 1.03
fineweb_q08/duckdb:vortex-compact 599763856 469798453 1.28
duckdb / parquet (1.021x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1246189414 1094365897 1.14
fineweb_q01/duckdb:parquet 1410809501 1358535219 1.04
fineweb_q02/duckdb:parquet 1401380398 1390455068 1.01
fineweb_q03/duckdb:parquet 3601601677 3745566972 0.96
fineweb_q04/duckdb:parquet 1957987082 1928065636 1.02
fineweb_q05/duckdb:parquet 2156628991 2120217606 1.02
fineweb_q06/duckdb:parquet 4333687534 4376841385 0.99
fineweb_q07/duckdb:parquet 2628148775 2677624246 0.98
fineweb_q08/duckdb:parquet 1133596791 1077554983 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -37.1% +18.7% -47.0% +168.3% ➖ noise
0 datafusion:vortex-file-compressed -1.2% +18.7% -16.7% +200.9% ➖ noise
0 duckdb:vortex-compact +65.1% +18.7% +39.1% +67.8% ➖ noise
0 duckdb:vortex-file-compressed +4.7% +18.7% -11.8% +59.6% ➖ noise
1 datafusion:vortex-compact +22.5% +3.8% +18.1% +54.1% ➖ noise
1 datafusion:vortex-file-compressed +3.9% +3.8% +0.1% +70.7% ➖ noise
1 duckdb:vortex-compact -1.6% +3.8% -5.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -2.3% +3.8% -5.8% +30.0% ➖ noise
2 datafusion:vortex-compact +31.0% -4.5% +37.2% +30.0% 🚨 regression
2 datafusion:vortex-file-compressed +32.2% -4.5% +38.4% +34.3% 🚨 regression
2 duckdb:vortex-compact +5.3% -4.5% +10.2% +40.0% ➖ noise
2 duckdb:vortex-file-compressed -12.7% -4.5% -8.6% +35.4% ➖ noise
3 datafusion:vortex-compact +0.5% -0.7% +1.2% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +7.4% -0.7% +8.2% +30.0% ➖ noise
3 duckdb:vortex-compact +1.1% -0.7% +1.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.0% -0.7% +3.7% +30.0% ➖ noise
4 datafusion:vortex-compact +0.2% -1.3% +1.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.8% -1.3% +3.2% +30.0% ➖ noise
4 duckdb:vortex-compact +5.1% -1.3% +6.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +1.2% -1.3% +2.5% +30.0% ➖ noise
5 datafusion:vortex-compact -0.4% +8.0% -7.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +4.4% +8.0% -3.3% +30.0% ➖ noise
5 duckdb:vortex-compact -5.6% +8.0% -12.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -0.5% +8.0% -7.9% +30.0% ➖ noise
6 datafusion:vortex-compact -3.4% +7.6% -10.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.0% +7.6% -2.4% +30.0% ➖ noise
6 duckdb:vortex-compact +5.2% +7.6% -2.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +3.9% +7.6% -3.4% +30.0% ➖ noise
7 datafusion:vortex-compact -1.3% +1.7% -3.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.6% +1.7% +1.8% +30.0% ➖ noise
7 duckdb:vortex-compact +3.3% +1.7% +1.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +12.8% +1.7% +10.9% +30.0% ➖ noise
8 datafusion:vortex-compact +0.0% +6.9% -6.4% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +2.3% +6.9% -4.3% +30.0% ➖ noise
8 duckdb:vortex-compact +27.7% +6.9% +19.5% +35.2% ➖ noise
8 duckdb:vortex-file-compressed +18.6% +6.9% +11.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.984x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.5%


duckdb / vortex-file-compressed (0.973x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11405835 11647862 0.98
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19639155 27033750 0.73
statpopgen_q02/duckdb:vortex-file-compressed 1382565765 1392993476 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3150670494 3143605991 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3113219794 3223182606 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1454415601 1457478478 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2142647996 2129929514 1.01
statpopgen_q07/duckdb:vortex-file-compressed 208073093 206864612 1.01
statpopgen_q08/duckdb:vortex-file-compressed 239024161 230896505 1.04
statpopgen_q09/duckdb:vortex-file-compressed 2960015039 2886786264 1.03
statpopgen_q10/duckdb:vortex-file-compressed 4746767734 4715801835 1.01
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11212810 11219129 1.00
statpopgen_q01/duckdb:vortex-compact 165409358 165702809 1.00
statpopgen_q02/duckdb:vortex-compact 1824521515 1859815005 0.98
statpopgen_q03/duckdb:vortex-compact 3495641881 3532246348 0.99
statpopgen_q04/duckdb:vortex-compact 3553796630 3535654546 1.01
statpopgen_q05/duckdb:vortex-compact 1836918770 1867994030 0.98
statpopgen_q06/duckdb:vortex-compact 2708480069 2673808937 1.01
statpopgen_q07/duckdb:vortex-compact 880112793 884830583 0.99
statpopgen_q08/duckdb:vortex-compact 911174421 911391044 1.00
statpopgen_q09/duckdb:vortex-compact 3375244424 3360108064 1.00
statpopgen_q10/duckdb:vortex-compact 5394198367 5483277391 0.98
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 318184413 325469076 0.98
statpopgen_q01/duckdb:parquet 406620092 402634988 1.01
statpopgen_q02/duckdb:parquet 990822857 998345364 0.99
statpopgen_q03/duckdb:parquet 1492668731 1517869814 0.98
statpopgen_q04/duckdb:parquet 1518587851 1515573251 1.00
statpopgen_q05/duckdb:parquet 1006979586 1018229753 0.99
statpopgen_q06/duckdb:parquet 1493087853 1485399691 1.01
statpopgen_q07/duckdb:parquet 1318788301 1328579320 0.99
statpopgen_q08/duckdb:parquet 1318594480 1338432769 0.99
statpopgen_q09/duckdb:parquet 1340445842 1427098026 0.94
statpopgen_q10/duckdb:parquet 2687167165 2709895411 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.1% -2.2% +2.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -2.1% -2.2% +0.2% +10.0% ➖ noise
1 duckdb:vortex-compact -0.2% +1.0% -1.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -27.4% +1.0% -28.1% +201.9% ➖ noise
2 duckdb:vortex-compact -1.9% -0.8% -1.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.7% -0.8% +0.0% +10.0% ➖ noise
3 duckdb:vortex-compact -1.0% -1.7% +0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.2% -1.7% +1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +0.5% +0.2% +0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.4% +0.2% -3.6% +10.0% ➖ noise
5 duckdb:vortex-compact -1.7% -1.1% -0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.2% -1.1% +0.9% +10.0% ➖ noise
6 duckdb:vortex-compact +1.3% +0.5% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% +0.5% +0.1% +10.0% ➖ noise
7 duckdb:vortex-compact -0.5% -0.7% +0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% -0.7% +1.3% +10.0% ➖ noise
8 duckdb:vortex-compact -0.0% -1.5% +1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.5% -1.5% +5.1% +10.0% ➖ noise
9 duckdb:vortex-compact +0.5% -6.1% +6.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.5% -6.1% +9.2% +10.0% ➖ noise
10 duckdb:vortex-compact -1.6% -0.8% -0.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.7% -0.8% +1.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish +2.4%


datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 795818046 680840675 1.17
tpch_q02/datafusion:vortex-file-compressed 696797932 768523551 0.91
tpch_q03/datafusion:vortex-file-compressed 855894984 849443273 1.01
tpch_q04/datafusion:vortex-file-compressed 625197246 629281578 0.99
tpch_q05/datafusion:vortex-file-compressed 967491301 1071259691 0.90
tpch_q06/datafusion:vortex-file-compressed 667851550 755566971 0.88
tpch_q07/datafusion:vortex-file-compressed 979673617 1054200757 0.93
tpch_q08/datafusion:vortex-file-compressed 1153559469 1193356777 0.97
tpch_q09/datafusion:vortex-file-compressed 1265048948 1278459122 0.99
tpch_q10/datafusion:vortex-file-compressed 934536468 1168217664 0.80
tpch_q11/datafusion:vortex-file-compressed 476614186 522505906 0.91
tpch_q12/datafusion:vortex-file-compressed 1119754271 880207721 1.27
tpch_q13/datafusion:vortex-file-compressed 454897088 413979323 1.10
tpch_q14/datafusion:vortex-file-compressed 757231409 586249232 1.29
tpch_q15/datafusion:vortex-file-compressed 1101432932 1156273955 0.95
tpch_q16/datafusion:vortex-file-compressed 349143362 427746130 0.82
tpch_q17/datafusion:vortex-file-compressed 1125044369 1152028078 0.98
tpch_q18/datafusion:vortex-file-compressed 1230802251 1269455449 0.97
tpch_q19/datafusion:vortex-file-compressed 803850311 764577667 1.05
tpch_q20/datafusion:vortex-file-compressed 1012810147 964900232 1.05
tpch_q21/datafusion:vortex-file-compressed 1610024919 1631193026 0.99
tpch_q22/datafusion:vortex-file-compressed 404684582 342866527 1.18
datafusion / vortex-compact (1.043x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 676796127 694208234 0.97
tpch_q02/datafusion:vortex-compact 594091460 696292101 0.85
tpch_q03/datafusion:vortex-compact 742445889 681864130 1.09
tpch_q04/datafusion:vortex-compact 608727185 553676518 1.10
tpch_q05/datafusion:vortex-compact 969562524 838779689 1.16
tpch_q06/datafusion:vortex-compact 637666626 591095542 1.08
tpch_q07/datafusion:vortex-compact 983936077 930265758 1.06
tpch_q08/datafusion:vortex-compact 1082336403 1240467419 0.87
tpch_q09/datafusion:vortex-compact 1163480986 1320344386 0.88
tpch_q10/datafusion:vortex-compact 894537506 1133265153 0.79
tpch_q11/datafusion:vortex-compact 407458461 372285157 1.09
tpch_q12/datafusion:vortex-compact 937653793 791198268 1.19
tpch_q13/datafusion:vortex-compact 421227194 399816272 1.05
tpch_q14/datafusion:vortex-compact 🚨 809585002 568611922 1.42
tpch_q15/datafusion:vortex-compact 1192908724 1044855105 1.14
tpch_q16/datafusion:vortex-compact 331772823 307268723 1.08
tpch_q17/datafusion:vortex-compact 1138791709 1133866358 1.00
tpch_q18/datafusion:vortex-compact 1060409152 1044686845 1.02
tpch_q19/datafusion:vortex-compact 773384904 752696965 1.03
tpch_q20/datafusion:vortex-compact 876160140 833531015 1.05
tpch_q21/datafusion:vortex-compact 1452936853 1359578684 1.07
tpch_q22/datafusion:vortex-compact 423094468 374852006 1.13
datafusion / parquet (1.066x ➖, 0↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 848569254 815965624 1.04
tpch_q02/datafusion:parquet 825490830 859137562 0.96
tpch_q03/datafusion:parquet 1164465112 941230730 1.24
tpch_q04/datafusion:parquet 559129396 501388934 1.12
tpch_q05/datafusion:parquet 1142267758 1104051898 1.03
tpch_q06/datafusion:parquet 560205750 496468695 1.13
tpch_q07/datafusion:parquet 1238430398 1197520800 1.03
tpch_q08/datafusion:parquet 1628936380 1493131560 1.09
tpch_q09/datafusion:parquet 1900069400 1607730297 1.18
tpch_q10/datafusion:parquet 2029759617 1909320014 1.06
tpch_q11/datafusion:parquet 🚨 769871250 551601904 1.40
tpch_q12/datafusion:parquet 650173659 721265120 0.90
tpch_q13/datafusion:parquet 767243610 696485333 1.10
tpch_q14/datafusion:parquet 812106343 759690504 1.07
tpch_q15/datafusion:parquet 1257529485 1277697396 0.98
tpch_q16/datafusion:parquet 394366215 469359767 0.84
tpch_q17/datafusion:parquet 1353881728 1365661977 0.99
tpch_q18/datafusion:parquet 1536528334 1604872969 0.96
tpch_q19/datafusion:parquet 927768983 938944339 0.99
tpch_q20/datafusion:parquet 1280260368 1257684053 1.02
tpch_q21/datafusion:parquet 2019088033 1769560059 1.14
tpch_q22/datafusion:parquet 🚨 976350214 735966382 1.33
duckdb / vortex-file-compressed (1.022x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 661585624 591077452 1.12
tpch_q02/duckdb:vortex-file-compressed 1330855501 1106991772 1.20
tpch_q03/duckdb:vortex-file-compressed 932822003 913233544 1.02
tpch_q04/duckdb:vortex-file-compressed 622229751 666747770 0.93
tpch_q05/duckdb:vortex-file-compressed 1086741037 1009804052 1.08
tpch_q06/duckdb:vortex-file-compressed 729981227 781222438 0.93
tpch_q07/duckdb:vortex-file-compressed 1207351244 1146771250 1.05
tpch_q08/duckdb:vortex-file-compressed 1470311767 1365231298 1.08
tpch_q09/duckdb:vortex-file-compressed 1430247512 1432978554 1.00
tpch_q10/duckdb:vortex-file-compressed 1132226756 1089932173 1.04
tpch_q11/duckdb:vortex-file-compressed 707877899 625925077 1.13
tpch_q12/duckdb:vortex-file-compressed 862109751 703052506 1.23
tpch_q13/duckdb:vortex-file-compressed 919067600 961910853 0.96
tpch_q14/duckdb:vortex-file-compressed 777444790 886565007 0.88
tpch_q15/duckdb:vortex-file-compressed 553309046 559186068 0.99
tpch_q16/duckdb:vortex-file-compressed 521508475 580170930 0.90
tpch_q17/duckdb:vortex-file-compressed 987178073 1012935072 0.97
tpch_q18/duckdb:vortex-file-compressed 952833136 899197887 1.06
tpch_q19/duckdb:vortex-file-compressed 712027363 744207398 0.96
tpch_q20/duckdb:vortex-file-compressed 1224539232 1180751298 1.04
tpch_q21/duckdb:vortex-file-compressed 1987014951 1935755713 1.03
tpch_q22/duckdb:vortex-file-compressed 674979285 688224235 0.98
duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 606451932 604034524 1.00
tpch_q02/duckdb:vortex-compact 1073968660 1037338376 1.04
tpch_q03/duckdb:vortex-compact 849970431 946004837 0.90
tpch_q04/duckdb:vortex-compact 521153453 496048628 1.05
tpch_q05/duckdb:vortex-compact 1006563387 1101628432 0.91
tpch_q06/duckdb:vortex-compact 694638557 734966084 0.95
tpch_q07/duckdb:vortex-compact 1084423132 1082740515 1.00
tpch_q08/duckdb:vortex-compact 1422084994 1345293336 1.06
tpch_q09/duckdb:vortex-compact 1391484827 1313731297 1.06
tpch_q10/duckdb:vortex-compact 1079616726 1022056938 1.06
tpch_q11/duckdb:vortex-compact 673438653 618644199 1.09
tpch_q12/duckdb:vortex-compact 653285569 688218213 0.95
tpch_q13/duckdb:vortex-compact 846454100 854820388 0.99
tpch_q14/duckdb:vortex-compact 928291101 898235385 1.03
tpch_q15/duckdb:vortex-compact 526951772 551543185 0.96
tpch_q16/duckdb:vortex-compact 437659004 481640095 0.91
tpch_q17/duckdb:vortex-compact 908309037 874038651 1.04
tpch_q18/duckdb:vortex-compact 777053599 749222662 1.04
tpch_q19/duckdb:vortex-compact 717704932 736728765 0.97
tpch_q20/duckdb:vortex-compact 1141492242 1179670699 0.97
tpch_q21/duckdb:vortex-compact 1706971251 1682104668 1.01
tpch_q22/duckdb:vortex-compact 622676089 583158269 1.07
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 786729150 848800815 0.93
tpch_q02/duckdb:parquet 1385353343 1322969656 1.05
tpch_q03/duckdb:parquet 1568939495 1608115379 0.98
tpch_q04/duckdb:parquet 1079696267 1055877653 1.02
tpch_q05/duckdb:parquet 1867828563 1936233335 0.96
tpch_q06/duckdb:parquet 772145500 832275267 0.93
tpch_q07/duckdb:parquet 1729609930 1735336457 1.00
tpch_q08/duckdb:parquet 2247948300 2211138081 1.02
tpch_q09/duckdb:parquet 2689495801 2428470406 1.11
tpch_q10/duckdb:parquet 3079800688 2976810158 1.03
tpch_q11/duckdb:parquet 905707461 974298110 0.93
tpch_q12/duckdb:parquet 1087766750 1056250484 1.03
tpch_q13/duckdb:parquet 1222347674 1165175415 1.05
tpch_q14/duckdb:parquet 1239865485 1253635389 0.99
tpch_q15/duckdb:parquet 887977866 811269678 1.09
tpch_q16/duckdb:parquet 856305953 842366685 1.02
tpch_q17/duckdb:parquet 1226054432 1191722935 1.03
tpch_q18/duckdb:parquet 1365061147 1289968785 1.06
tpch_q19/duckdb:parquet 1487133960 1412371226 1.05
tpch_q20/duckdb:parquet 1842179336 1898338963 0.97
tpch_q21/duckdb:parquet 1770603198 1655611410 1.07
tpch_q22/duckdb:parquet 1035809306 1000913873 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.5% -1.8% -0.7% +35.2% ➖ noise
1 datafusion:vortex-file-compressed +16.9% -1.8% +19.1% +40.5% ➖ noise
1 duckdb:vortex-compact +0.4% -1.8% +2.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +11.9% -1.8% +14.0% +30.0% ➖ noise
2 datafusion:vortex-compact -14.7% +0.3% -14.9% +48.8% ➖ noise
2 datafusion:vortex-file-compressed -9.3% +0.3% -9.6% +41.7% ➖ noise
2 duckdb:vortex-compact +3.5% +0.3% +3.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +20.2% +0.3% +19.9% +30.0% ➖ noise
3 datafusion:vortex-compact +8.9% +9.9% -0.9% +43.8% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +9.9% -8.3% +50.6% ➖ noise
3 duckdb:vortex-compact -10.2% +9.9% -18.2% +31.6% ➖ noise
3 duckdb:vortex-file-compressed +2.1% +9.9% -7.0% +34.0% ➖ noise
4 datafusion:vortex-compact +9.9% +6.8% +3.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.6% +6.8% -7.0% +30.0% ➖ noise
4 duckdb:vortex-compact +5.1% +6.8% -1.6% +33.4% ➖ noise
4 duckdb:vortex-file-compressed -6.7% +6.8% -12.6% +30.0% ➖ noise
5 datafusion:vortex-compact +15.6% -0.1% +15.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -9.7% -0.1% -9.6% +30.0% ➖ noise
5 duckdb:vortex-compact -8.6% -0.1% -8.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +7.6% -0.1% +7.7% +30.0% ➖ noise
6 datafusion:vortex-compact +7.9% +2.3% +5.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -11.6% +2.3% -13.6% +30.0% ➖ noise
6 duckdb:vortex-compact -5.5% +2.3% -7.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -6.6% +2.3% -8.7% +30.0% ➖ noise
7 datafusion:vortex-compact +5.8% +1.5% +4.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.1% +1.5% -8.5% +30.0% ➖ noise
7 duckdb:vortex-compact +0.2% +1.5% -1.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.3% +1.5% +3.7% +30.0% ➖ noise
8 datafusion:vortex-compact -12.7% +5.3% -17.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -3.3% +5.3% -8.2% +30.0% ➖ noise
8 duckdb:vortex-compact +5.7% +5.3% +0.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.7% +5.3% +2.3% +30.0% ➖ noise
9 datafusion:vortex-compact -11.9% +14.4% -23.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -1.0% +14.4% -13.5% +30.0% ➖ noise
9 duckdb:vortex-compact +5.9% +14.4% -7.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +14.4% -12.8% +30.0% ➖ noise
10 datafusion:vortex-compact -21.1% +4.9% -24.7% +30.0% ✅ faster
10 datafusion:vortex-file-compressed -20.0% +4.9% -23.7% +30.0% ✅ faster
10 duckdb:vortex-compact +5.6% +4.9% +0.7% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +3.9% +4.9% -0.9% +30.0% ➖ noise
11 datafusion:vortex-compact +9.4% +13.9% -3.9% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -8.8% +13.9% -19.9% +30.8% ➖ noise
11 duckdb:vortex-compact +8.9% +13.9% -4.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +13.1% +13.9% -0.7% +30.0% ➖ noise
12 datafusion:vortex-compact +18.5% -3.7% +23.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +27.2% -3.7% +32.0% +30.0% 🚨 regression
12 duckdb:vortex-compact -5.1% -3.7% -1.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +22.6% -3.7% +27.3% +30.0% ➖ noise
13 datafusion:vortex-compact +5.4% +7.5% -2.0% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +9.9% +7.5% +2.2% +30.0% ➖ noise
13 duckdb:vortex-compact -1.0% +7.5% -7.9% +36.6% ➖ noise
13 duckdb:vortex-file-compressed -4.5% +7.5% -11.1% +32.0% ➖ noise
14 datafusion:vortex-compact +42.4% +2.8% +38.5% +30.0% 🚨 regression
14 datafusion:vortex-file-compressed +29.2% +2.8% +25.6% +30.0% ➖ noise
14 duckdb:vortex-compact +3.3% +2.8% +0.5% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -12.3% +2.8% -14.7% +30.0% ➖ noise
15 datafusion:vortex-compact +14.2% +3.8% +10.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -4.7% +3.8% -8.2% +30.0% ➖ noise
15 duckdb:vortex-compact -4.5% +3.8% -7.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -1.1% +3.8% -4.7% +30.0% ➖ noise
16 datafusion:vortex-compact +8.0% -7.6% +16.8% +33.4% ➖ noise
16 datafusion:vortex-file-compressed -18.4% -7.6% -11.7% +30.0% ➖ noise
16 duckdb:vortex-compact -9.1% -7.6% -1.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -10.1% -7.6% -2.7% +30.0% ➖ noise
17 datafusion:vortex-compact +0.4% +1.0% -0.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -2.3% +1.0% -3.3% +30.0% ➖ noise
17 duckdb:vortex-compact +3.9% +1.0% +2.9% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.5% +1.0% -3.5% +30.0% ➖ noise
18 datafusion:vortex-compact +1.5% +0.7% +0.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -3.0% +0.7% -3.7% +30.0% ➖ noise
18 duckdb:vortex-compact +3.7% +0.7% +3.0% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +6.0% +0.7% +5.3% +30.0% ➖ noise
19 datafusion:vortex-compact +2.7% +2.0% +0.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +5.1% +2.0% +3.1% +30.0% ➖ noise
19 duckdb:vortex-compact -2.6% +2.0% -4.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -4.3% +2.0% -6.2% +30.0% ➖ noise
20 datafusion:vortex-compact +5.1% -0.6% +5.8% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +5.0% -0.6% +5.6% +30.0% ➖ noise
20 duckdb:vortex-compact -3.2% -0.6% -2.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +3.7% -0.6% +4.3% +30.0% ➖ noise
21 datafusion:vortex-compact +6.9% +10.5% -3.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -1.3% +10.5% -10.6% +30.0% ➖ noise
21 duckdb:vortex-compact +1.5% +10.5% -8.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +2.6% +10.5% -7.1% +30.0% ➖ noise
22 datafusion:vortex-compact +12.9% +17.2% -3.7% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +18.0% +17.2% +0.7% +30.0% ➖ noise
22 duckdb:vortex-compact +6.8% +17.2% -8.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -1.9% +17.2% -16.3% +40.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.984x ➖
Shifts: Parquet (control) -1.6% · Median polish +0.0%


datafusion / vortex-file-compressed (1.009x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1651355 1645970 1.00
clickbench_q01/datafusion:vortex-file-compressed 18089756 18334027 0.99
clickbench_q02/datafusion:vortex-file-compressed 37537871 36107921 1.04
clickbench_q03/datafusion:vortex-file-compressed 41213865 42559573 0.97
clickbench_q04/datafusion:vortex-file-compressed 281187986 284473109 0.99
clickbench_q05/datafusion:vortex-file-compressed 297558117 307593223 0.97
clickbench_q06/datafusion:vortex-file-compressed 1655016 1651261 1.00
clickbench_q07/datafusion:vortex-file-compressed 22239479 21914836 1.01
clickbench_q08/datafusion:vortex-file-compressed 349049413 353397915 0.99
clickbench_q09/datafusion:vortex-file-compressed 531998728 542775438 0.98
clickbench_q10/datafusion:vortex-file-compressed 72540679 71475671 1.01
clickbench_q11/datafusion:vortex-file-compressed 83994322 84590504 0.99
clickbench_q12/datafusion:vortex-file-compressed 265385259 263697851 1.01
clickbench_q13/datafusion:vortex-file-compressed 407451166 405576873 1.00
clickbench_q14/datafusion:vortex-file-compressed 251742475 256993643 0.98
clickbench_q15/datafusion:vortex-file-compressed 326531659 319663034 1.02
clickbench_q16/datafusion:vortex-file-compressed 652715678 633611501 1.03
clickbench_q17/datafusion:vortex-file-compressed 645439549 630350831 1.02
clickbench_q18/datafusion:vortex-file-compressed 1312360896 1253547132 1.05
clickbench_q19/datafusion:vortex-file-compressed 🚨 34200139 30201978 1.13
clickbench_q20/datafusion:vortex-file-compressed 342607769 342010784 1.00
clickbench_q21/datafusion:vortex-file-compressed 397012377 367847480 1.08
clickbench_q22/datafusion:vortex-file-compressed 475152983 439840992 1.08
clickbench_q23/datafusion:vortex-file-compressed 698896194 652179540 1.07
clickbench_q24/datafusion:vortex-file-compressed 45581028 46497949 0.98
clickbench_q25/datafusion:vortex-file-compressed 74334035 70842621 1.05
clickbench_q26/datafusion:vortex-file-compressed 45889064 44991714 1.02
clickbench_q27/datafusion:vortex-file-compressed 708025860 703356747 1.01
clickbench_q28/datafusion:vortex-file-compressed 6590296304 6566653168 1.00
clickbench_q29/datafusion:vortex-file-compressed 232303552 234479463 0.99
clickbench_q30/datafusion:vortex-file-compressed 217920757 215586990 1.01
clickbench_q31/datafusion:vortex-file-compressed 251171725 260217538 0.97
clickbench_q32/datafusion:vortex-file-compressed 1090176168 1101857719 0.99
clickbench_q33/datafusion:vortex-file-compressed 1288056457 1289731908 1.00
clickbench_q34/datafusion:vortex-file-compressed 1262946958 1274113452 0.99
clickbench_q35/datafusion:vortex-file-compressed 447352045 456548662 0.98
clickbench_q36/datafusion:vortex-file-compressed 69329630 72631748 0.95
clickbench_q37/datafusion:vortex-file-compressed 35225540 35045672 1.01
clickbench_q38/datafusion:vortex-file-compressed 18729323 18875551 0.99
clickbench_q39/datafusion:vortex-file-compressed 131123513 133776628 0.98
clickbench_q40/datafusion:vortex-file-compressed 16575408 15972598 1.04
clickbench_q41/datafusion:vortex-file-compressed 15234994 14847036 1.03
clickbench_q42/datafusion:vortex-file-compressed 16937833 16612122 1.02
datafusion / parquet (0.964x ➖, 7↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1520272 1894311 0.80
clickbench_q01/datafusion:parquet 19111074 19809793 0.96
clickbench_q02/datafusion:parquet 46247288 48272124 0.96
clickbench_q03/datafusion:parquet 🚀 37103931 42971566 0.86
clickbench_q04/datafusion:parquet 🚀 288042300 344779265 0.84
clickbench_q05/datafusion:parquet 🚀 345427906 401633381 0.86
clickbench_q06/datafusion:parquet 1575320 1746763 0.90
clickbench_q07/datafusion:parquet 22618670 22796202 0.99
clickbench_q08/datafusion:parquet 🚀 365013862 440776759 0.83
clickbench_q09/datafusion:parquet 🚀 605469346 725808969 0.83
clickbench_q10/datafusion:parquet 104516176 115803953 0.90
clickbench_q11/datafusion:parquet 🚀 129192325 162246316 0.80
clickbench_q12/datafusion:parquet 335658682 361984339 0.93
clickbench_q13/datafusion:parquet 491738945 507176842 0.97
clickbench_q14/datafusion:parquet 339785691 340184087 1.00
clickbench_q15/datafusion:parquet 334276894 343134971 0.97
clickbench_q16/datafusion:parquet 654066651 701363451 0.93
clickbench_q17/datafusion:parquet 649701453 694085843 0.94
clickbench_q18/datafusion:parquet 1304541366 1349605254 0.97
clickbench_q19/datafusion:parquet 28413224 28901712 0.98
clickbench_q20/datafusion:parquet 633084967 599800582 1.06
clickbench_q21/datafusion:parquet 691570728 646069756 1.07
clickbench_q22/datafusion:parquet 🚨 1049752298 951063147 1.10
clickbench_q23/datafusion:parquet 3600417623 3568782909 1.01
clickbench_q24/datafusion:parquet 79727396 81942300 0.97
clickbench_q25/datafusion:parquet 132071457 132958704 0.99
clickbench_q26/datafusion:parquet 81366932 83085331 0.98
clickbench_q27/datafusion:parquet 1040655692 1013687818 1.03
clickbench_q28/datafusion:parquet 6532902751 6472192422 1.01
clickbench_q29/datafusion:parquet 234455514 231622645 1.01
clickbench_q30/datafusion:parquet 321650734 315645325 1.02
clickbench_q31/datafusion:parquet 364773709 359441768 1.01
clickbench_q32/datafusion:parquet 1205778479 1135861285 1.06
clickbench_q33/datafusion:parquet 1440859309 1451446470 0.99
clickbench_q34/datafusion:parquet 1462502611 1460636278 1.00
clickbench_q35/datafusion:parquet 454444214 452661692 1.00
clickbench_q36/datafusion:parquet 139773846 139793982 1.00
clickbench_q37/datafusion:parquet 56330170 56344167 1.00
clickbench_q38/datafusion:parquet 83468141 81566651 1.02
clickbench_q39/datafusion:parquet 253581717 254044729 1.00
clickbench_q40/datafusion:parquet 29890929 30276088 0.99
clickbench_q41/datafusion:parquet 26925655 26827524 1.00
clickbench_q42/datafusion:parquet 30304431 29659824 1.02
duckdb / vortex-file-compressed (0.999x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5775856 6121114 0.94
clickbench_q01/duckdb:vortex-file-compressed 13206904 12593126 1.05
clickbench_q02/duckdb:vortex-file-compressed 24770186 24787504 1.00
clickbench_q03/duckdb:vortex-file-compressed 29374854 29570484 0.99
clickbench_q04/duckdb:vortex-file-compressed 181518935 182905063 0.99
clickbench_q05/duckdb:vortex-file-compressed 168194822 172873653 0.97
clickbench_q06/duckdb:vortex-file-compressed 19697873 20068235 0.98
clickbench_q07/duckdb:vortex-file-compressed 14066394 14159480 0.99
clickbench_q08/duckdb:vortex-file-compressed 258660548 262490891 0.99
clickbench_q09/duckdb:vortex-file-compressed 328780512 326348760 1.01
clickbench_q10/duckdb:vortex-file-compressed 64123816 66115136 0.97
clickbench_q11/duckdb:vortex-file-compressed 75202616 74693236 1.01
clickbench_q12/duckdb:vortex-file-compressed 189127630 194540430 0.97
clickbench_q13/duckdb:vortex-file-compressed 403218539 400515318 1.01
clickbench_q14/duckdb:vortex-file-compressed 230807665 228367900 1.01
clickbench_q15/duckdb:vortex-file-compressed 244616460 241684792 1.01
clickbench_q16/duckdb:vortex-file-compressed 574243669 574171668 1.00
clickbench_q17/duckdb:vortex-file-compressed 473565647 471991567 1.00
clickbench_q18/duckdb:vortex-file-compressed 1030994282 959277351 1.07
clickbench_q19/duckdb:vortex-file-compressed 22223973 20952017 1.06
clickbench_q20/duckdb:vortex-file-compressed 343286067 328548652 1.04
clickbench_q21/duckdb:vortex-file-compressed 386127483 355646483 1.09
clickbench_q22/duckdb:vortex-file-compressed 491347607 498656132 0.99
clickbench_q23/duckdb:vortex-file-compressed 🚀 303604505 373482503 0.81
clickbench_q24/duckdb:vortex-file-compressed 33073593 32753087 1.01
clickbench_q25/duckdb:vortex-file-compressed 71717463 72250145 0.99
clickbench_q26/duckdb:vortex-file-compressed 41256467 40904512 1.01
clickbench_q27/duckdb:vortex-file-compressed 485172076 460145528 1.05
clickbench_q28/duckdb:vortex-file-compressed 2969979891 2966272920 1.00
clickbench_q29/duckdb:vortex-file-compressed 27492116 27676755 0.99
clickbench_q30/duckdb:vortex-file-compressed 186429591 189195026 0.99
clickbench_q31/duckdb:vortex-file-compressed 278916558 273437092 1.02
clickbench_q32/duckdb:vortex-file-compressed 1167289021 1140069341 1.02
clickbench_q33/duckdb:vortex-file-compressed 1154100119 1197562267 0.96
clickbench_q34/duckdb:vortex-file-compressed 1179296470 1231309294 0.96
clickbench_q35/duckdb:vortex-file-compressed 378860171 379279435 1.00
clickbench_q36/duckdb:vortex-file-compressed 26041566 26322769 0.99
clickbench_q37/duckdb:vortex-file-compressed 19248008 18361468 1.05
clickbench_q38/duckdb:vortex-file-compressed 20891894 19750021 1.06
clickbench_q39/duckdb:vortex-file-compressed 37630728 40469052 0.93
clickbench_q40/duckdb:vortex-file-compressed 18344182 18094382 1.01
clickbench_q41/duckdb:vortex-file-compressed 18078697 18085569 1.00
clickbench_q42/duckdb:vortex-file-compressed 19753396 20166503 0.98
duckdb / parquet (1.005x ➖, 1↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24971503 26327639 0.95
clickbench_q01/duckdb:parquet 27366106 26837879 1.02
clickbench_q02/duckdb:parquet 48485335 48273104 1.00
clickbench_q03/duckdb:parquet 37660362 39127264 0.96
clickbench_q04/duckdb:parquet 200393461 203689563 0.98
clickbench_q05/duckdb:parquet 265558144 269230199 0.99
clickbench_q06/duckdb:parquet 46961101 47419727 0.99
clickbench_q07/duckdb:parquet 29961876 29445507 1.02
clickbench_q08/duckdb:parquet 263935919 262580013 1.01
clickbench_q09/duckdb:parquet 393832418 396141729 0.99
clickbench_q10/duckdb:parquet 80898913 80623203 1.00
clickbench_q11/duckdb:parquet 98745388 98382272 1.00
clickbench_q12/duckdb:parquet 286176152 287391613 1.00
clickbench_q13/duckdb:parquet 481474789 488075068 0.99
clickbench_q14/duckdb:parquet 331590378 320784763 1.03
clickbench_q15/duckdb:parquet 261653671 265694771 0.98
clickbench_q16/duckdb:parquet 636851901 657978663 0.97
clickbench_q17/duckdb:parquet 537664069 529363510 1.02
clickbench_q18/duckdb:parquet 1118954197 1086455991 1.03
clickbench_q19/duckdb:parquet 26035609 25648240 1.02
clickbench_q20/duckdb:parquet 439701588 422998016 1.04
clickbench_q21/duckdb:parquet 565314425 553857170 1.02
clickbench_q22/duckdb:parquet 925905882 931649279 0.99
clickbench_q23/duckdb:parquet 318617842 305287102 1.04
clickbench_q24/duckdb:parquet 70972400 70119664 1.01
clickbench_q25/duckdb:parquet 156774194 156789314 1.00
clickbench_q26/duckdb:parquet 50122015 47883263 1.05
clickbench_q27/duckdb:parquet 643229144 646310086 1.00
clickbench_q28/duckdb:parquet 4813851838 4821566402 1.00
clickbench_q29/duckdb:parquet 40180260 40769567 0.99
clickbench_q30/duckdb:parquet 299865768 297356679 1.01
clickbench_q31/duckdb:parquet 358128898 365692248 0.98
clickbench_q32/duckdb:parquet 1159299095 1126249384 1.03
clickbench_q33/duckdb:parquet 1214454251 1207269873 1.01
clickbench_q34/duckdb:parquet 1257706368 1272829279 0.99
clickbench_q35/duckdb:parquet 361874746 363745959 0.99
clickbench_q36/duckdb:parquet 🚀 44648000 49736673 0.90
clickbench_q37/duckdb:parquet 31042322 31067647 1.00
clickbench_q38/duckdb:parquet 34482851 36577221 0.94
clickbench_q39/duckdb:parquet 🚨 88029224 79268141 1.11
clickbench_q40/duckdb:parquet 🚨 19109325 17178017 1.11
clickbench_q41/duckdb:parquet 17664682 16685697 1.06
clickbench_q42/duckdb:parquet 21530881 21167297 1.02
duckdb / duckdb (1.012x ➖, 1↑ 3↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17400350 18371746 0.95
clickbench_q01/duckdb:duckdb 31558933 32712334 0.96
clickbench_q02/duckdb:duckdb 44296296 44699129 0.99
clickbench_q03/duckdb:duckdb 47082445 45931403 1.03
clickbench_q04/duckdb:duckdb 187889845 189883386 0.99
clickbench_q05/duckdb:duckdb 265701080 268827040 0.99
clickbench_q06/duckdb:duckdb 🚀 28646702 34120241 0.84
clickbench_q07/duckdb:duckdb 34779426 34867568 1.00
clickbench_q08/duckdb:duckdb 247879172 248601384 1.00
clickbench_q09/duckdb:duckdb 373747983 370194504 1.01
clickbench_q10/duckdb:duckdb 100860663 98496432 1.02
clickbench_q11/duckdb:duckdb 111858295 108401329 1.03
clickbench_q12/duckdb:duckdb 249069233 235681364 1.06
clickbench_q13/duckdb:duckdb 495787432 454410646 1.09
clickbench_q14/duckdb:duckdb 288389012 275772343 1.05
clickbench_q15/duckdb:duckdb 216590387 219866147 0.99
clickbench_q16/duckdb:duckdb 643660764 612578292 1.05
clickbench_q17/duckdb:duckdb 533351254 524985862 1.02
clickbench_q18/duckdb:duckdb 1166321461 1177182259 0.99
clickbench_q19/duckdb:duckdb 33659241 34503266 0.98
clickbench_q20/duckdb:duckdb 🚨 1012642335 857010952 1.18
clickbench_q21/duckdb:duckdb 🚨 1149418531 869590720 1.32
clickbench_q22/duckdb:duckdb 1084698801 991309502 1.09
clickbench_q23/duckdb:duckdb 253521313 254992098 0.99
clickbench_q24/duckdb:duckdb 59465082 61843950 0.96
clickbench_q25/duckdb:duckdb 141395821 142217474 0.99
clickbench_q26/duckdb:duckdb 57126219 60170612 0.95
clickbench_q27/duckdb:duckdb 🚨 1137798279 920444544 1.24
clickbench_q28/duckdb:duckdb 4587197527 4611486804 0.99
clickbench_q29/duckdb:duckdb 47600064 48290777 0.99
clickbench_q30/duckdb:duckdb 262165659 258893433 1.01
clickbench_q31/duckdb:duckdb 442840197 414576312 1.07
clickbench_q32/duckdb:duckdb 1413532111 1532622664 0.92
clickbench_q33/duckdb:duckdb 1963930813 2010262445 0.98
clickbench_q34/duckdb:duckdb 2078282058 2103964898 0.99
clickbench_q35/duckdb:duckdb 286537652 280477237 1.02
clickbench_q36/duckdb:duckdb 41517597 41704909 1.00
clickbench_q37/duckdb:duckdb 31043515 30657369 1.01
clickbench_q38/duckdb:duckdb 30500173 32393438 0.94
clickbench_q39/duckdb:duckdb 64626520 67497955 0.96
clickbench_q40/duckdb:duckdb 31305050 31213091 1.00
clickbench_q41/duckdb:duckdb 30325625 30228210 1.00
clickbench_q42/duckdb:duckdb 31754163 31046347 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.3% -12.8% +15.0% +769.8% ➖ noise
0 duckdb:duckdb -5.3% -12.8% +8.6% +282.2% ➖ noise
0 duckdb:vortex-file-compressed -5.6% -12.8% +8.2% +470.5% ➖ noise
1 datafusion:vortex-file-compressed -1.3% -0.8% -0.5% +24.9% ➖ noise
1 duckdb:duckdb -3.5% -0.8% -2.7% +61.2% ➖ noise
1 duckdb:vortex-file-compressed +4.9% -0.8% +5.7% +31.3% ➖ noise
2 datafusion:vortex-file-compressed +4.0% -1.9% +6.0% +20.5% ➖ noise
2 duckdb:duckdb -0.9% -1.9% +1.0% +21.2% ➖ noise
2 duckdb:vortex-file-compressed -0.1% -1.9% +1.9% +13.0% ➖ noise
3 datafusion:vortex-file-compressed -3.2% -8.8% +6.2% +142.8% ➖ noise
3 duckdb:duckdb +2.5% -8.8% +12.4% +43.8% ➖ noise
3 duckdb:vortex-file-compressed -0.7% -8.8% +9.0% +60.6% ➖ noise
4 datafusion:vortex-file-compressed -1.2% -9.3% +9.0% +12.9% ➖ noise
4 duckdb:duckdb -1.0% -9.3% +9.1% +12.9% ➖ noise
4 duckdb:vortex-file-compressed -0.8% -9.3% +9.5% +12.9% ➖ noise
5 datafusion:vortex-file-compressed -3.3% -7.9% +5.0% +12.9% ➖ noise
5 duckdb:duckdb -1.2% -7.9% +7.3% +12.9% ➖ noise
5 duckdb:vortex-file-compressed -2.7% -7.9% +5.6% +12.9% ➖ noise
6 datafusion:vortex-file-compressed +0.2% -5.5% +6.1% +39.1% ➖ noise
6 duckdb:duckdb -16.0% -5.5% -11.2% +28.8% ➖ noise
6 duckdb:vortex-file-compressed -1.8% -5.5% +3.9% +19.6% ➖ noise
7 datafusion:vortex-file-compressed +1.5% +0.5% +1.0% +19.2% ➖ noise
7 duckdb:duckdb -0.3% +0.5% -0.7% +19.4% ➖ noise
7 duckdb:vortex-file-compressed -0.7% +0.5% -1.1% +20.0% ➖ noise
8 datafusion:vortex-file-compressed -1.2% -8.8% +8.3% +12.9% ➖ noise
8 duckdb:duckdb -0.3% -8.8% +9.3% +12.9% ➖ noise
8 duckdb:vortex-file-compressed -1.5% -8.8% +8.0% +12.9% ➖ noise
9 datafusion:vortex-file-compressed -2.0% -8.9% +7.6% +12.9% ➖ noise
9 duckdb:duckdb +1.0% -8.9% +10.9% +12.9% ➖ noise
9 duckdb:vortex-file-compressed +0.7% -8.9% +10.6% +12.9% ➖ noise
10 datafusion:vortex-file-compressed +1.5% -4.8% +6.6% +14.0% ➖ noise
10 duckdb:duckdb +2.4% -4.8% +7.6% +12.9% ➖ noise
10 duckdb:vortex-file-compressed -3.0% -4.8% +1.9% +13.8% ➖ noise
11 datafusion:vortex-file-compressed -0.7% -10.6% +11.1% +12.9% ➖ noise
11 duckdb:duckdb +3.2% -10.6% +15.4% +12.9% 🚨 regression
11 duckdb:vortex-file-compressed +0.7% -10.6% +12.6% +12.9% ➖ noise
12 datafusion:vortex-file-compressed +0.6% -3.9% +4.7% +12.9% ➖ noise
12 duckdb:duckdb +5.7% -3.9% +10.0% +12.9% ➖ noise
12 duckdb:vortex-file-compressed -2.8% -3.9% +1.2% +12.9% ➖ noise
13 datafusion:vortex-file-compressed +0.5% -2.2% +2.7% +12.9% ➖ noise
13 duckdb:duckdb +9.1% -2.2% +11.6% +12.9% ➖ noise
13 duckdb:vortex-file-compressed +0.7% -2.2% +2.9% +12.9% ➖ noise
14 datafusion:vortex-file-compressed -2.0% +1.6% -3.6% +12.9% ➖ noise
14 duckdb:duckdb +4.6% +1.6% +2.9% +12.9% ➖ noise
14 duckdb:vortex-file-compressed +1.1% +1.6% -0.5% +12.9% ➖ noise
15 datafusion:vortex-file-compressed +2.1% -2.1% +4.3% +12.9% ➖ noise
15 duckdb:duckdb -1.5% -2.1% +0.6% +12.9% ➖ noise
15 duckdb:vortex-file-compressed +1.2% -2.1% +3.3% +12.9% ➖ noise
16 datafusion:vortex-file-compressed +3.0% -5.0% +8.4% +12.9% ➖ noise
16 duckdb:duckdb +5.1% -5.0% +10.6% +12.9% ➖ noise
16 duckdb:vortex-file-compressed +0.0% -5.0% +5.3% +12.9% ➖ noise
17 datafusion:vortex-file-compressed +2.4% -2.5% +5.0% +12.9% ➖ noise
17 duckdb:duckdb +1.6% -2.5% +4.2% +12.9% ➖ noise
17 duckdb:vortex-file-compressed +0.3% -2.5% +2.9% +12.9% ➖ noise
18 datafusion:vortex-file-compressed +4.7% -0.2% +4.9% +12.9% ➖ noise
18 duckdb:duckdb -0.9% -0.2% -0.7% +12.9% ➖ noise
18 duckdb:vortex-file-compressed +7.5% -0.2% +7.7% +12.9% ➖ noise
19 datafusion:vortex-file-compressed +13.2% -0.1% +13.4% +19.9% ➖ noise
19 duckdb:duckdb -2.4% -0.1% -2.3% +14.2% ➖ noise
19 duckdb:vortex-file-compressed +6.1% -0.1% +6.2% +16.5% ➖ noise
20 datafusion:vortex-file-compressed +0.2% +4.7% -4.4% +206.8% ➖ noise
20 duckdb:duckdb +18.2% +4.7% +12.8% +29.6% ➖ noise
20 duckdb:vortex-file-compressed +4.5% +4.7% -0.2% +60.4% ➖ noise
21 datafusion:vortex-file-compressed +7.9% +4.5% +3.3% +12.9% ➖ noise
21 duckdb:duckdb +32.2% +4.5% +26.5% +12.9% 🚨 regression
21 duckdb:vortex-file-compressed +8.6% +4.5% +3.9% +12.9% ➖ noise
22 datafusion:vortex-file-compressed +8.0% +4.7% +3.1% +13.4% ➖ noise
22 duckdb:duckdb +9.4% +4.7% +4.5% +12.9% ➖ noise
22 duckdb:vortex-file-compressed -1.5% +4.7% -5.9% +18.2% ➖ noise
23 datafusion:vortex-file-compressed +7.2% +2.6% +4.4% +47.1% ➖ noise
23 duckdb:duckdb -0.6% +2.6% -3.1% +12.9% ➖ noise
23 duckdb:vortex-file-compressed -18.7% +2.6% -20.8% +12.9% ✅ faster
24 datafusion:vortex-file-compressed -2.0% -0.8% -1.2% +12.9% ➖ noise
24 duckdb:duckdb -3.8% -0.8% -3.1% +12.9% ➖ noise
24 duckdb:vortex-file-compressed +1.0% -0.8% +1.8% +17.1% ➖ noise
25 datafusion:vortex-file-compressed +4.9% -0.3% +5.3% +12.9% ➖ noise
25 duckdb:duckdb -0.6% -0.3% -0.2% +12.9% ➖ noise
25 duckdb:vortex-file-compressed -0.7% -0.3% -0.4% +12.9% ➖ noise
26 datafusion:vortex-file-compressed +2.0% +1.2% +0.7% +12.9% ➖ noise
26 duckdb:duckdb -5.1% +1.2% -6.2% +12.9% ➖ noise
26 duckdb:vortex-file-compressed +0.9% +1.2% -0.4% +22.2% ➖ noise
27 datafusion:vortex-file-compressed +0.7% +1.1% -0.4% +12.9% ➖ noise
27 duckdb:duckdb +23.6% +1.1% +22.3% +12.9% 🚨 regression
27 duckdb:vortex-file-compressed +5.4% +1.1% +4.3% +12.9% ➖ noise
28 datafusion:vortex-file-compressed +0.4% +0.4% -0.0% +12.9% ➖ noise
28 duckdb:duckdb -0.5% +0.4% -0.9% +12.9% ➖ noise
28 duckdb:vortex-file-compressed +0.1% +0.4% -0.3% +12.9% ➖ noise
29 datafusion:vortex-file-compressed -0.9% -0.1% -0.8% +12.9% ➖ noise
29 duckdb:duckdb -1.4% -0.1% -1.3% +12.9% ➖ noise
29 duckdb:vortex-file-compressed -0.7% -0.1% -0.5% +17.1% ➖ noise
30 datafusion:vortex-file-compressed +1.1% +1.4% -0.3% +12.9% ➖ noise
30 duckdb:duckdb +1.3% +1.4% -0.1% +12.9% ➖ noise
30 duckdb:vortex-file-compressed -1.5% +1.4% -2.8% +12.9% ➖ noise
31 datafusion:vortex-file-compressed -3.5% -0.3% -3.2% +12.9% ➖ noise
31 duckdb:duckdb +6.8% -0.3% +7.1% +12.9% ➖ noise
31 duckdb:vortex-file-compressed +2.0% -0.3% +2.3% +12.9% ➖ noise
32 datafusion:vortex-file-compressed -1.1% +4.5% -5.4% +12.9% ➖ noise
32 duckdb:duckdb -7.8% +4.5% -11.8% +12.9% ✅ faster
32 duckdb:vortex-file-compressed +2.4% +4.5% -2.1% +12.9% ➖ noise
33 datafusion:vortex-file-compressed -0.1% -0.1% -0.1% +12.9% ➖ noise
33 duckdb:duckdb -2.3% -0.1% -2.2% +12.9% ➖ noise
33 duckdb:vortex-file-compressed -3.6% -0.1% -3.6% +12.9% ➖ noise
34 datafusion:vortex-file-compressed -0.9% -0.5% -0.3% +12.9% ➖ noise
34 duckdb:duckdb -1.2% -0.5% -0.7% +12.9% ➖ noise
34 duckdb:vortex-file-compressed -4.2% -0.5% -3.7% +12.9% ➖ noise
35 datafusion:vortex-file-compressed -2.0% -0.1% -2.0% +12.9% ➖ noise
35 duckdb:duckdb +2.2% -0.1% +2.2% +12.9% ➖ noise
35 duckdb:vortex-file-compressed -0.1% -0.1% -0.0% +12.9% ➖ noise
36 datafusion:vortex-file-compressed -4.5% -5.3% +0.8% +12.9% ➖ noise
36 duckdb:duckdb -0.4% -5.3% +5.1% +12.9% ➖ noise
36 duckdb:vortex-file-compressed -1.1% -5.3% +4.4% +12.9% ➖ noise
37 datafusion:vortex-file-compressed +0.5% -0.1% +0.6% +12.9% ➖ noise
37 duckdb:duckdb +1.3% -0.1% +1.3% +12.9% ➖ noise
37 duckdb:vortex-file-compressed +4.8% -0.1% +4.9% +12.9% ➖ noise
38 datafusion:vortex-file-compressed -0.8% -1.8% +1.0% +12.9% ➖ noise
38 duckdb:duckdb -5.8% -1.8% -4.1% +12.9% ➖ noise
38 duckdb:vortex-file-compressed +5.8% -1.8% +7.7% +12.9% ➖ noise
39 datafusion:vortex-file-compressed -2.0% +5.3% -6.9% +12.9% ➖ noise
39 duckdb:duckdb -4.3% +5.3% -9.1% +12.9% ➖ noise
39 duckdb:vortex-file-compressed -7.0% +5.3% -11.7% +12.9% ✅ faster
40 datafusion:vortex-file-compressed +3.8% +4.8% -1.0% +12.9% ➖ noise
40 duckdb:duckdb +0.3% +4.8% -4.3% +12.9% ➖ noise
40 duckdb:vortex-file-compressed +1.4% +4.8% -3.3% +12.9% ➖ noise
41 datafusion:vortex-file-compressed +2.6% +3.1% -0.5% +12.9% ➖ noise
41 duckdb:duckdb +0.3% +3.1% -2.7% +12.9% ➖ noise
41 duckdb:vortex-file-compressed -0.0% +3.1% -3.0% +12.9% ➖ noise
42 datafusion:vortex-file-compressed +2.0% +1.9% +0.0% +12.9% ➖ noise
42 duckdb:duckdb +2.3% +1.9% +0.3% +12.9% ➖ noise
42 duckdb:vortex-file-compressed -2.0% +1.9% -3.9% +12.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.8%
Vortex (geomean): 1.080x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish +5.6%


datafusion / vortex-file-compressed (1.121x ➖, 0↑ 3↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 255073135 270754936 0.94
tpch_q02/datafusion:vortex-file-compressed 🚨 926013061 538184268 1.72
tpch_q03/datafusion:vortex-file-compressed 424134614 434663354 0.98
tpch_q04/datafusion:vortex-file-compressed 246981705 317742624 0.78
tpch_q05/datafusion:vortex-file-compressed 463852364 483388630 0.96
tpch_q06/datafusion:vortex-file-compressed 371783742 320947814 1.16
tpch_q07/datafusion:vortex-file-compressed 493553249 386495902 1.28
tpch_q08/datafusion:vortex-file-compressed 743705701 646026329 1.15
tpch_q09/datafusion:vortex-file-compressed 🚨 708443550 446079495 1.59
tpch_q10/datafusion:vortex-file-compressed 655639316 517916753 1.27
tpch_q11/datafusion:vortex-file-compressed 🚨 1020554889 331063263 3.08
tpch_q12/datafusion:vortex-file-compressed 534201895 480540142 1.11
tpch_q13/datafusion:vortex-file-compressed 141421746 158194033 0.89
tpch_q14/datafusion:vortex-file-compressed 259797662 281154057 0.92
tpch_q15/datafusion:vortex-file-compressed 487800236 516425751 0.94
tpch_q16/datafusion:vortex-file-compressed 181886225 209864637 0.87
tpch_q17/datafusion:vortex-file-compressed 354386036 377936003 0.94
tpch_q18/datafusion:vortex-file-compressed 322976259 318131035 1.02
tpch_q19/datafusion:vortex-file-compressed 421095149 458683009 0.92
tpch_q20/datafusion:vortex-file-compressed 511749922 447606249 1.14
tpch_q21/datafusion:vortex-file-compressed 678400270 541935027 1.25
tpch_q22/datafusion:vortex-file-compressed 135010902 127590327 1.06
datafusion / vortex-compact (1.091x ➖, 0↑ 2↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 289564175 266531588 1.09
tpch_q02/datafusion:vortex-compact 445695572 497930065 0.90
tpch_q03/datafusion:vortex-compact 369488231 382373277 0.97
tpch_q04/datafusion:vortex-compact 226771214 222226699 1.02
tpch_q05/datafusion:vortex-compact 438210803 533646330 0.82
tpch_q06/datafusion:vortex-compact 377405703 331603848 1.14
tpch_q07/datafusion:vortex-compact 495099424 408576523 1.21
tpch_q08/datafusion:vortex-compact 640603446 556228314 1.15
tpch_q09/datafusion:vortex-compact 529056576 476662958 1.11
tpch_q10/datafusion:vortex-compact 🚨 626586573 429695386 1.46
tpch_q11/datafusion:vortex-compact 353746340 298641801 1.18
tpch_q12/datafusion:vortex-compact 484990896 531667094 0.91
tpch_q13/datafusion:vortex-compact 150417569 118287928 1.27
tpch_q14/datafusion:vortex-compact 283182576 288267206 0.98
tpch_q15/datafusion:vortex-compact 493921936 471560074 1.05
tpch_q16/datafusion:vortex-compact 218604572 206739631 1.06
tpch_q17/datafusion:vortex-compact 401432619 358246784 1.12
tpch_q18/datafusion:vortex-compact 309767686 304657857 1.02
tpch_q19/datafusion:vortex-compact 529172995 492847920 1.07
tpch_q20/datafusion:vortex-compact 522860980 471269674 1.11
tpch_q21/datafusion:vortex-compact 640299139 540844869 1.18
tpch_q22/datafusion:vortex-compact 🚨 179728743 127630947 1.41
datafusion / parquet (0.935x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 206872613 231618784 0.89
tpch_q02/datafusion:parquet 409218774 486475522 0.84
tpch_q03/datafusion:parquet 316048609 331052237 0.95
tpch_q04/datafusion:parquet 170395883 238429665 0.71
tpch_q05/datafusion:parquet 426167120 493199138 0.86
tpch_q06/datafusion:parquet 🚀 133357078 195729722 0.68
tpch_q07/datafusion:parquet 456909591 555438257 0.82
tpch_q08/datafusion:parquet 538143914 627901966 0.86
tpch_q09/datafusion:parquet 467823848 518630809 0.90
tpch_q10/datafusion:parquet 509253830 542877383 0.94
tpch_q11/datafusion:parquet 333926143 315010441 1.06
tpch_q12/datafusion:parquet 240999316 240308630 1.00
tpch_q13/datafusion:parquet 448334754 423908031 1.06
tpch_q14/datafusion:parquet 191076938 183416013 1.04
tpch_q15/datafusion:parquet 327383727 319576822 1.02
tpch_q16/datafusion:parquet 200293680 200584398 1.00
tpch_q17/datafusion:parquet 421411669 394175906 1.07
tpch_q18/datafusion:parquet 500779723 459525852 1.09
tpch_q19/datafusion:parquet 298828925 333462152 0.90
tpch_q20/datafusion:parquet 298997125 296838310 1.01
tpch_q21/datafusion:parquet 513279448 519534929 0.99
tpch_q22/datafusion:parquet 105853867 105246005 1.01
duckdb / vortex-file-compressed (1.103x ➖, 0↑ 4↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 266372165 327696200 0.81
tpch_q02/duckdb:vortex-file-compressed 🚨 1542864876 982503061 1.57
tpch_q03/duckdb:vortex-file-compressed 657839270 693041050 0.95
tpch_q04/duckdb:vortex-file-compressed 364277298 387598986 0.94
tpch_q05/duckdb:vortex-file-compressed 968723455 1015640322 0.95
tpch_q06/duckdb:vortex-file-compressed 417234178 504178458 0.83
tpch_q07/duckdb:vortex-file-compressed 906442999 824601238 1.10
tpch_q08/duckdb:vortex-file-compressed 1084836896 1013083964 1.07
tpch_q09/duckdb:vortex-file-compressed 🚨 1369288642 870384340 1.57
tpch_q10/duckdb:vortex-file-compressed 825078175 711377152 1.16
tpch_q11/duckdb:vortex-file-compressed 🚨 855581055 508539863 1.68
tpch_q12/duckdb:vortex-file-compressed 468711614 479451445 0.98
tpch_q13/duckdb:vortex-file-compressed 512223992 451154477 1.14
tpch_q14/duckdb:vortex-file-compressed 452883352 471099637 0.96
tpch_q15/duckdb:vortex-file-compressed 269914038 294682854 0.92
tpch_q16/duckdb:vortex-file-compressed 🚨 705618728 382130904 1.85
tpch_q17/duckdb:vortex-file-compressed 721089612 653193023 1.10
tpch_q18/duckdb:vortex-file-compressed 627976660 600122443 1.05
tpch_q19/duckdb:vortex-file-compressed 475503821 444350681 1.07
tpch_q20/duckdb:vortex-file-compressed 869811308 795235533 1.09
tpch_q21/duckdb:vortex-file-compressed 1154429652 1090910301 1.06
tpch_q22/duckdb:vortex-file-compressed 362766914 355380964 1.02
duckdb / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 309310943 262469868 1.18
tpch_q02/duckdb:vortex-compact 917741631 949361502 0.97
tpch_q03/duckdb:vortex-compact 619411380 645388214 0.96
tpch_q04/duckdb:vortex-compact 341622496 411968801 0.83
tpch_q05/duckdb:vortex-compact 910444090 871593584 1.04
tpch_q06/duckdb:vortex-compact 360647833 499560761 0.72
tpch_q07/duckdb:vortex-compact 782913945 748877515 1.05
tpch_q08/duckdb:vortex-compact 947044165 885419102 1.07
tpch_q09/duckdb:vortex-compact 921112167 905539026 1.02
tpch_q10/duckdb:vortex-compact 755682260 715206514 1.06
tpch_q11/duckdb:vortex-compact 537413519 523749474 1.03
tpch_q12/duckdb:vortex-compact 482674643 468199200 1.03
tpch_q13/duckdb:vortex-compact 436466227 474120224 0.92
tpch_q14/duckdb:vortex-compact 544442429 479838669 1.13
tpch_q15/duckdb:vortex-compact 315519651 268047473 1.18
tpch_q16/duckdb:vortex-compact 390757484 368378943 1.06
tpch_q17/duckdb:vortex-compact 638623815 604498852 1.06
tpch_q18/duckdb:vortex-compact 487531461 485678907 1.00
tpch_q19/duckdb:vortex-compact 477646868 481149303 0.99
tpch_q20/duckdb:vortex-compact 793985408 824908365 0.96
tpch_q21/duckdb:vortex-compact 1053626204 1065282973 0.99
tpch_q22/duckdb:vortex-compact 381518302 353282306 1.08
duckdb / parquet (1.017x ➖, 0↑ 1↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 427527964 411249580 1.04
tpch_q02/duckdb:parquet 972105442 1091586443 0.89
tpch_q03/duckdb:parquet 966344065 975853299 0.99
tpch_q04/duckdb:parquet 591319803 633645508 0.93
tpch_q05/duckdb:parquet 1230192483 1277796415 0.96
tpch_q06/duckdb:parquet 🚨 611270574 450060023 1.36
tpch_q07/duckdb:parquet 1117636605 1269017510 0.88
tpch_q08/duckdb:parquet 1469688526 1497201819 0.98
tpch_q09/duckdb:parquet 1296677506 1253287597 1.03
tpch_q10/duckdb:parquet 1270311290 1236110813 1.03
tpch_q11/duckdb:parquet 729692077 714201857 1.02
tpch_q12/duckdb:parquet 720493592 717367883 1.00
tpch_q13/duckdb:parquet 905499807 876987257 1.03
tpch_q14/duckdb:parquet 690698453 687895223 1.00
tpch_q15/duckdb:parquet 535332953 471013741 1.14
tpch_q16/duckdb:parquet 657360289 625361873 1.05
tpch_q17/duckdb:parquet 803131862 785960974 1.02
tpch_q18/duckdb:parquet 864481515 909709813 0.95
tpch_q19/duckdb:parquet 807343573 765759602 1.05
tpch_q20/duckdb:parquet 1116784700 1100598318 1.01
tpch_q21/duckdb:parquet 1098498653 1018701125 1.08
tpch_q22/duckdb:parquet 571092356 571279660 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +8.6% -3.6% +12.7% +57.1% ➖ noise
1 datafusion:vortex-file-compressed -5.8% -3.6% -2.2% +67.8% ➖ noise
1 duckdb:vortex-compact +17.8% -3.6% +22.3% +51.6% ➖ noise
1 duckdb:vortex-file-compressed -18.7% -3.6% -15.6% +53.4% ➖ noise
2 datafusion:vortex-compact -10.5% -13.4% +3.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +72.1% -13.4% +98.8% +35.7% 🚨 regression
2 duckdb:vortex-compact -3.3% -13.4% +11.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +57.0% -13.4% +81.4% +54.1% 🚨 regression
3 datafusion:vortex-compact -3.4% -2.8% -0.6% +41.8% ➖ noise
3 datafusion:vortex-file-compressed -2.4% -2.8% +0.4% +60.9% ➖ noise
3 duckdb:vortex-compact -4.0% -2.8% -1.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -5.1% -2.8% -2.4% +32.4% ➖ noise
4 datafusion:vortex-compact +2.0% -18.3% +25.0% +34.7% ➖ noise
4 datafusion:vortex-file-compressed -22.3% -18.3% -4.8% +30.0% ➖ noise
4 duckdb:vortex-compact -17.1% -18.3% +1.5% +34.3% ➖ noise
4 duckdb:vortex-file-compressed -6.0% -18.3% +15.1% +30.0% ➖ noise
5 datafusion:vortex-compact -17.9% -8.8% -10.0% +36.4% ➖ noise
5 datafusion:vortex-file-compressed -4.0% -8.8% +5.2% +30.0% ➖ noise
5 duckdb:vortex-compact +4.5% -8.8% +14.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -4.6% -8.8% +4.6% +30.0% ➖ noise
6 datafusion:vortex-compact +13.8% -3.8% +18.3% +37.3% ➖ noise
6 datafusion:vortex-file-compressed +15.8% -3.8% +20.4% +30.0% ➖ noise
6 duckdb:vortex-compact -27.8% -3.8% -25.0% +43.1% ➖ noise
6 duckdb:vortex-file-compressed -17.2% -3.8% -14.0% +30.0% ➖ noise
7 datafusion:vortex-compact +21.2% -14.9% +42.4% +30.0% 🚨 regression
7 datafusion:vortex-file-compressed +27.7% -14.9% +50.0% +30.0% 🚨 regression
7 duckdb:vortex-compact +4.5% -14.9% +22.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +9.9% -14.9% +29.1% +30.0% ➖ noise
8 datafusion:vortex-compact +15.2% -8.3% +25.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +15.1% -8.3% +25.5% +30.0% ➖ noise
8 duckdb:vortex-compact +7.0% -8.3% +16.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.1% -8.3% +16.7% +30.0% ➖ noise
9 datafusion:vortex-compact +11.0% -3.4% +14.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +58.8% -3.4% +64.4% +38.0% 🚨 regression
9 duckdb:vortex-compact +1.7% -3.4% +5.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +57.3% -3.4% +62.8% +30.0% 🚨 regression
10 datafusion:vortex-compact +45.8% -1.8% +48.5% +30.0% 🚨 regression
10 datafusion:vortex-file-compressed +26.6% -1.8% +28.9% +30.0% ➖ noise
10 duckdb:vortex-compact +5.7% -1.8% +7.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +16.0% -1.8% +18.1% +30.0% ➖ noise
11 datafusion:vortex-compact +18.5% +4.1% +13.8% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +208.3% +4.1% +196.2% +30.0% 🚨 regression
11 duckdb:vortex-compact +2.6% +4.1% -1.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +68.2% +4.1% +61.7% +30.0% 🚨 regression
12 datafusion:vortex-compact -8.8% +0.4% -9.1% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +11.2% +0.4% +10.8% +30.7% ➖ noise
12 duckdb:vortex-compact +3.1% +0.4% +2.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -2.2% +0.4% -2.6% +30.0% ➖ noise
13 datafusion:vortex-compact +27.2% +4.5% +21.7% +64.3% ➖ noise
13 datafusion:vortex-file-compressed -10.6% +4.5% -14.5% +51.5% ➖ noise
13 duckdb:vortex-compact -7.9% +4.5% -11.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +13.5% +4.5% +8.6% +30.0% ➖ noise
14 datafusion:vortex-compact -1.8% +2.3% -3.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -7.6% +2.3% -9.7% +30.0% ➖ noise
14 duckdb:vortex-compact +13.5% +2.3% +10.9% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -3.9% +2.3% -6.0% +30.0% ➖ noise
15 datafusion:vortex-compact +4.7% +7.9% -2.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -5.5% +7.9% -12.5% +30.0% ➖ noise
15 duckdb:vortex-compact +17.7% +7.9% +9.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -8.4% +7.9% -15.1% +30.0% ➖ noise
16 datafusion:vortex-compact +5.7% +2.5% +3.2% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -13.3% +2.5% -15.4% +30.0% ➖ noise
16 duckdb:vortex-compact +6.1% +2.5% +3.5% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +84.7% +2.5% +80.2% +34.4% 🚨 regression
17 datafusion:vortex-compact +12.1% +4.5% +7.2% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -6.2% +4.5% -10.3% +30.0% ➖ noise
17 duckdb:vortex-compact +5.6% +4.5% +1.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +10.4% +4.5% +5.6% +30.0% ➖ noise
18 datafusion:vortex-compact +1.7% +1.8% -0.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +1.5% +1.8% -0.2% +30.0% ➖ noise
18 duckdb:vortex-compact +0.4% +1.8% -1.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +4.6% +1.8% +2.8% +30.0% ➖ noise
19 datafusion:vortex-compact +7.4% -2.8% +10.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -8.2% -2.8% -5.6% +30.0% ➖ noise
19 duckdb:vortex-compact -0.7% -2.8% +2.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +7.0% -2.8% +10.1% +30.0% ➖ noise
20 datafusion:vortex-compact +10.9% +1.1% +9.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +14.3% +1.1% +13.1% +33.4% ➖ noise
20 duckdb:vortex-compact -3.7% +1.1% -4.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +9.4% +1.1% +8.2% +30.0% ➖ noise
21 datafusion:vortex-compact +18.4% +3.2% +14.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +25.2% +3.2% +21.3% +30.0% ➖ noise
21 duckdb:vortex-compact -1.1% +3.2% -4.2% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +5.8% +3.2% +2.5% +30.0% ➖ noise
22 datafusion:vortex-compact +40.8% +0.3% +40.4% +41.2% ➖ noise
22 datafusion:vortex-file-compressed +5.8% +0.3% +5.5% +30.0% ➖ noise
22 duckdb:vortex-compact +8.0% +0.3% +7.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +2.1% +0.3% +1.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 14, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%


datafusion / vortex-file-compressed (0.988x ➖, 1↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 398696058 391775901 1.02
tpch_q02/datafusion:vortex-file-compressed 104435632 104098842 1.00
tpch_q03/datafusion:vortex-file-compressed 213544337 210510277 1.01
tpch_q04/datafusion:vortex-file-compressed 114702815 113849560 1.01
tpch_q05/datafusion:vortex-file-compressed 367486891 366032905 1.00
tpch_q06/datafusion:vortex-file-compressed 43468286 44103026 0.99
tpch_q07/datafusion:vortex-file-compressed 491202305 494709012 0.99
tpch_q08/datafusion:vortex-file-compressed 353672932 355512466 0.99
tpch_q09/datafusion:vortex-file-compressed 622665087 615834655 1.01
tpch_q10/datafusion:vortex-file-compressed 226455241 228265782 0.99
tpch_q11/datafusion:vortex-file-compressed 80985640 79252951 1.02
tpch_q12/datafusion:vortex-file-compressed 121258664 123083475 0.99
tpch_q13/datafusion:vortex-file-compressed 209778094 210141918 1.00
tpch_q14/datafusion:vortex-file-compressed 57277066 56682892 1.01
tpch_q15/datafusion:vortex-file-compressed 105923146 105314350 1.01
tpch_q16/datafusion:vortex-file-compressed 75075153 75431903 1.00
tpch_q17/datafusion:vortex-file-compressed 620437716 620556142 1.00
tpch_q18/datafusion:vortex-file-compressed 826042623 825879441 1.00
tpch_q19/datafusion:vortex-file-compressed 🚀 69227945 94243561 0.73
tpch_q20/datafusion:vortex-file-compressed 164758497 166659292 0.99
tpch_q21/datafusion:vortex-file-compressed 643246221 646144643 1.00
tpch_q22/datafusion:vortex-file-compressed 65393906 64711515 1.01
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 432396836 442832414 0.98
tpch_q02/datafusion:vortex-compact 107991652 109857043 0.98
tpch_q03/datafusion:vortex-compact 213646370 213034203 1.00
tpch_q04/datafusion:vortex-compact 122020117 121425632 1.00
tpch_q05/datafusion:vortex-compact 371594099 368577485 1.01
tpch_q06/datafusion:vortex-compact 63680353 62536604 1.02
tpch_q07/datafusion:vortex-compact 509770932 512333900 0.99
tpch_q08/datafusion:vortex-compact 358133320 353778329 1.01
tpch_q09/datafusion:vortex-compact 623668385 629126977 0.99
tpch_q10/datafusion:vortex-compact 243308665 243411696 1.00
tpch_q11/datafusion:vortex-compact 81823981 81368214 1.01
tpch_q12/datafusion:vortex-compact 165652209 166159466 1.00
tpch_q13/datafusion:vortex-compact 259383596 258031705 1.01
tpch_q14/datafusion:vortex-compact 72262504 72301236 1.00
tpch_q15/datafusion:vortex-compact 160550038 159131059 1.01
tpch_q16/datafusion:vortex-compact 76924603 78464977 0.98
tpch_q17/datafusion:vortex-compact 622991204 633565686 0.98
tpch_q18/datafusion:vortex-compact 832800483 821684118 1.01
tpch_q19/datafusion:vortex-compact 121464311 132817552 0.91
tpch_q20/datafusion:vortex-compact 187726698 186714496 1.01
tpch_q21/datafusion:vortex-compact 646391446 647991699 1.00
tpch_q22/datafusion:vortex-compact 72537655 69862333 1.04
datafusion / parquet (1.003x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 442236730 450124088 0.98
tpch_q02/datafusion:parquet 169666842 168472250 1.01
tpch_q03/datafusion:parquet 274365798 273745114 1.00
tpch_q04/datafusion:parquet 123342854 122713028 1.01
tpch_q05/datafusion:parquet 424110929 421255349 1.01
tpch_q06/datafusion:parquet 122744772 118258400 1.04
tpch_q07/datafusion:parquet 589727780 586402789 1.01
tpch_q08/datafusion:parquet 446065179 466859219 0.96
tpch_q09/datafusion:parquet 719898557 717025998 1.00
tpch_q10/datafusion:parquet 489222251 487493825 1.00
tpch_q11/datafusion:parquet 115909772 114429665 1.01
tpch_q12/datafusion:parquet 197044584 194157368 1.01
tpch_q13/datafusion:parquet 328913477 325178487 1.01
tpch_q14/datafusion:parquet 154311804 150925854 1.02
tpch_q15/datafusion:parquet 246583052 240638480 1.02
tpch_q16/datafusion:parquet 127220046 127861063 0.99
tpch_q17/datafusion:parquet 664409905 660995161 1.01
tpch_q18/datafusion:parquet 862853524 857871436 1.01
tpch_q19/datafusion:parquet 249544785 251879423 0.99
tpch_q20/datafusion:parquet 283836993 283174369 1.00
tpch_q21/datafusion:parquet 674626624 680777104 0.99
tpch_q22/datafusion:parquet 208171869 210878200 0.99
datafusion / arrow (0.915x ➖, 7↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 596291822 757232702 0.79
tpch_q02/datafusion:arrow 🚀 164427259 191248148 0.86
tpch_q03/datafusion:arrow 🚀 456966153 603403945 0.76
tpch_q04/datafusion:arrow 341297155 375507727 0.91
tpch_q05/datafusion:arrow 922303472 1010037553 0.91
tpch_q06/datafusion:arrow 🚀 278083663 318161320 0.87
tpch_q07/datafusion:arrow 1136228763 1252236497 0.91
tpch_q08/datafusion:arrow 1119005236 1188131006 0.94
tpch_q09/datafusion:arrow 1327825764 1372123718 0.97
tpch_q10/datafusion:arrow 580043718 616274271 0.94
tpch_q11/datafusion:arrow 🚀 135002726 152890743 0.88
tpch_q12/datafusion:arrow 🚀 660564216 834517406 0.79
tpch_q13/datafusion:arrow 501675021 522140934 0.96
tpch_q14/datafusion:arrow 🚀 313337921 358391084 0.87
tpch_q15/datafusion:arrow 681725887 727182550 0.94
tpch_q16/datafusion:arrow 102528582 106250869 0.96
tpch_q17/datafusion:arrow 1299610759 1384877241 0.94
tpch_q18/datafusion:arrow 1853175321 1869263529 0.99
tpch_q19/datafusion:arrow 473224724 479353895 0.99
tpch_q20/datafusion:arrow 482969677 486346246 0.99
tpch_q21/datafusion:arrow 2953576599 2957647705 1.00
tpch_q22/datafusion:arrow 125240129 125281180 1.00
duckdb / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171214664 170778629 1.00
tpch_q02/duckdb:vortex-file-compressed 51123676 51138935 1.00
tpch_q03/duckdb:vortex-file-compressed 125187570 123643322 1.01
tpch_q04/duckdb:vortex-file-compressed 152010352 150326130 1.01
tpch_q05/duckdb:vortex-file-compressed 126183756 123510933 1.02
tpch_q06/duckdb:vortex-file-compressed 46327715 47583155 0.97
tpch_q07/duckdb:vortex-file-compressed 143226757 142899050 1.00
tpch_q08/duckdb:vortex-file-compressed 166372173 165913088 1.00
tpch_q09/duckdb:vortex-file-compressed 324973856 322322533 1.01
tpch_q10/duckdb:vortex-file-compressed 141614445 141526964 1.00
tpch_q11/duckdb:vortex-file-compressed 33415932 32263663 1.04
tpch_q12/duckdb:vortex-file-compressed 92136383 92881242 0.99
tpch_q13/duckdb:vortex-file-compressed 227510555 224027502 1.02
tpch_q14/duckdb:vortex-file-compressed 65938995 66285916 0.99
tpch_q15/duckdb:vortex-file-compressed 85929353 85537687 1.00
tpch_q16/duckdb:vortex-file-compressed 79110734 76335843 1.04
tpch_q17/duckdb:vortex-file-compressed 97380310 96037253 1.01
tpch_q18/duckdb:vortex-file-compressed 295365749 283092721 1.04
tpch_q19/duckdb:vortex-file-compressed 84016957 83204701 1.01
tpch_q20/duckdb:vortex-file-compressed 158712852 158013476 1.00
tpch_q21/duckdb:vortex-file-compressed 569170450 558396430 1.02
tpch_q22/duckdb:vortex-file-compressed 70384459 70320755 1.00
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227720371 227066173 1.00
tpch_q02/duckdb:vortex-compact 55992886 55576274 1.01
tpch_q03/duckdb:vortex-compact 139451434 138358175 1.01
tpch_q04/duckdb:vortex-compact 173030655 169970653 1.02
tpch_q05/duckdb:vortex-compact 143734209 143485752 1.00
tpch_q06/duckdb:vortex-compact 82339752 81603833 1.01
tpch_q07/duckdb:vortex-compact 194603274 196372213 0.99
tpch_q08/duckdb:vortex-compact 180386939 183458221 0.98
tpch_q09/duckdb:vortex-compact 349756329 352017733 0.99
tpch_q10/duckdb:vortex-compact 173237481 174217730 0.99
tpch_q11/duckdb:vortex-compact 40999776 39262338 1.04
tpch_q12/duckdb:vortex-compact 200629969 199949600 1.00
tpch_q13/duckdb:vortex-compact 276392555 275991869 1.00
tpch_q14/duckdb:vortex-compact 99030204 96374473 1.03
tpch_q15/duckdb:vortex-compact 111313413 112669431 0.99
tpch_q16/duckdb:vortex-compact 82930523 82311298 1.01
tpch_q17/duckdb:vortex-compact 110917107 111131843 1.00
tpch_q18/duckdb:vortex-compact 298454344 285739944 1.04
tpch_q19/duckdb:vortex-compact 107822942 105535288 1.02
tpch_q20/duckdb:vortex-compact 202292777 198956251 1.02
tpch_q21/duckdb:vortex-compact 610492464 604801659 1.01
tpch_q22/duckdb:vortex-compact 84957693 83544025 1.02
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258954700 257959931 1.00
tpch_q02/duckdb:parquet 99542216 102090399 0.98
tpch_q03/duckdb:parquet 201769377 204247685 0.99
tpch_q04/duckdb:parquet 133476504 131026149 1.02
tpch_q05/duckdb:parquet 216534512 213371063 1.01
tpch_q06/duckdb:parquet 67604410 65892952 1.03
tpch_q07/duckdb:parquet 178548385 177759271 1.00
tpch_q08/duckdb:parquet 248772392 249437106 1.00
tpch_q09/duckdb:parquet 488200565 476661097 1.02
tpch_q10/duckdb:parquet 607388692 605895163 1.00
tpch_q11/duckdb:parquet 56693425 57321852 0.99
tpch_q12/duckdb:parquet 123362470 123792779 1.00
tpch_q13/duckdb:parquet 440112603 452639613 0.97
tpch_q14/duckdb:parquet 173745508 176611998 0.98
tpch_q15/duckdb:parquet 95006015 96257806 0.99
tpch_q16/duckdb:parquet 160325398 158663622 1.01
tpch_q17/duckdb:parquet 175117887 176785830 0.99
tpch_q18/duckdb:parquet 350980145 351320787 1.00
tpch_q19/duckdb:parquet 283167008 278046036 1.02
tpch_q20/duckdb:parquet 226943844 228832296 0.99
tpch_q21/duckdb:parquet 552112021 554702077 1.00
tpch_q22/duckdb:parquet 288683538 287159614 1.01
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 6324341 (ns) base 7349cd6 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 115677889 115883367 1.00
tpch_q02/duckdb:duckdb 48661596 47833185 1.02
tpch_q03/duckdb:duckdb 95668850 95839668 1.00
tpch_q04/duckdb:duckdb 131259339 129553530 1.01
tpch_q05/duckdb:duckdb 108413042 110470165 0.98
tpch_q06/duckdb:duckdb 37156428 37241865 1.00
tpch_q07/duckdb:duckdb 86444944 85588135 1.01
tpch_q08/duckdb:duckdb 109075457 109573603 1.00
tpch_q09/duckdb:duckdb 279895422 278517443 1.00
tpch_q10/duckdb:duckdb 203460781 204157401 1.00
tpch_q11/duckdb:duckdb 15428393 15144581 1.02
tpch_q12/duckdb:duckdb 84892119 84664558 1.00
tpch_q13/duckdb:duckdb 219476840 218068006 1.01
tpch_q14/duckdb:duckdb 69353215 70091612 0.99
tpch_q15/duckdb:duckdb 76989082 77878064 0.99
tpch_q16/duckdb:duckdb 72873063 73212171 1.00
tpch_q17/duckdb:duckdb 84192231 84499266 1.00
tpch_q18/duckdb:duckdb 212003499 211954027 1.00
tpch_q19/duckdb:duckdb 115829675 115533022 1.00
tpch_q20/duckdb:duckdb 112263905 112046034 1.00
tpch_q21/duckdb:duckdb 299497965 300463703 1.00
tpch_q22/duckdb:duckdb 65210554 69512626 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -21.3% -0.7% -20.7% +10.0% ✅ faster
1 datafusion:vortex-compact -2.4% -0.7% -1.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +1.8% -0.7% +2.5% +10.0% ➖ noise
1 duckdb:duckdb -0.2% -0.7% +0.5% +10.0% ➖ noise
1 duckdb:vortex-compact +0.3% -0.7% +1.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +0.3% -0.7% +1.0% +10.0% ➖ noise
2 datafusion:arrow -14.0% -0.9% -13.2% +10.0% ✅ faster
2 datafusion:vortex-compact -1.7% -0.9% -0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.3% -0.9% +1.2% +10.0% ➖ noise
2 duckdb:duckdb +1.7% -0.9% +2.7% +10.0% ➖ noise
2 duckdb:vortex-compact +0.7% -0.9% +1.7% +11.6% ➖ noise
2 duckdb:vortex-file-compressed -0.0% -0.9% +0.9% +10.0% ➖ noise
3 datafusion:arrow -24.3% -0.5% -23.9% +10.0% ✅ faster
3 datafusion:vortex-compact +0.3% -0.5% +0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.4% -0.5% +1.9% +10.0% ➖ noise
3 duckdb:duckdb -0.2% -0.5% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +0.8% -0.5% +1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.2% -0.5% +1.8% +10.0% ➖ noise
4 datafusion:arrow -9.1% +1.2% -10.2% +10.0% ✅ faster
4 datafusion:vortex-compact +0.5% +1.2% -0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.7% +1.2% -0.4% +10.0% ➖ noise
4 duckdb:duckdb +1.3% +1.2% +0.1% +10.0% ➖ noise
4 duckdb:vortex-compact +1.8% +1.2% +0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +1.2% -0.1% +10.0% ➖ noise
5 datafusion:arrow -8.7% +1.1% -9.7% +10.0% ✅ faster
5 datafusion:vortex-compact +0.8% +1.1% -0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.4% +1.1% -0.7% +10.0% ➖ noise
5 duckdb:duckdb -1.9% +1.1% -2.9% +10.0% ➖ noise
5 duckdb:vortex-compact +0.2% +1.1% -0.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +1.1% +1.1% +10.0% ➖ noise
6 datafusion:arrow -12.6% +3.2% -15.3% +10.0% ✅ faster
6 datafusion:vortex-compact +1.8% +3.2% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.4% +3.2% -4.5% +10.0% ➖ noise
6 duckdb:duckdb -0.2% +3.2% -3.3% +10.0% ➖ noise
6 duckdb:vortex-compact +0.9% +3.2% -2.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.6% +3.2% -5.7% +10.0% ➖ noise
7 datafusion:arrow -9.3% +0.5% -9.7% +10.0% ✅ faster
7 datafusion:vortex-compact -0.5% +0.5% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.7% +0.5% -1.2% +10.0% ➖ noise
7 duckdb:duckdb +1.0% +0.5% +0.5% +10.0% ➖ noise
7 duckdb:vortex-compact -0.9% +0.5% -1.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.2% +0.5% -0.3% +10.0% ➖ noise
8 datafusion:arrow -5.8% -2.4% -3.5% +10.0% ➖ noise
8 datafusion:vortex-compact +1.2% -2.4% +3.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.5% -2.4% +1.9% +10.0% ➖ noise
8 duckdb:duckdb -0.5% -2.4% +2.0% +10.0% ➖ noise
8 duckdb:vortex-compact -1.7% -2.4% +0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.3% -2.4% +2.7% +10.0% ➖ noise
9 datafusion:arrow -3.2% +1.4% -4.6% +10.0% ➖ noise
9 datafusion:vortex-compact -0.9% +1.4% -2.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.1% +1.4% -0.3% +10.0% ➖ noise
9 duckdb:duckdb +0.5% +1.4% -0.9% +10.0% ➖ noise
9 duckdb:vortex-compact -0.6% +1.4% -2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.8% +1.4% -0.6% +10.0% ➖ noise
10 datafusion:arrow -5.9% +0.3% -6.2% +10.0% ➖ noise
10 datafusion:vortex-compact -0.0% +0.3% -0.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.8% +0.3% -1.1% +10.0% ➖ noise
10 duckdb:duckdb -0.3% +0.3% -0.6% +10.0% ➖ noise
10 duckdb:vortex-compact -0.6% +0.3% -0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.1% +0.3% -0.2% +10.0% ➖ noise
11 datafusion:arrow -11.7% +0.1% -11.8% +10.0% ✅ faster
11 datafusion:vortex-compact +0.6% +0.1% +0.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.2% +0.1% +2.1% +10.0% ➖ noise
11 duckdb:duckdb +1.9% +0.1% +1.8% +10.8% ➖ noise
11 duckdb:vortex-compact +4.4% +0.1% +4.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.6% +0.1% +3.5% +10.9% ➖ noise
12 datafusion:arrow -20.8% +0.6% -21.3% +33.5% ➖ noise
12 datafusion:vortex-compact -0.3% +0.6% -0.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.5% +0.6% -2.0% +10.0% ➖ noise
12 duckdb:duckdb +0.3% +0.6% -0.3% +10.0% ➖ noise
12 duckdb:vortex-compact +0.3% +0.6% -0.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.8% +0.6% -1.4% +10.0% ➖ noise
13 datafusion:arrow -3.9% -0.8% -3.1% +10.0% ➖ noise
13 datafusion:vortex-compact +0.5% -0.8% +1.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.2% -0.8% +0.7% +10.0% ➖ noise
13 duckdb:duckdb +0.6% -0.8% +1.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.1% -0.8% +1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.6% -0.8% +2.4% +10.0% ➖ noise
14 datafusion:arrow -12.6% +0.3% -12.8% +10.0% ✅ faster
14 datafusion:vortex-compact -0.1% +0.3% -0.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.0% +0.3% +0.8% +10.0% ➖ noise
14 duckdb:duckdb -1.1% +0.3% -1.3% +10.0% ➖ noise
14 duckdb:vortex-compact +2.8% +0.3% +2.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.5% +0.3% -0.8% +10.0% ➖ noise
15 datafusion:arrow -6.3% +0.6% -6.8% +10.0% ➖ noise
15 datafusion:vortex-compact +0.9% +0.6% +0.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.6% +0.6% +0.0% +10.0% ➖ noise
15 duckdb:duckdb -1.1% +0.6% -1.7% +10.0% ➖ noise
15 duckdb:vortex-compact -1.2% +0.6% -1.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.5% +0.6% -0.1% +10.0% ➖ noise
16 datafusion:arrow -3.5% +0.3% -3.8% +10.0% ➖ noise
16 datafusion:vortex-compact -2.0% +0.3% -2.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.5% +0.3% -0.7% +10.0% ➖ noise
16 duckdb:duckdb -0.5% +0.3% -0.7% +10.0% ➖ noise
16 duckdb:vortex-compact +0.8% +0.3% +0.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +3.6% +0.3% +3.4% +10.0% ➖ noise
17 datafusion:arrow -6.2% -0.2% -6.0% +10.0% ➖ noise
17 datafusion:vortex-compact -1.7% -0.2% -1.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.0% -0.2% +0.2% +10.0% ➖ noise
17 duckdb:duckdb -0.4% -0.2% -0.1% +10.0% ➖ noise
17 duckdb:vortex-compact -0.2% -0.2% +0.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.4% -0.2% +1.6% +10.0% ➖ noise
18 datafusion:arrow -0.9% +0.2% -1.1% +10.0% ➖ noise
18 datafusion:vortex-compact +1.4% +0.2% +1.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.0% +0.2% -0.2% +10.0% ➖ noise
18 duckdb:duckdb +0.0% +0.2% -0.2% +10.0% ➖ noise
18 duckdb:vortex-compact +4.4% +0.2% +4.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.3% +0.2% +4.1% +10.0% ➖ noise
19 datafusion:arrow -1.3% +0.4% -1.7% +10.0% ➖ noise
19 datafusion:vortex-compact -8.5% +0.4% -9.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -26.5% +0.4% -26.9% +10.0% ✅ faster
19 duckdb:duckdb +0.3% +0.4% -0.2% +10.0% ➖ noise
19 duckdb:vortex-compact +2.2% +0.4% +1.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.0% +0.4% +0.5% +10.0% ➖ noise
20 datafusion:arrow -0.7% -0.3% -0.4% +10.0% ➖ noise
20 datafusion:vortex-compact +0.5% -0.3% +0.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.1% -0.3% -0.8% +10.0% ➖ noise
20 duckdb:duckdb +0.2% -0.3% +0.5% +10.0% ➖ noise
20 duckdb:vortex-compact +1.7% -0.3% +2.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.4% -0.3% +0.7% +10.0% ➖ noise
21 datafusion:arrow -0.1% -0.7% +0.6% +10.0% ➖ noise
21 datafusion:vortex-compact -0.2% -0.7% +0.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.4% -0.7% +0.2% +10.0% ➖ noise
21 duckdb:duckdb -0.3% -0.7% +0.4% +10.0% ➖ noise
21 duckdb:vortex-compact +0.9% -0.7% +1.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.9% -0.7% +2.6% +10.0% ➖ noise
22 datafusion:arrow -0.0% -0.4% +0.3% +10.0% ➖ noise
22 datafusion:vortex-compact +3.8% -0.4% +4.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.1% -0.4% +1.4% +10.0% ➖ noise
22 duckdb:duckdb -6.2% -0.4% -5.8% +10.0% ➖ noise
22 duckdb:vortex-compact +1.7% -0.4% +2.1% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.1% -0.4% +0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 14, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 14, 2026
@AdamGS AdamGS requested review from a10y and robert3005 May 14, 2026 12:46
Signed-off-by: Adam Gutglick <[email protected]>
@AdamGS AdamGS marked this pull request as ready for review May 14, 2026 13:00
@AdamGS AdamGS changed the title Push down decimals with some explicit coercion DataFusion: Push down decimals with some explicit coercion May 14, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 14, 2026

Merging this PR will improve performance by 20.27%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 6 improved benchmarks
✅ 1210 untouched benchmarks
⏩ 24 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation new_bp_prim_test_between[i64, 16384] 144.4 µs 115.1 µs +25.45%
Simulation new_bp_prim_test_between[i64, 32768] 236.7 µs 178 µs +32.97%
Simulation new_bp_prim_test_between[i16, 32768] 134.1 µs 120.2 µs +11.58%
Simulation new_alp_prim_test_between[f64, 16384] 148.8 µs 126.9 µs +17.22%
Simulation new_bp_prim_test_between[i32, 16384] 109.1 µs 94.8 µs +15.13%
Simulation new_bp_prim_test_between[i32, 32768] 169.9 µs 141.1 µs +20.46%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/df-decimal (40ca877) with develop (7349cd6)

Open in CodSpeed

Footnotes

  1. 24 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change ext/datafusion Relates to the DataFusion integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant