Skip to content

[Evaluation] Inline everything on the evaluation path #7000

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[Evaluation] Inline everything on the evaluation path #7000

wants to merge 1 commit into from

Conversation

effectfully
Copy link
Contributor

Couldn't make it a proper performance improvement, but let's see if it helps.

@effectfully effectfully self-assigned this Apr 1, 2025
@effectfully effectfully added the EXPERIMENT Experiments that we probably don't want to merge label Apr 1, 2025
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Comparing benchmark results of 'validation' on '89b1ad0477' (base) and '9be4680c92' (PR)

Results table
Script 89b1ad0 9be4680 Change
auction_1-1 163.1 μs 213.2 μs +30.7%
auction_1-2 522.3 μs 794.2 μs +52.1%
auction_1-3 526.9 μs 784.2 μs +48.8%
auction_1-4 212.6 μs 274.2 μs +29.0%
auction_2-1 162.8 μs 213.1 μs +30.9%
auction_2-2 526.0 μs 792.4 μs +50.6%
auction_2-3 676.5 μs 1.037 ms +53.3%
auction_2-4 516.5 μs 781.6 μs +51.3%
auction_2-5 210.8 μs 272.8 μs +29.4%
crowdfunding-success-1 191.9 μs 245.9 μs +28.1%
crowdfunding-success-2 191.3 μs 246.0 μs +28.6%
crowdfunding-success-3 190.9 μs 245.3 μs +28.5%
currency-1 209.7 μs 300.9 μs +43.5%
escrow-redeem_1-1 295.4 μs 422.2 μs +42.9%
escrow-redeem_1-2 295.2 μs 422.2 μs +43.0%
escrow-redeem_2-1 345.5 μs 492.4 μs +42.5%
escrow-redeem_2-2 345.5 μs 492.5 μs +42.5%
escrow-redeem_2-3 346.5 μs 491.7 μs +41.9%
escrow-refund-1 144.5 μs 181.2 μs +25.4%
future-increase-margin-1 210.6 μs 299.7 μs +42.3%
future-increase-margin-2 446.2 μs 653.9 μs +46.5%
future-increase-margin-3 454.6 μs 648.0 μs +42.5%
future-increase-margin-4 401.1 μs 590.4 μs +47.2%
future-increase-margin-5 679.3 μs 966.9 μs +42.3%
future-pay-out-1 209.3 μs 299.4 μs +43.0%
future-pay-out-2 445.7 μs 649.9 μs +45.8%
future-pay-out-3 446.6 μs 648.9 μs +45.3%
future-pay-out-4 676.1 μs 979.8 μs +44.9%
future-settle-early-1 208.7 μs 301.2 μs +44.3%
future-settle-early-2 446.2 μs 650.5 μs +45.8%
future-settle-early-3 447.5 μs 649.9 μs +45.2%
future-settle-early-4 520.3 μs 729.7 μs +40.2%
game-sm-success_1-1 333.2 μs 465.5 μs +39.7%
game-sm-success_1-2 181.8 μs 234.1 μs +28.8%
game-sm-success_1-3 530.5 μs 772.5 μs +45.6%
game-sm-success_1-4 218.2 μs 269.2 μs +23.4%
game-sm-success_2-1 333.2 μs 466.2 μs +39.9%
game-sm-success_2-2 182.1 μs 233.5 μs +28.2%
game-sm-success_2-3 529.7 μs 770.0 μs +45.4%
game-sm-success_2-4 210.9 μs 269.2 μs +27.6%
game-sm-success_2-5 531.9 μs 772.6 μs +45.3%
game-sm-success_2-6 211.6 μs 269.2 μs +27.2%
multisig-sm-1 332.8 μs 473.4 μs +42.2%
multisig-sm-2 322.0 μs 462.5 μs +43.6%
multisig-sm-3 329.3 μs 468.9 μs +42.4%
multisig-sm-4 328.2 μs 475.3 μs +44.8%
multisig-sm-5 454.5 μs 673.5 μs +48.2%
multisig-sm-6 331.8 μs 470.6 μs +41.8%
multisig-sm-7 320.5 μs 463.1 μs +44.5%
multisig-sm-8 323.1 μs 468.4 μs +45.0%
multisig-sm-9 327.6 μs 474.2 μs +44.7%
multisig-sm-10 460.6 μs 675.8 μs +46.7%
ping-pong-1 273.2 μs 391.0 μs +43.1%
ping-pong-2 273.2 μs 392.4 μs +43.6%
ping-pong_2-1 174.3 μs 238.2 μs +36.7%
prism-1 152.5 μs 195.4 μs +28.1%
prism-2 347.7 μs 492.1 μs +41.5%
prism-3 314.5 μs 484.9 μs +54.2%
pubkey-1 130.3 μs 164.7 μs +26.4%
stablecoin_1-1 790.4 μs 1.082 ms +36.9%
stablecoin_1-2 177.0 μs 228.5 μs +29.1%
stablecoin_1-3 902.8 μs 1.254 ms +38.9%
stablecoin_1-4 187.0 μs 240.5 μs +28.6%
stablecoin_1-5 1.163 ms 1.619 ms +39.2%
stablecoin_1-6 231.0 μs 299.5 μs +29.7%
stablecoin_2-1 788.1 μs 1.087 ms +37.9%
stablecoin_2-2 176.9 μs 230.3 μs +30.2%
stablecoin_2-3 902.0 μs 1.265 ms +40.2%
stablecoin_2-4 186.8 μs 242.1 μs +29.6%
token-account-1 162.3 μs 221.6 μs +36.5%
token-account-2 285.2 μs 412.2 μs +44.5%
uniswap-1 333.4 μs 506.9 μs +52.0%
uniswap-2 192.6 μs 268.7 μs +39.5%
uniswap-3 1.443 ms 2.134 ms +47.9%
uniswap-4 300.9 μs 395.6 μs +31.5%
uniswap-5 957.0 μs 1.400 ms +46.3%
uniswap-6 286.3 μs 380.6 μs +32.9%
vesting-1 288.4 μs 418.7 μs +45.2%
89b1ad0 9be4680 Change
TOTAL 29.88 ms 42.44 ms +42.1%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Comparing benchmark results of 'nofib' on '89b1ad0477' (base) and '9be4680c92' (PR)

Results table
Script 89b1ad0 9be4680 Change
clausify/formula1 2.388 ms 3.678 ms +54.0%
clausify/formula2 3.197 ms 4.878 ms +52.6%
clausify/formula3 8.835 ms 13.36 ms +51.2%
clausify/formula4 20.51 ms 29.92 ms +45.9%
clausify/formula5 43.02 ms 64.86 ms +50.8%
knights/4x4 14.86 ms 19.84 ms +33.5%
knights/6x6 36.30 ms 50.85 ms +40.1%
knights/8x8 62.99 ms 89.60 ms +42.2%
primetest/05digits 9.203 ms 11.22 ms +21.9%
primetest/10digits 17.78 ms 22.22 ms +25.0%
primetest/30digits 54.02 ms 68.53 ms +26.9%
primetest/50digits 89.79 ms 113.0 ms +25.8%
queens4x4/bt 4.137 ms 5.684 ms +37.4%
queens4x4/bm 5.091 ms 7.190 ms +41.2%
queens4x4/bjbt1 4.949 ms 6.882 ms +39.1%
queens4x4/bjbt2 4.704 ms 6.470 ms +37.5%
queens4x4/fc 10.29 ms 14.63 ms +42.2%
queens5x5/bt 58.15 ms 77.77 ms +33.7%
queens5x5/bm 58.81 ms 80.71 ms +37.2%
queens5x5/bjbt1 67.10 ms 90.59 ms +35.0%
queens5x5/bjbt2 65.37 ms 88.13 ms +34.8%
queens5x5/fc 130.2 ms 186.0 ms +42.9%
89b1ad0 9be4680 Change
TOTAL 771.7 ms 1.056 s +36.8%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

what the fuck lololol

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Comparing benchmark results of 'lists' on '89b1ad0477' (base) and '9be4680c92' (PR)

Results table
Script 89b1ad0 9be4680 Change
sort/ghcSort/50 185.6 μs 272.9 μs +47.0%
sort/ghcSort/100 431.9 μs 631.5 μs +46.2%
sort/ghcSort/150 742.1 μs 1.091 ms +47.0%
sort/ghcSort/200 1.013 ms 1.471 ms +45.2%
sort/ghcSort/250 1.306 ms 1.891 ms +44.8%
sort/ghcSort/300 1.722 ms 2.480 ms +44.0%
sort/insertionSort/50 602.0 μs 822.7 μs +36.7%
sort/insertionSort/100 2.413 ms 3.251 ms +34.7%
sort/insertionSort/150 5.427 ms 7.347 ms +35.4%
sort/insertionSort/200 9.694 ms 13.11 ms +35.2%
sort/insertionSort/250 15.11 ms 20.55 ms +36.0%
sort/insertionSort/300 21.97 ms 29.67 ms +35.0%
sort/mergeSort/50 552.0 μs 732.6 μs +32.7%
sort/mergeSort/100 1.264 ms 1.684 ms +33.2%
sort/mergeSort/150 2.036 ms 2.712 ms +33.2%
sort/mergeSort/200 2.859 ms 3.816 ms +33.5%
sort/mergeSort/250 3.757 ms 5.005 ms +33.2%
sort/mergeSort/300 4.563 ms 6.104 ms +33.8%
sort/quickSort/50 1.522 ms 2.201 ms +44.6%
sort/quickSort/100 6.269 ms 8.796 ms +40.3%
sort/quickSort/150 14.11 ms 19.64 ms +39.2%
sort/quickSort/200 24.95 ms 34.70 ms +39.1%
sort/quickSort/250 39.37 ms 54.59 ms +38.7%
sort/quickSort/300 56.98 ms 78.76 ms +38.2%
sum/compiled-from-Haskell/sum-right-builtin/100 76.65 μs 109.9 μs +43.4%
sum/compiled-from-Haskell/sum-right-builtin/500 401.3 μs 570.3 μs +42.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 851.8 μs 1.224 ms +43.7%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.625 ms 3.575 ms +36.2%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.691 ms 7.482 ms +31.5%
sum/compiled-from-Haskell/sum-right-Scott/100 42.53 μs 65.15 μs +53.2%
sum/compiled-from-Haskell/sum-right-Scott/500 227.2 μs 349.6 μs +53.9%
sum/compiled-from-Haskell/sum-right-Scott/1000 483.4 μs 754.7 μs +56.1%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.689 ms 2.472 ms +46.4%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.095 ms 5.317 ms +29.8%
sum/compiled-from-Haskell/sum-right-data/100 255.6 μs 331.9 μs +29.9%
sum/compiled-from-Haskell/sum-right-data/500 1.404 ms 1.825 ms +30.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.153 ms 3.964 ms +25.7%
sum/compiled-from-Haskell/sum-right-data/2500 8.475 ms 10.33 ms +21.9%
sum/compiled-from-Haskell/sum-right-data/5000 18.08 ms 21.68 ms +19.9%
sum/compiled-from-Haskell/sum-left-builtin/100 75.60 μs 105.8 μs +39.9%
sum/compiled-from-Haskell/sum-left-builtin/500 392.5 μs 552.1 μs +40.7%
sum/compiled-from-Haskell/sum-left-builtin/1000 844.5 μs 1.182 ms +40.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.584 ms 3.453 ms +33.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.713 ms 7.272 ms +27.3%
sum/compiled-from-Haskell/sum-left-Scott/100 42.59 μs 62.04 μs +45.7%
sum/compiled-from-Haskell/sum-left-Scott/500 223.8 μs 330.6 μs +47.7%
sum/compiled-from-Haskell/sum-left-Scott/1000 493.9 μs 714.8 μs +44.7%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.619 ms 2.340 ms +44.5%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.043 ms 5.088 ms +25.8%
sum/compiled-from-Haskell/sum-left-data/100 256.9 μs 342.3 μs +33.2%
sum/compiled-from-Haskell/sum-left-data/500 1.424 ms 1.896 ms +33.1%
sum/compiled-from-Haskell/sum-left-data/1000 3.208 ms 4.149 ms +29.3%
sum/compiled-from-Haskell/sum-left-data/2500 8.546 ms 10.87 ms +27.2%
sum/compiled-from-Haskell/sum-left-data/5000 18.21 ms 22.42 ms +23.1%
sum/hand-written-PLC/sum-right-builtin/100 52.07 μs 77.76 μs +49.3%
sum/hand-written-PLC/sum-right-builtin/500 258.8 μs 382.2 μs +47.7%
sum/hand-written-PLC/sum-right-builtin/1000 534.2 μs 794.8 μs +48.8%
sum/hand-written-PLC/sum-right-builtin/2500 1.550 ms 2.252 ms +45.3%
sum/hand-written-PLC/sum-right-builtin/5000 3.448 ms 4.730 ms +37.2%
sum/hand-written-PLC/sum-right-Scott/100 35.58 μs 63.76 μs +79.2%
sum/hand-written-PLC/sum-right-Scott/500 183.7 μs 325.4 μs +77.1%
sum/hand-written-PLC/sum-right-Scott/1000 388.9 μs 679.0 μs +74.6%
sum/hand-written-PLC/sum-right-Scott/2500 1.180 ms 2.061 ms +74.7%
sum/hand-written-PLC/sum-right-Scott/5000 3.026 ms 4.489 ms +48.3%
sum/hand-written-PLC/sum-left-builtin/100 54.10 μs 82.54 μs +52.6%
sum/hand-written-PLC/sum-left-builtin/500 268.0 μs 411.4 μs +53.5%
sum/hand-written-PLC/sum-left-builtin/1000 532.8 μs 817.2 μs +53.4%
sum/hand-written-PLC/sum-left-builtin/2500 1.334 ms 2.030 ms +52.2%
sum/hand-written-PLC/sum-left-builtin/5000 2.645 ms 4.046 ms +53.0%
sum/hand-written-PLC/sum-left-Scott/100 38.11 μs 67.64 μs +77.5%
sum/hand-written-PLC/sum-left-Scott/500 192.4 μs 337.0 μs +75.2%
sum/hand-written-PLC/sum-left-Scott/1000 394.5 μs 678.0 μs +71.9%
sum/hand-written-PLC/sum-left-Scott/2500 1.109 ms 1.930 ms +74.0%
sum/hand-written-PLC/sum-left-Scott/5000 2.564 ms 4.022 ms +56.9%
89b1ad0 9be4680 Change
TOTAL 333.9 ms 452.4 ms +35.5%

# for free to join this conversation on GitHub. Already have an account? # to comment
Reviewers
No reviews
Assignees

@effectfully effectfully

Labels
Evaluation EXPERIMENT Experiments that we probably don't want to merge Performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@effectfully