Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Import snailtracer benchmark #320

Closed
wants to merge 2 commits into from
Closed

Import snailtracer benchmark #320

wants to merge 2 commits into from

Conversation

axic
Copy link
Member

@axic axic commented May 11, 2021

@axic
Copy link
Member Author

axic commented May 11, 2021

Do not merge yet, want to actually commit the changed sources to https://github.com/axic/snailtracer so we can refer to it.

@codecov
Copy link

codecov bot commented May 11, 2021

Codecov Report

Merging #320 (3687c0f) into master (d20c2da) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #320   +/-   ##
=======================================
  Coverage   99.78%   99.78%           
=======================================
  Files          30       30           
  Lines        4144     4144           
=======================================
  Hits         4135     4135           
  Misses          9        9           
Flag Coverage Δ
consensus 91.51% <ø> (ø)
unittests 99.78% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

@chfast chfast force-pushed the bench_mocked_host branch from d60d80e to a7f404f Compare May 13, 2021 10:25
Base automatically changed from bench_mocked_host to master May 13, 2021 10:41
@axic
Copy link
Member Author

axic commented Jun 30, 2021

Rebased. Before merged, I'd still want to point the commit to a commithash in the source repo.

@chfast do you remember what else was blocking this?

@chfast
Copy link
Member

chfast commented Jun 30, 2021

-------------------------------------------------------------------------------------------------------------
Benchmark                                                   Time             CPU   Iterations UserCounters...
-------------------------------------------------------------------------------------------------------------
advanced/analyse/main/snailtracer_mean                   96.3 us         96.3 us           20 rate=184.084M/s size=17.73k
advanced/analyse/main/snailtracer_median                 96.3 us         96.3 us           20 rate=184.065M/s size=17.73k
advanced/analyse/main/snailtracer_stddev                0.059 us        0.059 us           20 rate=112.918k/s size=0
baseline/analyse/main/snailtracer_mean                   12.6 us         12.6 us           20 rate=1.4106G/s size=17.73k
baseline/analyse/main/snailtracer_median                 12.6 us         12.6 us           20 rate=1.41027G/s size=17.73k
baseline/analyse/main/snailtracer_stddev                0.066 us        0.066 us           20 rate=7.41335M/s size=0
advanced/execute/main/snailtracer/benchmark_mean        51780 us        51779 us           20 gas_rate=4.44572G/s gas_used=230.193M
advanced/execute/main/snailtracer/benchmark_median      51735 us        51734 us           20 gas_rate=4.44951G/s gas_used=230.193M
advanced/execute/main/snailtracer/benchmark_stddev        208 us          208 us           20 gas_rate=17.5997M/s gas_used=0
baseline/execute/main/snailtracer/benchmark_mean        44518 us        44518 us           20 gas_rate=5.17079G/s gas_used=230.193M
baseline/execute/main/snailtracer/benchmark_median      44520 us        44520 us           20 gas_rate=5.1706G/s gas_used=230.193M
baseline/execute/main/snailtracer/benchmark_stddev       17.0 us         17.0 us           20 gas_rate=1.98M/s gas_used=0
advanced/total/main/snailtracer/benchmark_mean          57670 us        57669 us           20 gas_rate=3.99168G/s gas_used=230.193M
advanced/total/main/snailtracer/benchmark_median        57687 us        57687 us           20 gas_rate=3.9904G/s gas_used=230.193M
advanced/total/main/snailtracer/benchmark_stddev          263 us          263 us           20 gas_rate=18.0965M/s gas_used=0
baseline/total/main/snailtracer/benchmark_mean          45215 us        45215 us           20 gas_rate=5.09119G/s gas_used=230.193M
baseline/total/main/snailtracer/benchmark_median        45166 us        45167 us           20 gas_rate=5.09653G/s gas_used=230.193M
baseline/total/main/snailtracer/benchmark_stddev          210 us          210 us           20 gas_rate=23.2184M/s gas_used=0

The gas_rate is screwed because a lot of EVM memory is used.

@chfast
Copy link
Member

chfast commented Dec 20, 2022

Done in ipsilon/evm-benchmarks#12.

@chfast chfast closed this Dec 20, 2022
@chfast chfast deleted the snailtracer branch December 20, 2022 10:38
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants