Speedup execute.py: Reuse same manager and dict in #277

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Open

michaelfeil wants to merge 1 commit into bigcode-project:main from michaelfeil:patch-1

michaelfeil commented Oct 1, 2024 •

edited

Loading

In my case, brought down the end-to-end latency from 3-5 seconds per execution to ~0.9 seconds.

Potentially needs a good review, I pulled this from an internal fork.


          Update execute.py

b46c0ca

michaelfeil changed the title ~~Speedup execute: Reuse same manager and dict in~~ Speedup execute.py: Reuse same manager and dict in

# for free to join this conversation on GitHub. Already have an account? # to comment

Labels

None yet