Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Evals or other hooks can be skipped if preempted #855

Open
dlwh opened this issue Jan 14, 2025 · 0 comments
Open

Evals or other hooks can be skipped if preempted #855

dlwh opened this issue Jan 14, 2025 · 0 comments

Comments

@dlwh
Copy link
Member

dlwh commented Jan 14, 2025

Right now the basic flow for hooks is checkpoint -> other hooks -> continue. However, if hooks are interrupted, the resume logic will skip the hooks. This is happening more frequently now that we're using highly preemptible compute.
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@dlwh