Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Fix callback logic attempt #2 #194

Merged
merged 1 commit into from
Jan 22, 2025
Merged

Fix callback logic attempt #2 #194

merged 1 commit into from
Jan 22, 2025

Conversation

MrCreosote
Copy link
Member

The prior attempt polled the NERSC task CTS server side to wait for it to finish, which it never would since the task code was waiting for the request to return, which in turn was sitting there polling, so fun with deadlocks.

Instead, use the result file written by the remote code to determine whether the data transfer is complete, which is now written out prior to the callback execution, so the task can still be running when the server decides to proceed with the data transfer completion routine.

The prior attempt polled the NERSC task CTS server side to wait for it
to finish, which it never would since the task code was waiting for the
request to return, which in turn was sitting there polling, so fun with
deadlocks.

Instead, use the result file written by the remote code to determine
whether the data transfer is complete, which is now written out prior to
the callback execution, so the task can still be running when the server
decides to proceed with the data transfer completion routine.
@MrCreosote MrCreosote requested a review from Tianhao-Gu January 22, 2025 20:26
Copy link

codecov bot commented Jan 22, 2025

Codecov Report

Attention: Patch coverage is 28.57143% with 35 lines in your changes missing coverage. Please review.

Project coverage is 51.02%. Comparing base (202cb98) to head (abec6f3).
Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
cdmtaskservice/nersc/remote.py 0.00% 22 Missing ⚠️
cdmtaskservice/nersc/manager.py 57.14% 9 Missing ⚠️
cdmtaskservice/jobflows/nersc_jaws.py 20.00% 4 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #194      +/-   ##
==========================================
+ Coverage   50.93%   51.02%   +0.09%     
==========================================
  Files          37       37              
  Lines        2617     2626       +9     
==========================================
+ Hits         1333     1340       +7     
- Misses       1284     1286       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@Tianhao-Gu Tianhao-Gu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm.

@MrCreosote MrCreosote merged commit eb76816 into main Jan 22, 2025
10 of 11 checks passed
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants