Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Implement timeout on the scan functions #135

Closed
tdruez opened this issue Apr 7, 2021 · 3 comments
Closed

Implement timeout on the scan functions #135

tdruez opened this issue Apr 7, 2021 · 3 comments
Assignees
@tdruez
Milestone
2021-05

Comments

@tdruez
Copy link
Contributor

tdruez commented Apr 7, 2021

Process can get stuck forever at the moment.
@tdruez tdruez added this to the 2021-05 milestone Apr 7, 2021
@tdruez tdruez self-assigned this Apr 7, 2021
tdruez added a commit that referenced this issue Apr 7, 2021
@tdruez
Refactor scan_file to reuse scancode-toolkit scan_resource and benefi…
80d310e 
…t from timeout support #135

Signed-off-by: Thomas Druez <tdruez@nexb.com>
tdruez added a commit that referenced this issue Apr 8, 2021
@tdruez
Add unit test for the timeout on the scan functions #135
6fb93f6 
Signed-off-by: Thomas Druez <tdruez@nexb.com>
@tdruez tdruez closed this as completed Apr 8, 2021
tdruez added a commit that referenced this issue Apr 14, 2021
@tdruez
Refactor scan_for_package_info to use scan_resource and benefit from …
1eaf35f 
…timeout support #135

Signed-off-by: Thomas Druez <tdruez@nexb.com>
@cco3
Copy link

cco3 commented Apr 20, 2021

I started a root_filesystem scan yesterday on a 1GB image (using 21.4.14) and it's still running. Is this possibly still the same issue?

@tdruez
Copy link
Contributor Author

tdruez commented Apr 20, 2021

@cco3 Yes, it's most likely related to multiprocessing, 1GB image should not take more than 1h max.
We are looking into solving those issues at the moment.
In the mean time, could you try to turn off multiprocessing a run the scan again (as a new project)?
See https://scancodeio.readthedocs.io/en/latest/scancodeio-settings.html#scancodeio-processes

@cco3
Copy link

cco3 commented Apr 21, 2021

Hasn't finished after about 5 hours. There's a report, but the "running" progress indicator is still going and the log is stuck at Step [scan_for_files] starting

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@tdruez tdruez

Labels
None yet
Projects
None yet
Milestone
2021-05
Development

No branches or pull requests
2 participants
@cco3 @tdruez