Logs Hardcoded to 10000 Lines

[emimaesmith]

Description
The logs retrieved for each running job are capped at 10000 lines. This is a hardcoded number in the code to retrieve the logs json:

scale/scale/job/models.py

Line 1525 in 9a6714a

'size': 10000,

Suggested to look into paging the logs content to allow for streaming over 10000 lines.

[cshamis]

That’s a retrieval big right? We don’t have limits I place on elastic ?

…

On Feb 4, 2020, at 4:03 PM, emimaesmith ***@***.***> wrote:  Description The logs retrieved for each running job are capped at 10000 lines. This is a hardcoded number in the code to retrieve the logs json. Reproduction Steps Steps to reproduce the problem: Go to '...' Click on '....' Scroll down to '....' See error Expected behavior A clear and concise description of what you expected to happen. Screenshots If applicable, add screenshots to help explain your problem. Version and Environment Details Client OS: [e.g. Windows 10 build 1601] Browser: [e.g. chrome 76.x, etc.] Scale API: [e.g. v6.9.0-snapshot+1d15ca7e] Can be found at /api/v6/version/ Scale UI: [e.g. v0.4.3] Can be found at the bottom of the UI interface. Cluster details below are very helpful for problem resolution, but external Scale users aren't expected to provide. DC/OS: [e.g. 1.11.2 Enterprise, 1.12.0 Community, etc.] Marathonlb: [e.g. 1.4.2] Agent OS: [e.g. CentOS 7.4] Agent Docker: [e.g. 1.17.05] Agent Infrastructure: [e.g. AWS, GovCloud, On-premise] Additional context Add any other context about the problem here. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.