output from jobs is truncated

[tim-moody]

• when Install Configured Options is run only the tail of the job output is shown in Job Status
• what looks like entire output went to /tmp/job (76398 bytes)
• but the db also only contains this tail
• for get zim only tail appeared in Job Status
• but entire output went to /tmp/job
• and again only tail is in db

The design called for only the tail to be returned to Job Status, for performance reasons, but the entire output to be stored in the db against a future enhancement that would allow the entire output to be read in Job Status.

[tim-moody]

On further investigation this seems to have been intentional under the rationale that there is no reason to store the entire output until it can be viewed. Not sure if this is what's desired. Should probably be modified in conjunction with https://github.com/iiab/iiab-admin-console/projects/7

jobs_running[job_id]['file'].close()

# load output from tmp file
output_file = jobs_running[job_id]['output_file']
#file = open(output_file, 'r')
#job_output = file.read()
#file.close()

command = "tail " + output_file
args = shlex.split(command)
job_output = subproc_check_output(args)
print(type(job_output))
print(job_output)

[tim-moody]

In a similar vein I think there are some scripts, mostly python, where the output is only flushed to the output file at the end so that no output appears in Job Status until the job is complete. There are others where output is buffered in ? 256/512 bytes so there are delays in its appearance in Job Status.

[tim-moody]

#545