Find a way to retrieve job results when the output is large

[odow]

Job submitted by @healy-pa Job Number=4791864, Password=PdmVqbQA

#9 (comment)

There is a large quantity of log info and a large number of variables with non-zero values

[odow]

@healy-pa you may want to try changing the display frequency to see if it reduces the output sufficiently.

s = NEOSCPLEXSolver()
addparameter!(s, "mip display", 0)

[odow]

Attaching the archived job for future reference. 4791864.tar.gz

The model took approximately 25 minutes to solve, and had ~1700 lines of log information and ~1400 solution lines for the non-zero variables. Currently re-running to see what happens.

Edit: it's now been running for 3 hours with no result. Return email says

Job results too long for email. Download results from https://neos-server.org/neos/admin.html
Job Number=5726275, Password=qvrKkgJL

getFinalResults returns a page 2822 lines long. It looks as if the log gets truncated so that the solution is never displayed to the screen.

Have emailed NEOS support for advice.

[odow]

There are two issues here.

1. OP Issue: http pipe timed out

The original request waiting for getFinalResults timed out. The return email said results were too long, but getFinalResults will return the complete results. The timeout issue is now fixed (we poll getJobStatus although see #22 ).

2. NEOS time-limit

When I resubmitted the job, I got the same email, and the truncated log. From NEOS support:

That particular job actually hit the 8-hour limit, which explains why the output appears incomplete. getFinalResults is the appropriate way to retrieve results for a problem, though it obviously does not report back on time limit issues unfortunately.

I suggested they add a Error or TimeLimit status to getJobStatus.