Derivative Generation Timeouts are expected for large files at scale

[noahwsmith]

This issue will likely need to be resolve to handle full-scale ingests with large original files:

Islandora/documentation#1896

[noahwsmith]

There is now a potential solution in that Issue.

[noahwsmith]

I would assign this to @dannylamb if I could, but I can't

[dannylamb]

Did a couple hours diving into this, and it's the interplay of a bunch o' things. I either set, or added logic to set, every nginx and php timeout I could find.

For nginx I did:

• fastcgi_read_timeout
• fastcgi_send_timeout
• fastcgi_connect_timeout
• proxy_read_timeout
• proxy_send_timeout
• proxy_connect_timeout
• send_timeout
• keepalive_timeout
• client_body_timeout
• lingering_timeout

For PHP I did:

• default_socket_timeout
• max_execution_time
• max_input_time
• process_control_timeout
• request_terminate_timeout

It also required me to really really really bump up the timeout values for Alpaca that y'all did in Islandora/Alpaca#79. Since they're in milliseconds, it needs to be something super duper high like 999999999999.

This was all done in a fervor to try and make things work, so I'm not sure if it's one, all, or some combination of these settings to do the trick. But I can at least contribute back the stuff I did to allow us to set all these values.

[birkland]

Resolved in jhu-idc/idc-isle-dc#260