pushing an app containing large set of files times out during the resource matching step

[mgadiya]

Our app contains over 17K files and cf push in some environments time out. CF Trace helped narrow down the problem to the slower resource matching causing the time out. Having an option to disable it will help us get around this issue.

Command

cf push metrics -i 4 --no-route

What occurred

REQUEST: [2016-12-07T20:43:31Z]
PUT /v2/resource_match HTTP/1.1
Host: api.system.nprd-pcf.aig.net
Accept: application/json
Authorization: [PRIVATE DATA HIDDEN]
Connection: close
Content-Type: application/json
User-Agent: go-cli 6.21.1+6fd3c9f / linux

[{"sha1":"fa8c84f17f313c93e3cf86be1437aa3870414ed7","size":371},{"sha1":"0","size":0},{"sha1":"21cd7604a345423f57950d2415063d69d9c32504","size":4025},{"sha1":"0bfd0cbeccf23d3193823527b8caa40eee35dc24","size":122},{"sha1":"6a1a5de08072d5bcdd2e01e8aa6a0753f3fba22b","size":5709},
...........,
..........,
{"sha1":"803c2d5eda0462ae13cc1f4a2b50211d2b28da6a","size":422},{"sha1":"c62c660abc4b012302dbd51ef62f20b408a7bfa7","size":5196},{"sha1":"1f471ed248298d2a6a6faf4eb2b6592d163e8d8e","size":1035},{"sha1":"dd82528b1541448463447ca916efd6b36917fed1","size":346}]

RESPONSE: [2016-12-07T20:44:30Z]
HTTP/1.1 504 GATEWAY_TIMEOUT
Connection: close
Content-Length: 0

FAILED
Error processing app files: Error uploading application.
Server error, status code: 504, error code: 0, message:

CLI Version

1.6.21

[cf-gitbot]

We have created an issue in Pivotal Tracker to manage this:

https://www.pivotaltracker.com/story/show/136928671

The labels on this github issue will be updated when the story is started.

[dkoper]

Hi @mgadiya , thanks so much for the trace!

[mmb]

@mgadiya Which type of blobstore are you using for cloud controller's resource pool blobstore?

[dkoper]

Hi @mgadiya

This issue should now be resolved in cf CLI 6.23.1. If CC times out on the resource matching, push will no longer abort.
https://github.com/cloudfoundry/cli#downloads

Thanks again for your trace, it's been very useful.

Regards,
Dies Koper
CF CLI PM