Backport of Add refreshes and retries to server-acl-init job (#3137) to release/1.1.x

Backport of Add refreshes and retries to server-acl-init job (#3137) to release/1.1.x #3617