Backport of Add refreshes and retries to server-acl-init job into release/1.1.x

Backport of Add refreshes and retries to server-acl-init job into release/1.1.x #2500