core24 lxd image intermittenly fails to launch

[mr-cal]

Bug Description

Launching the core24 image intermittently fails and is blocking up our CI.

To Reproduce

1. lxc remote add craft-com.ubuntu.cloud-buildd-daily https://cloud-images.ubuntu.com/buildd/daily --protocol simplestreams
2. lxc launch craft-com.ubuntu.cloud-buildd-daily:core24

It often will start working after 5-10 attempts of retrying the second step.

The next troubleshooting step is to run lxc launch --debug craft-com.ubuntu.cloud-buildd-daily:core24 then reach out to the LXD and/or cloud image teams.

part yaml

No response

Relevant log output

logger.debug(
                      "Failed to launch instance %s, retrying %s.",
                      instance_name,
                      retry_count,
                  )
                  logger.debug(str(error))
                  # Ignore first 3 failed "create" attempts that other craft-providers
                  # are creating the same instance.
                  # LXD: Instance is busy running a "create" operation
                  if retry_count >= 2 or (
                      error.stderr and '"create"' not in error.stderr.decode()
                  ):
  >                   raise LXDError(
                          brief=f"Failed to launch instance {instance_name!r}.",
                          details=errors.details_from_called_process_error(error),
                      ) from error
  E                   craft_providers.lxd.errors.LXDError: Failed to launch instance 'itest-SERAAXYI'.
  E                   * Command that failed: 'lxc --project default launch craft-com.ubuntu.cloud-buildd-daily:core24 local:itest-SERAAXYI --config security.syscalls.intercept.mknod=true --config user.craft_providers.status=STARTING --config user.craft_providers.timer=2024-01-16T18:15:33.714268+00:00 --config user.craft_providers.pid=3215'
  E                   * Command exit code: 1
  E                   * Command output: b'Creating itest-SERAAXYI\n'
  E                   * Command standard error output: b"Error: Failed instance creation: Couldn't find the requested image\n"
  
  ../../craft_providers/lxd/lxc.py:628: LXDError

[mr-cal]

This has been escalated to the cloud image team. It appears to be an issue with how their servers are providing the buildd images. See here for details.