podman save fails when specifying an image using a digest #5234

mprahl · 2020-02-17T17:43:46Z

/kind bug

Description

podman save fails when specifying an image using a digest

Steps to reproduce the issue:

podman pull quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f
podman save quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f -o temp.tar

Describe the results you received:

Error: error getting Docker archive ImageReference for "temp.tar:quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f": docker-archive doesn't support digest references: temp.tar:quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f

Describe the results you expected:

The archive should be created like the Docker CLI does.

Output of podman version:

Version:            1.7.0
RemoteAPI Version:  1
Go Version:         go1.12.14
OS/Arch:            linux/amd64

Output of podman info --debug:

debug:
  compiler: gc
  git commit: ""
  go version: go1.12.14
  podman version: 1.7.0
host:
  BuildahVersion: 1.12.0
  CgroupVersion: v1
  Conmon:
    package: conmon-2.0.10-2.fc30.x86_64
    path: /usr/bin/conmon
    version: 'conmon version 2.0.10, commit: 35d9b09d9d2791c7167091a9f25792535a380967'
  Distribution:
    distribution: fedora
    version: "30"
  IDMappings:
    gidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 10000
      size: 65536
    - container_id: 65537
      host_id: 100000
      size: 65536
    uidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 10000
      size: 65536
    - container_id: 65537
      host_id: 100000
      size: 65536
  MemFree: 282464256
  MemTotal: 8058654720
  OCIRuntime:
    name: runc
    package: runc-1.0.0-102.dev.gitdc9208a.fc30.x86_64
    path: /usr/bin/runc
    version: |-
      runc version 1.0.0-rc10
      commit: ffa084d279c26351e6e63bd2c3f28d43fa1f6e57
      spec: 1.0.1-dev
  SwapFree: 7726428160
  SwapTotal: 8384409600
  arch: amd64
  cpus: 4
  eventlogger: journald
  hostname: mprahl-laptop
  kernel: 5.4.17-100.fc30.x86_64
  os: linux
  rootless: true
  slirp4netns:
    Executable: /usr/bin/slirp4netns
    Package: slirp4netns-0.4.0-4.git19d199a.fc30.x86_64
    Version: |-
      slirp4netns version 0.4.0-beta.2
      commit: 19d199a6ca424fcf9516320a327cedad85cf4dfb
  uptime: 4h 33m 53.01s (Approximately 0.17 days)
registries:
  search:
  - docker.io
  - registry.fedoraproject.org
  - quay.io
  - registry.access.redhat.com
  - registry.centos.org
store:
  ConfigFile: /home/mprahl/.config/containers/storage.conf
  ContainerStore:
    number: 9
  GraphDriverName: overlay
  GraphOptions:
    overlay.mount_program:
      Executable: /usr/bin/fuse-overlayfs
      Package: fuse-overlayfs-0.7.5-2.fc30.x86_64
      Version: |-
        fusermount3 version: 3.6.2
        fuse-overlayfs: version 0.7.5
        FUSE library version 3.6.2
        using FUSE kernel interface version 7.29
  GraphRoot: /home/mprahl/.local/share/containers/storage
  GraphStatus:
    Backing Filesystem: extfs
    Native Overlay Diff: "false"
    Supports d_type: "true"
    Using metacopy: "false"
  ImageStore:
    number: 19
  RunRoot: /run/user/1000
  VolumePath: /home/mprahl/.local/share/containers/storage/volumes

Package info (e.g. output of rpm -q podman or apt list podman):

podman-1.7.0-3.fc30.x86_64

Additional environment details (AWS, VirtualBox, physical, etc.):

physical

The text was updated successfully, but these errors were encountered:

vrothberg · 2020-02-18T09:09:23Z

Thanks for opening the issue! I changed it to a feature request as it's documented to not be supported.

@mtrmac, do you know why we're not supporting it? I didn't check the specific parts in the code yet but Docker seems to be able doing that.

mtrmac · 2020-02-18T14:50:45Z

If you check the archive that results from (docker save name@digest), it doesn’t contain the name@digest value at all — it’s just not possible, the format (https://github.com/moby/moby/blob/749d90e10f989802638ae542daf54257f3bf71f2/image/spec/v1.2.md ) has a RepoTags field and a repo/tag structure in the repositories file.

I suppose Podman should mimic the Docker behavior and create an unnamed image in this case, or maybe (probably not?) reject the input outright.

github-actions · 2020-03-20T00:05:05Z

A friendly reminder that this issue had no activity for 30 days.

rhatdan · 2020-03-20T14:50:45Z

@vrothberg do you think we should do this?

vrothberg · 2020-03-20T15:03:14Z

I like @mtrmac's idea to mimic what Docker does. @mtrmac what do you think?

mtrmac · 2020-03-20T15:09:15Z

Sure, why not. AFAICS docker-archive: (preferably via archive.NewReference) already supports unnamed archives, so this is something to do around https://github.com/containers/libpod/blob/235f367861be6b7f9ca3b4a62c240a03728a7a21/libpod/image/image.go#L1416 .

vrothberg · 2020-03-20T15:11:23Z

@rhatdan, something for interns?

rhatdan · 2020-03-20T15:24:12Z

Sure unless @sujil02 gets to it first.

vrothberg · 2020-03-20T15:26:14Z

🎺 🎺 🎺 🎶 Let the games begin!

github-actions · 2020-04-20T00:04:07Z

A friendly reminder that this issue had no activity for 30 days.

rhatdan · 2020-04-20T13:29:27Z

@sujil02 Did you ever get a chance to look at this?

sujil02 · 2020-04-20T19:18:42Z

@sujil02 Did you ever get a chance to look at this?

Nope didn't get a chance, But I can give it a shot later in the week once v2 system prune I am working on is in.

cdjohnson · 2020-04-27T19:31:57Z

@sujil02 Any updates on a fix for this? This is blocking our ability to use podman with opm.

sujil02 · 2020-04-27T19:33:59Z

@sujil02 Any updates on a fix for this? This is blocking our ability to use podman with opm.

Currently working on this only. PR will be out soon.

sujil02 · 2020-04-28T02:42:34Z

@sujil02 Any updates on a fix for this? This is blocking our ability to use podman with opm.

@cdjohnson issue fixes with #6011

…iners#5234 Adds check to parse normalized name and create docker archive dst reference for tagged untagged image. Relevant test case added. Signed-off-by: Sujil02 <[email protected]>

jeyaramashok · 2020-04-28T21:02:12Z

@sujil02 do you know which release would have this change ? and roughly when that release would be available ?

mheon · 2020-04-28T21:19:03Z

As things stand now, Podman v2.0.0, probably in 4-6 weeks. If this is a critical issue we can consider a backport to the v1.9.x release series.

cdjohnson · 2020-04-28T22:08:44Z

@mheon
Yes, this is a very critical issue for us. Please consider this for 1.9.

FYI: It looks like Podman v2 no longer has Docker CLI compatibility, so we'll likely need to use Podman v1.9 anyway.

jeyaramashok · 2020-04-28T22:10:56Z

yes. It would be great if you can backport this change to 1.9.x, we've been using podman heavily along with opm tool to build catalog images for openshift. we are currently are blocked by this since the tool does a save using digests. Also since 2.0.0 is major version bump, we aren't sure what other changes the version may entail.

I can help with this , if you need.

mheon · 2020-04-28T22:12:41Z

v2 is just under heavy development - it will return to being CLI compatible in a few weeks. We're steadily re-enabling functionality and tests at present.

@sujil02 Mind cherry-picking the fix to the v1.9 branch? I can help you if you're not sure how.

Adds check to parse normalized name and create docker archive dst reference for tagged untagged image. Relevant test case added. Signed-off-by: Sujil02 <[email protected]>

Fixes podman save fails when specifying an image using a digest #5234

lcarva · 2020-04-30T17:13:09Z

In case this is blocking anyone, here's a workaround with skopeo that works for me:

$ podman pull quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f

$ skopeo copy containers-storage:quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f docker-archive:temp.tar

If you're only pulling the image so it can be saved to an archive, then a single command will do it:

$ skopeo copy docker://quay.io/olmtest/single-bundle-index@sha256:dce3d3e858ecfb7f2ddfb0e3550a867faaf39706dfb6da71cab04f909edc428f docker-archive:temp.tar

rhatdan · 2020-04-30T18:05:11Z

@sujil02 Can you back port #6011 to podman 1.9?

mheon · 2020-04-30T18:15:19Z

Already done, AFAIK

sujil02 · 2020-04-30T18:17:34Z

@sujil02 Can you back port #6011 to podman 1.9?

yup already done.
#6032

rhatdan · 2020-04-30T18:42:24Z

#6032
Is a back port of this for podman v1.9.
The fix will show up in podman-1.9.2

jeyaramashok · 2020-05-04T19:05:18Z

@rhatdan just curious, when will v1.9.2 will be released ( approx) ?

rhatdan · 2020-05-04T19:35:56Z

No idea. It is probably best to pester @mheon. We probably could release new minor versions every couple of weeks. We only want tiny changes, since we are concentrating mainly on podman-2.0 right now. But this is going to take a long time to stabilize.

mheon · 2020-05-04T21:44:29Z

Early next week sounds like a reasonable target for a 1.9.2

…iners#5234 Adds check to parse normalized name and create docker archive dst reference for tagged untagged image. Relevant test case added. Signed-off-by: Sujil02 <[email protected]>

openshift-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Feb 17, 2020

vrothberg added kind/feature Categorizes issue or PR as related to a new feature. and removed kind/bug Categorizes issue or PR as related to a bug. labels Feb 18, 2020

github-actions bot added the stale-issue label Mar 20, 2020

rhatdan added Good First Issue This issue would be a good issue for a first time contributor to undertake. and removed stale-issue labels Mar 20, 2020

jdockter mentioned this issue Apr 18, 2020

opm 1.11.1 error - "Error: error getting Docker archive ImageReference docker-archive doesn't support digest references" operator-framework/operator-registry#288

Closed

github-actions bot added the stale-issue label Apr 20, 2020

sujil02 self-assigned this Apr 28, 2020

openshift-merge-robot added a commit that referenced this issue Apr 29, 2020

Merge pull request #6032 from sujil02/v1.9

fb51b3b

Fixes podman save fails when specifying an image using a digest #5234

rhatdan closed this as completed Apr 30, 2020

kevinrizza mentioned this issue Apr 30, 2020

Bug 1829994: Index generate dameonless operator-framework/operator-registry#314

Merged

mprahl mentioned this issue May 27, 2020

non-root opm fails when a layer contains a file owned by root operator-framework/operator-registry#339

Closed

mprahl mentioned this issue Oct 12, 2020

Don't perform index image verification when overwrite_from_index is False release-engineering/iib#166

Merged

mprahl mentioned this issue Oct 27, 2020

Change IIB to use index image specified by digest in its operations release-engineering/iib#181

Merged

github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 23, 2023

github-actions bot locked as resolved and limited conversation to collaborators Sep 23, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

podman save fails when specifying an image using a digest #5234

podman save fails when specifying an image using a digest #5234

mprahl commented Feb 17, 2020

vrothberg commented Feb 18, 2020

mtrmac commented Feb 18, 2020

github-actions bot commented Mar 20, 2020

rhatdan commented Mar 20, 2020

vrothberg commented Mar 20, 2020

mtrmac commented Mar 20, 2020

vrothberg commented Mar 20, 2020

rhatdan commented Mar 20, 2020

vrothberg commented Mar 20, 2020

github-actions bot commented Apr 20, 2020

rhatdan commented Apr 20, 2020

sujil02 commented Apr 20, 2020

cdjohnson commented Apr 27, 2020

sujil02 commented Apr 27, 2020

sujil02 commented Apr 28, 2020

jeyaramashok commented Apr 28, 2020

mheon commented Apr 28, 2020

cdjohnson commented Apr 28, 2020

jeyaramashok commented Apr 28, 2020 •

edited

Loading

mheon commented Apr 28, 2020

lcarva commented Apr 30, 2020

rhatdan commented Apr 30, 2020

mheon commented Apr 30, 2020

sujil02 commented Apr 30, 2020

rhatdan commented Apr 30, 2020

jeyaramashok commented May 4, 2020

rhatdan commented May 4, 2020

mheon commented May 4, 2020

podman save fails when specifying an image using a digest #5234

podman save fails when specifying an image using a digest #5234

Comments

mprahl commented Feb 17, 2020

vrothberg commented Feb 18, 2020

mtrmac commented Feb 18, 2020

github-actions bot commented Mar 20, 2020

rhatdan commented Mar 20, 2020

vrothberg commented Mar 20, 2020

mtrmac commented Mar 20, 2020

vrothberg commented Mar 20, 2020

rhatdan commented Mar 20, 2020

vrothberg commented Mar 20, 2020

github-actions bot commented Apr 20, 2020

rhatdan commented Apr 20, 2020

sujil02 commented Apr 20, 2020

cdjohnson commented Apr 27, 2020

sujil02 commented Apr 27, 2020

sujil02 commented Apr 28, 2020

jeyaramashok commented Apr 28, 2020

mheon commented Apr 28, 2020

cdjohnson commented Apr 28, 2020

jeyaramashok commented Apr 28, 2020 • edited Loading

mheon commented Apr 28, 2020

lcarva commented Apr 30, 2020

rhatdan commented Apr 30, 2020

mheon commented Apr 30, 2020

sujil02 commented Apr 30, 2020

rhatdan commented Apr 30, 2020

jeyaramashok commented May 4, 2020

rhatdan commented May 4, 2020

mheon commented May 4, 2020

jeyaramashok commented Apr 28, 2020 •

edited

Loading