OCI runtime create failed: runsc did not terminate successfully (unable to retrieve OCI runtime error: open /run/containerd/io.containerd.runtime.v2.task/k8s.io/xxx/log.json: no such file or directory): unknown

[PSKP-95]

Description

Trying to run gvisor sandbox using contained. Following documentation https://gvisor.dev/docs/user_guide/containerd/quick_start/. All commands and example are from this doc.

Working fine with runc

Not working fine with runsc

Checked permissions & looks fine

Cgroup v1 and v2 available

Here are logs found for containerd service

Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.523809475Z" level=info msg="starting containerd" revision=7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c version=v1.7.22
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.542335577Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544111060Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/6.1.109-118.189.amzn2023.x86_64\\n\"): skip plugin" type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544136396Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544153626Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544183935Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544194974Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544221615Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544232055Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544352137Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (xfs) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544374161Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544396235Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." error="devmapper not configured: skip plugin" type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544409218Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544434243Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544692448Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544939463Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.544969575Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545011561Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545047127Z" level=info msg="metadata content store policy set" policy=shared
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545514871Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545587393Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545607769Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545631003Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545823961Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.545907867Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546131540Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546285047Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546302370Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546316185Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546328483Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546340522Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546351266Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546367133Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546379305Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546390658Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546401754Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546411780Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546432816Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546443787Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546454668Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546466049Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546476446Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546490293Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546500053Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546511156Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546522576Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546535264Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546545065Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546554694Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546564874Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546575757Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546607167Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546623625Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546632902Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546680848Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546703409Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546715067Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546728237Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546738252Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546754840Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546788166Z" level=info msg="NRI interface is disabled by configuration."
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.546801825Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547190726Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:runc DefaultRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} UntrustedWorkloadRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} Runtimes:map[nvidia:{Type:io.containerd.runc.v2 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[BinaryName:/usr/bin/nvidia-container-runtime CriuImagePath: CriuPath: CriuWorkPath: IoGid:0 IoUid:0 NoNewKeyring:false NoPivotRoot:false Root: ShimCgroup: SystemdCgroup:false] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox} runc:{Type:io.containerd.runc.v2 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[BinaryName: CriuImagePath: CriuPath: CriuWorkPath: IoGid:0 IoUid:0 NoNewKeyring:false NoPivotRoot:false Root: ShimCgroup: SystemdCgroup:false] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox} runsc:{Type:io.containerd.runsc.v1 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[ConfigPath:/etc/containerd/runsc.toml TypeUrl:io.containerd.runsc.v1.options] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false IgnoreBlockIONotEnabledErrors:false IgnoreRdtNotEnabledErrors:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPluginConfDir:/etc/cni/net.d NetworkPluginMaxConfNum:1 NetworkPluginSetupSerially:false NetworkPluginConfTemplate: IPPreference:} Registry:{ConfigPath: Mirrors:map[] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:node} DisableTCPService:true StreamServerAddress:127.0.0.1 StreamServerPort:0 StreamIdleTimeout:4h0m0s EnableSelinux:false SelinuxCategoryRange:1024 SandboxImage:registry.k8s.io/pause:3.8 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true DeviceOwnershipFromSecurityContext:false IgnoreImageDefinedVolumes:false NetNSMountsUnderStateDir:false EnableUnprivilegedPorts:false EnableUnprivilegedICMP:false EnableCDI:false CDISpecDirs:[/etc/cdi /var/run/cdi] ImagePullProgressTimeout:5m0s DrainExecSyncIOTimeout:0s ImagePullWithSyncFs:false IgnoreDeprecationWarnings:[]} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547242008Z" level=info msg="Connect containerd service"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547268436Z" level=info msg="using legacy CRI server"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547274427Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547354369Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\""
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547842975Z" level=info msg="Start subscribing containerd event"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.547888620Z" level=info msg="Start recovering state"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.548208857Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.548261455Z" level=info msg=serving... address=/run/containerd/containerd.sock
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.561008002Z" level=info msg="Start event monitor"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.561034282Z" level=info msg="Start snapshots syncer"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.561047804Z" level=info msg="Start cni network conf syncer for default"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.561057732Z" level=info msg="Start streaming server"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:40.561119610Z" level=info msg="containerd successfully booted in 0.039367s"
Oct 04 10:59:40 ip-172-21-148-200.eu-central-1.compute.internal systemd[1]: Started containerd.service - containerd container runtime.
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.639048623Z" level=warning msg="CRI API v1alpha2 is deprecated since containerd v1.7 and removed in containerd v2.0. Use CRI API v1 instead."
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.639103692Z" level=info msg="RunPodSandbox for name:\"nginx-2sandbox\"  uid:\"hdishd73djaidwnduwk28bcsb\"  namespace:\"default\"  attempt:1"
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.782684927Z" level=info msg="starting signal loop" namespace=k8s.io path=/run/containerd/io.containerd.runtime.v2.task/k8s.io/0c073186aedf42fb5699e84ff1907f5849862e76b81b42ba719102e75e9d51d3 pid=18793
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.876587670Z" level=info msg="shim disconnected" id=0c073186aedf42fb5699e84ff1907f5849862e76b81b42ba719102e75e9d51d3 namespace=k8s.io
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.876626096Z" level=warning msg="cleaning up after shim disconnected" id=0c073186aedf42fb5699e84ff1907f5849862e76b81b42ba719102e75e9d51d3 namespace=k8s.io
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.876638831Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.954260006Z" level=warning msg="cleanup warnings time=\"2024-10-04T10:59:53Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=18839\n" namespace=k8s.io
Oct 04 10:59:53 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:53.954676896Z" level=error msg="copy shim log" error="read /proc/self/fd/13: file already closed" namespace=k8s.io
Oct 04 10:59:54 ip-172-21-148-200.eu-central-1.compute.internal containerd[18660]: time="2024-10-04T10:59:54.325202513Z" level=error msg="RunPodSandbox for name:\"nginx-2sandbox\"  uid:\"hdishd73djaidwnduwk28bcsb\"  namespace:\"default\"  attempt:1 failed, error" error="failed to create containerd task: failed to create shim task: OCI runtime create failed: runsc did not terminate successfully (unable to retrieve OCI runtime error: open /run/containerd/io.containerd.runtime.v2.task/k8s.io/0c073186aedf42fb5699e84ff1907f5849862e76b81b42ba719102e75e9d51d3/log.json: no such file or directory): unknown"

Steps to reproduce

• Install containerd using https://github.com/containerd/containerd/blob/main/docs/getting-started.md
• install gvisor using https://gvisor.dev/docs/user_guide/install/
• configure containerd https://gvisor.dev/docs/user_guide/containerd/quick_start/
• Try to run sandboxed pod using above quick start.

runsc version

runsc version release-20240826.0
spec: 1.1.0-rc.1

docker version (if using docker)

No response

uname

Linux ip-172-21-148-200.eu-central-1.compute.internal 6.1.109-118.189.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Sep 10 08:59:12 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

kubectl (if using Kubernetes)

No response

repo state (if built from source)

No response

runsc debug logs (if available)

No response

[PSKP-95]

My configuration was wrong in runsc.toml. Instead of network = "host" it was "key" = "value".