stevenstetzler
commented
4 years ago I think I found a hint toward the issue by doing a diff on the container inspect outputs. It looks like the PATH environment variable gets messed up in container creation:
For the Python API created container (incorrect PATH):
"Env": [
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin",
"TERM=xterm",
"HOSTNAME=a07d93be42c8",
"LANGUAGE=en_US.UTF-8",
"CONDA_VERSION=4.8.3",
"NB_USER=jovyan",
"MINICONDA_VERSION=4.8.3",
"SHELL=/bin/bash",
"LC_ALL=en_US.UTF-8",
"container=podman",
"NB_GID=100",
"LANG=en_US.UTF-8",
"DEBIAN_FRONTEND=noninteractive",
"HOME=/home/jovyan",
"NB_UID=1000",
"CONDA_DIR=/opt/conda",
"MINICONDA_MD5=d63adf39f2c220950a063e0529d4ff74"
],and for the CLI created container (correct PATH):
"Env": [
"PATH=/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
"TERM=xterm",
"CONDA_VERSION=4.8.3",
"LC_ALL=en_US.UTF-8",
"LANG=en_US.UTF-8",
"CONDA_DIR=/opt/conda",
"NB_GID=100",
"NB_USER=jovyan",
"DEBIAN_FRONTEND=noninteractive",
"MINICONDA_VERSION=4.8.3",
"container=podman",
"LANGUAGE=en_US.UTF-8",
"MINICONDA_MD5=d63adf39f2c220950a063e0529d4ff74",
"NB_UID=1000",
"SHELL=/bin/bash",
"HOME=/home/jovyan",
"HOSTNAME="
],This is a bit confusing as it seems to me that the PATH is being taken correctly from the image before creation: https://github.com/containers/python-podman/blob/master/podman/libs/images.py#L44-L48 in the Python API, and I can see from the log output that the config sent to the varlink and go APIs appears correct: (from above)
DEBUG:root:Image f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19: create config: {'image_id': 'f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19', 'command': ['start-notebook.sh'], 'env': {'PATH': '/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', 'DEBIAN_FRONTEND': 'noninteractive', 'CONDA_DIR': '/opt/conda', 'SHELL': '/bin/bash', 'NB_USER': 'jovyan', 'NB_UID': '1000', 'NB_GID': '100', 'LC_ALL': 'en_US.UTF-8', 'LANG': 'en_US.UTF-8', 'LANGUAGE': 'en_US.UTF-8', 'HOME': '/home/jovyan', 'MINICONDA_VERSION': '4.8.3', 'MINICONDA_MD5': 'd63adf39f2c220950a063e0529d4ff74', 'CONDA_VERSION': '4.8.3'}, 'image': 'docker.io/jupyterhub/singleuser:latest', 'labels': {'maintainer': 'Jupyter Project <jupyter@googlegroups.com>'}, 'net_mode': 'bridge', 'network': 'bridge', 'args': ['docker.io/jupyterhub/singleuser:latest', 'start-notebook.sh']}I can actually fix the issue by setting the env keyword during container creation to something new, which overrides the default set by the Python API:
# up log level
import logging
logging.getLogger().setLevel(logging.DEBUG)
# action
import podman
with podman.Client() as client:
image_id = client.images.pull("jupyterhub/singleuser:latest")
image = client.images.get(image_id)
container = image.create(
env={
"FOO": "BAR"
}
)
print(container.inspect().config.get("env"))
container.start()produces
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da2c44828>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da2c44828>
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da264d3c8>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da264d3c8>
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da25a7748>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da25a7748>
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da26244e0>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da26244e0>
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da263a898>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da263a898>
DEBUG:root:Image f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19: create config: {'image_id': 'f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19', 'env': {'FOO': 'BAR'}, 'command': ['start-notebook.sh'], 'image': 'docker.io/jupyterhub/singleuser:latest', 'labels': {'maintainer': 'Jupyter Project <jupyter@googlegroups.com>'}, 'net_mode': 'bridge', 'network': 'bridge', 'args': ['docker.io/jupyterhub/singleuser:latest', 'start-notebook.sh']}
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da24f4d68>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da24f4d68>
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da2455cc0>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da2455cc0>
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da2455518>
DEBUG:root:LocalClient closed varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da2455518>
['PATH=/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', 'TERM=xterm', 'HOSTNAME=', 'SHELL=/bin/bash', 'CONDA_VERSION=4.8.3', 'container=podman', 'DEBIAN_FRONTEND=noninteractive', 'LANGUAGE=en_US.UTF-8', 'LC_ALL=en_US.UTF-8', 'MINICONDA_VERSION=4.8.3', 'MINICONDA_MD5=d63adf39f2c220950a063e0529d4ff74', 'LANG=en_US.UTF-8', 'HOME=/home/jovyan', 'CONDA_DIR=/opt/conda', 'NB_USER=jovyan', 'NB_UID=1000', 'NB_GID=100']
DEBUG:root:LocalClient opened varlink connection <varlink.client.SimpleClientInterfaceHandler object at 0x7f5da25c97f0>
DEBUG:root:Starting Container "79912b88ed238ade23bd67d806fe7591547cb0ab26acdb3ccbaaba3da6adcdf2"
DEBUG:root:Started Container "79912b88ed238ade23bd67d806fe7591547cb0ab26acdb3ccbaaba3da6adcdf2"and creates the container successfully. I print out the environment from the Container inspect in the output above and see that the PATH is set correctly using the image defaults. However, the FOO=BAR environment variable is not set in the container. I think the PATH gets set from the image in the go API: ParseCreateOpts (https://github.com/containers/podman/blob/v2.0.6/pkg/varlinkapi/create.go#L504-L556) called by CreateContainer (https://github.com/containers/podman/blob/v2.0.6/pkg/varlinkapi/create.go#L184).
Is this a problem of the communication between the Python API and the Varlink API?
I am trying to start a container using the python API from this repo:
this throws an error, claims that the entrypoint command
tinican't be found in the container:I can get the container to start just fine if I use the CLI:
is succesful.
I tried using a different image, and it works fine:
I then tried doing a mix: creating the container with the CLI:
which returns a container id
<container-id>, and then using the Python API to start it:which is successful
Additionally, I can go the other way: create the container with the Python API
which outputs
<container-id>, and I can use the CLI to start it:which gives an error:
This tells me that there's something going wrong with how this particular image is being created as a container using the Python API.
Here's the inspect information for the image:
Image Inspect
``` $ podman image inspect jupyterhub/singleuser:latest [ { "Id": "f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19", "Digest": "sha256:e65267c652a3dea035c25bdc93d179788a61c233a662f9a5366b4142e46a7b5d", "RepoTags": [ "docker.io/jupyterhub/singleuser:latest" ], "RepoDigests": [ "docker.io/jupyterhub/singleuser@sha256:e65267c652a3dea035c25bdc93d179788a61c233a662f9a5366b4142e46a7b5d" ], "Parent": "", "Comment": "", "Created": "2020-07-31T10:22:38.17249833Z", "Config": { "User": "1000", "ExposedPorts": { "8888/tcp": {} }, "Env": [ "PATH=/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "DEBIAN_FRONTEND=noninteractive", "CONDA_DIR=/opt/conda", "SHELL=/bin/bash", "NB_USER=jovyan", "NB_UID=1000", "NB_GID=100", "LC_ALL=en_US.UTF-8", "LANG=en_US.UTF-8", "LANGUAGE=en_US.UTF-8", "HOME=/home/jovyan", "MINICONDA_VERSION=4.8.3", "MINICONDA_MD5=d63adf39f2c220950a063e0529d4ff74", "CONDA_VERSION=4.8.3" ], "Entrypoint": [ "tini", "-g", "--" ], "Cmd": [ "start-notebook.sh" ], "WorkingDir": "/home/jovyan", "Labels": { "maintainer": "Jupyter Projectand the container inspect for the container made with the Python API:
Python API Container Inspect
``` $ podman container inspect a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604 [ { "Id": "a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604", "Created": "2020-09-08T05:54:57.063997704Z", "Path": "tini", "Args": [ "-g", "--", "start-notebook.sh" ], "State": { "OciVersion": "1.0.2-dev", "Status": "configured", "Running": false, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 0, "ExitCode": 0, "Error": "", "StartedAt": "0001-01-01T00:00:00Z", "FinishedAt": "0001-01-01T00:00:00Z", "Healthcheck": { "Status": "", "FailingStreak": 0, "Log": null } }, "Image": "f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19", "ImageName": "docker.io/jupyterhub/singleuser:latest", "Rootfs": "", "Pod": "", "ResolvConfPath": "/var/run/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata/resolv.conf", "HostnamePath": "/var/run/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata/hostname", "HostsPath": "/var/run/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata/hosts", "StaticDir": "/var/lib/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata", "OCIConfigPath": "/var/lib/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata/config.json", "OCIRuntime": "runc", "LogPath": "/var/lib/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata/ctr.log", "LogTag": "", "ConmonPidFile": "/var/run/containers/storage/overlay-containers/a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604/userdata/conmon.pid", "Name": "stupefied_napier", "RestartCount": 0, "Driver": "overlay", "MountLabel": "system_u:object_r:container_file_t:s0:c63,c267", "ProcessLabel": "system_u:system_r:container_t:s0:c63,c267", "AppArmorProfile": "", "EffectiveCaps": null, "BoundingCaps": [ "CAP_AUDIT_WRITE", "CAP_CHOWN", "CAP_DAC_OVERRIDE", "CAP_FOWNER", "CAP_FSETID", "CAP_KILL", "CAP_MKNOD", "CAP_NET_BIND_SERVICE", "CAP_NET_RAW", "CAP_SETFCAP", "CAP_SETGID", "CAP_SETPCAP", "CAP_SETUID", "CAP_SYS_CHROOT" ], "ExecIDs": [], "GraphDriver": { "Name": "overlay", "Data": { "LowerDir": "/var/lib/containers/storage/overlay/1b89d8d85ea7f40093b690a78a0fa19d028418f41c0bfb3660fdba9ccfe5e3cc/diff:/var/lib/containers/storage/overlay/6e97361a4c0f6238f3f847bbbd84e476f3d12db6a75d524cdaa9c9d3b7641b1c/diff:/var/lib/containers/storage/overlay/1a759e27e0fc9122830680f71fe9c6dc71570dadd84e65bc08a2643eff87eadf/diff:/var/lib/containers/storage/overlay/333ffdfeeda6f14ab81ec3159f26c42f5c8514bc943b684c90ed98adef0d3dca/diff:/var/lib/containers/storage/overlay/f8c412df741909af0a20553b43c0a3895cee40317fc812f44572c9f04eaa66f2/diff:/var/lib/containers/storage/overlay/618a3af6a816f4d7fe48810ce798dd43e1277c39d85c8fa3144f20e6ccaa6193/diff:/var/lib/containers/storage/overlay/e74ffc54c99cd259134e36b203c6ab005df0bfd03efb68b5e1404071b6f1fc7d/diff:/var/lib/containers/storage/overlay/1ea64673d3aed0ab4c524a06f66b12275ea9e811d83763cedcf87a643d10b2a9/diff:/var/lib/containers/storage/overlay/47d3ba77a6da5e64f5dd3f3103729c41d4ea28dd3acf4eda6aa3deabc0a6ba3e/diff:/var/lib/containers/storage/overlay/0f13289ee6047a0af2c2da72fde4b07dde2760c6bd5ffbfdff50d18964a9f3e4/diff:/var/lib/containers/storage/overlay/103b666a8482eebcd34b088eea2b8955bfdca9280b4b802c15b1a06bf72bfc9e/diff:/var/lib/containers/storage/overlay/a365215521412762b731791a4e98169577428f319cadbbaca54c6b2d857cb37f/diff:/var/lib/containers/storage/overlay/626699adc61f1d9a01899423de78c7b875d9f4fa8c156d78cca37a1e8586458e/diff:/var/lib/containers/storage/overlay/7ee3433ebdb9fcfd9e1921e98ce740895e4f7fe0d23a4ce0e7a8ad2cc898f07f/diff:/var/lib/containers/storage/overlay/c5914a774f598d300553acb5dc31da85e04f813cfab7744db900e94c289d1af2/diff:/var/lib/containers/storage/overlay/60a71c5e6c29304f84beb1a85400368c5646b0b0e01c5a10ff50f7693fe60ffa/diff:/var/lib/containers/storage/overlay/3f9c2b6d8dddbad5d70cc4ccdcb4f6f68c1b65f6718dd3efac794a5035d64183/diff:/var/lib/containers/storage/overlay/df1094fb82405e981824e9705aca12f396d8175c0bd0fd6bb97c7a4f49d1ec88/diff:/var/lib/containers/storage/overlay/d22cfd6a8b16689838c570b91794ed18acc752a08a10bce891cc64acc1533b3f/diff", "UpperDir": "/var/lib/containers/storage/overlay/81261f5e99a1a46fa7717881d1c44fb72e388bbd2a4a4fde0bf8f72755d2629b/diff", "WorkDir": "/var/lib/containers/storage/overlay/81261f5e99a1a46fa7717881d1c44fb72e388bbd2a4a4fde0bf8f72755d2629b/work" } }, "Mounts": [], "Dependencies": [], "NetworkSettings": { "EndpointID": "", "Gateway": "", "IPAddress": "", "IPPrefixLen": 0, "IPv6Gateway": "", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "MacAddress": "", "Bridge": "", "SandboxID": "", "HairpinMode": false, "LinkLocalIPv6Address": "", "LinkLocalIPv6PrefixLen": 0, "Ports": {}, "SandboxKey": "" }, "ExitCommand": [ "/usr/bin/podman", "--root", "/var/lib/containers/storage", "--runroot", "/var/run/containers/storage", "--log-level", "error", "--cgroup-manager", "systemd", "--tmpdir", "/var/run/libpod", "--runtime", "runc", "--storage-driver", "overlay", "--events-backend", "file", "container", "cleanup", "a07d93be42c8c13e39b4185c1fb16c9677b3f99da1c15c15728348085998d604" ], "Namespace": "", "IsInfra": false, "Config": { "Hostname": "a07d93be42c8", "Domainname": "", "User": "1000", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin", "TERM=xterm", "HOSTNAME=a07d93be42c8", "LANGUAGE=en_US.UTF-8", "CONDA_VERSION=4.8.3", "NB_USER=jovyan", "MINICONDA_VERSION=4.8.3", "SHELL=/bin/bash", "LC_ALL=en_US.UTF-8", "container=podman", "NB_GID=100", "LANG=en_US.UTF-8", "DEBIAN_FRONTEND=noninteractive", "HOME=/home/jovyan", "NB_UID=1000", "CONDA_DIR=/opt/conda", "MINICONDA_MD5=d63adf39f2c220950a063e0529d4ff74" ], "Cmd": [ "start-notebook.sh" ], "Image": "docker.io/jupyterhub/singleuser:latest", "Volumes": null, "WorkingDir": "/home/jovyan", "Entrypoint": "tini -g --", "OnBuild": null, "Labels": { "maintainer": "Jupyter Projectand by the CLI:
CLI Container Inspect
``` $ podman container inspect daaa730a2b97ca9f7bcc586812726b30bb88c81fcfa7d7ebaa9c62d13c140475 [ { "Id": "daaa730a2b97ca9f7bcc586812726b30bb88c81fcfa7d7ebaa9c62d13c140475", "Created": "2020-09-08T06:01:22.73682913Z", "Path": "tini", "Args": [ "-g", "--", "start-notebook.sh" ], "State": { "OciVersion": "1.0.2-dev", "Status": "configured", "Running": false, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 0, "ExitCode": 0, "Error": "", "StartedAt": "0001-01-01T00:00:00Z", "FinishedAt": "0001-01-01T00:00:00Z", "Healthcheck": { "Status": "", "FailingStreak": 0, "Log": null } }, "Image": "f98c2844eec476cbb932cb58def069bcd5cff8f674978881fc055bcf0693ec19", "ImageName": "docker.io/jupyterhub/singleuser:latest", "Rootfs": "", "Pod": "", "ResolvConfPath": "", "HostnamePath": "", "HostsPath": "", "StaticDir": "/var/lib/containers/storage/overlay-containers/daaa730a2b97ca9f7bcc586812726b30bb88c81fcfa7d7ebaa9c62d13c140475/userdata", "OCIRuntime": "runc", "LogPath": "/var/lib/containers/storage/overlay-containers/daaa730a2b97ca9f7bcc586812726b30bb88c81fcfa7d7ebaa9c62d13c140475/userdata/ctr.log", "LogTag": "", "ConmonPidFile": "/var/run/containers/storage/overlay-containers/daaa730a2b97ca9f7bcc586812726b30bb88c81fcfa7d7ebaa9c62d13c140475/userdata/conmon.pid", "Name": "zealous_shaw", "RestartCount": 0, "Driver": "overlay", "MountLabel": "system_u:object_r:container_file_t:s0:c468,c770", "ProcessLabel": "system_u:system_r:container_t:s0:c468,c770", "AppArmorProfile": "", "EffectiveCaps": null, "BoundingCaps": [ "CAP_AUDIT_WRITE", "CAP_CHOWN", "CAP_DAC_OVERRIDE", "CAP_FOWNER", "CAP_FSETID", "CAP_KILL", "CAP_MKNOD", "CAP_NET_BIND_SERVICE", "CAP_NET_RAW", "CAP_SETFCAP", "CAP_SETGID", "CAP_SETPCAP", "CAP_SETUID", "CAP_SYS_CHROOT" ], "ExecIDs": [], "GraphDriver": { "Name": "overlay", "Data": { "LowerDir": "/var/lib/containers/storage/overlay/1b89d8d85ea7f40093b690a78a0fa19d028418f41c0bfb3660fdba9ccfe5e3cc/diff:/var/lib/containers/storage/overlay/6e97361a4c0f6238f3f847bbbd84e476f3d12db6a75d524cdaa9c9d3b7641b1c/diff:/var/lib/containers/storage/overlay/1a759e27e0fc9122830680f71fe9c6dc71570dadd84e65bc08a2643eff87eadf/diff:/var/lib/containers/storage/overlay/333ffdfeeda6f14ab81ec3159f26c42f5c8514bc943b684c90ed98adef0d3dca/diff:/var/lib/containers/storage/overlay/f8c412df741909af0a20553b43c0a3895cee40317fc812f44572c9f04eaa66f2/diff:/var/lib/containers/storage/overlay/618a3af6a816f4d7fe48810ce798dd43e1277c39d85c8fa3144f20e6ccaa6193/diff:/var/lib/containers/storage/overlay/e74ffc54c99cd259134e36b203c6ab005df0bfd03efb68b5e1404071b6f1fc7d/diff:/var/lib/containers/storage/overlay/1ea64673d3aed0ab4c524a06f66b12275ea9e811d83763cedcf87a643d10b2a9/diff:/var/lib/containers/storage/overlay/47d3ba77a6da5e64f5dd3f3103729c41d4ea28dd3acf4eda6aa3deabc0a6ba3e/diff:/var/lib/containers/storage/overlay/0f13289ee6047a0af2c2da72fde4b07dde2760c6bd5ffbfdff50d18964a9f3e4/diff:/var/lib/containers/storage/overlay/103b666a8482eebcd34b088eea2b8955bfdca9280b4b802c15b1a06bf72bfc9e/diff:/var/lib/containers/storage/overlay/a365215521412762b731791a4e98169577428f319cadbbaca54c6b2d857cb37f/diff:/var/lib/containers/storage/overlay/626699adc61f1d9a01899423de78c7b875d9f4fa8c156d78cca37a1e8586458e/diff:/var/lib/containers/storage/overlay/7ee3433ebdb9fcfd9e1921e98ce740895e4f7fe0d23a4ce0e7a8ad2cc898f07f/diff:/var/lib/containers/storage/overlay/c5914a774f598d300553acb5dc31da85e04f813cfab7744db900e94c289d1af2/diff:/var/lib/containers/storage/overlay/60a71c5e6c29304f84beb1a85400368c5646b0b0e01c5a10ff50f7693fe60ffa/diff:/var/lib/containers/storage/overlay/3f9c2b6d8dddbad5d70cc4ccdcb4f6f68c1b65f6718dd3efac794a5035d64183/diff:/var/lib/containers/storage/overlay/df1094fb82405e981824e9705aca12f396d8175c0bd0fd6bb97c7a4f49d1ec88/diff:/var/lib/containers/storage/overlay/d22cfd6a8b16689838c570b91794ed18acc752a08a10bce891cc64acc1533b3f/diff", "UpperDir": "/var/lib/containers/storage/overlay/dfc8276bb474890bb1b1befbb8c9e5503a1544b193325fb64a3927d6f33fce90/diff", "WorkDir": "/var/lib/containers/storage/overlay/dfc8276bb474890bb1b1befbb8c9e5503a1544b193325fb64a3927d6f33fce90/work" } }, "Mounts": [], "Dependencies": [], "NetworkSettings": { "EndpointID": "", "Gateway": "", "IPAddress": "", "IPPrefixLen": 0, "IPv6Gateway": "", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "MacAddress": "", "Bridge": "", "SandboxID": "", "HairpinMode": false, "LinkLocalIPv6Address": "", "LinkLocalIPv6PrefixLen": 0, "Ports": {}, "SandboxKey": "" }, "ExitCommand": [ "/usr/bin/podman", "--root", "/var/lib/containers/storage", "--runroot", "/var/run/containers/storage", "--log-level", "error", "--cgroup-manager", "systemd", "--tmpdir", "/var/run/libpod", "--runtime", "runc", "--storage-driver", "overlay", "--events-backend", "file", "container", "cleanup", "daaa730a2b97ca9f7bcc586812726b30bb88c81fcfa7d7ebaa9c62d13c140475" ], "Namespace": "", "IsInfra": false, "Config": { "Hostname": "daaa730a2b97", "Domainname": "", "User": "1000", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "TERM=xterm", "CONDA_VERSION=4.8.3", "LC_ALL=en_US.UTF-8", "LANG=en_US.UTF-8", "CONDA_DIR=/opt/conda", "NB_GID=100", "NB_USER=jovyan", "DEBIAN_FRONTEND=noninteractive", "MINICONDA_VERSION=4.8.3", "container=podman", "LANGUAGE=en_US.UTF-8", "MINICONDA_MD5=d63adf39f2c220950a063e0529d4ff74", "NB_UID=1000", "SHELL=/bin/bash", "HOME=/home/jovyan", "HOSTNAME=" ], "Cmd": [ "start-notebook.sh" ], "Image": "docker.io/jupyterhub/singleuser:latest", "Volumes": null, "WorkingDir": "/home/jovyan", "Entrypoint": "tini -g --", "OnBuild": null, "Labels": { "maintainer": "Jupyter ProjectAnd here is system/version info:
I was previously running
podmanversion1.6.4, from the default Centos repositories, paired with the defaultpython-podmanversion from the PyPi repository, but I was experiencing the same behavior before and after both upgrades.I've read elsewhere that this might have to do with the container's file system not mounting correctly? Perhaps there is also something simple I am missing in how to use the Python API. Any help is appreciated!