Additional stores configuration to cache images
Hello All, I am following Dan Walsh’s SysAdmin article (https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-bui...) to speed up our CI builds in Jenkins. I am trying to do what’s suggested under “Additional stores”, basically volume mounting the directory where the containerd stores on the K8s host into a container under /var/lib/shared. We are running containerd as the runtime on an EKS cluster. According to the article, I need to do: # mkdir /var/lib/containers4 # podman run -v ./build:/build:z -v /var/lib/containers/storage:/var/lib/shared:ro -v \ /var/lib/containers4:/var/lib/containers:Z quay.io/buildah/stable<http://quay.io/buildah/stable> \ buildah -t image4 bud /build # podman run -v /var/lib/containers/storage:/var/lib/shared:ro \ -v >/var/lib/containers4:/var/lib/containers:Z quay.io/buildah/stable<http://quay.io/buildah/stable> buildah push image4 \ registry.company.com/myuser<http://registry.company.com/myuser> Can someone please tell me the equivalent directory for /var/lib/containers/storage? I.e where does containerd store the download images on the Kubernetes worker nodes? The containerd config looks like this: # cat /etc/containerd/config.toml version = 2 root = "/var/lib/containerd" state = "/run/containerd" [grpc] address = "/run/containerd/containerd.sock" [plugins."io.containerd.grpc.v1.cri".containerd] default_runtime_name = "runc" [plugins."io.containerd.grpc.v1.cri"] sandbox_image = “XXXXXXXX.amazonaws.com/eks/pause:3.5<http://XXXXXXXX.amazonaws.com/eks/pause:3.5>" [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc] runtime_type = "io.containerd.runc.v2" [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options] SystemdCgroup = true [plugins."io.containerd.grpc.v1.cri".cni] bin_dir = "/opt/cni/bin" conf_dir = "/etc/cni/net.d" Thanks in advance. Puvi Ganeshar
Where is this article located? Dewayne On Tue, Sep 27, 2022, 8:17 AM Ganeshar, Puvi <puvi.ganeshar@directv.com> wrote:
Hello All,
I am following Dan Walsh’s SysAdmin article ( https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-bui...) to speed up our CI builds in Jenkins.
I am trying to do what’s suggested under “*Additional stores*”, basically volume mounting the directory where the containerd stores on the K8s host into a container under /var/lib/shared.
We are running containerd as the runtime on an EKS cluster.
According to the article, I need to do:
# mkdir /var/lib/containers4 # podman run -v ./build:/build:z -v* /var/lib/containers/storage*:/var/lib/shared:ro -v \ */var/lib/containers4*:/var/lib/containers:Z quay.io/buildah/stable \ buildah -t image4 bud /build # podman run -v* /var/lib/containers/storage*:/var/lib/shared:ro \ -v >*/var/lib/containers4*:/var/lib/containers:Z quay.io/buildah/stable buildah push image4 \ registry.company.com/myuser
Can someone please tell me the equivalent directory for /var/lib/containers/storage? I.e where does containerd store the download images on the Kubernetes worker nodes? The containerd config looks like this: # cat /etc/containerd/config.toml version = 2 root = "/var/lib/containerd" state = "/run/containerd"
[grpc] address = "/run/containerd/containerd.sock"
[plugins."io.containerd.grpc.v1.cri".containerd] default_runtime_name = "runc"
[plugins."io.containerd.grpc.v1.cri"] sandbox_image = “XXXXXXXX.amazonaws.com/eks/pause:3.5"
[plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc] runtime_type = "io.containerd.runc.v2"
[plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options] SystemdCgroup = true
[plugins."io.containerd.grpc.v1.cri".cni] bin_dir = "/opt/cni/bin" conf_dir = "/etc/cni/net.d"
Thanks in advance.
Puvi Ganeshar
_______________________________________________ Podman mailing list -- podman@lists.podman.io To unsubscribe send an email to podman-leave@lists.podman.io
Hi Dewayne, Here it is: https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-bui... Puvi On Sep 27, 2022, at 7:45 AM, Dewayne Branch <bdbranch@gmail.com<mailto:bdbranch@gmail.com>> wrote: Where is this article located? Dewayne On Tue, Sep 27, 2022, 8:17 AM Ganeshar, Puvi <puvi.ganeshar@directv.com<mailto:puvi.ganeshar@directv.com>> wrote: Hello All, I am following Dan Walsh’s SysAdmin article (https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-buildah-in-a-container#running_buildah_inside_a_container<https://urldefense.com/v3/__https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-buildah-in-a-container*running_buildah_inside_a_container__;Iw!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeIMVLaG-S$>) to speed up our CI builds in Jenkins. I am trying to do what’s suggested under “Additional stores”, basically volume mounting the directory where the containerd stores on the K8s host into a container under /var/lib/shared. We are running containerd as the runtime on an EKS cluster. According to the article, I need to do: # mkdir /var/lib/containers4 # podman run -v ./build:/build:z -v /var/lib/containers/storage:/var/lib/shared:ro -v \ /var/lib/containers4:/var/lib/containers:Z quay.io/buildah/stable<https://urldefense.com/v3/__http://quay.io/buildah/stable__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeICSrIaux$> \ buildah -t image4 bud /build # podman run -v /var/lib/containers/storage:/var/lib/shared:ro \ -v >/var/lib/containers4:/var/lib/containers:Z quay.io/buildah/stable<https://urldefense.com/v3/__http://quay.io/buildah/stable__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeICSrIaux$> buildah push image4 \ registry.company.com/myuser<https://urldefense.com/v3/__http://registry.company.com/myuser__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeIAIdGFsZ$> Can someone please tell me the equivalent directory for /var/lib/containers/storage? I.e where does containerd store the download images on the Kubernetes worker nodes? The containerd config looks like this: # cat /etc/containerd/config.toml version = 2 root = "/var/lib/containerd" state = "/run/containerd" [grpc] address = "/run/containerd/containerd.sock" [plugins."io.containerd.grpc.v1.cri".containerd] default_runtime_name = "runc" [plugins."io.containerd.grpc.v1.cri"] sandbox_image = “XXXXXXXX.amazonaws.com/eks/pause:3.5<https://urldefense.com/v3/__http://XXXXXXXX.amazonaws.com/eks/pause:3.5__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeIBt1u4hu$>" [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc] runtime_type = "io.containerd.runc.v2" [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options] SystemdCgroup = true [plugins."io.containerd.grpc.v1.cri".cni] bin_dir = "/opt/cni/bin" conf_dir = "/etc/cni/net.d" Thanks in advance. Puvi Ganeshar _______________________________________________ Podman mailing list -- podman@lists.podman.io<mailto:podman@lists.podman.io> To unsubscribe send an email to podman-leave@lists.podman.io<mailto:podman-leave@lists.podman.io>
Adding Aditya who has some steps that can help here. On Tue, Sep 27, 2022 at 9:49 AM Ganeshar, Puvi <puvi.ganeshar@directv.com> wrote:
Hi Dewayne,
Here it is: https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-bui...
Puvi
On Sep 27, 2022, at 7:45 AM, Dewayne Branch <bdbranch@gmail.com> wrote:
Where is this article located? Dewayne
On Tue, Sep 27, 2022, 8:17 AM Ganeshar, Puvi <puvi.ganeshar@directv.com> wrote:
Hello All,
I am following Dan Walsh’s SysAdmin article ( https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-bui... <https://urldefense.com/v3/__https://developers.redhat.com/blog/2019/08/14/best-practices-for-running-buildah-in-a-container*running_buildah_inside_a_container__;Iw!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeIMVLaG-S$>) to speed up our CI builds in Jenkins.
I am trying to do what’s suggested under “*Additional stores*”, basically volume mounting the directory where the containerd stores on the K8s host into a container under /var/lib/shared.
We are running containerd as the runtime on an EKS cluster.
According to the article, I need to do:
# mkdir /var/lib/containers4 # podman run -v ./build:/build:z -v* /var/lib/containers/storage*:/var/lib/shared:ro -v \ */var/lib/containers4*:/var/lib/containers:Z quay.io/buildah/stable <https://urldefense.com/v3/__http://quay.io/buildah/stable__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeICSrIaux$> \ buildah -t image4 bud /build # podman run -v* /var/lib/containers/storage*:/var/lib/shared:ro \ -v >*/var/lib/containers4*:/var/lib/containers:Z quay.io/buildah/stable <https://urldefense.com/v3/__http://quay.io/buildah/stable__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeICSrIaux$> buildah push image4 \ registry.company.com/myuser <https://urldefense.com/v3/__http://registry.company.com/myuser__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeIAIdGFsZ$>
Can someone please tell me the equivalent directory for /var/lib/containers/storage? I.e where does containerd store the download images on the Kubernetes worker nodes? The containerd config looks like this: # cat /etc/containerd/config.toml version = 2 root = "/var/lib/containerd" state = "/run/containerd"
[grpc] address = "/run/containerd/containerd.sock"
[plugins."io.containerd.grpc.v1.cri".containerd] default_runtime_name = "runc"
[plugins."io.containerd.grpc.v1.cri"] sandbox_image = “XXXXXXXX.amazonaws.com/eks/pause:3.5 <https://urldefense.com/v3/__http://XXXXXXXX.amazonaws.com/eks/pause:3.5__;!!BhdT!h9g4s0DDgYAzE8q8LUDmALE2RGAfjcgIs5B37u3D1DZkJOdzRRskeYxKus4g6nVhV0yRHRNPKdBeIBt1u4hu$> "
[plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc] runtime_type = "io.containerd.runc.v2"
[plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options] SystemdCgroup = true
[plugins."io.containerd.grpc.v1.cri".cni] bin_dir = "/opt/cni/bin" conf_dir = "/etc/cni/net.d"
Thanks in advance.
Puvi Ganeshar
_______________________________________________ Podman mailing list -- podman@lists.podman.io To unsubscribe send an email to podman-leave@lists.podman.io
_______________________________________________ Podman mailing list -- podman@lists.podman.io To unsubscribe send an email to podman-leave@lists.podman.io
-- Urvashi Mohnani Senior Software Engineer, OpenShift Runtimes Red Hat <https://www.redhat.com> umohnani@redhat.com <https://www.redhat.com>
? 1) How different is rocky 8 containers from red hat containers? 2) if https://github.com/OPENDAP/hyrax uses docker then podman should work correct? 3) on these chainguard containers... https://www.zdnet.com/article/chainguard -releases-wolfi-a-linux-undistribution/ 4) what is the fastest roadmap for me to master containers? is this a future all containers will attempt? Thanks, Dewayne
participants (3)
-
Dewayne Branch -
Ganeshar, Puvi -
Urvashi Mohnani