test cvmfs image on nurion

slowmoyang commented 4 months ago

test cvmfs image on nurion for sample generation

https://cvmfs.readthedocs.io/en/2.8/cpt-containers.html

jhgoh commented 4 months ago

information to pull cmssw image https://awesome-workshop.github.io/docker-cms/05-singularity/index.html

slowmoyang commented 3 months ago

https://docs-ksc.gitbook.io/nurion-user-guide/undefined-2/appendix-3-how-to-use-singularity-container

slowmoyang commented 3 months ago

I requested fakeroot on nurion

slowmoyang commented 3 months ago

I failed to build an image from docker hub and am waiting for the reply from admin. FYI, nurion guibuilding ubuntu image from docker hub

> whoami
x2718a04

> pwd
/scratch/x2718a04/work/test-singulairty

> module list
Currently Loaded Modulefiles:
  1) craype-network-opa   2) gcc/8.3.0            3) git/2.35.1           4) singularity/3.9.7

> singularity build --fakeroot mg5.sif docker://scailfin/madgraph5-amc-nlo:mg5_amc3.5.1
INFO:    Starting build...
Getting image source signatures
Copying blob 428bad6fa242 skipped: already exists  
Copying blob 10af454068ac skipped: already exists  
Copying blob 7d676dc8a994 skipped: already exists  
Copying blob 63cd35141f3a skipped: already exists  
Copying blob 14726c8f7834 skipped: already exists  
Copying blob 03bdd165d0d2 skipped: already exists  
Copying blob 733edd70d78e skipped: already exists  
Copying blob 8f0f476fac94 skipped: already exists  
Copying blob 4f4fb700ef54 skipped: already exists  
Copying blob 98cb6b640f1e skipped: already exists  
Copying blob 81518f7010ce skipped: already exists  
Copying config 2617bc8ea0 done  
Writing manifest to image destination
Storing signatures
2024/05/11 17:29:27  info unpack layer: sha256:14726c8f78342865030f97a8d3492e2d1a68fbd22778f9a31dc6be4b4f12a9bc
FATAL:   While performing build: packer failed to pack: while unpacking tmpfs: error unpacking rootfs: unpack layer: unpack entry: bin/pidof: link: symlink /sbin/killall5 /tmp/build-temp-203135147/rootfs/bin/pidof: permission denied

> singularity build --fakeroot ubuntu2.sif library://ubuntu:18.04
INFO:    Starting build...
INFO:    Downloading library image
24.7MiB / 24.7MiB [=========================================================================================================================================================] 100 % 4.4 MiB/s 0s
INFO:    Verifying bootstrap image /root/.singularity/cache/library/sha256.2219fbb65c0ab156828bcc4af7544268531f7d51fb7c423983bad29dfb06682f
INFO:    Creating SIF file...
INFO:    Build complete: ubuntu2.sif

> singularity build --fakeroot ubuntu3.sif docker://ubuntu:18.04 
INFO:    Starting build...
Getting image source signatures
Copying blob 7c457f213c76 skipped: already exists  
Copying config f9a80a55f4 done  
Writing manifest to image destination
Storing signatures
2024/05/11 17:44:29  info unpack layer: sha256:7c457f213c7634afb95a0fb2410a74b7b5bc0ba527033362c240c7a11bef4331
FATAL:   While performing build: packer failed to pack: while unpacking tmpfs: error unpacking rootfs: unpack layer: unpack entry: bin/pidof: link: symlink /sbin/killall5 /tmp/build-temp-3674985026/rootfs/bin/pidof: permission denied

jhgoh commented 3 months ago

~singularity version이 3.x이상이어야 일반 유저 권한으로 build가 돼요.~ build는 다른 머신에서 하고 sif를 가져가서 하시면 돼요.

slowmoyang commented 3 months ago

안녕하세요. 슈퍼컴퓨팅인프라센터의 singularity 담당자입니다. 누리온 로그인 노드의 보안 OS에서 singularity 이미지 빌드 관련 오퍼레이션을 차단하여 발생한 문제입니다. 현재는 조치를 하여 정상적으로 이미지가 빌드 되고 있습니다. singularity 활용에 불편을 드려 죄송합니다. 감사합니다.

slowmoyang commented 3 months ago

solved

nurion4hep / KSC-RnD-2024-Transformer4MET

test cvmfs image on nurion #6