awslabs / mountpoint-s3-csi-driver

Built on Mountpoint for Amazon S3, the Mountpoint CSI driver presents an Amazon S3 bucket as a storage volume accessible by containers in your Kubernetes cluster.
Apache License 2.0
195 stars 23 forks source link

Unable to create sonatype nexus pod when using s3 bucket as pvc #273

Open anchaubey opened 2 hours ago

anchaubey commented 2 hours ago

/kind bug

NOTE: If this is a filesystem related bug, please take a look at the Mountpoint repo to submit a bug report

What happened?

I have created a nexus deployment where I am using s3 static provisioning feature https://github.com/awslabs/mountpoint-s3-csi-driver/blob/main/examples/kubernetes/static_provisioning/non_root.yaml

My pvc/pv config


apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: s3-csi provisioner: s3.csi.aws.com parameters: mounter: rclone region: eu-west-1 bucket: test-s3-blob-store storageClass: STANDARD reclaimPolicy: Delete volumeBindingMode: Immediate

apiVersion: v1 kind: PersistentVolume metadata: name: pv-s3 spec: capacity: storage: 10Gi csi: driver: s3.csi.aws.com volumeHandle: bucketname/nexus-data volumeAttributes: bucketName: bucketname accessModes:

What you expected to happen?

I am getting error once the pod is trying to launch as below:-

/sys/fs/cgroup/memory/memory.limit_in_bytes (No such file or directory) java.lang.RuntimeException: /nexus-data/log/karaf.log (Invalid argument)

How to reproduce it (as minimally and precisely as possible)?

Anything else we need to know?:

Environment - EKS - 1.30

anchaubey commented 2 hours ago

Just one more update that it's creating files in s3 bucket but still few directories are missing:-

image

The logs as below:-

OpenJDK 64-Bit Server VM warning: Unable to open cgroup memory limit file /sys/fs/cgroup/memory/memory.limit_in_bytes (No such file or directory) java.lang.RuntimeException: /nexus-data/log/karaf.log (Invalid argument) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlerInternal(BootstrapLogManager.java:102) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlersInternal(BootstrapLogManager.java:137) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlers(BootstrapLogManager.java:70) at org.apache.karaf.main.util.BootstrapLogManager.configureLogger(BootstrapLogManager.java:75) at org.apache.karaf.main.Main.launch(Main.java:279) at org.sonatype.nexus.karaf.NexusMain.launch(NexusMain.java:120) at org.sonatype.nexus.karaf.NexusMain.main(NexusMain.java:52) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.exe4j.runtime.LauncherEngine.launch(LauncherEngine.java:85) at com.install4j.runtime.launcher.UnixLauncher.main(UnixLauncher.java:69) Caused by: java.io.FileNotFoundException: /nexus-data/log/karaf.log (Invalid argument) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.(FileOutputStream.java:213) at org.apache.karaf.main.util.BootstrapLogManager$SimpleFileHandler.open(BootstrapLogManager.java:193) at org.apache.karaf.main.util.BootstrapLogManager$SimpleFileHandler.(BootstrapLogManager.java:182) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlerInternal(BootstrapLogManager.java:100) ... 12 more java.lang.RuntimeException: /nexus-data/log/karaf.log (Invalid argument) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlerInternal(BootstrapLogManager.java:102) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlersInternal(BootstrapLogManager.java:137) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlers(BootstrapLogManager.java:70) at org.apache.karaf.main.util.BootstrapLogManager.configureLogger(BootstrapLogManager.java:75) at org.apache.karaf.main.KarafActivatorManager.(KarafActivatorManager.java:48) at org.apache.karaf.main.Main.launch(Main.java:315) at org.sonatype.nexus.karaf.NexusMain.launch(NexusMain.java:120) at org.sonatype.nexus.karaf.NexusMain.main(NexusMain.java:52) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.exe4j.runtime.LauncherEngine.launch(LauncherEngine.java:85) at com.install4j.runtime.launcher.UnixLauncher.main(UnixLauncher.java:69) Caused by: java.io.FileNotFoundException: /nexus-data/log/karaf.log (Invalid argument) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.(FileOutputStream.java:213) at org.apache.karaf.main.util.BootstrapLogManager$SimpleFileHandler.open(BootstrapLogManager.java:193) at org.apache.karaf.main.util.BootstrapLogManager$SimpleFileHandler.(BootstrapLogManager.java:182) at org.apache.karaf.main.util.BootstrapLogManager.getDefaultHandlerInternal(BootstrapLogManager.java:100) ... 13 more Failed to write lock file: /nexus-data/lock java.io.FileNotFoundException: /nexus-data/lock (Invalid argument) at java.io.RandomAccessFile.open0(Native Method) at java.io.RandomAccessFile.open(RandomAccessFile.java:316) at java.io.RandomAccessFile.(RandomAccessFile.java:243) at org.sonatype.nexus.karaf.NexusFileLock.doLock(NexusFileLock.java:67) at org.sonatype.nexus.karaf.NexusFileLock.lock(NexusFileLock.java:54) at org.apache.karaf.main.Main.doMonitor(Main.java:425) at org.apache.karaf.main.Main.access$100(Main.java:78) at org.apache.karaf.main.Main$3.run(Main.java:409) Nexus data directory already in use: /nexus-data