search

datashim-io / datashim

A kubernetes based framework for hassle free handling of datasets
http://datashim-io.github.io/datashim
Apache License 2.0
479 stars 68 forks source link

Not able to write/update data into s3 bucket in inside kubernetes pod #306

Open Venkatesh7591 opened 1 year ago

Venkatesh7591 commented 1 year ago

Hi Team,

We are able to create file but not able to write/update in that file on S3 bucket mounted path in inside kubernetes pod. We are getting this error "ERROR: "E297: Write error in swap file" Please help me in this issue.

Thanks, Venkatesh.

Venkatesh7591 commented 1 year ago

We are getting this issue in all the clouds after login to the pod. But here bucket is mounted perfectly. We used helm chart to install datashim in cloud " root@emyt-plus-ocr-6d5fffc689-sf78g:/workspace/ocr/s3/ocr_data# echo abc.txt >> abc1.txt bash: echo: write error: Operation not supported "

srikumar003 commented 1 year ago

@Venkatesh7591 have you set read-only: true in the dataset

srikumar003 commented 1 year ago

@Venkatesh7591 for your first issue, if it appears again, please paste the logs of csi-s3 daemons here

Venkatesh7591 commented 1 year ago

@Venkatesh7591 have you set read-only: true in the dataset

No, Please find my below yaml file. apiVersion: com.ie.ibm.hpsys/v1alpha1 kind: Dataset metadata: name: bucket spec: local: type: "COS" accessKeyID: "****" secretAccessKey: "**" endpoint: "https://hfghfjtfv.compat.objectstorage.us-ashburn-1.oraclecloud.com" bucket: "usa" region: "us-ashburn" #it can be empty

Thanks, Venkatesh.

vabburi commented 9 months ago

I'm facing the same issue...any pointers on how to resolve this?

srikumar003 commented 8 months ago

@vabburi Hi, can you paste the logs for the csi-s3 daemons here ?