cartons-taller
commented
9 months ago I believe I've also ran into this issue. I've replicated it by permanently deleting a folder containing files; oCIS will report that deletion was successful, the folder will disappear from the trash bin, but the files contained within that folder will remain on disk.
Selecting all the files individually, sending to trash + perma-deleting will work as expected.
I initially ran into this issue 6 month ago. My oCIS 4.0.0 Docker instance (with Keycloak IDP + Apache Tika, Debian 11 LXC in Proxmox VE 8.1) was using a whopping 29TB of space, despite oCIS reporting a total size of 9.8TB via the web interface.
I then followed the Binary Setup guide and migrated my data to a 2nd instance of oCIS 4.0.4 (with Keycloak IDP + Apache Tika, Debian 12 LXC in Proxmox VE 8.1) and can confirm the issue is still present.
File permissions were setup correctly on both instances. The orphaned files/folders in /var/lib/ocis/storage/ also had correct permissions. Both LXCs were each installed onto their own ZFS RAIDz1 dataset.
I've recorded a video (can't upload directly) where I recreate this issue on a fresh oCIS 4.0.4 instance (with Apache Tika, Debian 12 LXC in Proxmox VE 8.1, this time installed onto a ZFS dataset on a new NVME drive).
The top left window contains statistics on the LXC's total HDD usage, which reveals whether a perma-deletion succeeds or fails. There's also a live journal log for both oCIS and Apache Tika Server.
As you can see, I'm able to successfully upload + select individual files for perma-deletion as expected, but selecting a folder for perma-deletion results in orphaned files.
1st instance's docker-compose.yml:
version: '3.8'
services:
ocis:
image: owncloud/ocis
container_name: ocis
networks:
ocis-net:
ports:
- '9200:9200'
entrypoint:
- /bin/sh
command: ["-c", "ocis init || true; ocis server"]
environment:
- OCIS_INSECURE=true
- PROXY_HTTP_ADDR=0.0.0.0:9200
- OCIS_URL=https://ocis.[redacted].com
- DEMO_USERS=false
- PROXY_TLS=false
- OCIS_LOG_LEVEL=info
# Use Keycloak IDP
- OCIS_OIDC_ISSUER=https://keycloak.[redacted].com/realms/ocis
- PROXY_AUTOPROVISION_ACCOUNTS=true
- PROXY_OIDC_REWRITE_WELLKNOWN=true
- WEB_OIDC_CLIENT_ID=ocis-web
- OCIS_ADMIN_USER_ID=9efa99a9-2ddb-40bb-adc5-49511ef1f953
# Use Apache Tika indexer
- SEARCH_EXTRACTOR_TYPE=tika
- SEARCH_EXTRACTOR_TIKA_TIKA_URL=http://apache-tika:9998
- FRONTEND_FULL_TEXT_SEARCH_ENABLED=true
volumes:
- ${PWD}/config:/etc/ocis
- ${PWD}/data:/var/lib/ocis
restart: always
apache-tika:
image: apache/tika
container_name: apache-tika
networks:
ocis-net:
ports:
- '9998:9998'
restart: always
networks:
ocis-net:
name: ocis-net
danth
HerzogVonWiesel
leepfrog-ger
individual-it
Describe the bug
My instance uses much more storage on the disk than expected. When looking into what files use the space I found files on the disk that I have deleted in ocis e.g.
storage/users/spaces/00/7f0f4e-cb0c-4d60-a229-180920aa97ec/blobs/97/79/ab/b8/-bbea-4d25-bee8-d418129a5568The messagepack of that file has this content:
I can find it's parent on disk:
The parent has this messagepack content:
These are files that I have deleted previously, including the folder.
I cannot find that folder or the files in the ocis webUI, nor the but not the grand-parent with the id
4629d530-c6f7-4fdf-ab4c-8ce3025a9d9canywhere on diskSteps to reproduce
Not sure! But I have uploaded a lot of files, generated previews (what sometimes crashed), deleted files, created & deleted spaces
Expected behavior
no orphan files/folders on harddrive
Actual behavior
orphan files/folders exist on the harddrive
Setup
docker compose
```yml --- version: "3.7" services: ocis: image: owncloud/ocis:${OCIS_DOCKER_TAG:-latest} networks: ocis-net: ports: - "9200:9200" entrypoint: - /bin/sh command: [ "-c", "ocis init || true; ocis server" ] environment: OCIS_URL: https://${OCIS_DOMAIN:-ocis.in-nepal.de} OCIS_LOG_LEVEL: ${OCIS_LOG_LEVEL:-info} OCIS_LOG_COLOR: "${OCIS_LOG_COLOR:-false}" OCIS_INSECURE: true PROXY_HTTP_ADDR: 0.0.0.0:9200 PROXY_TLS: false OCIS_CACHE_STORE: "redis" OCIS_CACHE_STORE_NODES: "cache:6379" OCIS_LOG_FILE: /var/log/ocis/ocis.log restart: always depends_on: - cache volumes: - type: bind source: /mnt/HC_Volume_32687865/ocis-config target: /etc/ocis - type: bind source: /mnt/HC_Volume_32687865/ocis-data target: /var/lib/ocis - type: bind source: /mnt/HC_Volume_32687865/ocis-logs target: /var/log/ocis cache: image: redis:6.2-alpine restart: always networks: ocis-net: volumes: - cache:/data networks: ocis-net: volumes: cache: driver: local ```
Additional context
Add any other context about the problem here.