owncloud / core

:cloud: ownCloud web server core (Files, DAV, etc.)
https://owncloud.com
GNU Affero General Public License v3.0
8.39k stars 2.05k forks source link

[External Storage] Amazon S3 uploaded folders via AWS console are not available in ownCloud #26819

Closed SamuAlfageme closed 6 years ago

SamuAlfageme commented 7 years ago

Steps to reproduce

  1. Configure a bucket in Amazon S3 and mount it as ext. storage option in ownCloud
  2. Create a couple of folders / upload some files
  3. Upload some folders to the bucket root:

screen shot 2016-12-13 at 10 01 04

Expected behaviour

The same dir tree is mounted in the external storage folder: /AmazonS3

Actual behaviour

The folders/files created in step 2 are the only ones displayed in the web UI:

screen shot 2016-12-13 at 10 03 51

To force updating the external storage directory (#11797) tried running sudo -u www-data ./occ files:scan --all -vvvvvv but again, it returns only those folders/files:

        ...
    Folder /admin/files/AmazonS3/
    File   /admin/files/AmazonS3/Screen Shot 2016-12-07 at 16.54.47.png
    File   /admin/files/AmazonS3/Screen Shot 2016-12-09 at 10.51.22.png
    File   /admin/files/AmazonS3/Screen Shot 2016-12-09 at 11.15.34.png
    File   /admin/files/AmazonS3/Screen Shot 2016-12-09 at 13.49.04.png
    File   /admin/files/AmazonS3/data_too_big.png
    Folder /admin/files/AmazonS3/new

+---------+-------+--------------+
| Folders | Files | Elapsed time |
+---------+-------+--------------+
| 16      | 27    | 00:00:04     |
+---------+-------+--------------+

Server configuration

- core
    - EXTRA_FILE
        - container_status.php

Logs

ownCloud log (data/owncloud.log)

{"reqId":"VCe4gCRZoDBR1+MA0IZq","remoteAddr":"","app":"PHP","message":"Class 'OC_Mount_Config' not found at \/opt\/owncloud\/apps\/windows_network_drive\/appinfo\/register_command.php#24","level":3,"time":"2016-12-12T12:35:33+00:00","method":"--","url":"--","user":"--"}
mitiih commented 7 years ago

Same problem here... If I use "Cloudberry Explorer for Amazon S3" to upload folders OR upload a folder through AWS S3 web console, the folder does not show up in owncloud storage. Then if I create (not upload) a folder in AWS S3, that does show up in owncloud. Folder size does not seem to matter in uploading problem.

Uploaded files does show up, no problem there but uploaded folders do not.

I'm just testing owncloud with AWS S3 so using t2 micro EC2 Ubuntu 16.04 and owncloud version 10.0.2. The setup is just installed and updated.

jdopson0624 commented 6 years ago

Why are these getting added to stale issues when they are in fact bugs?

phil-davis commented 6 years ago

Why are automated tools stupid? What is the meaning of life, the universe and everything?

ghost commented 6 years ago

Sorry, incomplete thought on my part. I saw another issue go stale, then close without any action taken and was thinking that would happen here too on a legitimate bug.

phil-davis commented 6 years ago

This one got lucky - the automated bots have been closing a bunch of bug issues that are still valid.

PVince81 commented 6 years ago

@DeepDiver1975 mind having a look since you're in object store world ?

ownclouders commented 6 years ago

Hey, this issue has been closed because the label status/STALE is set and there were no updates for 7 days. Feel free to reopen this issue if you deem it appropriate.

(This is an automated comment from GitMate.io.)

DeepDiver1975 commented 6 years ago

Secondary s3 storage integration just got move over to https://github.com/owncloud/files_external_s3.

Unfortunately GitHub does not allow to move issues. Please reopen the issue at https://github.com/owncloud/files_external_s3/issues

lock[bot] commented 5 years ago

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.