solracsf
commented
3 years ago The problem is that renaming on S3 equals to COPY that object under a new name and then DELETE the previous one. https://docs.aws.amazon.com/AmazonS3/latest/API/API_CopyObject.html
You can store individual objects of up to 5 TB in Amazon S3. You create a copy of your object up to 5 GB in size in a single atomic operation using this API. However, to copy an object greater than 5 GB, you must use the multipart upload Upload Part - Copy API.
juliushaertl
szaimen
How to use GitHub
Steps to reproduce
Expected behaviour
File should be renamed.
Actual behaviour
An error occurs and file is not renamed. Two error messages are logged (see below for details), the more important being:
Aws\S3\Exception\S3Exception: Error executing "CopyObject" [...] resulted in a
400 Bad Requestresponse [...] InvalidRequest (client): The specified copy source is larger than the maximum allowable size for a copy source: 5368709120 [...]Server configuration
Operating system: Ubuntu Server 20.04.1 LTS
Web server: Nginx 1.18.0
Database: PostgreSQL 12.5
PHP version: 7.4.3
Nextcloud version: 19.0.5
Updated from an older Nextcloud/ownCloud or fresh install: Originally installed at version 14 or 15
Where did you install Nextcloud from: Downloaded from nextcloud.com
Signing status:
Signing status
``` No errors have been found. ```List of activated apps:
App list
``` Enabled: - accessibility: 1.5.0 - activity: 2.12.1 - announcementcenter: 3.8.1 - apporder: 0.11.0 - bruteforcesettings: 2.0.1 - calendar: 2.0.4 - cloud_federation_api: 1.2.0 - comments: 1.9.0 - contacts: 3.4.2 - contactsinteraction: 1.0.0 - dav: 1.15.0 - deck: 1.2.2 - drawio: 0.9.8 - federatedfilesharing: 1.9.0 - federation: 1.9.0 - files: 1.14.0 - files_accesscontrol: 1.9.2 - files_automatedtagging: 1.9.0 - files_external: 1.10.0 - files_pdfviewer: 1.8.0 - files_readmemd: 1.2.0 - files_rightclick: 0.16.0 - files_sharing: 1.11.0 - files_trashbin: 1.9.0 - files_versions: 1.12.0 - files_videoplayer: 1.8.0 - firstrunwizard: 2.8.0 - flowupload: 1.1.2 - forms: 2.0.4 - groupfolders: 7.1.1 - logreader: 2.4.0 - lookup_server_connector: 1.7.0 - nextcloud_announcements: 1.8.0 - notes: 3.6.4 - notifications: 2.7.0 - oauth2: 1.7.0 - onlyoffice: 6.1.0 - password_policy: 1.9.1 - passwords: 2020.11.1 - photos: 1.1.0 - polls: 1.6.2 - previewgenerator: 2.3.0 - privacy: 1.3.0 - provisioning_api: 1.9.0 - serverinfo: 1.9.0 - settings: 1.1.0 - sharebymail: 1.9.0 - spreed: 9.0.6 - support: 1.2.1 - survey_client: 1.7.0 - systemtags: 1.9.0 - tasks: 0.13.6 - text: 3.0.1 - theming: 1.10.0 - twofactor_backupcodes: 1.8.0 - twofactor_nextcloud_notification: 2.3.0 - twofactor_totp: 5.0.0 - updatenotification: 1.9.0 - video_converter: 0.1.5 - viewer: 1.3.0 - workflow_script: 1.4.0 - workflowengine: 2.1.0 Disabled: - admin_audit - analytics - encryption - files_lock - recommendations - user_ldap ```Nextcloud configuration:
Config report
``` { "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "***removed domain***" ], "datadirectory": "***REMOVED SENSITIVE VALUE***", "tempdirectory": "\/data\/tmp", "dbtype": "pgsql", "version": "19.0.5.2", "overwrite.cli.url": "https:\/\/***removed domain***", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "maintenance": false, "trashbin_retention_obligation": "14, 30", "memcache.local": "\\OC\\Memcache\\APCu", "memcache.distributed": "\\OC\\Memcache\\Redis", "filelocking.enabled": true, "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 0 }, "mail_smtpmode": "smtp", "mail_smtpsecure": "tls", "mail_sendmailmode": "smtp", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "587", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "mail_smtpauthtype": "PLAIN", "twofactor_enforced": "true", "twofactor_enforced_groups": [ "admin" ], "twofactor_enforced_excluded_groups": [], "theme": "", "loglevel": 2, "updater.release.channel": "stable" } } ```Are you using external storage, if yes which one: AWS S3 object storage
Are you using encryption: no
Are you using an external user-backend, if yes which one: no
Client configuration
Browser: Microsoft Edge 87.0.664.52 (Official build) (64-bit), Firefox 83.0
Operating system: Windows 10
Logs
Web server error log
No errors in nginx error log.
Nextcloud log (data/nextcloud.log)
Nextcloud log
``` {"reqId":"nzo9hgexstIQFtpUzFOw","level":4,"time":"2020-12-04T00:14:40+00:00","remoteAddr":"2001:14ba:a00c:1100:e52b:89ce:a5c0:e5c4","user":"tlinna","app":"webdav","method":"MOVE","url":"/remote.php/dav/files/tlinna/Kylm%C3%A4varasto%20S3/Videoarkisto/FinRX/2020-11-23%2019-48-39.mkv","message":{"Exception":"Sabre\\DAV\\Exception","Message":"Failed to rename /Kylmävarasto S3/Videoarkisto/FinRX/2020-11-23 19-48-39.mkv to /Kylmävarasto S3/Videoarkisto/FinRX/02 jalkkari.mkv","Code":0,"Trace":[{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Tree.php","line":157,"function":"setName","class":"OCA\\DAV\\Connector\\Sabre\\Node","type":"->"},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php","line":641,"function":"move","class":"Sabre\\DAV\\Tree","type":"->"},{"file":"/var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"httpMove","class":"Sabre\\DAV\\CorePlugin","type":"->"},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":474,"function":"emit","class":"Sabre\\DAV\\Server","type":"->"},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":251,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->"},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":319,"function":"start","class":"Sabre\\DAV\\Server","type":"->"},{"file":"/var/www/nextcloud/apps/dav/lib/Server.php","line":320,"function":"exec","class":"Sabre\\DAV\\Server","type":"->"},{"file":"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php","line":35,"function":"exec","class":"OCA\\DAV\\Server","type":"->"},{"file":"/var/www/nextcloud/remote.php","line":167,"args":["/var/www/nextcloud/apps/dav/appinfo/v2/remote.php"],"function":"require_once"}],"File":"/var/www/nextcloud/apps/dav/lib/Connector/Sabre/Node.php","Line":143,"CustomMessage":"--"},"userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36 Edg/87.0.664.52","version":"19.0.5.2","id":"5fc97fec59a77"} {"reqId":"nzo9hgexstIQFtpUzFOw","level":3,"time":"2020-12-04T00:14:40+00:00","remoteAddr":"2001:14ba:a00c:1100:e52b:89ce:a5c0:e5c4","user":"tlinna","app":"files_external","method":"MOVE","url":"/remote.php/dav/files/tlinna/Kylm%C3%A4varasto%20S3/Videoarkisto/FinRX/2020-11-23%2019-48-39.mkv","message":{"Exception":"Aws\\S3\\Exception\\S3Exception","Message":"Error executing \"CopyObject\" on \"https://xxxxxxxxx.s3.eu-north-1.amazonaws.com/Videoarkisto/FinRX/02%20jalkkari.mkv\"; AWS HTTP error: Client error: `PUT https://xxxxxxxxx.s3.eu-north-1.amazonaws.com/Videoarkisto/FinRX/02%20jalkkari.mkv` resulted in a `400 Bad Request` response:\nInvalidRequestInvalidRequestInvalidRequestAdditional information
As far as I understand, a CopyObject action is limited to files under 5 GB and should not be used here, see: https://docs.aws.amazon.com/AmazonS3/latest/API/API_CopyObject.html
Unfortunately I don't have the knowledge needed to try to fix this myself.