search

mediacms-io / mediacms

MediaCMS is a modern, fully featured open source video and media CMS, written in Python/Django and React, featuring a REST API.
https://mediacms.io
GNU Affero General Public License v3.0
2.67k stars 495 forks source link

Questions about uploading multiple files #766

Closed cdorsat closed 1 year ago

cdorsat commented 1 year ago

Problem Description: Problem encountered: An independent server with mediacms installed, when I try to upload 10 media files at the same time, the size of a single file is 1G (actually uploading one by one), and ffmpeg starts transcoding after the first file is uploaded. At this time, ffmpeg will eat up all the memory, causing some subsequent file uploads to fail. At the same time, because ffmpeg eats almost 100% of the memory, the linux system will run abnormally until it crashes. Is there a solution for this?

Update: Situation supplement: After increasing the physical memory, the problem of memory usage during ffmpeg transcoding has been solved. It's just that the issue of multiple file boarding failures remains unresolved.

Status update: There is no problem in concurrent uploading of small files in the test, but the problem of concurrent uploading of large files (average 1.4G for a single file) still exists. In addition, it is found that some special characters in the file name to be uploaded may cause some errors.

The situation when an error occurs is as follows: Capture1

mgogoulos commented 1 year ago

Seems as system resources issue, as you have also found. What are they system specs (cpu/memory) when this is happening?