search

philhagen / sof-elk

Configuration files for the SOF-ELK VM
GNU General Public License v3.0
1.46k stars 272 forks source link

How to upload files greater than 50gb #258

Closed DYarizadeh closed 8 months ago

DYarizadeh commented 1 year ago

It seems that the /dev/mapper/centos_sof--elk-root disk runs out of disk space when trying to ingest files > 50gb.

Is there a way to ingest files great than 50gb? I'm having trouble resizing the partition.

Thanks!

philhagen commented 1 year ago

Hello! Yes, you'd need to resize the partition for this. I'd add a new VMDK and then use LVM processes/utilities to extend the necessary partition(s) to accommodate.

maersk-matthewkelly commented 9 months ago

Is there any reason that the folders for automatic ingestion could NOT be moved to the home directory for the elk_user?

I have also experienced issues when attempting to ingest files totalling more than 50GB, I accept your point above with the extend option; but was wondering if there is a particular reason why the root is used as the based for the sof-elk ingestion folders?

philhagen commented 9 months ago

I want to keep those directories separate from any specific user so the directories could be used with multiple system users. they're chmodded to 1777 to allow a more graceful multi-user approach for that reason.

the best approach would be to use LVM to add extents as noted above. I've needed to do this in the past (both on SOF-ELK instances and other linux systems) and while it's a little clunky, it works well. Although I can't provide direct support for this, I've found that this RedHat article is very helpful in showing how to do this at the command line.

philhagen commented 9 months ago

going to re-open this to remind me to merge /home/ and / in LVM in the ansible instructions and build.

philhagen commented 8 months ago

this has been fixed in the upstream VM and develop branch has updated ansible instructions