How to upload files greater than 50gb

[DYarizadeh]

It seems that the /dev/mapper/centos_sof--elk-root disk runs out of disk space when trying to ingest files > 50gb.

Is there a way to ingest files great than 50gb? I'm having trouble resizing the partition.

Thanks!

[philhagen]

Hello! Yes, you'd need to resize the partition for this. I'd add a new VMDK and then use LVM processes/utilities to extend the necessary partition(s) to accommodate.

[maersk-matthewkelly]

Is there any reason that the folders for automatic ingestion could NOT be moved to the home directory for the elk_user?

I have also experienced issues when attempting to ingest files totalling more than 50GB, I accept your point above with the extend option; but was wondering if there is a particular reason why the root is used as the based for the sof-elk ingestion folders?

[philhagen]

I want to keep those directories separate from any specific user so the directories could be used with multiple system users. they're chmodded to 1777 to allow a more graceful multi-user approach for that reason.

the best approach would be to use LVM to add extents as noted above. I've needed to do this in the past (both on SOF-ELK instances and other linux systems) and while it's a little clunky, it works well. Although I can't provide direct support for this, I've found that this RedHat article is very helpful in showing how to do this at the command line.

[philhagen]

going to re-open this to remind me to merge /home/ and / in LVM in the ansible instructions and build.

[philhagen]

this has been fixed in the upstream VM and develop branch has updated ansible instructions