h2oai / h2o-llmstudio

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
https://h2o.ai
Apache License 2.0
4.03k stars 418 forks source link

[BUG] The APP UI displays the memory different than the MemoryReservation on toml #883

Open abhishek-h2o opened 5 days ago

abhishek-h2o commented 5 days ago

🐛 Bug

On the UI of the App it shows different memory than what is specified in app.toml

The app uses /proc/meminfo to extract the memory details from the app. However, this reports the underlying memory allocated for the node except for the pod. Therefore, the reported memory is for the underlying node instead of the allocated memory for the running pod.

To Reproduce

configure MemoryReservation and MemoryLimit in app.toml and the app will show different Memory on UI which is of node and can be seen in /proc/meminfo.

LLM Studio version

Version = "1.12.1"