Why is the CPU peak memory usage set to 0?

FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

Apache License 2.0

9.18k stars 548 forks source link

Why is the CPU peak memory usage set to 0? #117

Open KAIWEILIUCC opened 1 year ago

KAIWEILIUCC commented 1 year ago

Hi,thank you for your great work! I notice that when measuring the cpu memory usage, only the current value is measured, while the peak value is set to zero. What is the reason for this? Thanks. :)