Memory leak when use fget_object function

[Hieu-github]

I am using fget_object function to download a list file in Minio Server. But the monitor show me something strange

The memory increases over time.

I try debug with Memory_profiler module and the result are in the image below

Enviroment:

• container
• image: python:3.8-slim
• cpu: amd64
• minio sdk version: minio==7.2.7
• file size: 3kb - 20kb

[balamurugana]

I see 0.3MiB increment in the profile output. Are you referring as memory leak?

[Hieu-github]

@balamurugana yes. And in the next call, the memory is not release 0.3MiB.

[balamurugana]

It could be http client connection pool thing. Use get_object() and handle file download your own. Check the memory usage on the process.

[Hieu-github]

When I use get_object() func. the result is I realized that The code doesn't seem to fully reclaim the memory allocated to the response stream.

[balamurugana]

It is urllib3 connection pool thing. Pass your own pool manager to Minio class for optimization.