refactor(api): move `TTLCache` usage to CLI-only

XuehaiPan / nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

https://nvitop.readthedocs.io

Apache License 2.0

4.79k stars 149 forks source link

refactor(api): move `TTLCache` usage to CLI-only #66

Closed XuehaiPan closed 1 year ago

XuehaiPan commented 1 year ago

Issue Type

Breaking changes

Description

Move TTLCache usage to CLI-only. Public APIs in nvitop.api will always return immediate results.

Motivation and Context

In the previous implementation, the public APIs may return cached results. Now all caching mechanisms are moved to CLI-only. This is more consistent with other packages such as psutil.Process.