MoseleyBioinformaticsLab / gpu_tracker

Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage.
Other
4 stars 1 forks source link

Usage over time #1

Open erikhuck opened 4 months ago

erikhuck commented 4 months ago

While the tracker currently reports the maximum usage of each resource, a user may want to see the usage over unit time (whichever sleep time they choose or the default). This should not be the default behavior considering it would use up more space (i.e. an increasing amount of space the longer the context lasts). So it should be an option. We may want to append to a file considering (e.g. a csv file) considering the increase in space per unit time. That should also be an option since a user may want the results provided in memory.

hunter-moseley commented 4 months ago

Could keep running sum and count, which would not require extra space, pragmatically. Would also track min as well as max.

On Mon, Feb 19, 2024, 12:18 PM Erik Huckvale @.***> wrote:

While the tracker currently reports the maximum usage of each resource, a user may want to see the usage over unit time (whichever sleep time they choose or the default). This should not be the default behavior considering it would use up more space (i.e. an increasing amount of space the longer the context lasts). So it should be an option. We may want to append to a file considering (e.g. a csv file) considering the increase in space per unit time. That should also be an option since a user may want the results provided in memory.

— Reply to this email directly, view it on GitHub https://github.com/MoseleyBioinformaticsLab/gpu_tracker/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADEP7B7GFQTIDYEORT5WA33YUOCOLAVCNFSM6AAAAABDP2GL5WVHI2DSMVQWIX3LMV43ASLTON2WKOZSGE2DEOBUGY2TOOA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

erikhuck commented 4 months ago

@hunter-moseley I was referring to a feature where we provide the usage amount of each resource over each time increment so that the user could, for example, plot the usage like with a line plot or whatever other use they have for that data. But maybe most users don't need this.

Tracking the sum and count is a good idea because that would enable us to provide the mean usage at the end. Could definitely provide the min as well.

hunter-moseley commented 4 months ago

Tracking over time is a potentially useful option.

On Wed, Feb 21, 2024, 8:46 AM Erik Huckvale @.***> wrote:

@hunter-moseley https://github.com/hunter-moseley I was referring to a feature where we provide the usage amount of each resource over each time increment so that the user could, for example, plot the usage like with a line plot or whatever other use they have for that data. But maybe most users don't need this.

Tracking the sum and count is a good idea because that would enable us to provide the mean usage at the end. Could definitely provide the min as well.

— Reply to this email directly, view it on GitHub https://github.com/MoseleyBioinformaticsLab/gpu_tracker/issues/1#issuecomment-1956688783, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADEP7B7MGB7Y2RTUE6SZI6TYUX3E7AVCNFSM6AAAAABDP2GL5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJWGY4DQNZYGM . You are receiving this because you were mentioned.Message ID: @.***>