caporaso-lab / sourcetracker2

SourceTracker2
BSD 3-Clause "New" or "Revised" License
61 stars 45 forks source link

add speedtest to CLI #82

Open wdwvt1 opened 7 years ago

wdwvt1 commented 7 years ago

Users frequently want to know the approximate runtime of algorithms so they can plan, e.g. computational use, queue size, etc.

On the algorithm side, the only parameters that alter runtime for gibbs are total number of passes through gibbs_sampler, number of sinks, and total number of sequences in the sinks.

On the hardware side, gibbs is CPU rather than memory intensive, so processor speed is the most important parameter for determining runtime.

We could provide a simple method that just tests a grid of: number of sinks X total sequences X total passes X number of cores and returns the user a very simple plot that would allow them to estimate run time.