cli: Add benchmark-per-layer functionality

EmbarkStudios / cervo

Utility wrappers for tract

Apache License 2.0

40 stars 1 forks source link

cli: Add benchmark-per-layer functionality #56

Open tgolsson opened 3 weeks ago

tgolsson commented 3 weeks ago

Currently we can do "whole-network" performance measurements, but that is not very helpful for finding performance bottlenecks or spotting issues. It would be useful to implement a plan-runner similar to how upstream does it where we can run each layer independently and benchmark it.

tgolsson commented 3 weeks ago

(This might also unlock more performance; reusing the same runner would allow us to cache scratchpads AFAICT)