Closed etrommer closed 2 years ago
Add (micro-)benchmarks to compare throughput of different inference modes
Add (micro-)benchmarks to compare throughput of different inference modes