Closed ahmadsharif1 closed 1 week ago
I assume the removal of the other decoders is temporary while getting everything working?
On the chart generated by generate_readme_*.py
, I think we want to be selective on what we add to it. I think we want no more than four experiments per row. This is in contrast to the output from benchmark_decoders.py
, where we can have many experiments. I see benchmark_decoders.py
as a perf development tool, and generate_readme_*.py
as our external showcase.
The batch mode is a new mode that decodes a batch of 40 copies of the decoder using 8 threads.
Tested: