search

pytorch / benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
BSD 3-Clause "New" or "Revised" License
868 stars 283 forks source link

Add fairseq roberta model #629

Closed xuzhao9 closed 2 years ago

xuzhao9 commented 2 years ago

We can add more NLP models through fairseq: https://github.com/pytorch/fairseq. Roberta is a good candidate (https://github.com/pytorch/fairseq/tree/main/examples/roberta) The benchmark could use a minimal/synthesized GLUE benchmark task dataset

joecummings commented 2 years ago

@xuzhao9 Just want to confirm that this is still a desired addition?

xuzhao9 commented 2 years ago

@joecummings Actually this can be closed since we recently added fambench_xlmr in https://github.com/pytorch/benchmark/pull/835. Thanks for the reminder though.