huggingface / optimum-graphcore

Blazing fast training of 🤗 Transformers on Graphcore IPUs
Apache License 2.0
81 stars 33 forks source link

Print execution time of each example test #440

Closed kundaMwiza closed 1 year ago

kundaMwiza commented 1 year ago

What does this PR do?

Show execution times of example tests

Output format:

1930.67s call     tests/test_examples.py::QuestionAnsweringExampleTester::test_run_qa_deberta                                                                                                                                                                                                                                              
1600.59s call     tests/test_examples.py::MultipleChoiceExampleTester::test_run_swag_groupbert                                                                                                                                                                                                                                             
1569.01s call     tests/test_examples.py::SummarizationExampleTester::test_run_summarization_t5                                                                                                                                                                                                                                            
1444.00s call     tests/test_examples.py::SummarizationExampleTester::test_run_summarization_mt5   

Fixes # (issue)

Before submitting

HuggingFaceDocBuilderDev commented 1 year ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.