Open dtsengAmazon opened 9 months ago
@michaelbenayoun can you take a look ?
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
I ran
RUN_SLOW=true COVERAGE=high RUN_TINY=true USE_VENV=false pytest tests/test_examples.py -v
on neuron 2.15 and ON 2.15 and ran into 2 errors.FAILED tests/test_examples.py::TextClassificationExampleTester::test_run_glue_bert_with_tp - assert 1 == 0 FAILED tests/test_examples.py::TokenClassificationExampleTester::test_run_ner_bert_with_tp - assert 1 == 0 FAILED tests/test_examples.py::MultipleChoiceExampleTester::test_run_swag_bert_with_tp - assert 1 == 0 FAILED tests/test_examples.py::QuestionAnsweringExampleTester::test_run_qa_bert_with_tp - assert 1 == 0 FAILED tests/test_examples.py::SummarizationExampleTester::test_run_summarization_t5_with_tp - assert 1 == 0 FAILED tests/test_examples.py::TranslationExampleTester::test_run_translation_t5_with_tp - assert 1 == 0 FAILED tests/test_examples.py::ImageClassificationExampleTester::test_run_image_classification_vit - assert 1 == 0``
With the only TP test passed being the first one (neo gpt). This result shows 7 failed 8 passed excluding the 4 tests commented out (lllama and mistral with and without tp each)