issues
search
nod-ai
/
SHARK-TestSuite
Temporary home of a test suite we are evaluating
Apache License 2.0
5
stars
35
forks
source link
non-conv huggingface models
#293
Open
renxida
opened
4 months ago
renxida
commented
4 months ago
Steps:
select representative models (done)
export onnx
upload to azure
write scripts to run them
representative models:
1. Buntan/bert-finetuned-ner 2. sandeepvarma99/bert-base-uncased-finetuned-squad 3. deepse/roberta-base-squad2-distilled 4. anas-awadalla/spanbert-base-cased-few-shot-k-1024-finetuned-squad-seed-0 5. timokurtz/finetuning-sentiment-model-3000-samples 6. jhaochenz/finetuned_distilgpt2_sst2_negation0.001_pretrainedTrue_epochs1 7. knkarthick/bart-large-xsum-samsum 8. rufimelo/Legal-BERTimbau-large-v2-sts 9. kbalde/marian-finetuned-kde4-en-to-fr 10. sahn/distilbert-base-uncased-finetuned-imdb 11. lnair/opt-1.3b-wikitext2 12. mosaicml/mpt-7b 13. openlm-research/open_llama_3b_v2 14. sjrhuschlee/mdeberta-v3-base-squad2 15. ferstappen/bert-finetuned-ner 16. Shushant/my_awesome_qa_model 17. bigcode/starcoder2-15b-instruct-v0.1 18. WRobinW/bert-finetuned-squad 19. tnet-devs/zephyr-7b-beta-inc 20. stjiris/bert-large-portuguese-cased-legal-tsdae-nli-sts-v0 21. Qwen/Qwen2-1.5B-Instruct 22. 01-ai/Yi-6B-Chat 23. anas-awadalla/roberta-base-few-shot-k-64-finetuned-squad-seed-2 24. yuhuizhang/finetuned_gpt2-medium_sst2_negation0.0_pretrainedFalse 25. illuin/tiny-random-FalconForCausalLM 26. pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP 27. muhtasham/small-mlm-imdb-target-imdb 28. himanshubeniwal/gpt2_wikitext37_7k_pretrained_iphone_1e4 29. BahAdoR0101/my_xlm-roberta-large-finetuned-conll03 30. issifuamajeed/distilbert-base-uncased-finetuned-ner 31. en/distilbert-base-uncased-finetuned-squad 32. muhtasham/finetuned-mlm_mini
Steps:
representative models:
1. Buntan/bert-finetuned-ner 2. sandeepvarma99/bert-base-uncased-finetuned-squad 3. deepse/roberta-base-squad2-distilled 4. anas-awadalla/spanbert-base-cased-few-shot-k-1024-finetuned-squad-seed-0 5. timokurtz/finetuning-sentiment-model-3000-samples 6. jhaochenz/finetuned_distilgpt2_sst2_negation0.001_pretrainedTrue_epochs1 7. knkarthick/bart-large-xsum-samsum 8. rufimelo/Legal-BERTimbau-large-v2-sts 9. kbalde/marian-finetuned-kde4-en-to-fr 10. sahn/distilbert-base-uncased-finetuned-imdb 11. lnair/opt-1.3b-wikitext2 12. mosaicml/mpt-7b 13. openlm-research/open_llama_3b_v2 14. sjrhuschlee/mdeberta-v3-base-squad2 15. ferstappen/bert-finetuned-ner 16. Shushant/my_awesome_qa_model 17. bigcode/starcoder2-15b-instruct-v0.1 18. WRobinW/bert-finetuned-squad 19. tnet-devs/zephyr-7b-beta-inc 20. stjiris/bert-large-portuguese-cased-legal-tsdae-nli-sts-v0 21. Qwen/Qwen2-1.5B-Instruct 22. 01-ai/Yi-6B-Chat 23. anas-awadalla/roberta-base-few-shot-k-64-finetuned-squad-seed-2 24. yuhuizhang/finetuned_gpt2-medium_sst2_negation0.0_pretrainedFalse 25. illuin/tiny-random-FalconForCausalLM 26. pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP 27. muhtasham/small-mlm-imdb-target-imdb 28. himanshubeniwal/gpt2_wikitext37_7k_pretrained_iphone_1e4 29. BahAdoR0101/my_xlm-roberta-large-finetuned-conll03 30. issifuamajeed/distilbert-base-uncased-finetuned-ner 31. en/distilbert-base-uncased-finetuned-squad 32. muhtasham/finetuned-mlm_mini