search

JohnSnowLabs / nlu

1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.
Apache License 2.0
854 stars 130 forks source link

3.4.4rc1 #119

Closed C-K-Loan closed 2 years ago

C-K-Loan commented 2 years ago

600 new models with over 75 new languages including Ancient,Dead and Extinct languages, 155 languages total covered, 400% Tokenizer Speedup, 18x USE-Embeddings GPU speedup in John Snow Labs NLU 3.4.4

We are very excited to announce NLU 3.4.4 has been released with over 600 new model, over 75 new languages and 155 languages covered in total, 400% speedup for tokenizers and 18x speedup of UniversalSentenceEncoder on GPU. On the general NLP side we have transformer based Embeddings and Token Classifiers powered by state of the art CamemBertEmbeddings and DeBertaForTokenClassification based architectures as well as various new models for
Historical, Ancient,Dead, Extinct, Genetic and Constructed languages like Old Church Slavonic, Latin, Sanskrit, Esperanto, Volapük, Coptic, Nahuatl, Ancient Greek (to 1453), Old Russian. On the healthcare side we have Portuguese De-identification Models, have NER models for Gene detection and finally RxNorm Sentence resolution model for mapping and extracting pharmaceutical actions (e.g. analgesic, hypoglycemic) as well as treatments (e.g. backache, diabetes).

First time language models covered

The languages for these models are covered for the very first time ever by NLU. Number Language Name(s) NLU Reference Spark NLP Reference Task Annotator Class Scope Language Type
0 Sanskrit sa.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Ancient
1 Sanskrit sa.lemma lemma_vedic Lemmatization LemmatizerModel Individual Ancient
2 Sanskrit sa.pos pos_vedic Part of Speech Tagging PerceptronModel Individual Ancient
3 Sanskrit sa.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Ancient
4 Volapük vo.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Constructed
5 Nahuatl languages nah.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Collective Genetic
6 Aragonese an.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
7 Assamese as.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
8 Asturian, Asturleonese, Bable, Leonese ast.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
9 Bashkir ba.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
10 Bavarian bar.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
11 Bishnupriya bpy.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
12 Burmese my.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
13 Cebuano ceb.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
14 Central Bikol bcl.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
15 Chechen ce.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
16 Chuvash cv.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
17 Corsican co.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
18 Dhivehi, Divehi, Maldivian dv.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
19 Egyptian Arabic arz.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
20 Emiliano-Romagnolo eml.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
21 Erzya myv.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
22 Georgian ka.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
23 Goan Konkani gom.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
24 Javanese jv.embed.distilbert distilbert_embeddings_javanese_distilbert_small Embeddings DistilBertEmbeddings Individual Living
25 Javanese jv.embed.javanese_distilbert_small_imdb distilbert_embeddings_javanese_distilbert_small_imdb Embeddings DistilBertEmbeddings Individual Living
26 Javanese jv.embed.javanese_roberta_small roberta_embeddings_javanese_roberta_small Embeddings RoBertaEmbeddings Individual Living
27 Javanese jv.embed.javanese_roberta_small_imdb roberta_embeddings_javanese_roberta_small_imdb Embeddings RoBertaEmbeddings Individual Living
28 Javanese jv.embed.javanese_bert_small_imdb bert_embeddings_javanese_bert_small_imdb Embeddings BertEmbeddings Individual Living
29 Javanese jv.embed.javanese_bert_small bert_embeddings_javanese_bert_small Embeddings BertEmbeddings Individual Living
30 Kirghiz, Kyrgyz ky.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
31 Letzeburgesch, Luxembourgish lb.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
32 Letzeburgesch, Luxembourgish lb.lemma lemma_spacylookup Lemmatization LemmatizerModel Individual Living
33 Letzeburgesch, Luxembourgish lb.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
34 Ligurian lij.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
35 Lombard lmo.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
36 Low German, Low Saxon nds.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
37 Macedonian mk.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
38 Macedonian mk.lemma lemma_spacylookup Lemmatization LemmatizerModel Individual Living
39 Macedonian mk.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
40 Maithili mai.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
41 Manx gv.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
42 Mazanderani mzn.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
43 Minangkabau min.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
44 Mingrelian xmf.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
45 Mirandese mwl.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
46 Neapolitan nap.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
47 Nepal Bhasa, Newari new.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
48 Northern Frisian frr.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
49 Northern Sami sme.lemma lemma_giella Lemmatization LemmatizerModel Individual Living
50 Northern Sami sme.pos pos_giella Part of Speech Tagging PerceptronModel Individual Living
51 Northern Sotho, Pedi, Sepedi nso.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
52 Occitan (post 1500) oc.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
53 Ossetian, Ossetic os.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
54 Pfaelzisch pfl.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
55 Piemontese pms.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
56 Romansh rm.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
57 Scots sco.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
58 Sicilian scn.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
59 Sinhala, Sinhalese si.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
60 Sinhala, Sinhalese si.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
61 Sundanese su.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
62 Sundanese su.embed.sundanese_roberta_base roberta_embeddings_sundanese_roberta_base Embeddings RoBertaEmbeddings Individual Living
63 Tagalog tl.lemma lemma_spacylookup Lemmatization LemmatizerModel Individual Living
64 Tagalog tl.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
65 Tagalog tl.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
66 Tagalog tl.embed.roberta_tagalog_large roberta_embeddings_roberta_tagalog_large Embeddings RoBertaEmbeddings Individual Living
67 Tagalog tl.embed.roberta_tagalog_base roberta_embeddings_roberta_tagalog_base Embeddings RoBertaEmbeddings Individual Living
68 Tajik tg.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
69 Tatar tt.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
70 Tatar tt.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
71 Tigrinya ti.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
72 Tosk Albanian als.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
73 Tswana tn.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Individual Living
74 Turkmen tk.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
75 Upper Sorbian hsb.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
76 Venetian vec.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
77 Vlaams vls.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
78 Walloon wa.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
79 Waray (Philippines) war.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
80 Western Armenian hyw.pos pos_armtdp Part of Speech Tagging PerceptronModel Individual Living
81 Western Armenian hyw.lemma lemma_armtdp Lemmatization LemmatizerModel Individual Living
82 Western Frisian fy.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
83 Western Panjabi pnb.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
84 Yakut sah.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
85 Zeeuws zea.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Individual Living
86 Albanian sq.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Macrolanguage Living
87 Albanian sq.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
88 Azerbaijani az.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
89 Azerbaijani az.stopwords stopwords_iso Stop Words Removal StopWordsCleaner Macrolanguage Living
90 Malagasy mg.embed.w2v_cc_300d w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
91 Malay (macrolanguage) ms.embed.albert albert_embeddings_albert_large_bahasa_cased Embeddings AlbertEmbeddings Macrolanguage Living
92 Malay (macrolanguage) ms.embed.distilbert distilbert_embeddings_malaysian_distilbert_small Embeddings DistilBertEmbeddings Macrolanguage Living
93 Malay (macrolanguage) [ms.embed.albert_tiny_bahasa_cased](https://nlp.johnsnowlabs.com/2022/04/14/albert_embeddings_albert_tiny_bahasa_cased_ms_3_0.html albert_embeddings_albert_tiny_bahasa_cased Embeddings AlbertEmbeddings Macrolanguage Living
94 Malay (macrolanguage) [ms.embed.albert_base_bahasa_cased](https://nlp.johnsnowlabs.com/2022/04/14/albert_embeddings_albert_base_bahasa_cased_ms_3_0.html albert_embeddings_albert_base_bahasa_cased Embeddings AlbertEmbeddings Macrolanguage Living
95 Malay (macrolanguage) [ms.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_ms_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
96 Mongolian [mn.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_mn_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
97 Oriya (macrolanguage) [or.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_or_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
98 Pashto, Pushto [ps.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_ps_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
99 Quechua [qu.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_qu_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
100 Sardinian [sc.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_sc_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
101 Serbo-Croatian [sh.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_sh_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living
102 Uzbek [uz.embed.w2v_cc_300d](https://nlp.johnsnowlabs.com/2022/03/16/w2v_cc_300d_uz_3_0.html w2v_cc_300d Embeddings WordEmbeddingsModel Macrolanguage Living

All Healthcare models

Powered by the amazing Spark NLP for Healthcare 3.5.2 and Spark NLP for Healthcare 3.5.1 releases.

Number NLU Reference Spark NLP Reference Task Language Name(s) Annotator Class Language Type Scope
0 en.med_ner.biomedical_bc2gm ner_biomedical_bc2gm Named Entity Recognition English MedicalNerModel Living Individual
1 en.med_ner.biomedical_bc2gm ner_biomedical_bc2gm Named Entity Recognition English MedicalNerModel Living Individual
2 en.resolve.rxnorm_action_treatment sbiobertresolve_rxnorm_action_treatment Entity Resolution English SentenceEntityResolverModel Living Individual
3 en.classify.token_bert.ner_ade bert_token_classifier_ner_ade Named Entity Recognition English MedicalBertForTokenClassifier Living Individual
4 en.classify.token_bert.ner_ade bert_token_classifier_ner_ade Named Entity Recognition English MedicalBertForTokenClassifier Living Individual
5 pt.med_ner.deid.subentity ner_deid_subentity De-identification Portuguese MedicalNerModel Living Individual
6 pt.med_ner.deid.generic ner_deid_generic De-identification Portuguese MedicalNerModel Living Individual
7 pt.med_ner.deid ner_deid_generic De-identification Portuguese MedicalNerModel Living Individual
C-K-Loan commented 2 years ago

All general NLP models

Powered by the incredible Spark NLP 3.4.4 and previous releases.

Number NLU Reference Spark NLP Reference Task Language Name(s) Annotator Class Language Type Scope
0 cu.pos pos_proiel Part of Speech Tagging Church Slavic, Church Slavonic, Old Bulgarian, Old Church Slavonic, Old Slavonic PerceptronModel Ancient Individual
1 la.lemma lemma_proiel Lemmatization Latin LemmatizerModel Ancient Individual
2 la.lemma lemma_proiel Lemmatization Latin LemmatizerModel Ancient Individual
3 la.pos pos_perseus Part of Speech Tagging Latin PerceptronModel Ancient Individual
4 la.pos pos_perseus Part of Speech Tagging Latin PerceptronModel Ancient Individual
5 sa.embed.w2v_cc_300d w2v_cc_300d Embeddings Sanskrit WordEmbeddingsModel Ancient Individual
6 sa.lemma lemma_vedic Lemmatization Sanskrit LemmatizerModel Ancient Individual
7 sa.pos pos_vedic Part of Speech Tagging Sanskrit PerceptronModel Ancient Individual
8 sa.stopwords stopwords_iso Stop Words Removal Sanskrit StopWordsCleaner Ancient Individual
9 eo.embed.w2v_cc_300d w2v_cc_300d Embeddings Esperanto WordEmbeddingsModel Constructed Individual
10 vo.embed.w2v_cc_300d w2v_cc_300d Embeddings Volapük WordEmbeddingsModel Constructed Individual
11 cop.pos pos_scriptorium Part of Speech Tagging Coptic PerceptronModel Extinct Individual
12 nah.embed.w2v_cc_300d w2v_cc_300d Embeddings Nahuatl languages WordEmbeddingsModel Genetic Collective
13 grc.lemma lemma_proiel Lemmatization Ancient Greek (to 1453) LemmatizerModel Historical Individual
14 grc.stopwords stopwords_iso Stop Words Removal Ancient Greek (to 1453) StopWordsCleaner Historical Individual
15 grc.lemma lemma_proiel Lemmatization Ancient Greek (to 1453) LemmatizerModel Historical Individual
16 grc.pos pos_proiel Part of Speech Tagging Ancient Greek (to 1453) PerceptronModel Historical Individual
17 orv.lemma lemma_torot Lemmatization Old Russian LemmatizerModel Historical Individual
18 af.embed.w2v_cc_300d w2v_cc_300d Embeddings Afrikaans WordEmbeddingsModel Living Individual
19 af.stopwords stopwords_iso Stop Words Removal Afrikaans StopWordsCleaner Living Individual
20 am.embed.w2v_cc_300d w2v_cc_300d Embeddings Amharic WordEmbeddingsModel Living Individual
21 am.embed.am_roberta roberta_embeddings_am_roberta Embeddings Amharic RoBertaEmbeddings Living Individual
22 am.stopwords stopwords_iso Stop Words Removal Amharic StopWordsCleaner Living Individual
23 an.embed.w2v_cc_300d w2v_cc_300d Embeddings Aragonese WordEmbeddingsModel Living Individual
24 hy.stopwords stopwords_iso Stop Words Removal Armenian StopWordsCleaner Living Individual
25 hy.lemma lemma_armtdp Lemmatization Armenian LemmatizerModel Living Individual
26 hy.embed.w2v_cc_300d w2v_cc_300d Embeddings Armenian WordEmbeddingsModel Living Individual
27 as.embed.w2v_cc_300d w2v_cc_300d Embeddings Assamese WordEmbeddingsModel Living Individual
28 ast.embed.w2v_cc_300d w2v_cc_300d Embeddings Asturian, Asturleonese, Bable, Leonese WordEmbeddingsModel Living Individual
29 ba.embed.w2v_cc_300d w2v_cc_300d Embeddings Bashkir WordEmbeddingsModel Living Individual
30 eu.stopwords stopwords_iso Stop Words Removal Basque StopWordsCleaner Living Individual
31 eu.embed.w2v_cc_300d w2v_cc_300d Embeddings Basque WordEmbeddingsModel Living Individual
32 eu.lemma lemma_bdt Lemmatization Basque LemmatizerModel Living Individual
33 bar.embed.w2v_cc_300d w2v_cc_300d Embeddings Bavarian WordEmbeddingsModel Living Individual
34 be.embed.w2v_cc_300d w2v_cc_300d Embeddings Belarusian WordEmbeddingsModel Living Individual
35 be.lemma lemma_hse Lemmatization Belarusian LemmatizerModel Living Individual
36 bn.embed.indic_transformers_bn_distilbert distilbert_embeddings_indic_transformers_bn_distilbert Embeddings Bengali DistilBertEmbeddings Living Individual
37 bn.embed.w2v_cc_300d w2v_cc_300d Embeddings Bengali WordEmbeddingsModel Living Individual
38 bn.embed.indic_transformers_bn_bert bert_embeddings_indic_transformers_bn_bert Embeddings Bengali BertEmbeddings Living Individual
39 bn.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Bengali BertEmbeddings Living Individual
40 bn.embed.bangla_bert bert_embeddings_bangla_bert Embeddings Bengali BertEmbeddings Living Individual
41 bn.stopwords stopwords_iso Stop Words Removal Bengali StopWordsCleaner Living Individual
42 bh.embed.w2v_cc_300d w2v_cc_300d Embeddings Bihari language group, also known ash bih in ISO 639-2/5 WordEmbeddingsModel Living Individual
43 bpy.embed.w2v_cc_300d w2v_cc_300d Embeddings Bishnupriya WordEmbeddingsModel Living Individual
44 bs.embed.w2v_cc_300d w2v_cc_300d Embeddings Bosnian WordEmbeddingsModel Living Individual
45 br.embed.w2v_cc_300d w2v_cc_300d Embeddings Breton WordEmbeddingsModel Living Individual
46 bg.embed.w2v_cc_300d w2v_cc_300d Embeddings Bulgarian WordEmbeddingsModel Living Individual
47 bg.stopwords stopwords_iso Stop Words Removal Bulgarian StopWordsCleaner Living Individual
48 my.embed.w2v_cc_300d w2v_cc_300d Embeddings Burmese WordEmbeddingsModel Living Individual
49 es.embed.distilbert_base_es_multilingual_cased distilbert_embeddings_distilbert_base_es_multilingual_cased Embeddings Castilian, Spanish DistilBertEmbeddings Living Individual
50 es.embed.distilbert_base_es_cased distilbert_embeddings_distilbert_base_es_cased Embeddings Castilian, Spanish DistilBertEmbeddings Living Individual
51 es.embed.bertin_base_gaussian roberta_embeddings_bertin_base_gaussian Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
52 es.embed.bertin_roberta_base_spanish roberta_embeddings_bertin_roberta_base_spanish Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
53 es.embed.bertin_roberta_large_spanish roberta_embeddings_bertin_roberta_large_spanish Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
54 es.embed.bertin_base_stepwise roberta_embeddings_bertin_base_stepwise Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
55 es.embed.dpr_spanish_passage_encoder_allqa_base bert_embeddings_dpr_spanish_passage_encoder_allqa_base Embeddings Castilian, Spanish BertEmbeddings Living Individual
56 es.embed.dpr_spanish_question_encoder_allqa_base bert_embeddings_dpr_spanish_question_encoder_allqa_base Embeddings Castilian, Spanish BertEmbeddings Living Individual
57 es.embed.beto_gn_base_cased bert_embeddings_beto_gn_base_cased Embeddings Castilian, Spanish BertEmbeddings Living Individual
58 es.embed.dpr_spanish_passage_encoder_squades_base bert_embeddings_dpr_spanish_passage_encoder_squades_base Embeddings Castilian, Spanish BertEmbeddings Living Individual
59 es.embed.dpr_spanish_question_encoder_squades_base bert_embeddings_dpr_spanish_question_encoder_squades_base Embeddings Castilian, Spanish BertEmbeddings Living Individual
60 es.embed.bert_base_es_cased bert_embeddings_bert_base_es_cased Embeddings Castilian, Spanish BertEmbeddings Living Individual
61 es.embed.bert_base_5lang_cased bert_embeddings_bert_base_5lang_cased Embeddings Castilian, Spanish BertEmbeddings Living Individual
62 es.embed.alberti_bert_base_multilingual_cased bert_embeddings_alberti_bert_base_multilingual_cased Embeddings Castilian, Spanish BertEmbeddings Living Individual
63 es.embed.roberta_base_bne roberta_embeddings_roberta_base_bne Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
64 es.embed.jurisbert roberta_embeddings_jurisbert Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
65 es.embed.mlm_spanish_roberta_base roberta_embeddings_mlm_spanish_roberta_base Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
66 es.embed.roberta_large_bne roberta_embeddings_roberta_large_bne Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
67 es.pos pos_ancora Part of Speech Tagging Castilian, Spanish PerceptronModel Living Individual
68 es.embed.bertin_base_random_exp_512seqlen roberta_embeddings_bertin_base_random_exp_512seqlen Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
69 es.embed.bertin_base_gaussian_exp_512seqlen roberta_embeddings_bertin_base_gaussian_exp_512seqlen Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
70 es.ner.roberta_base_bne_capitel_ner_plus roberta_ner_roberta_base_bne_capitel_ner_plus Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
71 es.ner.roberta_base_bne_capitel_ner roberta_ner_roberta_base_bne_capitel_ner Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
72 es.ner.RuPERTa_base_finetuned_ner roberta_ner_RuPERTa_base_finetuned_ner Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
73 es.pos.roberta_base_bne_capitel_pos roberta_pos_roberta_base_bne_capitel_pos Part of Speech Tagging Castilian, Spanish RoBertaForTokenClassification Living Individual
74 es.ner.NER_LAW_MONEY4 roberta_ner_NER_LAW_MONEY4 Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
75 es.pos.roberta_large_bne_capitel_pos roberta_pos_roberta_large_bne_capitel_pos Part of Speech Tagging Castilian, Spanish RoBertaForTokenClassification Living Individual
76 es.ner.bsc_bio_ehr_es_pharmaconer roberta_ner_bsc_bio_ehr_es_pharmaconer Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
77 es.embed.RoBERTalex roberta_embeddings_RoBERTalex Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
78 es.ner.roberta_large_bne_capitel_ner roberta_ner_roberta_large_bne_capitel_ner Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
79 es.embed.RuPERTa_base roberta_embeddings_RuPERTa_base Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
80 es.embed.bertin_base_random roberta_embeddings_bertin_base_random Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
81 es.lemma lemma_spacylookup Lemmatization Castilian, Spanish LemmatizerModel Living Individual
82 es.stopwords stopwords_iso Stop Words Removal Castilian, Spanish StopWordsCleaner Living Individual
83 es.pos.RuPERTa_base_finetuned_pos roberta_pos_RuPERTa_base_finetuned_pos Part of Speech Tagging Castilian, Spanish RoBertaForTokenClassification Living Individual
84 es.embed.bertin_base_stepwise_exp_512seqlen roberta_embeddings_bertin_base_stepwise_exp_512seqlen Embeddings Castilian, Spanish RoBertaEmbeddings Living Individual
85 es.ner.bsc_bio_ehr_es_cantemist roberta_ner_bsc_bio_ehr_es_cantemist Named Entity Recognition Castilian, Spanish RoBertaForTokenClassification Living Individual
86 ca.lemma lemma_spacylookup Lemmatization Catalan, Valencian LemmatizerModel Living Individual
87 ca.embed.w2v_cc_300d w2v_cc_300d Embeddings Catalan, Valencian WordEmbeddingsModel Living Individual
88 ca.stopwords stopwords_iso Stop Words Removal Catalan, Valencian StopWordsCleaner Living Individual
89 ceb.embed.w2v_cc_300d w2v_cc_300d Embeddings Cebuano WordEmbeddingsModel Living Individual
90 bcl.embed.w2v_cc_300d w2v_cc_300d Embeddings Central Bikol WordEmbeddingsModel Living Individual
91 ce.embed.w2v_cc_300d w2v_cc_300d Embeddings Chechen WordEmbeddingsModel Living Individual
92 cv.embed.w2v_cc_300d w2v_cc_300d Embeddings Chuvash WordEmbeddingsModel Living Individual
93 co.embed.w2v_cc_300d w2v_cc_300d Embeddings Corsican WordEmbeddingsModel Living Individual
94 hr.embed.w2v_cc_300d w2v_cc_300d Embeddings Croatian WordEmbeddingsModel Living Individual
95 hr.stopwords stopwords_iso Stop Words Removal Croatian StopWordsCleaner Living Individual
96 hr.lemma lemma_spacylookup Lemmatization Croatian LemmatizerModel Living Individual
97 cs.stopwords stopwords_iso Stop Words Removal Czech StopWordsCleaner Living Individual
98 cs.embed.w2v_cc_300d w2v_cc_300d Embeddings Czech WordEmbeddingsModel Living Individual
99 cs.pos pos_fictree Part of Speech Tagging Czech PerceptronModel Living Individual
100 cs.lemma lemma_cltt Lemmatization Czech LemmatizerModel Living Individual
101 cs.lemma lemma_cltt Lemmatization Czech LemmatizerModel Living Individual
102 cs.lemma lemma_cltt Lemmatization Czech LemmatizerModel Living Individual
103 da.embed.w2v_cc_300d w2v_cc_300d Embeddings Danish WordEmbeddingsModel Living Individual
104 da.lemma lemma_spacylookup Lemmatization Danish LemmatizerModel Living Individual
105 da.stopwords stopwords_iso Stop Words Removal Danish StopWordsCleaner Living Individual
106 dv.embed.w2v_cc_300d w2v_cc_300d Embeddings Dhivehi, Divehi, Maldivian WordEmbeddingsModel Living Individual
107 nl.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_nl_cased Embeddings Dutch, Flemish DistilBertEmbeddings Living Individual
108 nl.pos.fullstop_dutch_punctuation_prediction roberta_pos_fullstop_dutch_punctuation_prediction Part of Speech Tagging Dutch, Flemish RoBertaForTokenClassification Living Individual
109 nl.stopwords stopwords_iso Stop Words Removal Dutch, Flemish StopWordsCleaner Living Individual
110 nl.embed.robbert_v2_dutch_base roberta_embeddings_robbert_v2_dutch_base Embeddings Dutch, Flemish RoBertaEmbeddings Living Individual
111 nl.embed.robbertje_1_gb_bort roberta_embeddings_robbertje_1_gb_bort Embeddings Dutch, Flemish RoBertaEmbeddings Living Individual
112 nl.embed.robbertje_1_gb_shuffled roberta_embeddings_robbertje_1_gb_shuffled Embeddings Dutch, Flemish RoBertaEmbeddings Living Individual
113 nl.embed.robbertje_1_gb_non_shuffled roberta_embeddings_robbertje_1_gb_non_shuffled Embeddings Dutch, Flemish RoBertaEmbeddings Living Individual
114 nl.embed.robbertje_1_gb_merged roberta_embeddings_robbertje_1_gb_merged Embeddings Dutch, Flemish RoBertaEmbeddings Living Individual
115 nl.embed.w2v_cc_300d w2v_cc_300d Embeddings Dutch, Flemish WordEmbeddingsModel Living Individual
116 nl.lemma lemma_spacylookup Lemmatization Dutch, Flemish LemmatizerModel Living Individual
117 arz.embed.w2v_cc_300d w2v_cc_300d Embeddings Egyptian Arabic WordEmbeddingsModel Living Individual
118 eml.embed.w2v_cc_300d w2v_cc_300d Embeddings Emiliano-Romagnolo WordEmbeddingsModel Living Individual
119 en.ner.debertav3_large.conll03 deberta_v3_large_token_classifier_conll03 Named Entity Recognition English DeBertaForTokenClassification Living Individual
120 en.ner.debertav3_base.conll03 deberta_v3_base_token_classifier_conll03 Named Entity Recognition English DeBertaForTokenClassification Living Individual
121 en.ner.debertav3_small.conll03 deberta_v3_small_token_classifier_conll03 Named Entity Recognition English DeBertaForTokenClassification Living Individual
122 en.ner.debertav3_xsmall.conll03 deberta_v3_xsmall_token_classifier_conll03 Named Entity Recognition English DeBertaForTokenClassification Living Individual
123 en.ner.debertav3_large.ontonotes deberta_v3_large_token_classifier_ontonotes Named Entity Recognition English DeBertaForTokenClassification Living Individual
124 en.ner.debertav3_base.ontonotes deberta_v3_base_token_classifier_ontonotes Named Entity Recognition English DeBertaForTokenClassification Living Individual
125 en.ner.debertav3_small.ontonotes deberta_v3_small_token_classifier_ontonotes Named Entity Recognition English DeBertaForTokenClassification Living Individual
126 en.ner.debertav3_xsmall.ontonotes deberta_v3_xsmall_token_classifier_ontonotes Named Entity Recognition English DeBertaForTokenClassification Living Individual
127 en.med_ner.biomedical_bc2gm ner_biomedical_bc2gm Named Entity Recognition English MedicalNerModel Living Individual
128 en.med_ner.biomedical_bc2gm ner_biomedical_bc2gm Named Entity Recognition English MedicalNerModel Living Individual
129 en.resolve.rxnorm_action_treatment sbiobertresolve_rxnorm_action_treatment Entity Resolution English SentenceEntityResolverModel Living Individual
130 en.embed.albert_xlarge_v1 albert_embeddings_albert_xlarge_v1 Embeddings English AlbertEmbeddings Living Individual
131 en.embed.albert_base_v1 albert_embeddings_albert_base_v1 Embeddings English AlbertEmbeddings Living Individual
132 en.embed.albert_xxlarge_v1 albert_embeddings_albert_xxlarge_v1 Embeddings English AlbertEmbeddings Living Individual
133 en.embed.distilbert_base_en_cased distilbert_embeddings_distilbert_base_en_cased Embeddings English DistilBertEmbeddings Living Individual
134 en.embed.distilbert_base_uncased_sparse_90_unstructured_pruneofa distilbert_embeddings_distilbert_base_uncased_sparse_90_unstructured_pruneofa Embeddings English DistilBertEmbeddings Living Individual
135 en.embed.distilbert_base_uncased_sparse_85_unstructured_pruneofa distilbert_embeddings_distilbert_base_uncased_sparse_85_unstructured_pruneofa Embeddings English DistilBertEmbeddings Living Individual
136 en.classify.questionpair classifierdl_electra_questionpair Text Classification English ClassifierDLModel Living Individual
137 en.classify.question_vs_statement bert_sequence_classifier_question_statement Text Classification English BertForSequenceClassification Living Individual
138 en.classify.song_lyrics bert_sequence_classifier_song_lyrics Text Classification English BertForSequenceClassification Living Individual
139 en.embed.muppet_roberta_base roberta_embeddings_muppet_roberta_base Embeddings English RoBertaEmbeddings Living Individual
140 en.embed.muppet_roberta_large roberta_embeddings_muppet_roberta_large Embeddings English RoBertaEmbeddings Living Individual
141 en.embed.fairlex_ecthr_minilm roberta_embeddings_fairlex_ecthr_minilm Embeddings English RoBertaEmbeddings Living Individual
142 en.embed.distilroberta_base_finetuned_jira_qt_issue_titles_and_bodies roberta_embeddings_distilroberta_base_finetuned_jira_qt_issue_titles_and_bodies Embeddings English RoBertaEmbeddings Living Individual
143 en.embed.legal_roberta_base roberta_embeddings_legal_roberta_base Embeddings English RoBertaEmbeddings Living Individual
144 en.embed.distilroberta_base roberta_embeddings_distilroberta_base Embeddings English RoBertaEmbeddings Living Individual
145 en.embed.pmc_med_bio_mlm_roberta_large roberta_embeddings_pmc_med_bio_mlm_roberta_large Embeddings English RoBertaEmbeddings Living Individual
146 en.lemma lemma_lines Lemmatization English LemmatizerModel Living Individual
147 en.lemma lemma_lines Lemmatization English LemmatizerModel Living Individual
148 en.lemma lemma_lines Lemmatization English LemmatizerModel Living Individual
149 en.embed.roberta_pubmed roberta_embeddings_roberta_pubmed Embeddings English RoBertaEmbeddings Living Individual
150 en.embed.fairlex_scotus_minilm roberta_embeddings_fairlex_scotus_minilm Embeddings English RoBertaEmbeddings Living Individual
151 en.embed.distilroberta_base_finetuned_jira_qt_issue_title roberta_embeddings_distilroberta_base_finetuned_jira_qt_issue_title Embeddings English RoBertaEmbeddings Living Individual
152 en.embed.chEMBL26_smiles_v2 roberta_embeddings_chEMBL26_smiles_v2 Embeddings English RoBertaEmbeddings Living Individual
153 en.embed.SecRoBERTa roberta_embeddings_SecRoBERTa Embeddings English RoBertaEmbeddings Living Individual
154 en.embed.distilroberta_base_climate_d_s roberta_embeddings_distilroberta_base_climate_d_s Embeddings English RoBertaEmbeddings Living Individual
155 en.embed.chEMBL_smiles_v1 roberta_embeddings_chEMBL_smiles_v1 Embeddings English RoBertaEmbeddings Living Individual
156 en.embed.distilroberta_base_climate_f roberta_embeddings_distilroberta_base_climate_f Embeddings English RoBertaEmbeddings Living Individual
157 en.embed.distilroberta_base_climate_d roberta_embeddings_distilroberta_base_climate_d Embeddings English RoBertaEmbeddings Living Individual
158 en.embed.Bible_roberta_base roberta_embeddings_Bible_roberta_base Embeddings English RoBertaEmbeddings Living Individual
159 en.embed.w2v_cc_300d w2v_cc_300d Embeddings English WordEmbeddingsModel Living Individual
160 en.pos pos_atis Part of Speech Tagging English PerceptronModel Living Individual
161 en.ner.ner_chemical_bionlp_bc5cdr_pubmed roberta_ner_ner_chemical_bionlp_bc5cdr_pubmed Named Entity Recognition English RoBertaForTokenClassification Living Individual
162 en.pos.roberta_large_english_upos roberta_pos_roberta_large_english_upos Part of Speech Tagging English RoBertaForTokenClassification Living Individual
163 en.ner.roberta_ticker roberta_ner_roberta_ticker Named Entity Recognition English RoBertaForTokenClassification Living Individual
164 en.embed.bert_political_election2020_twitter_mlm bert_embeddings_bert_political_election2020_twitter_mlm Embeddings English BertEmbeddings Living Individual
165 en.embed.bert_base_uncased_mnli_sparse_70_unstructured_no_classifier bert_embeddings_bert_base_uncased_mnli_sparse_70_unstructured_no_classifier Embeddings English BertEmbeddings Living Individual
166 en.embed.crosloengual_bert bert_embeddings_crosloengual_bert Embeddings English BertEmbeddings Living Individual
167 en.embed.chemical_bert_uncased bert_embeddings_chemical_bert_uncased Embeddings English BertEmbeddings Living Individual
168 en.embed.deberta_base_uncased bert_embeddings_deberta_base_uncased Embeddings English BertEmbeddings Living Individual
169 en.embed.bert_base_en_cased bert_embeddings_bert_base_en_cased Embeddings English BertEmbeddings Living Individual
170 en.embed.bert_for_patents bert_embeddings_bert_for_patents Embeddings English BertEmbeddings Living Individual
171 en.embed.SecBERT bert_embeddings_SecBERT Embeddings English BertEmbeddings Living Individual
172 en.embed.bert_base_5lang_cased bert_embeddings_bert_base_5lang_cased Embeddings English BertEmbeddings Living Individual
173 en.embed.DiLBERT bert_embeddings_DiLBERT Embeddings English BertEmbeddings Living Individual
174 en.embed.FinancialBERT bert_embeddings_FinancialBERT Embeddings English BertEmbeddings Living Individual
175 en.embed.false_positives_scancode_bert_base_uncased_L8_1 bert_embeddings_false_positives_scancode_bert_base_uncased_L8_1 Embeddings English BertEmbeddings Living Individual
176 en.embed.legal_bert_small_uncased bert_embeddings_legal_bert_small_uncased Embeddings English BertEmbeddings Living Individual
177 en.embed.legal_bert_base_uncased bert_embeddings_legal_bert_base_uncased Embeddings English BertEmbeddings Living Individual
178 en.embed.COVID_SciBERT bert_embeddings_COVID_SciBERT Embeddings English BertEmbeddings Living Individual
179 en.embed.e bert_biolink_base Embeddings English BertEmbeddings Living Individual
180 en.embed.danbert_small_cased bert_embeddings_danbert_small_cased Embeddings English BertEmbeddings Living Individual
181 en.embed.bert_base_uncased_dstc9 bert_embeddings_bert_base_uncased_dstc9 Embeddings English BertEmbeddings Living Individual
182 en.embed.hateBERT bert_embeddings_hateBERT Embeddings English BertEmbeddings Living Individual
183 en.embed.childes_bert bert_embeddings_childes_bert Embeddings English BertEmbeddings Living Individual
184 en.embed.clinical_pubmed_bert_base_512 bert_embeddings_clinical_pubmed_bert_base_512 Embeddings English BertEmbeddings Living Individual
185 en.embed.netbert bert_embeddings_netbert Embeddings English BertEmbeddings Living Individual
186 en.embed.psych_search bert_embeddings_psych_search Embeddings English BertEmbeddings Living Individual
187 en.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings English BertEmbeddings Living Individual
188 en.embed.finbert_pretrain_yiyanghkust bert_embeddings_finbert_pretrain_yiyanghkust Embeddings English BertEmbeddings Living Individual
189 en.embed.lic_class_scancode_bert_base_cased_L32_1 bert_embeddings_lic_class_scancode_bert_base_cased_L32_1 Embeddings English BertEmbeddings Living Individual
190 en.embed.sec_bert_sh bert_embeddings_sec_bert_sh Embeddings English BertEmbeddings Living Individual
191 en.embed.sec_bert_num bert_embeddings_sec_bert_num Embeddings English BertEmbeddings Living Individual
192 en.embed.finest_bert bert_embeddings_finest_bert Embeddings English BertEmbeddings Living Individual
193 en.embed.bert_large_cased_whole_word_masking bert_embeddings_bert_large_cased_whole_word_masking Embeddings English BertEmbeddings Living Individual
194 en.embed.clinical_pubmed_bert_base_128 bert_embeddings_clinical_pubmed_bert_base_128 Embeddings English BertEmbeddings Living Individual
195 en.embed.bert_base_uncased_sparse_70_unstructured bert_embeddings_bert_base_uncased_sparse_70_unstructured Embeddings English BertEmbeddings Living Individual
196 en.embed.sec_bert_base bert_embeddings_sec_bert_base Embeddings English BertEmbeddings Living Individual
197 en.stopwords stopwords_iso Stop Words Removal English StopWordsCleaner Living Individual
198 en.embed.agriculture_bert_uncased bert_embeddings_agriculture_bert_uncased Embeddings English BertEmbeddings Living Individual
199 en.embed.bert_large_uncased_whole_word_masking bert_embeddings_bert_large_uncased_whole_word_masking Embeddings English BertEmbeddings Living Individual
200 en.embed.ge bert_biolink_large Embeddings English BertEmbeddings Living Individual
201 en.ner.roberta_large_finetuned_abbr roberta_ner_roberta_large_finetuned_abbr Named Entity Recognition English RoBertaForTokenClassification Living Individual
202 en.ner.roberta_classics_ner roberta_ner_roberta_classics_ner Named Entity Recognition English RoBertaForTokenClassification Living Individual
203 en.pos.roberta_base_english_upos roberta_pos_roberta_base_english_upos Part of Speech Tagging English RoBertaForTokenClassification Living Individual
204 en.ner.roberta_large_ner_english roberta_ner_roberta_large_ner_english Named Entity Recognition English RoBertaForTokenClassification Living Individual
205 en.ner.ner_gene_dna_rna_jnlpba_pubmed roberta_ner_ner_gene_dna_rna_jnlpba_pubmed Named Entity Recognition English RoBertaForTokenClassification Living Individual
206 en.ner.ner_disease_ncbi_bionlp_bc5cdr_pubmed roberta_ner_ner_disease_ncbi_bionlp_bc5cdr_pubmed Named Entity Recognition English RoBertaForTokenClassification Living Individual
207 myv.embed.w2v_cc_300d w2v_cc_300d Embeddings Erzya WordEmbeddingsModel Living Individual
208 fo.pos pos_farpahc Part of Speech Tagging Faroese PerceptronModel Living Individual
209 fi.embed.w2v_cc_300d w2v_cc_300d Embeddings Finnish WordEmbeddingsModel Living Individual
210 fi.pos pos_tdt Part of Speech Tagging Finnish PerceptronModel Living Individual
211 fi.lemma lemma_tdt Lemmatization Finnish LemmatizerModel Living Individual
212 fi.stopwords stopwords_iso Stop Words Removal Finnish StopWordsCleaner Living Individual
213 fi.lemma lemma_tdt Lemmatization Finnish LemmatizerModel Living Individual
214 fr.embed.camembert_large camembert_large Embeddings French CamemBertEmbeddings Living Individual
215 fr.embed.camembert_base camembert_base Embeddings French CamemBertEmbeddings Living Individual
216 fr.embed.camembert_ccnet4g camembert_base_ccnet_4gb Embeddings French CamemBertEmbeddings Living Individual
217 fr.embed.camembert_base_ccnet camembert_base_ccnet Embeddings French CamemBertEmbeddings Living Individual
218 fr.embed.camembert_oscar_4g camembert_base_oscar_4gb Embeddings French CamemBertEmbeddings Living Individual
219 fr.embed.camembert_wiki_4g camembert_base_wikipedia_4gb Embeddings French CamemBertEmbeddings Living Individual
220 fr.embed.albert albert_embeddings_fralbert_base Embeddings French AlbertEmbeddings Living Individual
221 fr.embed.distilbert distilbert_embeddings_distilbert_base_fr_cased Embeddings French DistilBertEmbeddings Living Individual
222 fr.embed.bert_base_fr_cased bert_embeddings_bert_base_fr_cased Embeddings French BertEmbeddings Living Individual
223 fr.pos pos_sequoia Part of Speech Tagging French PerceptronModel Living Individual
224 fr.pos pos_sequoia Part of Speech Tagging French PerceptronModel Living Individual
225 fr.embed.french_roberta roberta_embeddings_french_roberta Embeddings French RoBertaEmbeddings Living Individual
226 fr.lemma lemma_ftb Lemmatization French LemmatizerModel Living Individual
227 fr.lemma lemma_ftb Lemmatization French LemmatizerModel Living Individual
228 fr.stopwords stopwords_iso Stop Words Removal French StopWordsCleaner Living Individual
229 fr.embed.roberta_base_wechsel_french roberta_embeddings_roberta_base_wechsel_french Embeddings French RoBertaEmbeddings Living Individual
230 gd.embed.w2v_cc_300d w2v_cc_300d Embeddings Gaelic, Scottish Gaelic WordEmbeddingsModel Living Individual
231 gl.embed.w2v_cc_300d w2v_cc_300d Embeddings Galician WordEmbeddingsModel Living Individual
232 gl.lemma lemma_treegal Lemmatization Galician LemmatizerModel Living Individual
233 ka.embed.w2v_cc_300d w2v_cc_300d Embeddings Georgian WordEmbeddingsModel Living Individual
234 de.embed.distilbert_base_de_cased distilbert_embeddings_distilbert_base_de_cased Embeddings German DistilBertEmbeddings Living Individual
235 de.embed.distilbert_base_german_cased distilbert_embeddings_distilbert_base_german_cased Embeddings German DistilBertEmbeddings Living Individual
236 de.embed.albert_german_ner albert_embeddings_albert_german_ner Embeddings German AlbertEmbeddings Living Individual
237 de.embed.bert_base_historical_german_rw_cased bert_embeddings_bert_base_historical_german_rw_cased Embeddings German BertEmbeddings Living Individual
238 de.embed.gbert_base bert_embeddings_gbert_base Embeddings German BertEmbeddings Living Individual
239 de.embed.german_financial_statements_bert bert_embeddings_german_financial_statements_bert Embeddings German BertEmbeddings Living Individual
240 de.stopwords stopwords_iso Stop Words Removal German StopWordsCleaner Living Individual
241 de.lemma lemma_spacylookup Lemmatization German LemmatizerModel Living Individual
242 de.embed.bert_base_german_dbmdz_uncased bert_embeddings_bert_base_german_dbmdz_uncased Embeddings German BertEmbeddings Living Individual
243 de.embed.roberta_base_wechsel_german roberta_embeddings_roberta_base_wechsel_german Embeddings German RoBertaEmbeddings Living Individual
244 de.embed.gbert_large bert_embeddings_gbert_large Embeddings German BertEmbeddings Living Individual
245 de.embed.bert_base_5lang_cased bert_embeddings_bert_base_5lang_cased Embeddings German BertEmbeddings Living Individual
246 de.embed.bert_base_german_cased_oldvocab bert_embeddings_bert_base_german_cased_oldvocab Embeddings German BertEmbeddings Living Individual
247 de.embed.bert_base_de_cased bert_embeddings_bert_base_de_cased Embeddings German BertEmbeddings Living Individual
248 de.embed.bert_base_german_uncased bert_embeddings_bert_base_german_uncased Embeddings German BertEmbeddings Living Individual
249 de.embed.bert_base_german_dbmdz_cased bert_embeddings_bert_base_german_dbmdz_cased Embeddings German BertEmbeddings Living Individual
250 gom.embed.w2v_cc_300d w2v_cc_300d Embeddings Goan Konkani WordEmbeddingsModel Living Individual
251 gu.embed.RoBERTa_hindi_guj_san roberta_embeddings_RoBERTa_hindi_guj_san Embeddings Gujarati RoBertaEmbeddings Living Individual
252 gu.stopwords stopwords_iso Stop Words Removal Gujarati StopWordsCleaner Living Individual
253 he.stopwords stopwords_iso Stop Words Removal Hebrew StopWordsCleaner Living Individual
254 hi.embed.distilbert_base_hi_cased distilbert_embeddings_distilbert_base_hi_cased Embeddings Hindi DistilBertEmbeddings Living Individual
255 hi.embed.indic_transformers_hi_distilbert distilbert_embeddings_indic_transformers_hi_distilbert Embeddings Hindi DistilBertEmbeddings Living Individual
256 hi.stopwords stopwords_iso Stop Words Removal Hindi StopWordsCleaner Living Individual
257 hi.embed.RoBERTa_hindi_guj_san roberta_embeddings_RoBERTa_hindi_guj_san Embeddings Hindi RoBertaEmbeddings Living Individual
258 hi.embed.indic_transformers_hi_roberta roberta_embeddings_indic_transformers_hi_roberta Embeddings Hindi RoBertaEmbeddings Living Individual
259 hi.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Hindi BertEmbeddings Living Individual
260 hi.embed.indic_transformers_hi_bert bert_embeddings_indic_transformers_hi_bert Embeddings Hindi BertEmbeddings Living Individual
261 hu.lemma lemma_spacylookup Lemmatization Hungarian LemmatizerModel Living Individual
262 hu.stopwords stopwords_iso Stop Words Removal Hungarian StopWordsCleaner Living Individual
263 is.lemma lemma_icepahc Lemmatization Icelandic LemmatizerModel Living Individual
264 is.stopwords stopwords_iso Stop Words Removal Icelandic StopWordsCleaner Living Individual
265 id.embed.distilbert distilbert_embeddings_distilbert_base_indonesian Embeddings Indonesian DistilBertEmbeddings Living Individual
266 id.pos pos_csui Part of Speech Tagging Indonesian PerceptronModel Living Individual
267 id.embed.indo_roberta_small roberta_embeddings_indo_roberta_small Embeddings Indonesian RoBertaEmbeddings Living Individual
268 id.embed.indonesian_roberta_base roberta_embeddings_indonesian_roberta_base Embeddings Indonesian RoBertaEmbeddings Living Individual
269 id.pos.indonesian_roberta_base_posp_tagger roberta_pos_indonesian_roberta_base_posp_tagger Part of Speech Tagging Indonesian RoBertaForTokenClassification Living Individual
270 id.lemma lemma_gsd Lemmatization Indonesian LemmatizerModel Living Individual
271 id.lemma lemma_gsd Lemmatization Indonesian LemmatizerModel Living Individual
272 id.embed.roberta_base_indonesian_522M roberta_embeddings_roberta_base_indonesian_522M Embeddings Indonesian RoBertaEmbeddings Living Individual
273 id.stopwords stopwords_iso Stop Words Removal Indonesian StopWordsCleaner Living Individual
274 id.embed.indonesian_roberta_large roberta_embeddings_indonesian_roberta_large Embeddings Indonesian RoBertaEmbeddings Living Individual
275 ga.pos pos_idt Part of Speech Tagging Irish PerceptronModel Living Individual
276 ga.stopwords stopwords_iso Stop Words Removal Irish StopWordsCleaner Living Individual
277 it.embed.distilbert_base_it_cased distilbert_embeddings_distilbert_base_it_cased Embeddings Italian DistilBertEmbeddings Living Individual
278 it.embed.BERTino distilbert_embeddings_BERTino Embeddings Italian DistilBertEmbeddings Living Individual
279 it.stopwords stopwords_iso Stop Words Removal Italian StopWordsCleaner Living Individual
280 it.pos pos_partut Part of Speech Tagging Italian PerceptronModel Living Individual
281 it.embed.bert_base_italian_xxl_cased bert_embeddings_bert_base_italian_xxl_cased Embeddings Italian BertEmbeddings Living Individual
282 it.embed.bert_base_italian_xxl_uncased bert_embeddings_bert_base_italian_xxl_uncased Embeddings Italian BertEmbeddings Living Individual
283 it.embed.chefberto_italian_cased bert_embeddings_chefberto_italian_cased Embeddings Italian BertEmbeddings Living Individual
284 it.embed.hseBert_it_cased bert_embeddings_hseBert_it_cased Embeddings Italian BertEmbeddings Living Individual
285 it.embed.wineberto_italian_cased bert_embeddings_wineberto_italian_cased Embeddings Italian BertEmbeddings Living Individual
286 it.pos pos_partut Part of Speech Tagging Italian PerceptronModel Living Individual
287 it.lemma lemma_twittiro Lemmatization Italian LemmatizerModel Living Individual
288 it.lemma lemma_twittiro Lemmatization Italian LemmatizerModel Living Individual
289 it.lemma lemma_twittiro Lemmatization Italian LemmatizerModel Living Individual
290 ja.embed.distilbert_base_ja_cased distilbert_embeddings_distilbert_base_ja_cased Embeddings Japanese DistilBertEmbeddings Living Individual
291 ja.embed.albert_base_japanese_v1 albert_embeddings_albert_base_japanese_v1 Embeddings Japanese AlbertEmbeddings Living Individual
292 ja.embed.bert_base_ja_cased bert_embeddings_bert_base_ja_cased Embeddings Japanese BertEmbeddings Living Individual
293 ja.embed.bert_base_japanese_char_v2 bert_embeddings_bert_base_japanese_char_v2 Embeddings Japanese BertEmbeddings Living Individual
294 ja.embed.bert_base_japanese_char_extended bert_embeddings_bert_base_japanese_char_extended Embeddings Japanese BertEmbeddings Living Individual
295 ja.embed.bert_large_japanese_char bert_embeddings_bert_large_japanese_char Embeddings Japanese BertEmbeddings Living Individual
296 ja.embed.bert_large_japanese bert_embeddings_bert_large_japanese Embeddings Japanese BertEmbeddings Living Individual
297 ja.embed.bert_small_japanese bert_embeddings_bert_small_japanese Embeddings Japanese BertEmbeddings Living Individual
298 ja.embed.bert_large_japanese_char_extended bert_embeddings_bert_large_japanese_char_extended Embeddings Japanese BertEmbeddings Living Individual
299 ja.pos pos_gsd Part of Speech Tagging Japanese PerceptronModel Living Individual
300 ja.embed.bert_small_japanese_fin bert_embeddings_bert_small_japanese_fin Embeddings Japanese BertEmbeddings Living Individual
301 ja.embed.bert_base_japanese_basic_char_v2 bert_embeddings_bert_base_japanese_basic_char_v2 Embeddings Japanese BertEmbeddings Living Individual
302 ja.stopwords stopwords_iso Stop Words Removal Japanese StopWordsCleaner Living Individual
303 ja.embed.bert_base_japanese_char_whole_word_masking bert_embeddings_bert_base_japanese_char_whole_word_masking Embeddings Japanese BertEmbeddings Living Individual
304 ja.embed.bert_base_japanese_char bert_embeddings_bert_base_japanese_char Embeddings Japanese BertEmbeddings Living Individual
305 ja.embed.bert_base_japanese_whole_word_masking bert_embeddings_bert_base_japanese_whole_word_masking Embeddings Japanese BertEmbeddings Living Individual
306 ja.embed.bert_base_japanese_v2 bert_embeddings_bert_base_japanese_v2 Embeddings Japanese BertEmbeddings Living Individual
307 jv.embed.distilbert distilbert_embeddings_javanese_distilbert_small Embeddings Javanese DistilBertEmbeddings Living Individual
308 jv.embed.javanese_distilbert_small_imdb distilbert_embeddings_javanese_distilbert_small_imdb Embeddings Javanese DistilBertEmbeddings Living Individual
309 jv.embed.javanese_roberta_small roberta_embeddings_javanese_roberta_small Embeddings Javanese RoBertaEmbeddings Living Individual
310 jv.embed.javanese_roberta_small_imdb roberta_embeddings_javanese_roberta_small_imdb Embeddings Javanese RoBertaEmbeddings Living Individual
311 jv.embed.javanese_bert_small_imdb bert_embeddings_javanese_bert_small_imdb Embeddings Javanese BertEmbeddings Living Individual
312 jv.embed.javanese_bert_small bert_embeddings_javanese_bert_small Embeddings Javanese BertEmbeddings Living Individual
313 kn.embed.KNUBert roberta_embeddings_KNUBert Embeddings Kannada RoBertaEmbeddings Living Individual
314 kn.embed.KanBERTo roberta_embeddings_KanBERTo Embeddings Kannada RoBertaEmbeddings Living Individual
315 kn.stopwords stopwords_iso Stop Words Removal Kannada StopWordsCleaner Living Individual
316 ky.stopwords stopwords_iso Stop Words Removal Kirghiz, Kyrgyz StopWordsCleaner Living Individual
317 ko.lemma lemma_gsd Lemmatization Korean LemmatizerModel Living Individual
318 ko.stopwords stopwords_iso Stop Words Removal Korean StopWordsCleaner Living Individual
319 ko.embed.roberta_ko_small roberta_embeddings_roberta_ko_small Embeddings Korean RoBertaEmbeddings Living Individual
320 ko.pos pos_gsd Part of Speech Tagging Korean PerceptronModel Living Individual
321 ko.embed.bert_kor_base bert_embeddings_bert_kor_base Embeddings Korean BertEmbeddings Living Individual
322 ko.embed.dbert bert_embeddings_dbert Embeddings Korean BertEmbeddings Living Individual
323 ko.embed.KR_FinBert bert_embeddings_KR_FinBert Embeddings Korean BertEmbeddings Living Individual
324 ko.embed.bert_base_v1_sports bert_embeddings_bert_base_v1_sports Embeddings Korean BertEmbeddings Living Individual
325 ko.lemma lemma_gsd Lemmatization Korean LemmatizerModel Living Individual
326 lb.stopwords stopwords_iso Stop Words Removal Letzeburgesch, Luxembourgish StopWordsCleaner Living Individual
327 lb.lemma lemma_spacylookup Lemmatization Letzeburgesch, Luxembourgish LemmatizerModel Living Individual
328 lb.embed.w2v_cc_300d w2v_cc_300d Embeddings Letzeburgesch, Luxembourgish WordEmbeddingsModel Living Individual
329 lij.stopwords stopwords_iso Stop Words Removal Ligurian StopWordsCleaner Living Individual
330 lt.embed.w2v_cc_300d w2v_cc_300d Embeddings Lithuanian WordEmbeddingsModel Living Individual
331 lt.lemma lemma_spacylookup Lemmatization Lithuanian LemmatizerModel Living Individual
332 lt.stopwords stopwords_iso Stop Words Removal Lithuanian StopWordsCleaner Living Individual
333 lmo.embed.w2v_cc_300d w2v_cc_300d Embeddings Lombard WordEmbeddingsModel Living Individual
334 nds.embed.w2v_cc_300d w2v_cc_300d Embeddings Low German, Low Saxon WordEmbeddingsModel Living Individual
335 mk.stopwords stopwords_iso Stop Words Removal Macedonian StopWordsCleaner Living Individual
336 mk.lemma lemma_spacylookup Lemmatization Macedonian LemmatizerModel Living Individual
337 mk.embed.w2v_cc_300d w2v_cc_300d Embeddings Macedonian WordEmbeddingsModel Living Individual
338 mai.embed.w2v_cc_300d w2v_cc_300d Embeddings Maithili WordEmbeddingsModel Living Individual
339 ml.stopwords stopwords_iso Stop Words Removal Malayalam StopWordsCleaner Living Individual
340 ml.embed.w2v_cc_300d w2v_cc_300d Embeddings Malayalam WordEmbeddingsModel Living Individual
341 mt.lemma lemma_mudt Lemmatization Maltese LemmatizerModel Living Individual
342 mt.pos pos_mudt Part of Speech Tagging Maltese PerceptronModel Living Individual
343 mt.embed.w2v_cc_300d w2v_cc_300d Embeddings Maltese WordEmbeddingsModel Living Individual
344 gv.embed.w2v_cc_300d w2v_cc_300d Embeddings Manx WordEmbeddingsModel Living Individual
345 mr.embed.distilbert distilbert_embeddings_marathi_distilbert Embeddings Marathi DistilBertEmbeddings Living Individual
346 mr.embed.albert albert_embeddings_marathi_albert Embeddings Marathi AlbertEmbeddings Living Individual
347 mr.embed.albert albert_embeddings_marathi_albert Embeddings Marathi AlbertEmbeddings Living Individual
348 mr.embed.albert_v2 albert_embeddings_marathi_albert_v2 Embeddings Marathi AlbertEmbeddings Living Individual
349 mr.embed.albert_v2 albert_embeddings_marathi_albert_v2 Embeddings Marathi AlbertEmbeddings Living Individual
350 mr.lemma lemma_ufal Lemmatization Marathi LemmatizerModel Living Individual
351 mr.stopwords stopwords_iso Stop Words Removal Marathi StopWordsCleaner Living Individual
352 mr.embed.marathi_bert bert_embeddings_marathi_bert Embeddings Marathi BertEmbeddings Living Individual
353 mr.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Marathi BertEmbeddings Living Individual
354 mr.pos pos_ufal Part of Speech Tagging Marathi PerceptronModel Living Individual
355 mzn.embed.w2v_cc_300d w2v_cc_300d Embeddings Mazanderani WordEmbeddingsModel Living Individual
356 min.embed.w2v_cc_300d w2v_cc_300d Embeddings Minangkabau WordEmbeddingsModel Living Individual
357 xmf.embed.w2v_cc_300d w2v_cc_300d Embeddings Mingrelian WordEmbeddingsModel Living Individual
358 mwl.embed.w2v_cc_300d w2v_cc_300d Embeddings Mirandese WordEmbeddingsModel Living Individual
359 el.stopwords stopwords_iso Stop Words Removal Modern Greek (1453-) StopWordsCleaner Living Individual
360 ro.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_ro_cased Embeddings Moldavian, Moldovan, Romanian DistilBertEmbeddings Living Individual
361 ro.embed.ALR_BERT albert_embeddings_ALR_BERT Embeddings Moldavian, Moldovan, Romanian AlbertEmbeddings Living Individual
362 ro.embed.w2v_cc_300d w2v_cc_300d Embeddings Moldavian, Moldovan, Romanian WordEmbeddingsModel Living Individual
363 ro.stopwords stopwords_iso Stop Words Removal Moldavian, Moldovan, Romanian StopWordsCleaner Living Individual
364 ro.pos pos_nonstandard Part of Speech Tagging Moldavian, Moldovan, Romanian PerceptronModel Living Individual
365 ro.lemma lemma_spacylookup Lemmatization Moldavian, Moldovan, Romanian LemmatizerModel Living Individual
366 nap.embed.w2v_cc_300d w2v_cc_300d Embeddings Neapolitan WordEmbeddingsModel Living Individual
367 new.embed.w2v_cc_300d w2v_cc_300d Embeddings Nepal Bhasa, Newari WordEmbeddingsModel Living Individual
368 frr.embed.w2v_cc_300d w2v_cc_300d Embeddings Northern Frisian WordEmbeddingsModel Living Individual
369 sme.lemma lemma_giella Lemmatization Northern Sami LemmatizerModel Living Individual
370 sme.pos pos_giella Part of Speech Tagging Northern Sami PerceptronModel Living Individual
371 nso.embed.w2v_cc_300d w2v_cc_300d Embeddings Northern Sotho, Pedi, Sepedi WordEmbeddingsModel Living Individual
372 nb.stopwords stopwords_iso Stop Words Removal Norwegian Bokmål StopWordsCleaner Living Individual
373 nb.lemma lemma_spacylookup Lemmatization Norwegian Bokmål LemmatizerModel Living Individual
374 nn.embed.w2v_cc_300d w2v_cc_300d Embeddings Norwegian Nynorsk WordEmbeddingsModel Living Individual
375 oc.embed.w2v_cc_300d w2v_cc_300d Embeddings Occitan (post 1500) WordEmbeddingsModel Living Individual
376 os.embed.w2v_cc_300d w2v_cc_300d Embeddings Ossetian, Ossetic WordEmbeddingsModel Living Individual
377 pa.embed.w2v_cc_300d w2v_cc_300d Embeddings Panjabi, Punjabi WordEmbeddingsModel Living Individual
378 pa.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Panjabi, Punjabi BertEmbeddings Living Individual
379 pfl.embed.w2v_cc_300d w2v_cc_300d Embeddings Pfaelzisch WordEmbeddingsModel Living Individual
380 pms.embed.w2v_cc_300d w2v_cc_300d Embeddings Piemontese WordEmbeddingsModel Living Individual
381 pl.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_pl_cased Embeddings Polish DistilBertEmbeddings Living Individual
382 pl.stopwords stopwords_iso Stop Words Removal Polish StopWordsCleaner Living Individual
383 pl.embed.w2v_cc_300d w2v_cc_300d Embeddings Polish WordEmbeddingsModel Living Individual
384 pl.lemma lemma_lfg Lemmatization Polish LemmatizerModel Living Individual
385 pt.med_ner.deid.subentity ner_deid_subentity De-identification Portuguese MedicalNerModel Living Individual
386 pt.med_ner.deid.generic ner_deid_generic De-identification Portuguese MedicalNerModel Living Individual
387 pt.med_ner.deid ner_deid_generic De-identification Portuguese MedicalNerModel Living Individual
388 pt.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_pt_cased Embeddings Portuguese DistilBertEmbeddings Living Individual
389 pt.embed.BR_BERTo roberta_embeddings_BR_BERTo Embeddings Portuguese RoBertaEmbeddings Living Individual
390 pt.embed.gs_all biobert_embeddings_all Embeddings Portuguese BertEmbeddings Living Individual
391 pt.stopwords stopwords_iso Stop Words Removal Portuguese StopWordsCleaner Living Individual
392 pt.embed.gs_clinical biobert_embeddings_clinical Embeddings Portuguese BertEmbeddings Living Individual
393 pt.embed.gs_biomedical biobert_embeddings_biomedical Embeddings Portuguese BertEmbeddings Living Individual
394 pt.lemma lemma_bosque Lemmatization Portuguese LemmatizerModel Living Individual
395 pt.lemma lemma_bosque Lemmatization Portuguese LemmatizerModel Living Individual
396 pt.embed.bert_base_portuguese_cased_finetuned_tcu_acordaos bert_embeddings_bert_base_portuguese_cased_finetuned_tcu_acordaos Embeddings Portuguese BertEmbeddings Living Individual
397 pt.ner.satellite_instrument_roberta_NER roberta_ner_satellite_instrument_roberta_NER Named Entity Recognition Portuguese RoBertaForTokenClassification Living Individual
398 pt.embed.bert_small_gl_cased bert_embeddings_bert_small_gl_cased Embeddings Portuguese BertEmbeddings Living Individual
399 pt.embed.bert_large_cased_pt_lenerbr bert_embeddings_bert_large_cased_pt_lenerbr Embeddings Portuguese BertEmbeddings Living Individual
400 pt.embed.bert_large_portuguese_cased bert_embeddings_bert_large_portuguese_cased Embeddings Portuguese BertEmbeddings Living Individual
401 pt.embed.bert_base_cased_pt_lenerbr bert_embeddings_bert_base_cased_pt_lenerbr Embeddings Portuguese BertEmbeddings Living Individual
402 pt.embed.bert_base_portuguese_cased_finetuned_peticoes bert_embeddings_bert_base_portuguese_cased_finetuned_peticoes Embeddings Portuguese BertEmbeddings Living Individual
403 pt.embed.bert_base_portuguese_cased bert_embeddings_bert_base_portuguese_cased Embeddings Portuguese BertEmbeddings Living Individual
404 pt.embed.bert_base_pt_cased bert_embeddings_bert_base_pt_cased Embeddings Portuguese BertEmbeddings Living Individual
405 pt.embed.bert_base_gl_cased bert_embeddings_bert_base_gl_cased Embeddings Portuguese BertEmbeddings Living Individual
406 rm.embed.w2v_cc_300d w2v_cc_300d Embeddings Romansh WordEmbeddingsModel Living Individual
407 ru.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_ru_cased Embeddings Russian DistilBertEmbeddings Living Individual
408 ru.pos pos_syntagrus Part of Speech Tagging Russian PerceptronModel Living Individual
409 ru.lemma lemma_gsd Lemmatization Russian LemmatizerModel Living Individual
410 ru.lemma lemma_gsd Lemmatization Russian LemmatizerModel Living Individual
411 ru.embed.ruRoberta_large roberta_embeddings_ruRoberta_large Embeddings Russian RoBertaEmbeddings Living Individual
412 ru.pos pos_syntagrus Part of Speech Tagging Russian PerceptronModel Living Individual
413 ru.stopwords stopwords_iso Stop Words Removal Russian StopWordsCleaner Living Individual
414 ru.embed.roberta_base_russian_v0 roberta_embeddings_roberta_base_russian_v0 Embeddings Russian RoBertaEmbeddings Living Individual
415 ru.embed.bert_base_ru_cased bert_embeddings_bert_base_ru_cased Embeddings Russian BertEmbeddings Living Individual
416 ru.embed.w2v_cc_300d w2v_cc_300d Embeddings Russian WordEmbeddingsModel Living Individual
417 sco.embed.w2v_cc_300d w2v_cc_300d Embeddings Scots WordEmbeddingsModel Living Individual
418 sr.lemma lemma_spacylookup Lemmatization Serbian LemmatizerModel Living Individual
419 sr.embed.w2v_cc_300d w2v_cc_300d Embeddings Serbian WordEmbeddingsModel Living Individual
420 sr.lemma lemma_spacylookup Lemmatization Serbian LemmatizerModel Living Individual
421 sr.stopwords stopwords_iso Stop Words Removal Serbian StopWordsCleaner Living Individual
422 scn.embed.w2v_cc_300d w2v_cc_300d Embeddings Sicilian WordEmbeddingsModel Living Individual
423 sd.embed.w2v_cc_300d w2v_cc_300d Embeddings Sindhi WordEmbeddingsModel Living Individual
424 si.stopwords stopwords_iso Stop Words Removal Sinhala, Sinhalese StopWordsCleaner Living Individual
425 si.embed.w2v_cc_300d w2v_cc_300d Embeddings Sinhala, Sinhalese WordEmbeddingsModel Living Individual
426 sk.stopwords stopwords_iso Stop Words Removal Slovak StopWordsCleaner Living Individual
427 sk.lemma lemma_snk Lemmatization Slovak LemmatizerModel Living Individual
428 sk.embed.w2v_cc_300d w2v_cc_300d Embeddings Slovak WordEmbeddingsModel Living Individual
429 sl.lemma lemma_sst Lemmatization Slovenian LemmatizerModel Living Individual
430 sl.stopwords stopwords_iso Stop Words Removal Slovenian StopWordsCleaner Living Individual
431 sl.pos pos_sst Part of Speech Tagging Slovenian PerceptronModel Living Individual
432 sl.embed.w2v_cc_300d w2v_cc_300d Embeddings Slovenian WordEmbeddingsModel Living Individual
433 so.embed.w2v_cc_300d w2v_cc_300d Embeddings Somali WordEmbeddingsModel Living Individual
434 su.embed.w2v_cc_300d w2v_cc_300d Embeddings Sundanese WordEmbeddingsModel Living Individual
435 su.embed.sundanese_roberta_base roberta_embeddings_sundanese_roberta_base Embeddings Sundanese RoBertaEmbeddings Living Individual
436 sv.stopwords stopwords_iso Stop Words Removal Swedish StopWordsCleaner Living Individual
437 sv.embed.w2v_cc_300d w2v_cc_300d Embeddings Swedish WordEmbeddingsModel Living Individual
438 sv.lemma lemma_lines Lemmatization Swedish LemmatizerModel Living Individual
439 sv.lemma lemma_lines Lemmatization Swedish LemmatizerModel Living Individual
440 tl.lemma lemma_spacylookup Lemmatization Tagalog LemmatizerModel Living Individual
441 tl.embed.w2v_cc_300d w2v_cc_300d Embeddings Tagalog WordEmbeddingsModel Living Individual
442 tl.stopwords stopwords_iso Stop Words Removal Tagalog StopWordsCleaner Living Individual
443 tl.embed.roberta_tagalog_large roberta_embeddings_roberta_tagalog_large Embeddings Tagalog RoBertaEmbeddings Living Individual
444 tl.embed.roberta_tagalog_base roberta_embeddings_roberta_tagalog_base Embeddings Tagalog RoBertaEmbeddings Living Individual
445 tg.embed.w2v_cc_300d w2v_cc_300d Embeddings Tajik WordEmbeddingsModel Living Individual
446 ta.stopwords stopwords_iso Stop Words Removal Tamil StopWordsCleaner Living Individual
447 ta.embed.w2v_cc_300d w2v_cc_300d Embeddings Tamil WordEmbeddingsModel Living Individual
448 ta.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Tamil BertEmbeddings Living Individual
449 tt.stopwords stopwords_iso Stop Words Removal Tatar StopWordsCleaner Living Individual
450 tt.embed.w2v_cc_300d w2v_cc_300d Embeddings Tatar WordEmbeddingsModel Living Individual
451 te.embed.indic_transformers_te_bert bert_embeddings_indic_transformers_te_bert Embeddings Telugu BertEmbeddings Living Individual
452 te.embed.telugu_bertu bert_embeddings_telugu_bertu Embeddings Telugu BertEmbeddings Living Individual
453 te.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Telugu BertEmbeddings Living Individual
454 te.embed.indic_transformers_te_roberta roberta_embeddings_indic_transformers_te_roberta Embeddings Telugu RoBertaEmbeddings Living Individual
455 te.stopwords stopwords_iso Stop Words Removal Telugu StopWordsCleaner Living Individual
456 te.lemma lemma_mtg Lemmatization Telugu LemmatizerModel Living Individual
457 te.embed.w2v_cc_300d w2v_cc_300d Embeddings Telugu WordEmbeddingsModel Living Individual
458 th.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_th_cased Embeddings Thai DistilBertEmbeddings Living Individual
459 th.stopwords stopwords_iso Stop Words Removal Thai StopWordsCleaner Living Individual
460 th.embed.w2v_cc_300d w2v_cc_300d Embeddings Thai WordEmbeddingsModel Living Individual
461 ti.stopwords stopwords_iso Stop Words Removal Tigrinya StopWordsCleaner Living Individual
462 als.embed.w2v_cc_300d w2v_cc_300d Embeddings Tosk Albanian WordEmbeddingsModel Living Individual
463 tn.stopwords stopwords_iso Stop Words Removal Tswana StopWordsCleaner Living Individual
464 tr.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_tr_cased Embeddings Turkish DistilBertEmbeddings Living Individual
465 tr.lemma lemma_penn Lemmatization Turkish LemmatizerModel Living Individual
466 tr.stopwords stopwords_iso Stop Words Removal Turkish StopWordsCleaner Living Individual
467 tr.lemma lemma_penn Lemmatization Turkish LemmatizerModel Living Individual
468 tr.pos pos_boun Part of Speech Tagging Turkish PerceptronModel Living Individual
469 tr.embed.w2v_cc_300d w2v_cc_300d Embeddings Turkish WordEmbeddingsModel Living Individual
470 tr.lemma lemma_penn Lemmatization Turkish LemmatizerModel Living Individual
471 tr.pos pos_boun Part of Speech Tagging Turkish PerceptronModel Living Individual
472 tr.pos pos_boun Part of Speech Tagging Turkish PerceptronModel Living Individual
473 tr.lemma lemma_penn Lemmatization Turkish LemmatizerModel Living Individual
474 tr.lemma lemma_penn Lemmatization Turkish LemmatizerModel Living Individual
475 tk.embed.w2v_cc_300d w2v_cc_300d Embeddings Turkmen WordEmbeddingsModel Living Individual
476 ug.embed.w2v_cc_300d w2v_cc_300d Embeddings Uighur, Uyghur WordEmbeddingsModel Living Individual
477 uk.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_uk_cased Embeddings Ukrainian DistilBertEmbeddings Living Individual
478 uk.embed.ukr_roberta_base roberta_embeddings_ukr_roberta_base Embeddings Ukrainian RoBertaEmbeddings Living Individual
479 uk.stopwords stopwords_iso Stop Words Removal Ukrainian StopWordsCleaner Living Individual
480 uk.embed.w2v_cc_300d w2v_cc_300d Embeddings Ukrainian WordEmbeddingsModel Living Individual
481 uk.pos.bert_large_slavic_cyrillic_upos bert_pos_bert_large_slavic_cyrillic_upos Part of Speech Tagging Ukrainian BertForTokenClassification Living Individual
482 uk.pos.bert_base_slavic_cyrillic_upos bert_pos_bert_base_slavic_cyrillic_upos Part of Speech Tagging Ukrainian BertForTokenClassification Living Individual
483 hsb.embed.w2v_cc_300d w2v_cc_300d Embeddings Upper Sorbian WordEmbeddingsModel Living Individual
484 ur.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_ur_cased Embeddings Urdu DistilBertEmbeddings Living Individual
485 ur.embed.muril_adapted_local bert_embeddings_muril_adapted_local Embeddings Urdu BertEmbeddings Living Individual
486 ur.embed.roberta_urdu_small roberta_embeddings_roberta_urdu_small Embeddings Urdu RoBertaEmbeddings Living Individual
487 ur.lemma lemma_udtb Lemmatization Urdu LemmatizerModel Living Individual
488 ur.lemma lemma_udtb Lemmatization Urdu LemmatizerModel Living Individual
489 ur.pos pos_udtb Part of Speech Tagging Urdu PerceptronModel Living Individual
490 ur.embed.w2v_cc_300d w2v_cc_300d Embeddings Urdu WordEmbeddingsModel Living Individual
491 ur.stopwords stopwords_iso Stop Words Removal Urdu StopWordsCleaner Living Individual
492 vec.embed.w2v_cc_300d w2v_cc_300d Embeddings Venetian WordEmbeddingsModel Living Individual
493 vi.stopwords stopwords_iso Stop Words Removal Vietnamese StopWordsCleaner Living Individual
494 vi.embed.w2v_cc_300d w2v_cc_300d Embeddings Vietnamese WordEmbeddingsModel Living Individual
495 vls.embed.w2v_cc_300d w2v_cc_300d Embeddings Vlaams WordEmbeddingsModel Living Individual
496 wa.embed.w2v_cc_300d w2v_cc_300d Embeddings Walloon WordEmbeddingsModel Living Individual
497 war.embed.w2v_cc_300d w2v_cc_300d Embeddings Waray (Philippines) WordEmbeddingsModel Living Individual
498 hyw.pos pos_armtdp Part of Speech Tagging Western Armenian PerceptronModel Living Individual
499 hyw.lemma lemma_armtdp Lemmatization Western Armenian LemmatizerModel Living Individual
500 fy.embed.w2v_cc_300d w2v_cc_300d Embeddings Western Frisian WordEmbeddingsModel Living Individual
501 pnb.embed.w2v_cc_300d w2v_cc_300d Embeddings Western Panjabi WordEmbeddingsModel Living Individual
502 wo.pos pos_wtb Part of Speech Tagging Wolof PerceptronModel Living Individual
503 sah.embed.w2v_cc_300d w2v_cc_300d Embeddings Yakut WordEmbeddingsModel Living Individual
504 yo.embed.w2v_cc_300d w2v_cc_300d Embeddings Yoruba WordEmbeddingsModel Living Individual
505 zea.embed.w2v_cc_300d w2v_cc_300d Embeddings Zeeuws WordEmbeddingsModel Living Individual
506 sq.stopwords stopwords_iso Stop Words Removal Albanian StopWordsCleaner Living Macrolanguage
507 sq.embed.w2v_cc_300d w2v_cc_300d Embeddings Albanian WordEmbeddingsModel Living Macrolanguage
508 ar.embed.distilbert distilbert_embeddings_distilbert_base_ar_cased Embeddings Arabic DistilBertEmbeddings Living Macrolanguage
509 ar.embed.albert albert_embeddings_albert_base_arabic Embeddings Arabic AlbertEmbeddings Living Macrolanguage
510 ar.embed.albert_xlarge_arabic albert_embeddings_albert_xlarge_arabic Embeddings Arabic AlbertEmbeddings Living Macrolanguage
511 ar.embed.albert_large_arabic albert_embeddings_albert_large_arabic Embeddings Arabic AlbertEmbeddings Living Macrolanguage
512 ar.pos.arabic_camelbert_msa_pos_msa bert_pos_bert_base_arabic_camelbert_msa_pos_msa Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
513 ar.pos.arabic_camelbert_mix_pos_egy bert_pos_bert_base_arabic_camelbert_mix_pos_egy Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
514 ar.pos.arabic_camelbert_da_pos_glf bert_pos_bert_base_arabic_camelbert_da_pos_glf Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
515 ar.pos.arabic_camelbert_ca_pos_glf bert_pos_bert_base_arabic_camelbert_ca_pos_glf Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
516 ar.pos.arabic_camelbert_msa_pos_egy bert_pos_bert_base_arabic_camelbert_msa_pos_egy Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
517 ar.pos.arabic_camelbert_ca_pos_egy bert_pos_bert_base_arabic_camelbert_ca_pos_egy Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
518 ar.pos.arabic_camelbert_msa_pos_glf bert_pos_bert_base_arabic_camelbert_msa_pos_glf Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
519 ar.pos.arabic_camelbert_mix_pos_glf bert_pos_bert_base_arabic_camelbert_mix_pos_glf Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
520 ar.pos.arabic_camelbert_da_pos_egy bert_pos_bert_base_arabic_camelbert_da_pos_egy Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
521 ar.stopwords stopwords_iso Stop Words Removal Arabic StopWordsCleaner Living Macrolanguage
522 ar.embed.multi_dialect_bert_base_arabic bert_embeddings_multi_dialect_bert_base_arabic Embeddings Arabic BertEmbeddings Living Macrolanguage
523 ar.ner.arabic_camelbert_da_ner bert_ner_bert_base_arabic_camelbert_da_ner Named Entity Recognition Arabic BertForTokenClassification Living Macrolanguage
524 ar.ner.arabic_camelbert_mix_ner bert_ner_bert_base_arabic_camelbert_mix_ner Named Entity Recognition Arabic BertForTokenClassification Living Macrolanguage
525 ar.pos pos_padt Part of Speech Tagging Arabic PerceptronModel Living Macrolanguage
526 ar.ner.multilingual_cased_ner_hrl bert_ner_bert_base_multilingual_cased_ner_hrl Named Entity Recognition Arabic BertForTokenClassification Living Macrolanguage
527 ar.ner.arabic_camelbert_msa_ner bert_ner_bert_base_arabic_camelbert_msa_ner Named Entity Recognition Arabic BertForTokenClassification Living Macrolanguage
528 ar.ner.ANER bert_ner_ANER Named Entity Recognition Arabic BertForTokenClassification Living Macrolanguage
529 ar.ner.arabert_ner bert_ner_arabert_ner Named Entity Recognition Arabic BertForTokenClassification Living Macrolanguage
530 ar.lemma lemma_padt Lemmatization Arabic LemmatizerModel Living Macrolanguage
531 ar.pos.arabic_camelbert_mix_pos_msa bert_pos_bert_base_arabic_camelbert_mix_pos_msa Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
532 ar.embed.mbert_ar_c19 bert_embeddings_mbert_ar_c19 Embeddings Arabic BertEmbeddings Living Macrolanguage
533 ar.embed.bert_base_arabic_camelbert_msa_half bert_embeddings_bert_base_arabic_camelbert_msa_half Embeddings Arabic BertEmbeddings Living Macrolanguage
534 ar.embed.bert_large_arabertv02 bert_embeddings_bert_large_arabertv02 Embeddings Arabic BertEmbeddings Living Macrolanguage
535 ar.embed.AraBertMo_base_V1 bert_embeddings_AraBertMo_base_V1 Embeddings Arabic BertEmbeddings Living Macrolanguage
536 ar.embed.DarijaBERT bert_embeddings_DarijaBERT Embeddings Arabic BertEmbeddings Living Macrolanguage
537 ar.embed.bert_base_arabertv02 bert_embeddings_bert_base_arabertv02 Embeddings Arabic BertEmbeddings Living Macrolanguage
538 ar.embed.arabert_c19 bert_embeddings_arabert_c19 Embeddings Arabic BertEmbeddings Living Macrolanguage
539 ar.embed.bert_base_arabic_camelbert_msa bert_embeddings_bert_base_arabic_camelbert_msa Embeddings Arabic BertEmbeddings Living Macrolanguage
540 ar.embed.bert_base_arabertv2 bert_embeddings_bert_base_arabertv2 Embeddings Arabic BertEmbeddings Living Macrolanguage
541 ar.embed.bert_base_arabic bert_embeddings_bert_base_arabic Embeddings Arabic BertEmbeddings Living Macrolanguage
542 ar.embed.Ara_DialectBERT bert_embeddings_Ara_DialectBERT Embeddings Arabic BertEmbeddings Living Macrolanguage
543 ar.embed.MARBERT bert_embeddings_MARBERT Embeddings Arabic BertEmbeddings Living Macrolanguage
544 ar.embed.bert_base_arabic_camelbert_msa_eighth bert_embeddings_bert_base_arabic_camelbert_msa_eighth Embeddings Arabic BertEmbeddings Living Macrolanguage
545 ar.embed.MARBERTv2 bert_embeddings_MARBERTv2 Embeddings Arabic BertEmbeddings Living Macrolanguage
546 ar.embed.bert_large_arabertv2 bert_embeddings_bert_large_arabertv2 Embeddings Arabic BertEmbeddings Living Macrolanguage
547 ar.embed.bert_base_arabert bert_embeddings_bert_base_arabert Embeddings Arabic BertEmbeddings Living Macrolanguage
548 ar.embed.bert_base_arabertv01 bert_embeddings_bert_base_arabertv01 Embeddings Arabic BertEmbeddings Living Macrolanguage
549 ar.embed.bert_mini_arabic bert_embeddings_bert_mini_arabic Embeddings Arabic BertEmbeddings Living Macrolanguage
550 ar.embed.bert_large_arabic bert_embeddings_bert_large_arabic Embeddings Arabic BertEmbeddings Living Macrolanguage
551 ar.embed.bert_large_arabertv02_twitter bert_embeddings_bert_large_arabertv02_twitter Embeddings Arabic BertEmbeddings Living Macrolanguage
552 ar.embed.dziribert bert_embeddings_dziribert Embeddings Arabic BertEmbeddings Living Macrolanguage
553 ar.embed.bert_base_arabertv02_twitter bert_embeddings_bert_base_arabertv02_twitter Embeddings Arabic BertEmbeddings Living Macrolanguage
554 ar.embed.bert_medium_arabic bert_embeddings_bert_medium_arabic Embeddings Arabic BertEmbeddings Living Macrolanguage
555 ar.pos.arabic_camelbert_da_pos_msa bert_pos_bert_base_arabic_camelbert_da_pos_msa Part of Speech Tagging Arabic BertForTokenClassification Living Macrolanguage
556 ar.embed.bert_base_qarib bert_embeddings_bert_base_qarib Embeddings Arabic BertEmbeddings Living Macrolanguage
557 ar.embed.bert_base_qarib60_860k bert_embeddings_bert_base_qarib60_860k Embeddings Arabic BertEmbeddings Living Macrolanguage
558 ar.embed.bert_base_qarib60_1790k bert_embeddings_bert_base_qarib60_1790k Embeddings Arabic BertEmbeddings Living Macrolanguage
559 ar.embed.bert_base_arabic_camelbert_msa_sixteenth bert_embeddings_bert_base_arabic_camelbert_msa_sixteenth Embeddings Arabic BertEmbeddings Living Macrolanguage
560 ar.embed.bert_base_arabic_camelbert_mix bert_embeddings_bert_base_arabic_camelbert_mix Embeddings Arabic BertEmbeddings Living Macrolanguage
561 ar.embed.bert_base_arabic_camelbert_msa_quarter bert_embeddings_bert_base_arabic_camelbert_msa_quarter Embeddings Arabic BertEmbeddings Living Macrolanguage
562 az.embed.w2v_cc_300d w2v_cc_300d Embeddings Azerbaijani WordEmbeddingsModel Living Macrolanguage
563 az.stopwords stopwords_iso Stop Words Removal Azerbaijani StopWordsCleaner Living Macrolanguage
564 zh.embed.distilbert_base_cased distilbert_embeddings_distilbert_base_zh_cased Embeddings Chinese DistilBertEmbeddings Living Macrolanguage
565 zh.embed.wobert_chinese_plus_base bert_embeddings_wobert_chinese_plus_base Embeddings Chinese BertEmbeddings Living Macrolanguage
566 zh.embed.bert_base_chinese_jinyong bert_embeddings_bert_base_chinese_jinyong Embeddings Chinese BertEmbeddings Living Macrolanguage
567 zh.embed.rbt3 bert_embeddings_rbt3 Embeddings Chinese BertEmbeddings Living Macrolanguage
568 zh.embed.jdt_fin_roberta_wwm bert_embeddings_jdt_fin_roberta_wwm Embeddings Chinese BertEmbeddings Living Macrolanguage
569 zh.embed.mengzi_oscar_base bert_embeddings_mengzi_oscar_base Embeddings Chinese BertEmbeddings Living Macrolanguage
570 zh.embed.roberta_base_wechsel_chinese roberta_embeddings_roberta_base_wechsel_chinese Embeddings Chinese RoBertaEmbeddings Living Macrolanguage
571 zh.embed.sikubert bert_embeddings_sikubert Embeddings Chinese BertEmbeddings Living Macrolanguage
572 zh.embed.jdt_fin_roberta_wwm_large bert_embeddings_jdt_fin_roberta_wwm_large Embeddings Chinese BertEmbeddings Living Macrolanguage
573 zh.embed.rbtl3 bert_embeddings_rbtl3 Embeddings Chinese BertEmbeddings Living Macrolanguage
574 zh.embed.macbert4csc_base_chinese bert_embeddings_macbert4csc_base_chinese Embeddings Chinese BertEmbeddings Living Macrolanguage
575 zh.pos.chinese_roberta_large_upos bert_pos_chinese_roberta_large_upos Part of Speech Tagging Chinese BertForTokenClassification Living Macrolanguage
576 zh.pos.chinese_roberta_base_upos bert_pos_chinese_roberta_base_upos Part of Speech Tagging Chinese BertForTokenClassification Living Macrolanguage
577 zh.pos.chinese_bert_wwm_ext_upos bert_pos_chinese_bert_wwm_ext_upos Part of Speech Tagging Chinese BertForTokenClassification Living Macrolanguage
578 zh.pos pos_gsdsimp Part of Speech Tagging Chinese PerceptronModel Living Macrolanguage
579 zh.pos pos_gsdsimp Part of Speech Tagging Chinese PerceptronModel Living Macrolanguage
580 zh.stopwords stopwords_iso Stop Words Removal Chinese StopWordsCleaner Living Macrolanguage
581 zh.pos.bert_base_chinese_pos bert_pos_bert_base_chinese_pos Part of Speech Tagging Chinese BertForTokenClassification Living Macrolanguage
582 zh.embed.rbt6 bert_embeddings_rbt6 Embeddings Chinese BertEmbeddings Living Macrolanguage
583 zh.embed.sikuroberta bert_embeddings_sikuroberta Embeddings Chinese BertEmbeddings Living Macrolanguage
584 zh.embed.uer_large bert_embeddings_uer_large Embeddings Chinese BertEmbeddings Living Macrolanguage
585 zh.embed.env_bert_chinese bert_embeddings_env_bert_chinese Embeddings Chinese BertEmbeddings Living Macrolanguage
586 zh.embed.chinese_roberta_wwm_ext bert_embeddings_chinese_roberta_wwm_ext Embeddings Chinese BertEmbeddings Living Macrolanguage
587 zh.embed.chinese_macbert_base bert_embeddings_chinese_macbert_base Embeddings Chinese BertEmbeddings Living Macrolanguage
588 zh.embed.bert_base_zh_cased bert_embeddings_bert_base_zh_cased Embeddings Chinese BertEmbeddings Living Macrolanguage
589 zh.embed.bert_large_chinese bert_embeddings_bert_large_chinese Embeddings Chinese BertEmbeddings Living Macrolanguage
590 zh.embed.chinese_roberta_wwm_large_ext_fix_mlm bert_embeddings_chinese_roberta_wwm_large_ext_fix_mlm Embeddings Chinese BertEmbeddings Living Macrolanguage
591 zh.embed.chinese_roberta_wwm_ext_large bert_embeddings_chinese_roberta_wwm_ext_large Embeddings Chinese BertEmbeddings Living Macrolanguage
592 zh.embed.chinese_bert_wwm_ext bert_embeddings_chinese_bert_wwm_ext Embeddings Chinese BertEmbeddings Living Macrolanguage
593 zh.embed.chinese_macbert_large bert_embeddings_chinese_macbert_large Embeddings Chinese BertEmbeddings Living Macrolanguage
594 zh.embed.mengzi_oscar_base_retrieval bert_embeddings_mengzi_oscar_base_retrieval Embeddings Chinese BertEmbeddings Living Macrolanguage
595 zh.embed.mengzi_bert_base_fin bert_embeddings_mengzi_bert_base_fin Embeddings Chinese BertEmbeddings Living Macrolanguage
596 zh.embed.wobert_chinese_base bert_embeddings_wobert_chinese_base Embeddings Chinese BertEmbeddings Living Macrolanguage
597 zh.embed.wobert_chinese_plus bert_embeddings_wobert_chinese_plus Embeddings Chinese BertEmbeddings Living Macrolanguage
598 zh.embed.rbt4 bert_embeddings_rbt4 Embeddings Chinese BertEmbeddings Living Macrolanguage
599 zh.embed.mengzi_oscar_base_caption bert_embeddings_mengzi_oscar_base_caption Embeddings Chinese BertEmbeddings Living Macrolanguage
600 zh.embed.mengzi_bert_base bert_embeddings_mengzi_bert_base Embeddings Chinese BertEmbeddings Living Macrolanguage
601 zh.embed.w2v_cc_300d w2v_cc_300d Embeddings Chinese WordEmbeddingsModel Living Macrolanguage
602 et.stopwords stopwords_iso Stop Words Removal Estonian StopWordsCleaner Living Macrolanguage
603 et.pos pos_edt Part of Speech Tagging Estonian PerceptronModel Living Macrolanguage
604 et.embed.w2v_cc_300d w2v_cc_300d Embeddings Estonian WordEmbeddingsModel Living Macrolanguage
605 et.lemma lemma_ewt Lemmatization Estonian LemmatizerModel Living Macrolanguage
606 et.lemma lemma_ewt Lemmatization Estonian LemmatizerModel Living Macrolanguage
607 lv.stopwords stopwords_iso Stop Words Removal Latvian StopWordsCleaner Living Macrolanguage
608 lv.pos pos_lvtb Part of Speech Tagging Latvian PerceptronModel Living Macrolanguage
609 mg.embed.w2v_cc_300d w2v_cc_300d Embeddings Malagasy WordEmbeddingsModel Living Macrolanguage
610 ms.embed.albert albert_embeddings_albert_large_bahasa_cased Embeddings Malay (macrolanguage) AlbertEmbeddings Living Macrolanguage
611 ms.embed.distilbert distilbert_embeddings_malaysian_distilbert_small Embeddings Malay (macrolanguage) DistilBertEmbeddings Living Macrolanguage
612 ms.embed.albert_tiny_bahasa_cased albert_embeddings_albert_tiny_bahasa_cased Embeddings Malay (macrolanguage) AlbertEmbeddings Living Macrolanguage
613 ms.embed.albert_base_bahasa_cased albert_embeddings_albert_base_bahasa_cased Embeddings Malay (macrolanguage) AlbertEmbeddings Living Macrolanguage
614 ms.embed.w2v_cc_300d w2v_cc_300d Embeddings Malay (macrolanguage) WordEmbeddingsModel Living Macrolanguage
615 mn.embed.w2v_cc_300d w2v_cc_300d Embeddings Mongolian WordEmbeddingsModel Living Macrolanguage
616 ne.embed.w2v_cc_300d w2v_cc_300d Embeddings Nepali (macrolanguage) WordEmbeddingsModel Living Macrolanguage
617 ne.stopwords stopwords_iso Stop Words Removal Nepali (macrolanguage) StopWordsCleaner Living Macrolanguage
618 no.lemma lemma_nynorsk Lemmatization Norwegian LemmatizerModel Living Macrolanguage
619 no.pos pos_bokmaal Part of Speech Tagging Norwegian PerceptronModel Living Macrolanguage
620 no.pos pos_bokmaal Part of Speech Tagging Norwegian PerceptronModel Living Macrolanguage
621 no.pos pos_bokmaal Part of Speech Tagging Norwegian PerceptronModel Living Macrolanguage
622 no.embed.w2v_cc_300d w2v_cc_300d Embeddings Norwegian WordEmbeddingsModel Living Macrolanguage
623 no.lemma lemma_nynorsk Lemmatization Norwegian LemmatizerModel Living Macrolanguage
624 or.embed.w2v_cc_300d w2v_cc_300d Embeddings Oriya (macrolanguage) WordEmbeddingsModel Living Macrolanguage
625 ps.embed.w2v_cc_300d w2v_cc_300d Embeddings Pashto, Pushto WordEmbeddingsModel Living Macrolanguage
626 fa.embed.albert albert_embeddings_albert_fa_base_v2 Embeddings Persian AlbertEmbeddings Living Macrolanguage
627 fa.embed.distilbert_fa_zwnj_base distilbert_embeddings_distilbert_fa_zwnj_base Embeddings Persian DistilBertEmbeddings Living Macrolanguage
628 fa.embed.albert_fa_zwnj_base_v2 albert_embeddings_albert_fa_zwnj_base_v2 Embeddings Persian AlbertEmbeddings Living Macrolanguage
629 fa.embed.roberta_fa_zwnj_base roberta_embeddings_roberta_fa_zwnj_base Embeddings Persian RoBertaEmbeddings Living Macrolanguage
630 fa.ner.roberta_fa_zwnj_base_ner roberta_ner_roberta_fa_zwnj_base_ner Named Entity Recognition Persian RoBertaForTokenClassification Living Macrolanguage
631 fa.pos pos_perdt Part of Speech Tagging Persian PerceptronModel Living Macrolanguage
632 fa.stopwords stopwords_iso Stop Words Removal Persian StopWordsCleaner Living Macrolanguage
633 qu.embed.w2v_cc_300d w2v_cc_300d Embeddings Quechua WordEmbeddingsModel Living Macrolanguage
634 sc.embed.w2v_cc_300d w2v_cc_300d Embeddings Sardinian WordEmbeddingsModel Living Macrolanguage
635 sh.embed.w2v_cc_300d w2v_cc_300d Embeddings Serbo-Croatian WordEmbeddingsModel Living Macrolanguage
636 sw.embed.w2v_cc_300d w2v_cc_300d Embeddings Swahili (macrolanguage) WordEmbeddingsModel Living Macrolanguage
637 uz.embed.w2v_cc_300d w2v_cc_300d Embeddings Uzbek WordEmbeddingsModel Living Macrolanguage
638 yi.embed.w2v_cc_300d w2v_cc_300d Embeddings Yiddish WordEmbeddingsModel Living Macrolanguage
639 qhe.lemma lemma_hiencs Lemmatization Reserved for local use LemmatizerModel nan Local
640 qtd.pos pos_sagt Part of Speech Tagging Reserved for local use PerceptronModel nan Local

Additional NLU resources

1 line Install NLU on Google Colab

!wget https://setup.johnsnowlabs.com/nlu/colab.sh -O - | bash

1 line Install NLU on Kaggle

!wget https://setup.johnsnowlabs.com/nlu/kaggle.sh -O - | bash

Install via PIP

! pip install nlu pyspark streamlit==0.80.0

C-K-Loan commented 2 years ago

600 new models with over 75 new languages including Ancient,Dead and Extinct languages, 155 languages total covered, 400% Tokenizer Speedup, 18x USE-Embeddings GPU speedup in John Snow Labs NLU 3.4.4

We are very excited to announce NLU 3.4.4 has been released with over 600 new model, over 75 new languages and 155 languages covered in total, 400% speedup for tokenizers and 18x speedup of UniversalSentenceEncoder on GPU. On the general NLP side we have transformer based Embeddings and Token Classifiers powered by state of the art CamemBertEmbeddings and DeBertaForTokenClassification based architectures as well as various new models for
Historical, Ancient,Dead, Extinct, Genetic and Constructed languages like Old Church Slavonic, Latin, Sanskrit, Esperanto, Volapük, Coptic, Nahuatl, Ancient Greek (to 1453), Old Russian. On the healthcare side we have Portuguese De-identification Models, have NER models for Gene detection and finally RxNorm Sentence resolution model for mapping and extracting pharmaceutical actions (e.g. analgesic, hypoglycemic) as well as treatments (e.g. backache, diabetes).

See the comments for further details