ggerganov / ggml

Tensor library for machine learning
MIT License
10.92k stars 1k forks source link

Run T5 ggml #83

Open phanxuanphucnd opened 1 year ago

phanxuanphucnd commented 1 year ago

Dear author,

How can i run t5 like gpt-2 or gpt-j?

Thank

walking-octopus commented 1 year ago
redthing1 commented 1 year ago

Since ggerganov said this is no longer a priority, I recommend CTranslate2 to do fast Python-free CPU inference of T5 family models.