Desktop app for automatically translating comics - BDs, Manga, Manhwa, Fumetti and more in a variety of formats (Image, Pdf, Epub, cbr, cbz, etc) and in multiple languages.
Apache License 2.0
529
stars
47
forks
source link
Does it work with llama 3 70b running in local GPU ? #71
Hi ! You have done a great job in manga translate with LLM API, it can be better if it can work with local LLM models.
As we know, the open source LLM is becoming better and better today, some models like llama3 70b and qwen2 72b have the similar ability compare with the early GPT4 and is better than GPT3.5, so it would be great if the comic-translate can use local LLM to translate the manga.
It can use cpu to run the OCR model and use GPU to run the LLM, and all the model run in local !😊
Hi ! You have done a great job in manga translate with LLM API, it can be better if it can work with local LLM models. As we know, the open source LLM is becoming better and better today, some models like llama3 70b and qwen2 72b have the similar ability compare with the early GPT4 and is better than GPT3.5, so it would be great if the comic-translate can use local LLM to translate the manga. It can use cpu to run the OCR model and use GPU to run the LLM, and all the model run in local !😊