search

leancodepl / arb_translate

A command-line tool for automatically adding missing message translations to ARB files using Google Gemini LLM by LeanCode
https://leancode.co
Apache License 2.0
54 stars 5 forks source link

feat: allow translation using local LLM using ollama #10

Closed yeikel16 closed 2 months ago

yeikel16 commented 5 months ago

Hi, I think this feature is powerful because you could use ollama without external dependencies.

RobertOdrowaz commented 2 months ago

Hi, in the newest version (1.1.0), you can use a local model. However, the results with the models I'm able to run locally aren't great. llama3.1 doesn't return a valid result in most cases, and llama3.1:70B is much too slow on my machine to be usable. Please let me know if you have better results.

For reference, here is the command I used along with the required arguments arb_translate --api-key ollama --model-provider custom --custom-model llama3.1:70b --custom-model-provider-base-url http://localhost:11434 --arb-dir example_l10n