search

browsermt / bergamot-translator

Cross platform C++ library focusing on optimized machine translation on the consumer-grade device.
http://browser.mt
Mozilla Public License 2.0
327 stars 36 forks source link

App is hillariously difficult to use #440

Open kpu opened 2 years ago

kpu commented 2 years ago

I know it's just for internal testing but...

$ app/bergamot
Aborted (core dumped)
$ app/bergamot --help
Bergamot CLI
Usage: app/bergamot [OPTIONS]

Options:
  -h,--help                   Print this help message and exit
  --build-info                Print build-info and exit
  --version                   Print version-info and exit
  --model-config-paths TEXT ...
                              Configuration files list, can be used for pivoting multiple models or multiple model workflows
  --cpu-threads UINT          Workers to form translation backend
  --cache-size UINT           Number of entries to store in cache.
  --log-level TEXT            Set verbosity level of logging: trace, debug, info, warn, err(or), critical, off
$ app/bergamot --model-config-paths ~/.config/translateLocally/ende.student.base-1660853034/config.intgemm8bitalpha.yml --log-level trace
[2022-08-21 18:58:43] [data] Loading SentencePiece vocabulary from buffer
[2022-08-21 18:58:43] Missing list of protected prefixes for sentence splitting. Set with --ssplit-prefix-file.
[2022-08-21 18:58:43] Error: Fatal: max-length-break > mini-batch-words  will lead to sentences longer than what can fit in a batch.
[2022-08-21 18:58:43] Error: Aborted from marian::bergamot::BatchingPool::BatchingPool(marian::Ptr<marian::Options>) in /home/testing/bergamot-translator/src/translator/batching_pool.cpp:24

[CALL STACK]
[0x55c4526d7812]                                                       + 0x14f812
[0x55c4526c2702]                                                       + 0x13a702
[0x55c452656a57]                                                       + 0xcea57
[0x7f7b83c4e34a]                                                       + 0x2934a
[0x7f7b83c4e3fc]    __libc_start_main                                  + 0x7c
[0x55c452676bc1]                                                       + 0xeebc1

Aborted (core dumped)
$ app/bergamot --model-config-paths ~/.config/translateLocally/ende.student.base-1660853034/config.intgemm8bitalpha.yml --log-level trace --ssplit-prefix-file ~/preprocess/moses/share/nonbreaking_prefixes/nonbreaking_prefix.en 
The following arguments were not expected: /home/testing/preprocess/moses/share/nonbreaking_prefixes/nonbreaking_prefix.en --ssplit-prefix-file
Run with --help for more information.
sanderfoobar commented 1 year ago

FYI: I forked this project over at https://github.com/kroketio/kotki to enhance the developer experience, usage should be easier.

Edit: Linux only