search

nlpodyssey / spago

Self-contained Machine Learning and Natural Language Processing library in Go
BSD 2-Clause "Simplified" License
1.75k stars 86 forks source link

is:issue is:open Issue with bert compiling Q6A example #121

Open ior308 opened 1 year ago

ior308 commented 1 year ago

Hi Matteo,

compiling Q&A example I get the following error:

no required module provides package github.com/nlpodyssey/spago/pkg/nlp/transformers/bert; to add it: go get github.com/nlpodyssey/spago/pkg/nlp/transformers/bert

Then, when I try to get it I get the following error:

go get github.com/nlpodyssey/spago/pkg/nlp/transformers/bert go: module github.com/nlpodyssey/spago@upgrade found (v1.0.1), but does not contain package github.com/nlpodyssey/spago/pkg/nlp/transformers/bert

Any idea ?

Many thanks.

matteo-grella commented 1 year ago

We moved the NLP functionalities into another project powered by SpaGO. Check out https://github.com/nlpodyssey/cybertron

ior308 commented 1 year ago

Great.

I did a test, but I got the following:

cybertron@v0.1.2]# GOARCH=amd64 CYBERTRON_MODEL=Helsinki-NLP/opus-mt-en-it CYBERTRON_MODELS_DIR=models go run ./examples/questionanswering/main.go {"level":"debug","file":"models/Helsinki-NLP/opus-mt-en-it/config.json","time":"2023-06-23T14:26:57+02:00","message":"model file already exists, skipping download"} {"level":"debug","file":"models/Helsinki-NLP/opus-mt-en-it/pytorch_model.bin","time":"2023-06-23T14:26:57+02:00","message":"model file already exists, skipping download"} {"level":"debug","file":"models/Helsinki-NLP/opus-mt-en-it/vocab.json","time":"2023-06-23T14:26:57+02:00","message":"model file already exists, skipping download"} {"level":"debug","file":"models/Helsinki-NLP/opus-mt-en-it/source.spm","time":"2023-06-23T14:26:57+02:00","message":"model file already exists, skipping download"} {"level":"debug","file":"models/Helsinki-NLP/opus-mt-en-it/target.spm","time":"2023-06-23T14:26:57+02:00","message":"model file already exists, skipping download"} {"level":"info","model":"models/Helsinki-NLP/opus-mt-en-it/spago_model.bin","time":"2023-06-23T14:26:57+02:00","message":"model file already exists, skipping conversion"} {"level":"fatal","error":"model type \"marian\" doesn't support the question-answering task","time":"2023-06-23T14:26:57+02:00"} exit status 1