vespa-engine / vespa

AI + Data, online. https://vespa.ai
https://vespa.ai
Apache License 2.0
5.79k stars 604 forks source link

Emit logs on availability of embedding model on GPU #27815

Closed jobergum closed 1 year ago

jobergum commented 1 year ago

If you configure embedders with a GPU device

<component id="e5" type="hugging-face-embedder">
            <transformer-model path="model/multilingual-e5-small.onnx"/>
            <tokenizer-model path="model/tokenizer.json"/>
            <onnx-gpu-device>0</onnx-gpu-device>
        </component>

There is no warning or error if the device does not exist or the correct libraries are not present. It falls back to the CPU, which is fine, but there should be some noise in the vespa log. Plus, there should also be something in the log if device configuration and map is successful.

jobergum commented 1 year ago

Thanks @mpolden

stauntonjr commented 1 year ago

Thanks!!!