search

opea-project / GenAIComps

GenAI components at micro-service level; GenAI service composer to create mega-service
Apache License 2.0
41 stars 93 forks source link

add huggingface TEI Support with intel max GPU #306

Closed endomorphosis closed 1 month ago

endomorphosis commented 1 month ago

Rahul from Intel liftoff provided me with some code with support for intel GPU max, that he wanted some of the college students to use to process embeddings, I told him that I wanted the college students to design against the OPEA reference standard, and I asked him whether this was implemented inside of huggingface Text Embedding Interface TEI. He was unsure whether or not this was implemented, and so therefore, I am raising a feature request here and adding his code.

https://gist.github.com/rahulunair/5e048b76518962eddeeafaf9bcf8da1b

image

ZailiWang commented 1 month ago

Hi @endomorphosis , currently the support for Max GPU is not prioritized.