krassowski / jupyterlab-transformers-completer

Inline completion provider using tranformers.js for JupyterLab
BSD 3-Clause "New" or "Revised" License
19 stars 2 forks source link

Phi-3 WebGPU support #8

Open krassowski opened 5 months ago

krassowski commented 5 months ago

Transformers.js v3 will support Phi-3 with WebGPU acceleration https://github.com/xenova/transformers.js/pull/545#issuecomment-2100829552

It would be amazing to get it running in this extension. For now there is no jsdelivr assets and unless we find a way to fix webpack, we need to relay on it:

https://github.com/krassowski/jupyterlab-transformers-completer/blob/77a16b8d8497dd869f4c912cdcc1031b4c45ccda/src/worker.ts#L8-L17