search

Qiskit / qiskit-code-assistant-jupyterlab

A Jupyterlab extension to use the Qiskit Code Assistant
https://pypi.org/project/qiskit-code-assistant-jupyterlab/
Apache License 2.0
15 stars 2 forks source link

Add support for local mode via Ollama #6

Closed ajbozarth closed 1 week ago

ajbozarth commented 1 month ago

Adds support for running against local models by supporting the OpenAI API in addition to the Qiskit Code Assistant service API.

This allows users to input any OpenAL compatible API URL, such as Ollama, instead of a Qiskit Code Assistant service URL and the server extension will detect which API is set and call the correct endpoints.

Fixes #9

ajbozarth commented 1 month ago

This initial draft is fully functional afaik, I did not update any documentation yet though. I would expect we should probably update the various markdown files as well as the jupyterlab setting description for the service URL.

ajbozarth commented 1 month ago

@cbjuan @vabarbosa per our discussion today and Va's updates to the VSCode extension I've made the updates to switch to using the OpenAI API endpoints.

Afaik this is g2g based on the feature add, IIUC the other issues we discussed should be handled in separate feature PRs

ajbozarth commented 1 month ago

Afaik this is g2g based on the feature add

Still no doc updates though, I'll need some guidance on how we want to document this support

ajbozarth commented 2 weeks ago

@cbjuan I just pushed the doc updates for local mode if you want to take a look at the language and share feedback. I like how I updated the requirements section, but I'm on the fence about my wording for the jupyterlab settings section. IIUC these are the only two doc updates needed according to you comments in today's call.