instructlab / ui

Place to hack on UI for InstructLab
Apache License 2.0
15 stars 36 forks source link

Adding dev chat server running instructions #41

Closed aevo98765 closed 4 months ago

aevo98765 commented 4 months ago

It would be really useful as a dev contributor if you could quickly spin a model inference server.

Two approaches could be taken here:

1) ilab cli setup and ilab serve instructions - link to existing documentation here.

2) Docker contained service to expose port 8000 and 8001 just in case users have another server running on 8000.

Acceptance Criteria:

nerdalert commented 4 months ago

Resolved in #45 🎉