Hold: Add support for endpoint-url for ilab generate

instructlab / instructlab-bot

GitHub bot to assist with the taxonomy contribution workflow

Apache License 2.0

16 stars 17 forks source link

Hold: Add support for endpoint-url for ilab generate #158

Closed vishnoianil closed 7 months ago

vishnoianil commented 7 months ago

endpoint-url option is exposed for the worker/generate. User can use this option to configure worker nodes to run generate against specific endpoints hosting the model. Underneath both the options sets the --endpoint-url for ilab generate command.

Fixes #116

vishnoianil commented 7 months ago

Todo:

[x] Local dev env testing - done, no issues
[ ] Test against the remotely hosted model