search

opendatahub-io / caikit

Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.
Apache License 2.0
0 stars 4 forks source link

[STORY] Split caikit/TGIS ServingRuntime into three distinct images #11

Closed Xaenalt closed 6 months ago

Xaenalt commented 10 months ago

From req doc:

P0: OOTB support Caikit/TGIS

Caikit+TGIS:

TGIS standalone:

Caikit:

dtrifiro commented 9 months ago

Progress:

dtrifiro commented 9 months ago

Related to caikit-standalone image (without tgis backend):

https://github.com/caikit/caikit-nlp/pull/210

dtrifiro commented 8 months ago

PR at https://github.com/opendatahub-io/caikit-tgis-serving/pull/107

heyselbi commented 8 months ago

https://github.com/caikit/caikit-nlp/pull/216

bdattoma commented 8 months ago

@Xaenalt could you share how to use the 3 options? even if doc is not completed, maybe you could share some instructions internally. Thanks!

dtrifiro commented 8 months ago

@bdattoma the idea is to have the options reported here https://github.com/opendatahub-io/caikit-tgis-serving/issues/121. Feel free to reach out if you need more information. Hopefully I will have a PR ready in the next few hours

bdattoma commented 8 months ago

@bdattoma the idea is to have the options reported here opendatahub-io/caikit-tgis-serving#121. Feel free to reach out if you need more information. Hopefully I will have a PR ready in the next few hours

okay thank you. I'll wait for your PR :)

heyselbi commented 8 months ago

Caikit standalone image available at https://github.com/caikit/caikit-nlp/pull/244/

dtrifiro commented 8 months ago

@bdattoma it seems that the above issue I linked above does need a few requirements such as the above PR before being actionable, so you'll have to wait some more time :sweat_smile:

heyselbi commented 8 months ago

Follow up issue on OOTB inclusion of all images in RHODS: https://github.com/opendatahub-io/caikit/issues/17

bdattoma commented 7 months ago

@Xaenalt for tracking purposes, could you edit this Issue saying explicitly that the only scenario covered was the Caikit+TGIS? by reading at it it looks like this issue covered also standalone Caikit and standalone TGIS

Xaenalt commented 7 months ago

This got deferred to 2.6. TGIS standalone is ready for use, but won't ship in 2.5 due to management priorities, caikit standalone dockerfile has merged upstream, we just need to build downstream and that's done

Xaenalt commented 7 months ago

Additionally, prompt tuning workflow we're pretty close on having a working test for too

heyselbi commented 7 months ago

@bdattoma I will convert this issue to story and have separate issues for each image.

bdattoma commented 7 months ago

This got deferred to 2.6. TGIS standalone is ready for use, but won't ship in 2.5 due to management priorities, caikit standalone dockerfile has merged upstream, we just need to build downstream and that's done

thanks for the update @Xaenalt! We will plan QE effort accordingly.

@bdattoma I will convert this issue to story and have separate issues for each image.

@heyselbi lgmt, thanks!!

heyselbi commented 6 months ago

moved to JIRA