search

opendatahub-io / caikit

Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.
Apache License 2.0
0 stars 4 forks source link

[P1] Make CAIKit API compatible with KServe predict API or evolve KServe spec to consider HF like inference API #4

Open heyselbi opened 1 year ago

heyselbi commented 1 year ago

Ref 1: https://github.com/kserve/kserve/tree/master/docs/predict-api/v2 Ref 2: https://huggingface.co/docs/api-inference/detailed_parameters

heyselbi commented 12 months ago

@danielezonca could you provide more details here? and add relevant labels, complexity etc.

Xaenalt commented 12 months ago

Complexity is extremely high for this