caikit get started

[manisnesan]

https://github.com/caikit/caikit https://github.com/caikit/caikit#getting-started https://caikit.github.io/website/docs/tutorial_appdev.html

Steps

• text sentiment module - Load, Infer, Train model instructions for Caikit
• text sentiment data model - Input, Output of the task
• config
• server
• client

[manisnesan]

https://developer.ibm.com/articles/awb-power-of-ai-caikit-huggingface/ https://ibmdeveloper.skillsnetwork.site/courses/course-v1:IBMSkillsNetwork+GPXX0PYAEN+v1

https://github.com/rh-aiservices-bu/llm-on-openshift/blob/main/examples/caikit/README.md https://github.com/rh-aiservices-bu/llm-on-openshift/blob/main/examples/langchain/RAG_with_sources_Langchain-Caikit.ipynb

And info on caikit/tgis: https://github.com/opendatahub-io/caikit-tgis-serving

[manisnesan]

https://github.com/caikit/caikit-huggingface-demo

[manisnesan]

Caikit Reranker https://github.com/markstur/caikit-embeddings/blob/main/demo/client/reranker.py#L104

 request = self._rerank_request(queries=[query], documents=query_request_documents, top_n=len(query_documents))  

================ request: queries: "asia"
documents {
  documents {
    document {
      key: "text"
      value: "america"
    }
  }
  documents {
    document {
      key: "title"
      value: "doc_title"
    }
    document {
      key: "text"
      value: "x"
    }
    document {
      key: "document_id"
      value: "doc_id"
    }
  }
  documents {
    document {
      key: "text"
      value: "asia"
    }
  }
}
top_n: 3