datagero / pico-scholar

AI-Human collaboration platform that accelerates systematic reviews by organizing academic literature, building AI tools, and expanding into new domains to enhance the global knowledge catalog.
0 stars 0 forks source link

Deploy Free Open-Source LLM on OpenShift for Backend Operations #19

Open datagero opened 3 days ago

datagero commented 3 days ago

Objective: Deploy a free open-source LLM through OpenShift to power RAG and other LLM-enhanced features.

Details: • Select a free OS LLM (e.g., LLaMA 3.1). • Configure and deploy the model as a service on OpenShift. • Ensure it supports RAG and advanced query functionalities. • Test integration with other backend components.

Dependencies: OpenShift environment setup and LLM-based application integration.

Acceptance Criteria: • LLM deployed and operational on OpenShift. • Successful LLM calls from backend applications, supporting RAG.

Priority: High Estimated Effort: