Unable to upload files in Q&A Chatbot's RAG service

NVIDIA / GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

https://nvidia.github.io/GenerativeAIExamples/latest/index.html

Apache License 2.0

1.77k stars 294 forks source link

Unable to upload files in Q&A Chatbot's RAG service #119

Open Minxiangliu opened 1 month ago

Minxiangliu commented 1 month ago

Hi there, I'm currently trying to build a Q&A Chatbot using the example here. Since my GPU model is A30 (with two 20GB GPUs), I'm using a smaller-scale model: llama-2-7B-chat. I followed the instructions in the example to set up the service, but I'm having trouble uploading knowledge documents. What can I do here to solve the problem?