search

Jonhels / Word-Embeddings-AI-Jonhels-Project

Learning to work with AI and understand word embeddings
0 stars 0 forks source link

Backend service api endpoint for post #12

Closed Jonhels closed 1 month ago

Jonhels commented 1 month ago

Backend service api endpoint for post between ollama 3.1 and api endpoint. This is a crucial step for creating a rag chatbot. I need to be able to communicate with the ollama local llm before i can go to the next step.

This does not mean that the model will remember any previous message. This means that it should give a response. Memory can be added later when its time to make it more complex

Jonhels commented 1 month ago
Screenshot 2024-07-31 at 16 46 15

Communication through api endpoint now working when writing a message to the ollama 3.1 model. This is great. Response object shown in postman.

Jonhels commented 1 month ago

Keep in mind that the response time is on my macbook. In a production enviroment it would be much more quicker, but as always when it comes to llms it really comes to the power of the users computer.