-
### Description of the bug:
This is because the caching client is created with gRPC now (the REST one isn't working in the API)
### Actual vs expected behavior:
_No response_
### Any other infor…
-
### Context
This task regards enabling tests for **mpt-7b-chat**. You can find more details under openvino_notebooks [LLM chatbot README.md](https://github.com/openvinotoolkit/openvino_notebooks/tree…
-
-
How should the team structure surrounding QA change in reaction to the non-deterministic nature of GenAI?
-
### Describe the issue
Ride the chatter and implement a open vs closed source GenAI model
-
Such as chaqna-xeon-backend-server.yaml.
These will be auto generated by the microservice-connector tool, which will be versioned based on the pipeline specification language version.
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain.js documentation with the integrated search.
- [X] I used the GitHub search to find a …
Pupix updated
3 weeks ago
-
-
Running `npm run config` fails reproducible when following the [deploy](https://aws-samples.github.io/aws-genai-llm-chatbot/guide/deploy.html#deployment) instructions.
I get the following error:
…
-
It's typically quite useful to be able to associate genai telemetry with a particular user, for multiple reasons (i.e. track token consumption per user, rate limit per user, etc.). OpenAI and Claude s…