-
### What is the issue?
embedding model
When I submit a single fragment, it responds normally, but when I submit multiple fragments, an exception occurs.
I encountered this error on different Wind…
-
while there's the docs page, beyond that it's really the wild west out here - today I searched github for "llm install -e '.[test]'". Lots of other unrelated projects come up if you search pypi and gi…
-
### Description
Having problems getting a agent manage to work.
Using the `crewai create crew` command to setup a project.
Which uses different syntax than all the documentations, which is a bi…
-
Add LLM inference support for https://lmstudio.ai/
Implementation notes:
- Use appropriate SDK: https://github.com/lmstudio-ai/lmstudio.js
- Target directory: `src/adapters/lmstudio` with files `…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am trying to generate test data for ragas evaluation, I hav…
-
environment：
python 3.9.20
datasets 3.0.1
langchain 0.3.3
langchain-community 0.3.2
langchain-core 0.3.10
langchain-openai 0.2.2
la…
-
* I am following the example of BART LoRA at [here](https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/enc_dec#run-bart-with-lora). I cannot convert the engines without flag `--context_fmha dis…
-
### Question or Issue
Hi all,
I just installed and began to test NexaAI on my Win11 laptop... I first tested Qwen2.5:7b LLM, and...
- Same tokens/s than running the same LLM on Ollama in the same…
-
This issue is now to track the implementation of various evaluation methods and workflows for LLMs.
Evaluations:
- [x] G-Eval
- [ ] PingPong
- [ ] InfiniteBench
- [ ] Ruler
- [ ] MMLU
- [ ] M…
-
Hi,
I've created a blank Rust project with a single dependency:
```toml
llama_cpp_rs = "0.3.0"
```
However, when I tried to compile it, the build failed with the following error:
```bash…