-
Some prompts fail with:
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Utf8Error { valid_up_to: 0, error_len: None }', /home/kimt/.cargo/registry/src/index.crates.io-6f17d2…
-
### Describe the feature
How you thought of having another module core-text-generation where we can integrate [Rust binding of llama.cpp](https://github.com/utilityai/llama-cpp-rs)
I was thinking …
-
I'm new to llm and llama but learning fast, I've wrote a small piece of code to chat via cli, but it seems to not follow the context (ie work in interactive mode).
```
import { LLM } from "llama-n…
-
### Bug Description
I try to run example https://docs.llamaindex.ai/en/stable/examples/query_engine/sec_tables/tesla_10q_table/ with `OpenAILike`
I cannot run the sync version of code, it errors…
-
Getting this error `[Error: Could not load model] { code: 'GenericFailure' }` when trying to load a model:
```
$ node ./bin/llm/llm.js --model ~/models/gpt4-alpaca-lora-30B.ggml.q5_1.bin
[Error: …
-
Describe the bug
Get an AtrributeError when trying to convert llama3-8B model from HF format to mcore format, the error is below:
`AttributeError: 'Tokenizer' object has no attribute 'vocab_size'`…
-
@mdrokz are you planning to main this project? I saw it uses a pretty old llama.cpp version.
-
### What problem are you trying to solve?
Reading this blog post:
https://metalbear.co/blog/writing-a-kubernetes-operator/
on how to set up an [extension apiservice](https://kubernetes.io/docs/ta…
-
I really like this project, especially the plans to not only support llama based models but to create a more general llm runtime.
I was asking myself if there are any plans to create python bindi…
-
some time faced below issue:
thread 'main' panicked at src/main.rs:579:14:
The read bytes are not valid UTF-8: Error { kind: InvalidData, message: "stream did not contain valid UTF-8" }
note: run w…