-
The build is broken on fedora 37.
full logs : https://gist.github.com/sylvain-reynaud/fe73ccc7edad1f4f98688cb48b1f101c
```
--- stderr
ggml/ggml.h:177:10: fatal error: 'stddef.h' file not fou…
-
Hi,
I see that interactive mode has been merged in, I was trying to test the repository on a larger set of weights, and found that there is no output anymore. When running it in interactive mode, …
-
Hey, in llama.cpp, there are some useful output for telling the model predict / evaluation stats:
https://github.com/ggerganov/llama.cpp/blob/da5303c1ea68aa19db829c634f1e10d08d409680/main.cpp#L1086…
-
Justine's managed to land her mad-lass mmap-optimised format into llama.cpp. We should support loading this format in - and if we're smart about it, we should also support `mmap`ing it in. This should…
-
Hello everyone,
I am currently attempting to use Ludwig's AutoML method on the Modal.com cloud computing platform, but I keep running into an error. I've tried to search for a solution in the exist…
-
Hello there,
Newbie here, I am trying to reproduce "let's build GPT" lecture from Andrej Karpathy in candle. At 31 minutes mark in [this](https://www.youtube.com/watch?v=kCc8FmEb1nY) video, he impl…
-
Idea from: https://github.com/ggerganov/llama.cpp/issues/23#issuecomment-1465308592
We can add a `--cache_prompt` flag that if added will dump the computed KV caches of the prompt processing to the…
-
But if I upgrade transformers to its latest version, I get these errors:
```
/data/tgi/text-generation-inference$ text-generation-launcher --model-id bigscience/bloom-560m --num-shard 2 --port 8899
…
-
test
-
I tried passing rand::thread_rng() but it didn't help at all 🥲. Is this a bug or an issue with me 😅?
```rust
let mut conversation = vec![
"This is a conversation between two AI models…