rustformers llm issues - Githubissues

rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

https://docs.rs/llm/latest/llm/

Apache License 2.0

6.06k stars 350 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Question: GPU support

#456 toastxc opened 2 months ago
0
Not enough space in the context's memory pool

#455 thecodechemist99 opened 2 months ago
0
build: fix `nix build`

#454 tensor5 closed 1 week ago
1
Out of context answers

#453 DravidVaishnav opened 3 months ago
0
Include bytes of model in program?

#452 Lamby777 opened 3 months ago
1
Sub reddit is down

#451 Gamithon opened 4 months ago
2
Currently in dev any inference is broken

#450 gadLinux opened 4 months ago
2
When using tokio and HuggingFaceRemote it breaks dropping the runtime

#449 gadLinux opened 4 months ago
1
Build fails: error: no such file or directory: 'ggml/src/ggml.c'

#448 yurivict opened 6 months ago
0
Behavior when missing quantization version

#447 Reichenbachian opened 6 months ago
1
EOS is not read from gguf format

#446 Alisa-lisa opened 6 months ago
1
Support Separate Loading of Vocabulary or Tensors

#445 skirodev opened 6 months ago
0
Fix embedded tokenizer

#444 skirodev closed 6 months ago
2
fix &'static lifetime warning

#443 JRazek closed 7 months ago
1
Develop

#442 philpax closed 1 week ago
0
chore: update rustix 0.38

#441 philpax closed 7 months ago
0
Update to llm-samplers v0.0.7

#440 KerfuffleV2 closed 7 months ago
5
Why is the feed_prompt process so slow?

#439 zackshen opened 8 months ago
5
Fix snapshot serialization/deserialization: rename logits to last_logits

#438 lucksus closed 8 months ago
0
Reduce dependencies

#437 philpax opened 8 months ago
0
Disable tokenizers-remote support for the library by default

#436 philpax opened 8 months ago
1
Support for Mistral-7b

#434 ranaya-formant opened 9 months ago
5
How to disable ggml logging?

#433 mrwilby opened 9 months ago
1
Fix rewind crash

#432 olexiyb closed 8 months ago
0
Clarify MSRV policy

#431 chris-ha458 opened 9 months ago
2
Fix typo in README.md

#430 najielhachem closed 9 months ago
1
few unwrap removes

#429 chris-ha458 closed 9 months ago
1
Build against newer GGML version

#428 LLukas22 closed 7 months ago
8
How do I use Huggingface tokenization to use a model on Huggingace in MODEL_PATH instead of my local machine?

#427 alfellati opened 9 months ago
1
Fix build on macos m1

#426 olexiyb closed 9 months ago
1
Add "context swap" functions to session and add "decoded_tokens" to snapshot read/write

#425 Andreybest closed 9 months ago
0
Add "context swap" functions to session and add "decoded_tokens" to snapshot read/write

#424 Andreybest closed 7 months ago
1
Medusa Speculative Decoding

#423 someone13574 opened 9 months ago
1
SIGTRAP triggered on MacOS

#422 jafioti opened 10 months ago
2
Default String for ConfiguredSamplers

#420 JuliaMerz opened 10 months ago
1
Add Default GPU Split and Runtime Configuration

#419 jacohend closed 8 months ago
0
NaN logits on LLaMA 65B when using 2k+ token contexts

#418 hugoabonizio opened 10 months ago
0
WizardCoder llama assert failure

#417 jacohend opened 10 months ago
3
Rust 1.72 fixes

#416 philpax closed 10 months ago
0
AMD ROCm support with HIPBLAS

#415 xangelix opened 10 months ago
2
Api Server Example

#414 e253 opened 10 months ago
5
LLaMA-2 GGML formats fail to generate any new token

#413 AnubhabB opened 10 months ago
0
GGUF support

#412 philpax closed 7 months ago
3
System prompts

#411 kpcyrd opened 10 months ago
1
add `Tensor::is_contiguous`

#410 oppiliappan closed 10 months ago
1
Support for Llama 70-B

#409 AmineDiro closed 10 months ago
3
Issues using with whisper-rs

#408 jafioti closed 10 months ago
8
Proper Rewind+Refeed when stop token is detected.

#407 JuliaMerz opened 10 months ago
1
Updated tokenizers crate to 0.13.4

#406 clarkmcc closed 10 months ago
1
Cannot Compile llm-base on main

#405 carllippert closed 10 months ago
4