issues
search
rustformers
/
llm
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
https://docs.rs/llm/latest/llm/
Apache License 2.0
6.07k
stars
355
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Metal Prompt Feeding
#403
jafioti
opened
1 year ago
6
Supporting Llama-2 70B param
#402
AmineDiro
opened
1 year ago
6
Add the ability to quantize into k-quants
#401
LLukas22
closed
1 year ago
5
fix(deps): remove pinned `half` dependency
#400
radu-matei
closed
1 year ago
2
Video Tutorials
#399
okpatil4u
opened
1 year ago
3
add bert model
#398
oppiliappan
closed
10 months ago
9
GPT-2 load errors
#397
pabl-o-ce
closed
1 year ago
5
Build failure on Windows
#396
NuSkooler
closed
1 year ago
4
Remove `repeat` operation and add acceleration support for other architectures
#395
LLukas22
closed
1 year ago
6
Fix #393 halting feed_prompt
#394
clarkmcc
closed
1 year ago
3
Halting inference works for session.infer but not for session.feed_prompt
#393
clarkmcc
closed
1 year ago
0
Reddit community Wiki page is disabled
#392
viktor-ferenczi
closed
1 year ago
1
stack overflow after new merge
#391
fluffydolphin
closed
1 year ago
3
Free tensors from RAM if they are offloaded to an Accelerator
#390
LLukas22
opened
1 year ago
0
Custom RoPE Scaling
#389
LLukas22
closed
1 year ago
3
Installation of CLI on macOS
#388
twardoch
closed
1 year ago
2
[compile fail] Undefined symbols for architecture x86_64: "_ggml_graph_plan", referenced from: ggml::GraphExecutionPlan:: new ::h19443c1d77cb997e in libggml-a3125eb72f014293.rlib(ggml-a3125eb72f014293.ggml.9c60abbf9368402d-cgu.1.rcgu.o)
#387
twardoch
closed
1 year ago
1
Runtime GPU backend selection
#386
philpax
opened
1 year ago
4
Better GPU Documentation
#385
LLukas22
closed
1 year ago
1
Invalid magic number while loading LoRAs
#384
clarkmcc
opened
1 year ago
2
WizardLM inference error: ggml-metal.m:773: false && "not implemented"
#383
clarkmcc
opened
1 year ago
6
Any plans for being able to fine tune models in rustformers llm?
#382
moonstripe
closed
1 year ago
1
Update README.md
#380
baskrahmer
closed
1 year ago
1
Update README.md
#379
basraayman
closed
1 year ago
1
Implement SuperHOT/interpolated RoPE support
#378
philpax
closed
1 year ago
1
Add classifier-free guidance
#377
philpax
opened
1 year ago
2
Peg CUDA architecture
#376
LLukas22
closed
1 year ago
3
Fix MSRV to 1.65.0
#375
philpax
closed
1 year ago
0
I can't compile llm with nix
#374
GENDRAUD
opened
1 year ago
6
Certain quantization levels produce garbage with CUDA acceleration
#373
philpax
closed
1 year ago
1
Shared `ExecutionParameters` for all operations
#372
philpax
opened
1 year ago
0
Multi-GPU support for inferencing
#371
philpax
opened
1 year ago
1
feat(model/clone): derive `Clone` for `Box<dyn Model>`
#370
radu-matei
closed
1 year ago
3
Fix tensor name API
#369
philpax
closed
1 year ago
0
add Falcon 40B model support
#368
skirodev
closed
1 year ago
19
feat(tracing): add tracing to `llm` and `llm-base` crates
#367
radu-matei
closed
1 year ago
6
Add CI for OpenCL on windows
#366
LLukas22
closed
1 year ago
0
Support GGUF
#365
philpax
opened
1 year ago
4
allow chat to halt new token generation on `stop_sequence`
#364
averypelle
closed
1 year ago
5
Chat does not halt
#363
averypelle
closed
1 year ago
0
Update gpt2 to use wte if no lm_head
#362
steventrouble
closed
1 year ago
3
Bloom 176B inference is broken
#361
HaileyStorm
opened
1 year ago
10
Add CI for cuda builds
#360
LLukas22
closed
1 year ago
0
Use llm_samplers crate for sampler backend
#359
KerfuffleV2
closed
1 year ago
32
Fix linux CLBlast build and add CI for accelerated builds
#358
LLukas22
closed
1 year ago
1
Using gpu is slower as not using it
#357
sonic182
opened
1 year ago
4
Automatic CI testing of the `llm` CLI
#356
philpax
opened
1 year ago
2
Info on getting models?
#355
twardoch
closed
1 year ago
1
`ggml-metal.metal` download location?
#354
twardoch
closed
1 year ago
1
Error compiling CLI: Compiling macro_rules_attribute v0.1.3
#353
twardoch
closed
1 year ago
5
Previous
Next