huggingface candle issues

huggingface / candle

Minimalist ML framework for Rust

Apache License 2.0

13.79k stars 751 forks source link

issues

Recently updated

Newest Most commented Recently updated Oldest Least commented Least recently updated

Incorrect EOS token(s) in meta-llama/Meta-Llama-3-8B-Instruct example

#2164 socathie closed 4 hours ago
6
feat(gemm): implement Gemm operator in candle-onnx

#2188 socathie opened 9 hours ago
0
Allow the threshold argumet to be negative in the segment-anything example

#2187 vargad closed 11 hours ago
1
Example with model via `include_bytes!`?

#2186 boustrophedon opened 23 hours ago
0
Implement `torch.bucketize`

#2185 EricLBuehler opened 1 day ago
0
Metal error "no metal implementation for rms-norm" for Llama3 variant

#2184 n8mellis closed 1 day ago
2
add top_k option to `LogitsProcessor` new method

#2183 jorgeantonio21 closed 2 days ago
2
Latest commit on cudarc seems to have broken running the examples codes

#2175 hololite opened 1 week ago
10
Whisper microphone example outputs gibberish

#2182 krzysztofwos opened 2 days ago
0
`sort_last_dim` fails on cuda

#2181 lucasavila00 opened 3 days ago
0
VarBuilder::from_bytes?

#2177 boustrophedon closed 3 days ago
6
Fix VarBuilder::from_slice_safetensors

#2180 boustrophedon closed 3 days ago
1
Add SliceSafetensors.

#2179 LaurentMazare closed 4 days ago
0
Make it possible to use TF32 accumulation in F32 matmuls.

#2178 LaurentMazare closed 4 days ago
0
Support for tensors with 0-length dimensions

#2034 michaeleisel closed 6 days ago
2
qwen sse api

#2172 sunnyregion opened 1 week ago
1
Switch cudarc back to dynamic linking.

#2176 LaurentMazare closed 6 days ago
0
Mutable state in `MultiHeadAttention` Structure and its impact on Concurrency

#1199 WenqingZong opened 6 months ago
3
Upgrade cudarc dependency to v0.11.1

#2173 sidharthrajaram closed 1 week ago
0
Update cudarc requirement from 0.11.0 to 0.11.1

#2174 sidharthrajaram closed 1 week ago
3
Unsupported cuda toolkit version: `12040`

#2169 kdletters opened 1 week ago
1
Transparent Huge Pages Support

#2149 michaeleisel opened 2 weeks ago
2
Fix sigmoid gradient on large negative arg

#1722 agerasev closed 1 week ago
1
How to do a Axum's sse function for Candle?

#2167 sunnyregion closed 1 week ago
2
Why is the answer of my Gemma example not as expected? Did I miss something?

#2170 coolbeevip closed 1 week ago
4
How to run LLama-3 or Phi with more then 4096 prompt tokens?

#2171 baleksey opened 1 week ago
0
linking with `link.exe` failed: exit code: 1120

#1882 kulame opened 1 month ago
5
Any tips to speed up quantized Whisper inference on Android?

#1048 soupslurpr opened 7 months ago
24
No backward pass for `RmsNorm` if tensor is contiguous

#2168 agerasev opened 1 week ago
0
`broadcast_as` error when processing multiple tokens at once in quantized example

#2153 EricLBuehler opened 1 week ago
9
Refactor the metal backend to always reuse command encoders/buffers unless a shared memory access is requested

#2037 tomsanbear opened 1 month ago
9
Refactor usages of "from_raw_parts" to use bytemuck utilities instead

#2053 tomsanbear closed 1 week ago
1
Update cudarc requirement from 0.10.0 to 0.11.0

#2165 dependabot[bot] closed 1 week ago
0
Error: Metal error Error while loading function: "Function 'cast_bf16_f16' does not exist" with llama3

#2163 yIllusionSky opened 1 week ago
2
`Op::Unary(arg, UnaryOp::Silu)` branch in Tensor::backward() may cause NaN

#2082 Adamska1008 closed 3 weeks ago
4
Update metal requirement from 0.27.0 to 0.28.0

#2166 dependabot[bot] opened 1 week ago
0
Problem loading metadata of gguf file

#2152 cnlancehu opened 1 week ago
3
Use write rather than try-write on the metal rw-locks.

#2162 LaurentMazare closed 1 week ago
0
Model to architecture mapping

#2161 BDUG closed 1 week ago
2
Force the revision for the phi3-llama quantized models.

#2159 LaurentMazare closed 1 week ago
0
Separate quantized phi-3 implementation.

#2157 LaurentMazare closed 1 week ago
0
Quantized Phi-3 example fails "cannot find llama.attention.head_count in metadata"

#2154 MoonKraken opened 1 week ago
4
Pin the version used for the quantized phi 3 gguf file.

#2156 LaurentMazare closed 1 week ago
0
Bump the version number to 0.5.1.

#2155 LaurentMazare closed 1 week ago
0
Top-p halves the generation speed in the Llama example

#2147 Ayuei closed 1 week ago
3
Support top-k in tthe llama example.

#2150 LaurentMazare closed 2 weeks ago
0
Build Failure with candle-kernels: nvidia-smi Not Found in Docker Environment, Even Though It Is Available

#2105 Pox-here closed 3 weeks ago
6
.sum() with a u8 tensor overflows after 255

#1944 michaeleisel closed 1 month ago
4
Tensor Filtering

#2148 michaeleisel opened 2 weeks ago
0
Fix sigmoid gradient calculation and move sigmoid into a specialized op

#2114 MilkFather closed 2 weeks ago
5