mistralai mistral-inference issues

mistralai / mistral-inference

Official inference library for Mistral models

https://mistral.ai/

Apache License 2.0

9.76k stars 871 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Missing new line

#234 theophilegervet closed 2 weeks ago
0
[BUG: ] Do we have a paper of a doc describing Mixtral-8x7B and Mixtral-8x22B model architectures?

#233 vipannalla opened 2 weeks ago
1
[Relesae 1.5]

#231 patrickvonplaten closed 1 month ago
0
Add per-layer sliding window

#230 patrickvonplaten closed 1 month ago
0
[BUG: Using the fine-tuned Mistral-7B-v0.1 for inference, when encountering the backslash escape character '', the inference stalls, very slow, but after a few minutes, it continues generating.

#229 Essence9999 opened 1 month ago
0
[BUG: pip install mistral_inference: ModuleNotFoundError: No module named 'torch'

#228 chrisstankevitz opened 1 month ago
3
Pixtral-12B tokenizer error - special_token_policy=IGNORE does not ignore special tokens in decoding

#227 OmriKaduri opened 2 months ago
0
Update transformer.py

#226 siwer opened 2 months ago
0
[BUG: RuntimeError: Boolean value of Tensor with more than one value is ambiguous]

#225 siwer opened 2 months ago
0
[BUG: Cannot build on Mac M1 Silicion

#224 timspannzilliz opened 2 months ago
0
Update README.md

#223 devendrachaplot closed 2 months ago
0
[BUG: AttributeError: module 'torch.library' has no attribute 'custom_op'

#222 mruhlmannGit opened 2 months ago
0
[BUG: RuntimeError: Couldn't instantiate class <class 'mistral_inference.args.TransformerArgs'> using init args dict_keys(['dim', 'n_layers', 'vocab_size', 'model_type'])

#221 NM5035 opened 2 months ago
0
[BUG: TypeError: generate_mamba() takes 2 positional arguments but 3 positional arguments were given

#220 NM5035 opened 2 months ago
0
Pixtral 12B

#219 devendrachaplot closed 2 months ago
1
[fix] Correctly pass mask in TransformerBlock.forward in transformer_layers.py

#218 MarcSzafraniec opened 2 months ago
1
Pixtral

#217 patrickvonplaten closed 2 months ago
0
Fix device error when using cuda device other than cuda:0

#216 cornzz opened 3 months ago
0
[BUG] Device error when running on other cuda device than cuda:0

#215 cornzz opened 3 months ago
1
Fix generation not concluding when eos was hit for each prompt

#214 cornzz closed 3 months ago
1
[BUG: Mamba-Codestral-7B-v0.1 Internal Triton PTX codegen error: Ptx assembly aborted due to errors

#213 andretisch opened 3 months ago
0
[Feat] Add streaming support to Codestral Mamba

#212 xNul opened 3 months ago
0
Update README.md

#211 patrickvonplaten opened 3 months ago
0
[BUG: rate limit exceeded on basic examples

#210 AlbertoMQ opened 3 months ago
0
add Makefile

#209 bionicles opened 3 months ago
0
Fix wrong link

#208 arch-btw closed 3 months ago
1
[BUG: config.json in mamba-codestral-7B-v0.1 is error

#207 Fly-Pluche closed 3 months ago
2
[BUG: ImportError: cannot import name 'Transformer' from 'mistral_inference.model' (/usr/local/lib/python3.10/dist-packages/mistral_inference/model.py)

#206 rabeeqasem opened 4 months ago
9
[BUG: Could not find consolidated.00.pth or consolidated.safetensors in Mistral model path but mistralai/Mistral-Large-Instruct-2407 surely not contains it

#205 ShadowTeamCN opened 4 months ago
9
README newline

#204 timlacroix closed 4 months ago
0
Mistral Large 2 release

#203 timlacroix closed 4 months ago
0
[BUG: ModuleNotFoundError: No module named 'mistral_inference.transformer'

#202 yafangwang9 opened 4 months ago
6
Update README.md

#201 RahulMR42 opened 4 months ago
0
[BUG: ModuleNotFoundError: No module named 'triton']

#200 MaxAkbar closed 4 months ago
3
Improve mistral inference

#199 patrickvonplaten closed 3 months ago
0
Update README.md

#198 bhargavyagnik closed 3 months ago
0
[BUG] Transformer.from_folder() does not load the model on multiple GPU

#197 Cerrix opened 4 months ago
4
[BUG: mistralai/mamba-codestral-7B-v0.1 AttributeError: 'Mamba2' object has no attribute 'dconv'

#196 s-natsubori opened 4 months ago
0
Update README.md

#195 patrickvonplaten closed 4 months ago
0
Update README

#194 patrickvonplaten closed 4 months ago
0
Tekken

#193 patrickvonplaten closed 4 months ago
0
[BUG: AssertionError: Mamba is not installed. Please install it using `pip install mamba-ssm`.

#192 matbee-eth opened 4 months ago
9
Update hardcoded Mamba filenames

#191 Wauplin closed 4 months ago
1
Update README.md

#190 Simontwice closed 4 months ago
0
Update README.md

#189 patrickvonplaten closed 4 months ago
0
Add Mamba and Mathstral to README

#188 patrickvonplaten closed 4 months ago
0
Add mamba

#187 patrickvonplaten closed 4 months ago
0
bombastictranz/mistral-inference

#185 bombastictranz closed 5 months ago
0
Update README.md

#184 Simontwice closed 5 months ago
0
typo in ModelArgs class docstring.

#183 CharlesCNorton closed 5 months ago
0