issues
search
mistralai
/
mistral-inference
Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.49k
stars
835
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
how to explain Attention that input QKV tensor # xformers requires (B=1, S, H, D)
#65
dhcode-cpp
closed
10 months ago
1
Does mistral-instruct-7b support fast transformer deployment
#64
lebronjamesking
opened
10 months ago
0
Update README.md
#63
VinayKokate22
opened
10 months ago
1
Embedding model and Engine??
#62
muhtalhakhan
opened
10 months ago
6
More language support?
#61
OnceJune
opened
10 months ago
6
sliding window size in prefill and decode stage
#60
ofhwei
opened
10 months ago
0
Can't load xFormers because of PyTorch 2.1.0+cu121
#59
russ22cox
opened
10 months ago
2
Feature: Adding contributors section to the README.md file.
#58
Kalyanimhala
opened
10 months ago
2
Code complete?
#57
zhoumengbo
opened
10 months ago
3
Update README.md
#56
eltociear
opened
10 months ago
0
Batching, GQA and Flash Attnetion
#55
maximzubkov
opened
10 months ago
1
Unable to build Docker image with cuda:11.8.0-devel-ubuntu20.04 - CUDA version (11.8) mismatches the version that was used to compile PyTorch (12.1)
#54
hammad26
closed
10 months ago
1
What is the `max_seq_len` in Mistral?
#53
ParadoxZW
opened
10 months ago
1
Add simple classification example
#52
timlacroix
closed
10 months ago
0
Ray qelr_async_event not implemented yet
#51
Ryojikn
opened
10 months ago
0
Error on run main
#50
lrx1213
opened
10 months ago
1
[Model] Refactoring model.py into small modules
#49
sarveshwar-s
closed
10 months ago
1
it's fantastic! but can do 1.1b , 3b versions too?
#48
hiqsociety
opened
10 months ago
0
Are `RotatingBufferCache` and `RollingBufferCache` the same thing?
#47
ParadoxZW
closed
10 months ago
1
Update and rename main.py to mainwithcomments.py
#46
nikcode9
closed
10 months ago
2
Python 3.11.6 compatibility
#45
MasterLivens
opened
10 months ago
3
Update README.md
#44
infwinston
closed
10 months ago
2
Update PyTorch to 2.2.0 to support NVIDIA H100 PCIe
#43
quantumsheep
closed
10 months ago
3
python process keeps getting killed
#42
5hayanB
closed
10 months ago
1
How many tokens did Mistral-7B train on?
#41
ninjasaid2k
closed
10 months ago
0
Questions about layer-wise sliding window attention
#40
NormXU
closed
10 months ago
13
very good! thx! but...
#39
hiqsociety
closed
11 months ago
0
one_file_ref.py attention has an O(seqlen^2) matrix multiplication when prefilling
#38
Aniruddha-Deb
closed
10 months ago
1
🦒 colab
#37
camenduru
closed
11 months ago
1
Can you provide lora tutorial for mistral 7b instruction model on custom dataset?
#36
universewill
opened
11 months ago
1
System prompt handling in chat templates for Mistral-7b-instruct
#35
jamesr66a
closed
10 months ago
5
Mistral on CPU
#34
pruthvi1990
opened
11 months ago
2
.bin format?
#33
StanislawKarnacky
opened
11 months ago
0
Tokenizer.model error on pycharm
#32
dominique-AR
opened
11 months ago
1
Update Dockerfile
#31
lerela
closed
11 months ago
0
Mistral-7B-instruct-v0.1 compatibility with main.py
#30
nvidal01
opened
11 months ago
4
fix URL typo
#29
VictorNanka
closed
11 months ago
0
Dilation ?
#28
edmondja
opened
11 months ago
1
Update README.md
#27
Emporea
closed
11 months ago
0
Add top_k text decoding
#26
aahouzi
closed
3 months ago
0
ValueError: No available memory for the cache blocks.
#25
Stoobiedoo
opened
11 months ago
1
Update README.md
#24
numaroth
closed
11 months ago
1
test Mistral / llama2 with flowise and replicate
#23
scenaristeur
opened
11 months ago
0
Passkey retrieval results
#22
RonanKMcGovern
opened
11 months ago
0
Update README.md
#21
eltociear
closed
11 months ago
0
Out of Memory after training a few epochs
#20
waylonli
opened
11 months ago
0
Add Dockerfile and build instructions
#19
lerela
closed
11 months ago
2
ONNX?
#18
DiTo97
closed
10 months ago
1
python3: No module named main
#16
happybeing
opened
11 months ago
2
Custom Training Pipeline ?
#15
AMEERAZAM08
opened
11 months ago
0
Previous
Next