issues
search
ContextualAI
/
gritlm
Generative Representational Instruction Tuning
https://arxiv.org/abs/2402.09906
MIT License
475
stars
33
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
About OOM During Training and Questions Regarding Attn
#46
Zheng-Jay
opened
1 day ago
2
Can I select causal attention for retrieval embeddings when using GritLM
#45
Yangseung
opened
1 day ago
14
Question about in-batch negatives in the training loop.
#44
DreamInvoker
closed
2 days ago
3
When I was preparing to train the qwen2 model using the gritlm project, I encountered this error:AssertionError: Some of models are not wrapped in DistributedDataParallel. Make sure you are running DDP with proper initializations.
#43
YuvalCheung
closed
13 hours ago
12
Add support for encoding pretokenized sequences
#42
kabachuha
opened
2 weeks ago
4
When training a unified model, TypeError: MistralForCausalLM.forward() got an unexpected keyword argument 'is_causal'
#41
zillion-zhao
opened
2 weeks ago
5
Generative evaluation failed due to various error
#40
zillion-zhao
closed
1 week ago
2
Bugfix: Added missing functions in rag/index.py
#39
maharshi95
opened
3 weeks ago
0
About training data of embedding
#38
zillion-zhao
closed
2 weeks ago
2
[Fix] Don't use model .to( device when using bitsandbytes quant
#37
kabachuha
closed
4 weeks ago
0
How do I get the sentence embedding from GritLM/emb_m7_nodes16_fast?
#36
phartman-keysight
opened
1 month ago
4
projection layer
#35
CementMaker
opened
1 month ago
1
attn attribute setting
#34
louieworth
closed
1 month ago
8
MTEB Evaluation -BOS/EOS markers
#33
raghavlite
closed
1 month ago
3
Changes needed within modeling_mistral.py for an embedding model
#32
spookyQubit
closed
2 months ago
7
CustomRandomSampler not working in huggingface Trainer and Accelerator
#31
YanshekWoo
opened
2 months ago
1
sampling in-batch negatives
#30
raghavlite
closed
2 months ago
2
QLora + Mistral
#29
raghavlite
closed
2 months ago
2
Gradient Caching trainer error.
#28
raghavlite
closed
2 months ago
2
Unable to load trained model
#27
deepakkr-singh
opened
2 months ago
1
Update reranker
#26
hongjin-su
closed
2 months ago
0
How to use GritLM as a generative reranker?
#25
orionw
closed
2 months ago
6
TypeError: forward() got an unexpected keyword argument 'is_causal'
#24
DreamInvoker
closed
2 months ago
5
Have you set negatives_cross_device=True in GRITLM-7B？
#23
DreamInvoker
closed
2 months ago
2
Is there hope Grit-Embedding beats this task?
#22
marioeljuga
opened
3 months ago
2
Fix lora issue
#21
Hisarlik
closed
3 months ago
1
QLoRa / LoRa issue
#20
Hisarlik
closed
3 months ago
7
Grit model training scripts can be compatible with any other language model?
#19
5joon2
closed
3 months ago
10
Compatibility with HF
#18
Hannibal046
closed
3 months ago
3
E5 dataset
#17
wangskyGit
opened
3 months ago
1
RuntimeError
#16
BlackHandsomeLee
opened
3 months ago
1
bidirectional attention or casual attention for embedding?
#15
yonxie
opened
3 months ago
5
Are the embedding head weights published?
#14
fssh72
opened
3 months ago
1
which model should be used?
#13
MohammadAsadolahi
opened
3 months ago
5
model before fine-tuning issue
#12
BlackHandsomeLee
closed
3 months ago
3
Dose your evaluation code support data parallelism?
#11
selmiss
opened
3 months ago
3
Some Questions about the training code
#10
MikeDean2367
closed
4 months ago
7
eager vs. flash vs. sdpa
#9
hjq133
closed
4 months ago
1
BUG: NotImplementedError
#8
oYoungCo
opened
4 months ago
3
RWKV changes
#7
Muennighoff
opened
4 months ago
0
For document clustering, should we leave instruction blank?
#6
griff4692
opened
4 months ago
3
Full Finetuning or LoRA ?
#5
hjq133
closed
4 months ago
1
How to write the prompt to tell the model that it should only generate the answers based on the context?
#4
gabriead
opened
4 months ago
1
how to do doc cache if there are multiple documents in rag?
#3
SimonYx42
opened
4 months ago
2
How would one go about running embedding as a service using something like vLLM?
#2
sungkim11
opened
4 months ago
1
fix typo in Pretrained models section
#1
BilalKHA95
closed
4 months ago
0