-
I tried to compile `TinyLlama-1.1B-Chat-v1.0` model to vmfb but failed. The parameter data type unmatch in torch.nn.functional.scaled_dot_product_attention(). How can I fix it?
PS. I based on commi…
-
Today I had a discussion with @marcochiaramello, @rosiereflo, and @joyelfeghali about using C code generated with `--daeMode --generateSymbolicJacobian`.
Consider the following test case:
```model…
-
Hi Team,
It is amazing handbook. In the continued pre-training script (`run_cpt.py`), I saw that it is not using "mlm" (Masked Language Model) parameter in the training process. I though that the …
-
Hi! Thanks for sharing this wonderful work! I am wondering do you have any plan to release the causal models for inference on our own videos? Thanks!
-
reviewers of the higher-order probability paper raised two key worries:
1. we can just use first order probabilities, we don't need to go higher order
2. it'd be good to engage with literature about…
-
Hello all,
Thanks for your great work here. We are implementing speculative decoding at mistral.rs, and were in the final stages of testing when we discovered some incredibly strange behavior. Spec…
-
这个代码大家都复现成功了吗?为什么我的会报下面的错误?
File "/mnt/G/conda_envs/MambaDFuse/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1190, in _call_impl
return forward_call(*input, **kwargs)
File "/m…
-
I would like to ask you how I can use model from HF:
```python
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("google/flan-t5-xxl")
mode…
-
### Author Pages
https://aclanthology.org/people/c/chen-zhang/
### Type of Author Metadata Correction
- [X] The author page wrongly conflates different people with the same name.
- [ ] This author …
-
I am building GPT kinda model in Equinox, and right now the forward pass is extremely slow compared to my torch implementation. I think this is one of the cases where I would like to attach a profiler…