-
### Within 7 days Conferences
- ACM WSDM(Web Search and Deep Mining) 2023 https://www.wsdm-conference.org/2023/
> 2/27~3/3, Singapore
- NDSS (Network and Distributed System Security Symposium) http…
-
https://arxiv.org/pdf/1803.01271.pdf
#### Subject
+ An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
+ 시퀀스 모델링을 위한 일반 컨볼루션 및 반복 네트워크의 실증적 평가
#### A…
-
this was possible earlier before the bpe pre tokenizer fixes. now it leads to
File "/kaggle/working/llama.cpp/./convert-hf-to-gguf.py", line 432, in get_vocab_base_pre
raise NotImplementedErro…
-
It would be great to have a nice notebook explaining TransformerLM and maybe even full Transformer in models/ -- both to explain the code and if possible with illustrations clarifying the concepts.
-
I'm getting a `RuntimeError: CUDA error: an illegal memory access was encountered`
using FlashAttention with a GPT-NeoX-esque model. I
```
from transformers import AutoConfig
import torch
from…
-
### System Info
```shell
Debian 11 on CPU, Python3.10
optimum : 1.13.1
onnx : 1.14.1
onnxruntime : 1.15.1
```
### Who can help?
@philschmid, @michaelbenayoun, @JingyaHuang, @echarlaix
### Info…
gidzr updated
9 months ago
-
I remember that the soft-capping issue was resolved for forward pass in flash_attn. However, I am still seeing poor model outputs when I enable use_flash_attention_2 in Transformers, even for inferenc…
-
Input: ADMG
Output: Probability expression is independent of a set of nodes.
Note: this algorithm has already been implemented in the R package `causaleffect`. In #31, the `causaleffect` impleme…
-
Hello,
So far I see only regression loss incorporated. I'm curious if you plan to incorporate class response variable(s) via perhaps adjusting output activation using sigmoid or tanh. For example…
-
This ticket aims to get a better handle on how oncogenicity and pathogenicity are related, and the constraints we should model around them with respect to variant origin, the disease object, and the s…