allenai longformer issues

allenai / longformer

Longformer: The Long-Document Transformer

https://arxiv.org/abs/2004.05150

Apache License 2.0

2k stars 268 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Cosine similarity scores between random words are well above 0.9

#259 diogo-p-nunes opened 4 weeks ago
1
"requirements.txt" update (transformers==3.0.2)

#258 XinyiYing opened 6 months ago
2
Can Longformer support adapter transformer?

#257 14H034160212 opened 1 year ago
0
may you share link to somebody else latest development for long sentences pls?

#256 Sandy4321 opened 1 year ago
0
Reproducibility Problem

#255 wuj44 opened 1 year ago
0
Where is the global attention?

#254 Trace2333 opened 1 year ago
0
Longformer embeddings for calculating similarity score between 2 documents using KNN

#253 swethakasireddi opened 1 year ago
0
@ibeltagy I have similar issues with converting the model to ONNX, I converted the model to ONNX model, but when I tried to infer with onnxruntime I got ScatterND error while session run. I am guessing there are some operations not supported by onnx.

#252 wmh02240 closed 1 year ago
0
On cheatsheet

#251 chlorane opened 1 year ago
0
Mes/longformer on beaker copy all

#250 ItzVladick opened 1 year ago
0
T5 encoder decoder

#249 ItzVladick opened 1 year ago
0
Number of tokens per batch mismatch - longformer vs roberta

#248 nbroad1881 opened 1 year ago
1
Answering performance of Longformer-base on the HotpotQA dev set

#247 zycdev closed 1 year ago
0
CVE-2007-4559 Patch

#246 TrellixVulnTeam opened 1 year ago
0
Updated BART to Longformer-encoder-decoder (LED) converter

#245 erichans opened 1 year ago
0
Why the TVM impelmentation is memroy efficient

#244 jlidw opened 1 year ago
0
Pretraining longformer for NER on big pdf text

#243 ajaysurya1221 opened 1 year ago
0
LED Training Time

#242 gospelnnadi opened 1 year ago
0
One hot encoding classes

#241 PersianSpock opened 1 year ago
0
Can't find a valid checkpoint at tmp

#240 FarnazZeidi opened 1 year ago
0
AttributeError: module 'dill._dill' has no attribute 'stack'

#239 yangjenhao opened 1 year ago
0
AttributeError: 'RobertaEmbeddings' object has no attribute 'position_ids'

#238 XueqiYang closed 2 years ago
1
CUDA error: device-side assert triggered in multi class text classification

#237 iteimouri opened 2 years ago
0
ERROR: Command errored out with exit status 128: git

#236 CNwangbin opened 2 years ago
0
ModuleNotFoundError: No module named 'longformer'

#235 CNwangbin closed 2 years ago
1
Results on Hyperpartisian

#234 amineabdaoui opened 2 years ago
3
Unable to use longformer in contextualized topic models - CUDA error: device-side assert triggered

#233 siames3 opened 2 years ago
1
Where is the embedding?

#232 vqiangv closed 2 years ago
0
The expanded size of the tensor (4096) must match the existing size (512) at non-singleton dimension 1.

#231 vqiangv closed 2 years ago
0
where is the “transformers.modeling_roberta”？

#230 vqiangv closed 2 years ago
3
Error loading data in summarization.py

#229 yjqiu closed 2 years ago
1
Fine-tuning longformer for Question Answering

#228 SumeetSandhu opened 2 years ago
0
How to deal with 3-dimensional attention_mask in LongformerSelfAttention

#227 khang-nguyen2907 opened 2 years ago
0
Where is the longformer-loop version?

#226 diaodeyi opened 2 years ago
0
Cuda 11 support for Ubuntu 18.04 and 20.04

#225 jannessm closed 2 years ago
0
Indeterministic results with LongFormer

#224 Copilot-X opened 2 years ago
0
integrate with Lightning ecosystem CI

#223 Borda opened 2 years ago
0
Self-made Longformer doesn’t take more than 512 token

#222 LadyHangaku opened 2 years ago
0
Trying to run longformers on TPU

#221 siddagra opened 2 years ago
0
Adapting this repo to current version of transformers library

#220 MorenoLaQuatra opened 2 years ago
3
Autoregressive and Relative Position Embedding Support

#219 btyu opened 2 years ago
0
Confusion about attention mask for pretraining LongformerForMaskedLM

#218 frederikkemarin closed 2 years ago
0
Is it possible to train LongformerEncoderDecoder starting from Japanese T5 checkpoint?

#217 SleepingSkipper opened 2 years ago
0
LED models give: `IndexError: index out of range in self`

#216 nicola-decao closed 2 years ago
1
TypeError: forward() takes from 2 to 7 positional arguments but 8 were given

#215 SCS2017 opened 2 years ago
3
is here a simple example for seq2seq?

#214 seyeeet opened 2 years ago
1
Longformer issue in Huggingface implementation

#213 aleSuglia closed 2 years ago
1
Longformer for autoregression

#212 siddagra opened 2 years ago
0
Initialization for large-model-training is far too slow

#211 CaoYiqingT opened 2 years ago
0
Difference between this codebase and Huggingface?

#210 aleSuglia opened 2 years ago
0