allenai longformer issues

allenai / longformer

Longformer: The Long-Document Transformer

https://arxiv.org/abs/2004.05150

Apache License 2.0

2.05k stars 276 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

question about pretrain

#260 etoilestar opened 4 days ago
1
Cosine similarity scores between random words are well above 0.9

#259 diogo-p-nunes opened 5 months ago
1
"requirements.txt" update (transformers==3.0.2)

#258 XinyiYing opened 11 months ago
2
Can Longformer support adapter transformer?

#257 14H034160212 opened 1 year ago
0
may you share link to somebody else latest development for long sentences pls?

#256 Sandy4321 opened 1 year ago
0
Reproducibility Problem

#255 wuj44 opened 1 year ago
0
Where is the global attention?

#254 Trace2333 opened 1 year ago
0
Longformer embeddings for calculating similarity score between 2 documents using KNN

#253 swethakasireddi opened 1 year ago
0
@ibeltagy I have similar issues with converting the model to ONNX, I converted the model to ONNX model, but when I tried to infer with onnxruntime I got ScatterND error while session run. I am guessing there are some operations not supported by onnx.

#252 wmh02240 closed 1 year ago
0
On cheatsheet

#251 chlorane opened 1 year ago
0
Mes/longformer on beaker copy all

#250 ItzVladick opened 1 year ago
0
T5 encoder decoder

#249 ItzVladick opened 1 year ago
0
Number of tokens per batch mismatch - longformer vs roberta

#248 nbroad1881 opened 1 year ago
1
Answering performance of Longformer-base on the HotpotQA dev set

#247 zycdev closed 1 year ago
0
CVE-2007-4559 Patch

#246 TrellixVulnTeam opened 2 years ago
0
Updated BART to Longformer-encoder-decoder (LED) converter

#245 erichans opened 2 years ago
0
Why the TVM impelmentation is memroy efficient

#244 jlidw opened 2 years ago
0
Pretraining longformer for NER on big pdf text

#243 ajaysurya1221 opened 2 years ago
0
LED Training Time

#242 gospelnnadi opened 2 years ago
0
One hot encoding classes

#241 PersianSpock opened 2 years ago
0
Can't find a valid checkpoint at tmp

#240 FarnazZeidi opened 2 years ago
0
AttributeError: module 'dill._dill' has no attribute 'stack'

#239 yangjenhao opened 2 years ago
0
AttributeError: 'RobertaEmbeddings' object has no attribute 'position_ids'

#238 XueqiYang closed 2 years ago
1
CUDA error: device-side assert triggered in multi class text classification

#237 iteimouri opened 2 years ago
0
ERROR: Command errored out with exit status 128: git

#236 CNwangbin opened 2 years ago
0
ModuleNotFoundError: No module named 'longformer'

#235 CNwangbin closed 2 years ago
1
Results on Hyperpartisian

#234 amineabdaoui opened 2 years ago
3
Unable to use longformer in contextualized topic models - CUDA error: device-side assert triggered

#233 siames3 opened 2 years ago
1
Where is the embedding?

#232 vqiangv closed 2 years ago
0
The expanded size of the tensor (4096) must match the existing size (512) at non-singleton dimension 1.

#231 vqiangv closed 2 years ago
0
where is the “transformers.modeling_roberta”？

#230 vqiangv closed 2 years ago
3
Error loading data in summarization.py

#229 yjqiu closed 2 years ago
1
Fine-tuning longformer for Question Answering

#228 SumeetSandhu opened 2 years ago
0
How to deal with 3-dimensional attention_mask in LongformerSelfAttention

#227 khang-nguyen2907 opened 2 years ago
0
Where is the longformer-loop version?

#226 diaodeyi opened 2 years ago
0
Cuda 11 support for Ubuntu 18.04 and 20.04

#225 jannessm closed 2 years ago
0
Indeterministic results with LongFormer

#224 Copilot-X opened 2 years ago
0
integrate with Lightning ecosystem CI

#223 Borda opened 2 years ago
0
Self-made Longformer doesn’t take more than 512 token

#222 LadyHangaku opened 2 years ago
0
Trying to run longformers on TPU

#221 siddagra opened 2 years ago
0
Adapting this repo to current version of transformers library

#220 MorenoLaQuatra opened 2 years ago
3
Autoregressive and Relative Position Embedding Support

#219 btyu opened 2 years ago
0
Confusion about attention mask for pretraining LongformerForMaskedLM

#218 frederikkemarin closed 2 years ago
0
Is it possible to train LongformerEncoderDecoder starting from Japanese T5 checkpoint?

#217 SleepingSkipper opened 2 years ago
0
LED models give: `IndexError: index out of range in self`

#216 nicola-decao closed 3 years ago
1
TypeError: forward() takes from 2 to 7 positional arguments but 8 were given

#215 SCS2017 opened 3 years ago
3
is here a simple example for seq2seq?

#214 seyeeet opened 3 years ago
1
Longformer issue in Huggingface implementation

#213 aleSuglia closed 3 years ago
1
Longformer for autoregression

#212 siddagra opened 3 years ago
0
Initialization for large-model-training is far too slow

#211 CaoYiqingT opened 3 years ago
0