Closed mrticker closed 2 months ago
Token indices sequence length is longer than the specified maximum sequence length for this model (395 > 384). Running this sequence through the model will result in indexing errors
I get this warning relatively often when converting arxiv papers. Examples: https://arxiv.org/abs/2001.04451 https://arxiv.org/abs/2301.10226 https://arxiv.org/abs/2002.05770
+1! Same on various biorxiv papers
+1, same problem
This should be fine - texify can work above this length. (it's a warning, not an error)
Token indices sequence length is longer than the specified maximum sequence length for this model (395 > 384). Running this sequence through the model will result in indexing errors
I get this warning relatively often when converting arxiv papers. Examples: https://arxiv.org/abs/2001.04451 https://arxiv.org/abs/2301.10226 https://arxiv.org/abs/2002.05770