-
So this is a strange one. I am stumped.
In way, this is sort of like #416, but I confirmed that if Batch==1, then the problem does not occur. (See below)
My inference loop looks like this
```
…
-
I would like to test a tokenizer, but this corpus does not include the original sentences. Would it be possible to include the original sentences?
Some of the sentences seem to come from here: ht…
-
I wonder if there is a straightforward way to add from the tokenizer the sentences and their token content to build a new folia doc.
It is not clear to me how to do that with the `add` method: is one…
-
Comparing models to NLTK, it seems like it would be better to pickle sentence tokenizer models as type ```nltk.tokenize.punkt.PunktSentenceTokenizer``` objects as opposed to their current type of ```n…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I recently upgraded llama_index to version 0.11.2.
I also changed from using Sentence…
-
I tried to visualize the attention maps for the T5 model but have encountered issues while getting the plots.
I would like to emphasize few points:
- I have used `model.generate` because I don't …
-
基于pytorch版本的bertspanner训练了一个NER模型。在pytorch下推理结果很好。但是通过torch.onnx.export将其转换成onnx模型后,再用onnx模型推理结果跟之前pytorch模型推理结果不一致。是我漏掉了什么?还是模型中有onnx不支持的op?谢谢!
pytorch 推理代码如下:
```
from processors.ner_span impor…
-
Another question: Why am i forced to give a file instead of giving a text? imagine i get the text from a webservice, i want to feed it to the pipeline without having first to save it to a file. Also i…
-
### Describe the issue
I am attempting to export a model from HuggingFace from PyTorch to Onnx. After exporting the model, I am trying to confirm the outputs are still correct however it appears that…
-
The official ollama supports this model in v0.3.4
[https://github.com/ollama/ollama/releases/tag/v0.3.4](https://github.com/ollama/ollama/releases/tag/v0.3.4)
Tried with ollama in 2.1.0b20240820, …