-
In pre-training of umls with default parameter, the result is as followed:
{'Test/hits1': 0.00202020202020202,
'Test/hits10': 0.06868686868686869,
'Test/hits20': 0.13198653198653199,
'Test/hi…
-
## İçerik
Çözülmeye çalışan probleme benzer şekilde problemler için eğitilmiş model araştırılması ve bulunabilirse uygun olan bir modelin seçilmesi.
## Gereksinimler
Pretrained model bulunursa…
-
**Describe the bug**
When I am training my model, everything goes well in the first batch, but an error occurs in the second batch:
`RuntimeError: Trying to backward through the graph a second time …
-
Hi,
I took out the token embedding layer in Bert and built tensorrt engine to test the inference effect of int8 mode, but found that int8 mode is slower than fp16;
i use nvprof to view the GPU consu…
-
I am getting the following error when trying to fine-tune the 7B and 13B models from a Llama 2 base:
> ../aten/src/ATen/native/cuda/Indexing.cu:1146: indexSelectLargeIndex: block: [187,0,0], thread…
-
Hi Piotr,
Thank you for your great work on the nanoT5 repository.
I'm going to try to pre-train the T5-base variant model on C4 corpus by using V100 gpu and then I'll evaluate the model on GLUE ta…
-
This point has been raised multiple times. Our benchmarks today only focus on single iteration of fwd-bwd (and optimizers soon). But we lack a real training example, with loss going down.
We could …
-
When running HuggingFace BERT (any size) [fine-tuning tutorial](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/frameworks/torch/torch-neuronx/tutorials/training/finetune_hftrainer.html) with …
-
The repository comes with an index file for each data set, as mentioned [here](https://github.com/RUCAIBox/VQ-Rec/tree/master/dataset/downstream/OR).
What if I have a new dataset? How can I finetu…
-
## Background
If really overpowered models can't learn something basic like arithmetic well (assuming all-arithmetic training set, sane tokenization w/out BPEs, etc), that implies something about w…