-
I'm running this sample code [https://github.com/aws-neuron/transformers-neuronx#hugging-face-generate-api-support] using GPT-NeoX on an inf2.24xlarge instance, but the model.generate method kills the…
-
您好~想请问一下您在附录中有关IMDB情感分类数据集的实验细节。因为数据集中对每个query只包含单条样本,我们尝试使用imdb-gpt2进行采样扩充出另一条样本,可是效果不是很理想,所以想请问一下您是如何构建RRHF的训练样本对的呢
祝好~:)
-
我使用百度网盘下载后出现了ckpt不完整的问题,可否提供一个git的下载链接,例如在visualstudio.com上开个repo存一下模型。或者google drive也行。
-
how to randomly GPT-2 text generate(not prompt) by run_generation.py?
-
Dear Author,
While running "run.bat" installation crashes. Microsoft visual C++ is already installed. Please advise. thanks.
copying fairseq\examples\womens_bios\README.md -> build\lib.win32…
-
Certain fast tokenizers now fail on batches given as tuples, e.g. (on a MacBook M2 with transformers 4.46.1):
```
>>> from transformers import AutoTokenizer
>>> tok = AutoTokenizer.from_pretraine…
-
202307_OneFlow_libai_Report_On_master
-
Shown in https://github.com/google-ai-edge/model-explorer/issues/54, netron is able to display the graph more clearly using the same screen real estate. Things are more legible.
## 1v1 comparison
…
-
Thank you very much.
-
We can profile the code with with `examples/ds_pretrain_gpt2_pipe_flops_profiler.sh`. It seems to break after profiling, but still returns the profile result. Not sure what's going on here and it's wo…