search

ThilinaRajapakse / pytorch-transformers-classification

Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.
Apache License 2.0
306 stars 97 forks source link

Update prerec packages info: transformer and apex? #45

Open HaoLi111 opened 1 year ago

HaoLi111 commented 1 year ago
  1. replacing every pytorch_transformers by transformers fixes the problem of giving negative dimensions to create tensor.
  2. fp 16 requires nv apex, but can you write something to note that it is not the pip apex, and point to a way to install from nv or just let the default fp16=False to circumvent the issue for beginners? Thanks
HaoLi111 commented 1 year ago

maybe 2 is not a good idea. Maybe include the code to install apex and use fp16 to save cost?