ThilinaRajapakse / pytorch-transformers-classification

Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.
Apache License 2.0
306 stars 97 forks source link

How to run utils.py? #23

Open Mahhos opened 5 years ago

Mahhos commented 5 years ago

Is there any specific parameter that we should pass to run the utils.py? Running the file itself seems does nothing. It does not create the InputFeature objects or anything. What should we expect utils.py return/create? I have already done the data preprocessing part and generated the train.tsv and dev.tsv files. They are both on my data/ folder.

ThilinaRajapakse commented 5 years ago

You don't need to run utils.py. The readme tells you which notebooks to run.

Mahhos commented 5 years ago

Thanks for the clarification. I was following the steps in the A Hands-On Guide To Text Classification With Transformer Models (XLNet, BERT, XLM, RoBERTa) and thought we should run utils.py.

ThilinaRajapakse commented 5 years ago

No problem. The stuff in utils is used in the next notebook.