microsoft / xtreme-distil-transformers

XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
MIT License
153 stars 14 forks source link

data format doesn't match #4

Open liaocs2008 opened 2 years ago

liaocs2008 commented 2 years ago

I think your MNLI data format is not the one from download_glue_data.py

The preprocessing script didn't skip the csv header (which I can fix), but it still throws error due to format issue: ValueError: invalid literal for int() with base 10: '31193n'

eldapere8 commented 1 year ago

Same issue here.