Chapter 09: nlpaug is extremely slow (more than 60s to generate a subsituted sentence !!

[jeromemassot]

Information

The question or comment is about chapter:

• [ ] Introduction
• [ ] Text Classification
• [ ] Transformer Anatomy
• [ ] Multilingual Named Entity Recognition
• [ ] Text Generation
• [ ] Summarization
• [ ] Question Answering
• [ ] Making Transformers Efficient in Production
• [x ] Dealing with Few to No Labels
• [ ] Training Transformers from Scratch
• [ ] Future Directions

Question or comment

Has someone also noticed that the nlpaug naw.ContextualWordEmbsAug(model_path="distilbert-base-uncased", device="cuda", action="substitute") is extremely slow even on "cuda" device?

I have a decent computer Xeon E5, 64 GB, RTX Titan 24 Gbs so I cannot understand why this module is so slow.

Thanks

Best regards

Jerome