search

djaszak / NLPAug

A framework to simplify the usage of common Data Augmentation methods in the NLP context.
MIT License
2 stars 0 forks source link

Refactor on base of other known frameworks #6

Closed djaszak closed 2 years ago

djaszak commented 2 years ago

Data augmentation on image data is used a lot, so there are known big frameworks like torchvision that implemented data augmentation. My current attempt was not on dataset level to help automatize when working with datasets, like the huggingface.co ones, but more on a text level, where i put in strings and output strings that have to be processed again into a dataset. So I want to refactor it.

djaszak commented 2 years ago

Functions laying in nlpaug.character can be used in a way, that hugginface datasets.map() function can be used easily.