Custom torch.utils.data.DataLoader.collate_fn

nyu-mll / jiant

jiant is an nlp toolkit

https://jiant.info

MIT License

1.64k stars 297 forks source link

Custom torch.utils.data.DataLoader.collate_fn #1328

Open fabriceyhc opened 3 years ago

fabriceyhc commented 3 years ago

I'm working on a series of data augmentations for text and have implemented their use via the torch.utils.data.DataLoader.collate_fn but jiant appears to be using this function already. Is there a recommended workaround or roadmap item to accommodate custom a collate_fn alongside your own? If not, I'll just work on my own changes and possibly submit as a pull request.

zphang commented 3 years ago

Hi,

Not as far as I know. Feel free to make a PR!