Instance Discard for Data Loader

allenai / allennlp

An open-source NLP research library, built on PyTorch.

http://www.allennlp.org

Apache License 2.0

11.74k stars 2.25k forks source link

Instance Discard for Data Loader #5705

Closed alexixu closed 2 years ago

alexixu commented 2 years ago

Is your feature request related to a problem? Please describe. I need to discard examples when I read the data. BUT the data loader will stop when the data reader return None or raising Exception. Empty Instance can not satisfy either.

Describe the solution you'd like Data loader can automatic discard the instance when data reader return None.

Describe alternatives you've considered Define a Type of Exception like DiscardException to implement this logic gracefully.

github-actions[bot] commented 2 years ago

This issue is being closed due to lack of activity. If you think it still needs to be addressed, please comment on this thread 👇