search

nyu-mll / jiant

jiant is an nlp toolkit
https://jiant.info
MIT License
1.62k stars 294 forks source link

Replace jiant caching.py with existing package #1192

Open jeswan opened 4 years ago

jeswan commented 4 years ago

Currently, jiant relies on custom caching code found in caching.py. To reduce effort required to maintain jiant, it is desirable to use a tested, existing package. It is likely possible to use an off the shelf package such as shelve or Joblib to replace caching.py. All caching functionality should be tested before doing a switch to a new caching package (so that the switch is seamless).

jeswan commented 3 years ago

If jiant switches to completely use https://github.com/huggingface/nlp, caching.py will no longer be necessary.