Closed bnewm0609 closed 1 year ago
For API SpanQA, you can clear the cache with: span_qa_predictor.retrieval_qa_step.model.cache.remove_all_unsafe_no_confirm.
span_qa_predictor.retrieval_qa_step.model.cache.remove_all_unsafe_no_confirm
You can also invalidate the cache for a prediction with:
from decontext.cache import CacheState span_qa_predictor.retrieval_qa_step.cache_state=CacheState.INVALIDATE
before running span_qa_predictor.run.
span_qa_predictor.run
See the decontext README for more information on how to use CacheState
decontext
CacheState
For API SpanQA, you can clear the cache with:
span_qa_predictor.retrieval_qa_step.model.cache.remove_all_unsafe_no_confirm
.You can also invalidate the cache for a prediction with:
before running
span_qa_predictor.run
.See the
decontext
README for more information on how to useCacheState