add exact match catching so to save obvious LLM requests. While semantic caching might add noise exact match caching will avoid that. It also makes testset generation and evaluation options easily re-runnable - solving the issue of lost tokens in case of an error somewhere in the pipeline
add exact match catching so to save obvious LLM requests. While semantic caching might add noise exact match caching will avoid that. It also makes testset generation and evaluation options easily re-runnable - solving the issue of lost tokens in case of an error somewhere in the pipeline
refference issues
From SyncLinear.com | R-311