UBC-MDS / fixml

LLM Tool for effective test evaluation of ML projects with curated Checklists and LLM prompts
https://ubc-mds.github.io/fixml
Other
3 stars 2 forks source link

Add checks for overwrite protection before running expensive operations #163

Closed SoloSynth1 closed 4 months ago

SoloSynth1 commented 5 months ago

Currently, the system will only check if a report is writable when it is called to export/write the report. This creates user friction as operations done before the export/write could be expensive. It is best for us to do the check before running any expensive calls e.g. API calls to LLM service providers.