Ensure robust and fault tolerant generation

flairNLP / fabricator

[EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.

Apache License 2.0

98 stars 12 forks source link

Ensure robust and fault tolerant generation #9

Closed HallerPatrick closed 1 year ago

HallerPatrick commented 1 year ago

Due to the costs involved in using OpenAI, ensure that during generation the program does not crash, based on the library code. Generated examples should be saved immediately. Give user feedback if something fails (api calls, sampling, etc)