dglazkov / polymath

MIT License
133 stars 9 forks source link

When a conversion has an exception, save the conversion that has been produced so far #84

Open PaulKinlan opened 1 year ago

PaulKinlan commented 1 year ago

I just spent all day importing my Twitter and MDN and it started to error with

 500 {'error': {'message': 'The server had an error while processing your request. Sorry about that! You can retry your request, or contact us through our help center at help.openai.com if the error persists. (Please include the request ID BLAH in your message.)', 'type': 'server_error', 'param': None, 'code': None}} {'Date': 'Mon, 30 Jan 2023 20:17:07 GMT', 'Content-Type': 'application/json', 'Content-Length': '366', 'Connection': 'keep-alive', 'Access-Control-Allow-Origin': '*', 'Openai-Processing-Ms': '12', 'Openai-Version': '2020-10-01', 'Strict-Transport-Security': 'max-age=15724800; includeSubDomains', 'X-Request-Id': 'BLAH'}

and it lost it. I would have loved it to be written out and then I can recover from it later.

dglazkov commented 1 year ago

Eek. That sounds like a pain. Yeah, need to figure out a way to do this more elegantly.