search

haesleinhuepf / human-eval-bia

Benchmarking Large Language Models for Bio-Image Analysis Code Generation
MIT License
19 stars 11 forks source link

Timeout when sampling #60

Open haesleinhuepf opened 5 months ago

haesleinhuepf commented 5 months ago

I heard reports that sampling sometimes fails due to a timeout. It might be possible, to modify this timeout. But I'm not sure about the actual error message and thus can only speculate that it's in this notebook, and the timeout might be specified in this line:

client = openai.OpenAI(timout=1000)

I couldn't find this in the documentation, but in the code.

jkh1 commented 5 months ago

Issue hasn't surfaced again. Must have been a local network glitch.