search

haesleinhuepf / human-eval-bia

Benchmarking Large Language Models for Bio-Image Analysis Code Generation
MIT License
13 stars 4 forks source link

rename codellama #64

Open haesleinhuepf opened 2 months ago

haesleinhuepf commented 2 months ago

The codellama model should have a more precise name. I just checked on my computer and here is visual proof that it was codellama:7b:

image

haesleinhuepf commented 2 months ago

I'm afraid renaming it now, in notebooks, filenames and figures will cause errors, e.g. when it comes to reproducing our work. Thus, I pospone this for now. We should do it before the next sampling run though.