search

llSourcell / Doctor-Dignity

Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.
Apache License 2.0
3.83k stars 406 forks source link

is there any info constitutional_evaluation function?? #24

Open yeongsang2 opened 10 months ago

yeongsang2 commented 10 months ago

3.3 Training Loop

Screenshot 2023-08-23 at 9 11 04 PM
chunhualiao commented 10 months ago

I guess evaluate_response_for_RL() could be used as a workaround. This function tries to use OpenAI's text-davinci-003 to return a reward number.

yeongsang2 commented 10 months ago

I guess evaluate_response_for_RL() could be used as a workaround. This function tries to use OpenAI's text-davinci-003 to return a reward number.

I think so too, thanks for the reply.