google / langfun

OO for LLMs
Apache License 2.0
100 stars 17 forks source link

Refine `lf.LanguageModel`. #193

Closed copybara-service[bot] closed 3 months ago

copybara-service[bot] commented 3 months ago

Refine lf.LanguageModel.

1) Move LM input/response tagging logic from LangFunc to LanguageModel. 2) Improve debugging, preferred prompt.formatted_text over prompt.text when available. 3) Refine the logic to attach score/logprobs/usage to response message, which is now more general.