search

aalok-sathe / surprisal

A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models.
https://aalok-sathe.github.io/surprisal/
MIT License
32 stars 6 forks source link

Adding support for OpenAI chat models #21

Closed jennhu closed 10 months ago

jennhu commented 10 months ago

OpenAI recently announced they've added logprob access to the Chat completion endpoint: https://twitter.com/OpenAIDevs/status/1735730662362189872

Would be useful to add support for computing surprisals with chat-based models.

jennhu commented 10 months ago

Sorry, just saw https://github.com/aalok-sathe/surprisal/issues/15! Closing.