search

DNGros / lmwrapper

An object-oriented wrapper around language models (like openai endpoints or huggingface)
1 stars 1 forks source link

Top Tokens #6

Open DNGros opened 1 year ago

DNGros commented 1 year ago

Expose the probabilities of the top tokens in a prediction result

TODO:

DNGros commented 7 months ago

@claudiosv this is fully complete, right?

claudiosv commented 7 months ago

@claudiosv this is fully complete, right?

No, this is not yet implemented for HF models, at least as far as I recall.

DNGros commented 7 months ago

Ok, c86b21622f290 should add support at least when logprobs=1. A more robust solution might be needed later