Implement an extension showing the alternative words the model could have chosen - similar to the following project.

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.

GNU Affero General Public License v3.0

40.82k stars 5.34k forks source link

Implement an extension showing the alternative words the model could have chosen - similar to the following project. #6513

Open marknasr22 opened 3 weeks ago

marknasr22 commented 3 weeks ago

Description It would be great if an extension is implemented for showing the alternative words/tokens the model could have chosen and a possibility to choose any of the words to continue generating from there. Here is the standalone project that does that.

https://github.com/TC-Zheng/ActuosusAI