Add back and forth prompt for a more chat like experience

NolanoOrg / cformers

SoTA Transformers with C-backend for fast inference on your CPU.

MIT License

311 stars 29 forks source link

Closed ChobPT closed 1 year ago

ChobPT commented 1 year ago

A very simple way to interface with pythia without having to reload the model.

Added the -t parameter that will allow you to specify how many tokens
Added the -p parameter for you to send an input and get a response for that right away
If no -p parameter is present, it'll ask the user to input the prompt until they type 'exit'

Usage: python pythia.py -t 200 for 200 tokens

python pythia.py -t 200 -p tell me a joke for getting a joke with 200 tokens

ChobPT commented 1 year ago

Updated the readme to include instructions, hope it helps

Ayushk4 commented 1 year ago

Thanks a lot.