Parallel prediction for multiple prompts

r2d4 / rellm

Exact structure out of any language model completion.

MIT License

501 stars 23 forks source link

Open EgorBu opened 1 year ago

EgorBu commented 1 year ago

Hello,

Thank you for a very interesting solution!

Do you have any ideas how rellm can be used to make controllable generation for multiple prompts?