Vincent-Stragier
commented
1 year ago Hi @philogicae,
For BLOOMZ, there is already an interface that is being developed there. BLOOMZ seems terrible as a chatbot, but it has a huge potential. And BLOOM as a chatbot is even worse than BLOOMZ, since it's trained to do mainly text completion and not to receive commands, unlike BLOOMZ.
Still, the use of Petals with BLOOMZ/BLOOM could be interesting.
Hi guys, First of all, great video and funny project ! There are 3 ideas that could be nice to implement: 1) Model selector, to be able to easily download and switch between models. 2) Bloom Petals integration. It's a distributed version of Bloom (also Bloomz), that is an open-source equivalent of GPT-3 (176 billions parameters, so 1b more), allowing you to only download a small part of the model and then to act as a node to share/leverage/use the GPU power of the whole p2p network. Yes, that's amazing ! 3) Adding some buttons for the parameters : max length, temperature, top k, top p, repetition penalty, etc. What do you think ?