Model Request: Blenderbot 2.0

[Xirider]

🌟 New model addition

Model description

Facebook released Blenderbot 2.0, a chatbot that builds on RAG and Blenderbot 1.0. It can save interactions for later reference and use web search to find information on the web.

https://parl.ai/projects/blenderbot2/

Open source status

• [x] the model implementation is available: in Parl.ai
• [x] the model weights are available: https://parl.ai/docs/zoo.html#wizard-of-internet-models
• [ ] who are the authors: (mention them, if possible by @gh-username)

[shamanez]

I am interested to work on this. Can we use RAG-end2end ?

[Mahmoud-Yasser-16]

Is there any news regarding Blenderbot 2.0 with huggingface?

[rvong65]

Any new updates? It's been three months.

[rvong65]

Does anyone want to work together on this?

[louis030195]

I'm interested too. FYI https://github.com/JulesGM/ParlAI_SearchEngine.

[rmiaouh]

+1

[shamanez]

+1 GitHub - shamanez

On Sat, Nov 20, 2021, 23:30 RM @.***> wrote:

+1

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/huggingface/transformers/issues/12807#issuecomment-974628903, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEA4FGTW5KWREVEYFQT5PUTUM52EPANCNFSM5AVTBZYQ .

[neuromaancer]

+1 is there any progress for this?

[patil-suraj]

Hi @AlafateABULIMITI Yes, we are considering adding this model. But since this is a complex model it might take a couple of weeks to fully integrate it.

[avacaondata]

+1

[Darth-Carrotpie]

Really excited for it! I think even without a search engine implementation people would use it, though examples wouldn't hurt! Also, btw, someone did a simple search engine implementation already here: https://github.com/JulesGM/ParlAI_SearchEngine

[patil-suraj]

Thank you for sharing this @Darth-Carrotpie

[photonic-genesis]

Is anyone currently working on this or is it's inclusion just being discussed?

[patil-suraj]

I have started working on it. Should have a PR soon!

[photonic-genesis]

I should probably also mention that using Newspaper (https://pypi.org/project/newspaper3k/) to extract webpage text is slightly cleaner than the custom solution provided in JulesGM's search server implementation!

[infoCoachAI]

@patil-suraj It has been two months since your last post on Blender 2.0. Do you know when it will be included in Transformers?

[louis030195]

Blenderbot2 is obsolete now. See Seeker https://parl.ai/projects/seeker/

Unfortunately, these conversational AIs seems to be a combination bunch of models and/or APIs, so I understand that they enter with difficulty in Huggingface's transformers.

I wrote something to deploy Seeker and its API on Kubernetes: https://louis030195.medium.com/deploy-seeker-search-augmented-conversational-ai-on-kubernetes-in-5-minutes-81a61aa4e749

[Darth-Carrotpie]

Blenderbot2 is obsolete now. See Seeker https://parl.ai/projects/seeker/

Unfortunately, these conversational AIs seems to be a combination bunch of models and/or APIs, so I understand that they enter with difficulty in Huggingface's transformers.

I wrote something to deploy Seeker and its API on Kubernetes: https://louis030195.medium.com/deploy-seeker-search-augmented-conversational-ai-on-kubernetes-in-5-minutes-81a61aa4e749

Blenderbot 2 has memory as well as search engine capabilities, so the potential to remember chat topics between sessions. Unless I'm missing something, SeeKeR doesn't seem to have this feature, so I wouldn't call Blenderbot completely obsolete just yet...

[stefan-it]

Blenderbot 3 is out now: https://parl.ai/projects/bb3/#models

[shermansiu]

Any progress? With ChatGPT and Sparrow, it seems like chatbots are increasing in both relevance and importance in NLP.

[shermansiu]

I have started working on it. Should have a PR soon!

@patil-suraj Could you please create a draft PR or something so that others can pick up where you left off?

[shermansiu]

(It seems like he's switched over to working on diffusers in the meantime...)

[shermansiu]

@ArthurZucker @younesbelkada (the ML engineers currently in charge of the text models)

[sgowdaks]

Do we have any updates?

[shermansiu]

Patil is no longer working on this issue: he's working on diffusers instead. There don't seem to be any active contributors to this issue at the moment.

I would like to contribute at some point, but I'm swamped with my other to-do items.

[ArthurZucker]

Hey, there has not been any progress here! So currently this is not planned by someone on our team, so if you want to pick it up feel free to do so. Also since the BlenderBot model is already supported, unless the architecture is very different, adding the model should be pretty easy with transformers-cli add-new-model-like 😉 But blenderBot is a pretty complex model, so this is not a good first issue and is better fitted for someone who already added a model! 🚀 In that case we'll gladly support and be there to help!

[Cuteistfox]

+1

[shermansiu]

I guess BlenderBot 3x is also out! https://twitter.com/ylecun/status/1667196416043925505

It might be a good idea to try porting the dataset over to Huggingface and fine-tuning a better base model...

[shermansiu]

I'm not sure how relevant this is anymore since Llama 2 is all the rage these days, but hopefully, I'll find the time to port all of the Parlai models over to Huggingface!