When deploying the Bloom model, I noticed that the POST method is used for the generation task. Is it possible to modify it to perform question-answering instead?

huggingface / transformers-bloom-inference

Fast Inference Solutions for BLOOM

Apache License 2.0

560 stars 114 forks source link

When deploying the Bloom model, I noticed that the POST method is used for the generation task. Is it possible to modify it to perform question-answering instead? #97

Open dizhenx opened 1 year ago

dizhenx commented 1 year ago

After executing make gen-proto and make bloom-560m, I observed that the generated text is related to the input text. Is it possible to modify it to have a conversational style? If so, how can it be achieved?