search

huggingface / transformers-bloom-inference

Fast Inference Solutions for BLOOM
Apache License 2.0
561 stars 114 forks source link

Adding minor changes to improve server deployment experience #57

Closed joe32140 closed 1 year ago

joe32140 commented 1 year ago

Updating instructions for server deployment section.

mayank31398 commented 1 year ago

@joe32140, this change can't be acceepted sorry. If the space is not being generated that means thats what the model generated. The space is generated by the model itself for decoder models.

joe32140 commented 1 year ago

@joe32140, this change can't be acceepted sorry. If the space is not being generated that means thats what the model generated. The space is generated by the model itself for decoder models.

I see. Thank you for the clarification!