As the question states, does transformer-deploy text generation work on the byt5 models? (google/byt5-small, google/byt5-base etc..)? Basically ByT5 works on raw UTF-8 bytes and can be used without a tokenizer. Thanks
@NOT-HAL9000 For the moment we don't support ByT5 models but it should not be very different from T5 models. I think it can work with some minor manipulations and modifications in the present code.
As the question states, does transformer-deploy text generation work on the byt5 models? (google/byt5-small, google/byt5-base etc..)? Basically ByT5 works on raw UTF-8 bytes and can be used without a tokenizer. Thanks
model: https://huggingface.co/google/byt5-base