search

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku
Apache License 2.0
6.29k stars 892 forks source link

end sequence possible? #169

Closed sharaku17 closed 2 years ago

sharaku17 commented 2 years ago

Hi,

I just want to ask if there is a possibility in the colab demo to define a end_sequence parameter, like end_sequence = '###' for example and the model will just generate text until this sequence and not further ?

thank you!

kingoflolz commented 2 years ago

I suggest you use the huggingface implementation (https://huggingface.co/EleutherAI/gpt-j-6B) for more advanced sampling parameters. There is no ability to stop the generation on a particular sequence in this repository.