search

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku
Apache License 2.0
6.29k stars 892 forks source link

Style transfer #114

Closed jb33k closed 3 years ago

jb33k commented 3 years ago

Can GPT-J do style transfer?

Also, thank you for creating GPT-J!

kingoflolz commented 3 years ago

Specific capabilities of the model is difficult to evaluate, but you can see similar examples of doing style transfer using GPT-3 and try it with GPT-J https://www.gwern.net/GPT-3#single-line-style-transfer