search

lucidrains / x-transformers

A concise but complete full-attention transformer with a set of promising experimental features from various papers
MIT License
4.63k stars 395 forks source link

Enhancement: Multi Input/Output transformers #222

Closed RyanKim17920 closed 2 months ago

RyanKim17920 commented 9 months ago

Hey @lucidrains, while working with your x-transformers for a music transformer, I found the need to incorporate multiple input/output modifications into the code. If I adapt this code to handle various inputs/outputs, would you be open to me submitting a pull request? I'm thinking of either modifying the existing TransformerWrapper and AutoRegressiveWrapper or creating a new version, perhaps named MultiIOTransformerWrapper/MultiIOAutoRegressiveWrapper. What do you think?

lucidrains commented 9 months ago

yea definitely! they could live in a separate file, like continuous or xval