ContinuousTransformerWrapper: turning on absolute positional embedding: mirror TransformerWrapper

lucidrains / x-transformers

A concise but complete full-attention transformer with a set of promising experimental features from various papers

MIT License

4.63k stars 395 forks source link

Closed pfeatherstone closed 7 months ago

lucidrains commented 7 months ago

@pfeatherstone looks good! i'll fix that alibi / memory tokens issue to before my time is up

pfeatherstone commented 7 months ago

Before your time is up? Have you not found any funding?