Integrate ALiBi position encoding

OpenBioML / protein-lm-scaling

Other

54 stars 15 forks source link

Closed pascalnotin closed 10 months ago

talkhanz commented 10 months ago

/take

talkhanz commented 10 months ago

im waiting for the PR here and then push my PR reintegrating the alibi encoding @pascalnotin

NZ99 commented 10 months ago

Sounds good Tal, that PR should be merged shortly

pascalnotin commented 10 months ago

PR was merged - closing issue