Open Akbarable opened 1 year ago
@Akbarable Letting you know I see this issue. π Having a very busy week, so it may be a few days before I can dedicate time to this. Will update you as soon as I am able to.
@Akbarable Letting you know I see this issue. π Having a very busy week, so it may be a few days before I can dedicate time to this. Will update you as soon as I am able to.
Thanks for the response. No worries! π
Bumping this as I'd also be interested in a training script -- tried the code @Akbarable posted here and saw the same behavior.
Hello Frank!
I love what you have created, and am having a great time going through and parsing through your implementation of the paper. It appears you have nailed the dilated attention calculation method.
Here are my observations so far: