Will the transformer overfit on just the Fibonacci sequence? - Githubissues

whitebox-research / excursions

1 stars 1 forks source link

Will the transformer overfit on just the Fibonacci sequence? #7

Open kgreyy opened 2 months ago

kgreyy commented 2 months ago

Check performance on the simple Fibonacci sequence
Change the offset/initial starting number (originally 1,1, 2)
Try training on Lucas numbers