Can anyone put kan(attention and mlp) into llama2.c? - Githubissues

Blealtan / efficient-kan

An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).

MIT License

3.49k stars 306 forks source link

Can anyone put kan(attention and mlp) into llama2.c? #9

Closed win10ogod closed 1 month ago

win10ogod commented 1 month ago

Can anyone put kan(attention and mlp) into llama2.c?

Blealtan commented 1 month ago

I don't have plan working on this and it's irrelevant to this repo. Please fire an issue on that project instead.