kyegomez / Hedgehog

Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"
https://discord.gg/GYbXvDGevY
MIT License
9 stars 0 forks source link

An issue about "tokens" #3

Open AlfieDiCaprio opened 3 months ago

AlfieDiCaprio commented 3 months ago

Hi, thank you for your excellent work!

After reading your article and code, I want to ask if Hedgehog is applicable to combinatorial optimization problems such as the traveling salesman problem, because the article and code mention "tokens", but it is well known that combinatorial optimization problems do not involve this key point. Could you tell me if I need to make some modifications for "tokens"?

I would be extremely grateful for any advice you could provide, and thank you so much for sharing such great work!

Upvote & Fund

Fund with Polar

github-actions[bot] commented 3 months ago

Hello there, thank you for opening an Issue ! 🙏🏻 The team was notified and they will get back to you asap.