Closed andresnowak closed 4 months ago
Now in 0.5, fixing everything needed for 0.5 doesn't even compile
Cool! Those are reasons to contribute more to open source 😀
Closing this pr for now, since autotune is removed from the latest mojo releases, probably it will be back in future
This is a proof of concept, because there are some problems with the implementation.
So I'm doing this pull request see your opinion on the problem, if you would like this to be implemented as it is now, or would you like to wait, or if you have an idea for the problem.
Another idea would be to instead make the transformer function the adaptive function, but doing this would require for the search autotune part to be able to read the stories15m.bin, and i don't know if for each function (like matmul and rope_llama), different nelts could give different results (I would think that this isn't the case), and i don't know if it would work, it seems that the search function can fail with various things when trying to do the expansions.