search

ridgerchu / matmulfreellm

Implementation for MatMul-free LM.
Apache License 2.0
2.36k stars 131 forks source link

FPGA implementation #10

Open ws200106 opened 2 weeks ago

ws200106 commented 2 weeks ago

Hello author, thank you very much for being able to open source your project, can you provide systemverilog code for FPGA implementation?

ridgerchu commented 2 weeks ago

Hi there, Thank you for your interest in our open-source project and for your request regarding SystemVerilog code for FPGA implementation. At the moment, we are still in the process of optimizing our FPGA implementation to ensure the best possible performance and reliability. We understand the importance of providing FPGA support and are actively working on it. Once we have completed the optimization and thoroughly tested the FPGA implementation, we will make it available to the community!

RCoeurjoly commented 2 weeks ago

Thank you for your dedication to optimizing the FPGA implementation. I understand the importance of ensuring performance and reliability. However, if possible, would you consider sharing the current version of the SystemVerilog code? Access to the work-in-progress could be incredibly beneficial for users like myself who are eager to learn from your approach and contribute to the project's development. Any level of access would be greatly appreciated, even if it's not the final version!

jainhitesh9998 commented 2 weeks ago

Hi @ridgerchu , out of curiosity, what fpga toolkits are planned to be supported? if you could list them.

Also are there any plans to make it work on intel arria 10 series of fpga. we have a bunch of them used for some other purpose, would love to benchmark and contribute in that aspect if it will be supported