I was wondering if a javascript WebGPU implementation of BitNET might be a fun idea to explore.
Motivation
While Bitnet is a brand new and experimental technology, it does seem to be a great fit for the mobile/browser use case, where memory is by definition more scarse.
It would get the attention of LLM enthousiasts. There is currently no Javascript BitNET implementation that I can find.
It might be useful to think about how to integrate technology early*, in case it does gain traction later? At the moment there are very few trained BitNET models (three that I know of), but that is surely to change?
Your contribution
While I am not a programmer, I can do web-dev. I could help with creating a demo, or keep an eye out for new models to try.
Feature request
I was wondering if a javascript WebGPU implementation of BitNET might be a fun idea to explore.
Motivation
Your contribution
While I am not a programmer, I can do web-dev. I could help with creating a demo, or keep an eye out for new models to try.
Example code: https://2084.substack.com/p/2084-bitnet-overhyped-training-bitnet
There's a C implementation here, that could perhaps be used with Emcriptem?* https://github.com/cpldcpu/BitNetMCU
*I have no idea what I'm talking about