Closed bararchy closed 1 year ago
So @ArtLinkov had a great idea about a way to combine the uniqueness of each neurons while also have ability to represent them as a Matrix.
The overview is creating a Matrix of pointers, the pointers will be of each bias and wights of each neurons.
This will give us the ability to add GPU and multi-threading support while also keep what we love in SHAInet.
So @ArtLinkov had a great idea about a way to combine the uniqueness of each neurons while also have ability to represent them as a Matrix.
The overview is creating a Matrix of pointers, the pointers will be of each bias and wights of each neurons.
This will give us the ability to add GPU and multi-threading support while also keep what we love in SHAInet.