search

josephjaspers / blackcat_tensors

Matrix-Vector Library Designed for Neural Network Construction. cuda (gpu) support, openmp (multithreaded cpu) support, partial support of BLAS, expression template based implementation PTX code generation identical to hand written kernels, and support for auto-differentiation
12 stars 4 forks source link

Neural_Networks: Add Attention-LSTM #48

Open josephjaspers opened 5 years ago

josephjaspers commented 5 years ago

Original request: https://github.com/josephjaspers/blackcat_tensors/issues/28

josephjaspers commented 4 years ago

Hi! @xinsuinizhuan

Sorry, I have been very busy as of late (most of the recent changes have been easier refactorings) would you be interested in trying to add this yourself?

I am working on trying to get the cuda-code with Windows in addition to removing any old/dead code. Likewise I am trying to add more examples to the neural networks and better tests!

xinsuinizhuan commented 4 years ago

I'm sorry, but now my country is suffering from the new coronavirus.I went back to my hometown for the Spring Festival. Now I have to stay at home every day, and can't go to work. I can't access the "github" website right now.

xinsuinizhuan commented 4 years ago

now let you working yourself work, i have access the github website, i will first test my project and test the precision, then i will try to add the attension-lstm.

josephjaspers commented 4 years ago

I've heard about the virus on the news, sounds scary. Best of luck and stay healthy!

I am working on re-writing the neural-network architecture as I noticed a significant performance regression compared to an older version I had written.

I will try to keep the layer interface the same but the backend architecture will most likely be changed significantly.