LSTM - Githubissues

lhnguyen102 / cuTAGI

CUDA implementation of Tractable Approximate Gaussian Inference

MIT License

24 stars 9 forks source link

LSTM #53

Closed lhnguyen102 closed 3 months ago

lhnguyen102 commented 3 months ago

Description

This PR adds LSTM layer supporting both CPU and CUDA, and its Python API

Changes Made

Added LSTM layer for both CPU and CUDA
Added test function for testing LSTM layers
Added a test function for LSTM's Python API
Transferred UtilityWrapper including dataloader untils to new version

Note for Reviewers

Here is a command to run an example using LSTM layer in Python
```
cd pytagi/pytagi_v1
python test_lstm.py
```
@jamesgoulet Please take a look at the activation functions (mixture relu, sigmoid, and tanhg) to see if it is correct. I noticed an inconsistency between CPU and CUDA version