Add new activation functions for neural network

[Benardi]

Description

Add new activation functions (at least Tanh and ReLU) and modify the Neural Network Module to employ whatever activation unit is specified

Files

• touvlo/supv/nn_clsf.py
  • Existing Classification Neural Network
• tests/supv/test_nn_clsf.py
  • Test suite for Classification Neural Network
• /docs/source/supv.rst
  • File to edit to add pydoc of submodules of supv to the docs

Tasks

Include specific tasks in the order they need to be done in. Include links to specific lines of code where the task should happen at.

• [ ] Implementation
• Implement Tanh and ReLU activation functions
• Edit Classification Neural Network to allow one to choose an activation function for each layer
• [ ] Testing
• Edit Classification Neural Network's test suite to conform to updates to module
• Add test cases for new functions and module routines that employ them
• [ ] Documentation
• Update documentation of edited functions
• Add documentation for new functions

[UtnansN]

I'd like to work on this

[Benardi]

Sure thing

[ghost]

Hi, I also want to work on this. I can add some other activation functions too.

[Benardi]

Hi, I also want to work on this. I can add some other activation functions too.

Sure, no problem. Just make sure you both synchronize as to not redo each other's work.