SciML / ModelingToolkitNeuralNets.jl

Symbolic-Numeric Universal Differential Equations for Automating Scientific Machine Learning (SciML)
MIT License
18 stars 1 forks source link

Public API #9

Closed SebastianM-C closed 3 months ago

SebastianM-C commented 3 months ago

The main feature so far in the package is creating a ODESystem with a neural network inside. Comparing this to the MTKStdlib, this seems like a Block.

@ChrisRackauckas Would NeuralNetworkBlock be a good name?

Besides that, we also have a small utility for creating simple Lux models, should that be renamed?

Other than that, what should we add in here?

Would it make sense to add components in the future that are similar to the electrical, thermal etc. components?

ChrisRackauckas commented 3 months ago

@ChrisRackauckas Would NeuralNetworkBlock be a good name?

Yes

Besides that, we also have a small utility for creating simple Lux models, should that be renamed?

What's the API there?

Other than that, what should we add in here?

I don't think anything else is needed, other specifying units of inputs and outputs.

ChrisRackauckas commented 3 months ago

Would it make sense to add components in the future that are similar to the electrical, thermal etc. components?

That should just be handled by units. You don't need acausal connectors here, and so you don't need the special pieces other than RealInput and RealOutput like connectivity.

SebastianM-C commented 3 months ago

What's the API there?

multi_layer_feed_forward(input_length, output_length; width::Int = 5, depth::Int = 1, activation = tanh, disable_optimizations = false)