Use more sensible defaults

[tLewisII]

There are a few places where I think adding some defaults in constructors would be beneficial/sensible.

Stuff like inflightBuffers and kernel in Convolution and Pooling layers could have defaults that would reduce repetition and clean up model construction.

On the flip side, perhaps some people might not notice the default params and it could lead to errors.

Thoughts?

[hollance]

What would you suggest for these defaults? I'm open to the suggestion but one person's defaults may not be reasonable to another person.

For example, I chose padding: true as the default for Convolution layers (makes sense to me) but Keras uses padding: 'VALID' as the default, which is the opposite of what Forge uses. This already lead to confusion with a user of Forge.

So I'm all for reasonable defaults but I'm not sure yet what "reasonable" means here. ;-)

One possibility would be something like this:

let model = Model
    --> SetDefaults(kernel: (3, 3), padding: true)
    --> Convolution()
    --> and so on

[tLewisII]

I was thinking the following:

• inflightBuffers:Int = 3 I think you provided a good rational for this
• kernel:(Int, Int) = (3, 3) for Convolution layers seems pretty standard
• kernel:(Int, Int) = (2, 2) and stride:(Int, Int) = (2, 2) for Pooling layers also seems fairly standard

So not a huge amount of changes really.

[hollance]

I'll have to think some more about this. You're right that 3x3 convolution seems to be very common now, but there is an argument to be made for keeping certain things (like the kernel sizes) explicitly specified.