Use more sensible defaults about forge HOT 3 CLOSED

I'll have to think some more about this. You're right that 3x3 convolution seems to be very common now, but there is an argument to be made for keeping certain things (like the kernel sizes) explicitly specified.

from forge.

What would you suggest for these defaults? I'm open to the suggestion but one person's defaults may not be reasonable to another person.

For example, I chose padding: true as the default for Convolution layers (makes sense to me) but Keras uses padding: 'VALID' as the default, which is the opposite of what Forge uses. This already lead to confusion with a user of Forge.

So I'm all for reasonable defaults but I'm not sure yet what "reasonable" means here. ;-)

One possibility would be something like this:

let model = Model
    --> SetDefaults(kernel: (3, 3), padding: true)
    --> Convolution()
    --> and so on

from forge.

I was thinking the following:

• inflightBuffers:Int = 3 I think you provided a good rational for this
• kernel:(Int, Int) = (3, 3) for Convolution layers seems pretty standard
• kernel:(Int, Int) = (2, 2) and stride:(Int, Int) = (2, 2) for Pooling layers also seems fairly standard

So not a huge amount of changes really.

from forge.