The repository contains a set of artificial intelligence/ machine learning algorithms in Fortran.
File | Description |
---|---|
linear_3.f90 | 3-neuron linear network employing the Adam gradient descent optimisation algorithm |
linear_8_att.f90 | 8-neuron linear network employing the Adam gradient descent optimisation algorithm and element-wise dot-product attention |
linear_8_mh_att.f90 | 8-neuron linear network employing the Adam gradient descent optimisation algorithm and multi-head attention |
sompr_5.f90 | Second order multivariate polynomial regression employing the Adam gradient descent optimisation algorithm |
gelu_att.f90 | GELU activation function, Adam gradient descent optimisation algorithm, element-wise dot-product attention |
mish_att.f90 | Mish activation function, Adam gradient descent optimisation algorithm, element-wise dot-product attention |
smish_att.f90 | Smish activation function, Adam gradient descent optimisation algorithm, element-wise dot-product attention |
gms_att.f90 | GELU + Mish + Smish activation functions, Adam gradient descent optimisation algorithm, element-wise dot-product attention |