Random init about glint HOT 1 OPEN

This seems quite useful and relatively easy to do. I feel like Glint is starting to look more like a distributed linear algebra library and less of a parameter server, which is quite an interesting direction.

I would need to refactor some code that deals with initialization though. The easiest approach to me seems to design an abstract Initializer class, which can be implemented as a ZeroInitializer or a RandomNormalInitializer. The class should be serializable and shipped to the parameter servers when we construct the actors (e.g. by providing it in the Akka Props, such as at Client.scala#L175).

This would allow us to easily write some high-level wrapper functions in Client such as client.randn(...). I'm still quite busy in the next few weeks, but after Spark Summit EU I should have some more time to look into this. Nevertheless, I like the suggestion!

from glint.