[Feature request] adding support for "iter_size" like hyperparameters (Caffe) about benchmarks HOT 4 OPEN

@ppwwyyxx TensorPack has everything. :-) I like looking through your code and examples.

from benchmarks.

This can be done by writing a new tf.train.Optimizer.
I have one here which at least works for common cases. (and you can probably copy-paste and use)

from benchmarks.

That is a cool trick. I am not aware of a plan right now but as we start working with converging FP16 this might be something that is done to test larger batch sizes. I will leave this open so everyone on the perf team can see it. If we do something, I will try to update the ticket and if not close it in 30-60 days.

from benchmarks.

@tfboyd thanks for your reply. If supporting the case is easy with what @ppwwyyxx has now, I would hope this feature be supported soon.
I'm also looking at the Optimize provided above and not sure I can manage this. I'm quite a newbie in TF and python, and the code in this repo is an excellent example for me to dig in.
Thanks again!

from benchmarks.