Implementation of the paper BReG-NeXt: Facial Affect Computing Using Adaptive Residual Networks With Bounded Gradient

BReG-NeXt paper can be found on IEEE Xplore and arXiv

Tensorflow 1.14.0 is suggested to run the code. For installing the rest of the required packages, run the following command:

pip install -r requirements.txt

• tfrecords: Sample tfrecords for training and validation from FER2013 database
• Snapshots: Example model trained on AffectNet database on BReG-NeXt-50
• Logs: Log report of the BReG-NeXt-50 trained model on AffectNet database

As mentioned above trained parameters on the AffectNet database on BReG-NeXt-50 is provided in the Snapshots folder. You can find various trained parameter values in this file. More specifically, the adaptive coefficient (alpha and beta) are stored in variables that have the following regex:

ResidualBlock[_]*[1-9]*/shortcut_mod[_]*[1-9]*/[a,c][_]*[1-9]*

Simply run the BReG-NeXt.py file:

codes/>> python BReG-NeXt.py

To write your own customized complex mapping (given the restrictions and properties mentioned in the BReG-NeXt paper), you need to modify Lines 136 to 140 of the BReG-NeXt.py file. Simply write your own function for the mapping and assign it to the identity variable.

 with tf.name_scope('shortcut_mod'): # Write your customized function
  multiplier1 = tf.Variable(1, dtype=tf.float32, trainable=True, name='alpha') # first optional coefficient
  multiplier2 = tf.Variable(1, dtype=tf.float32, trainable=True, name='beta') # second optional coefficient
  with tf.name_scope('shortcut_mod_function'): 
    identity = your_function(multiplier1, multiplier2) # must assign your function to the 'identity' variable

All submitted papers (or any publically available text) that uses the entire or parts of this code, must cite the following paper:

B. Hasani, P. S. Negi and M. Mahoor, "BReG-NeXt: Facial affect computing using adaptive residual networks with bounded gradient," in IEEE Transactions on Affective Computing, 2020.

BibTex:

@ARTICLE{9064942,  author={B. {Hasani} and P. S. {Negi} and M. {Mahoor}},  journal={IEEE Transactions on Affective Computing},  title={BReG-NeXt: Facial affect computing using adaptive residual networks with bounded gradient},   year={2020},  volume={},  number={},  pages={1-1},}