Chainer Backend for Intel Architecture, a Chainer module providing numpy like API and DNN acceleration using MKL-DNN.

This preview version is tested on Ubuntu 16.04, Centos 7.4 and OS X.

Minimum requirements:

• cmake 3.0.0+
• C++ compiler with C++11 standard support (GCC 5.3+ if you want to build tests)
• Python 2.7.6+, 3.5.2+, 3.6.0+
• Numpy 1.13
• Swig 3.0.12
• Doxygen 1.8.5
• (optional) MPICH devel 3.2

Other requirements:

• Testing utilities
  • Gtest
  • pytest

If you use old setuptools, upgrade it:

pip install -U setuptools

CentOS:

git submodule update --init && mkdir build && cd build && cmake3 ..
cd ../python
python setup.py install

Other:

git submodule update --init && mkdir build && cd build && cmake ..
cd ../python
python setup.py install

pip install ideep4py

Since Python3.7 doesn't work with numpy==1.13, we built iDeep4py Python3.7 wheel based on numpy==1.16.0, remember to upgrade numpy version to 1.16.0 before install iDeep4py Python3.7 wheel. Suggest installing Python package using virtualenv to avoid installing Python packages globally which could break system tools or other projects.

conda install -c intel ideep4py

We are providing the official Docker images based on different platforms on Docker Hub.

docker pull chainer/chainer:latest-intel-python2
docker run -it chainer/chainer:latest-intel-python2 /bin/bash

Non-blocking multinode data parallelism is supported. The system is requried to meet MPICH dependency and user needs to replace the cmake command in build process:

Make sure your MPI executable is in PATH:

PATH=$PATH:<path-to-mpiexec>
# use the following line when you execute cmake or cmake3
# CentOS:
cmake3 -Dmultinode=ON ..
# Other:
cmake -Dmultinode=ON ..

Execute the test:

cd total_reduce/test
mpirun -N 4 python3 test_1payload_inplace.py

The commands above will start 4 MPI processes on your machine and conduct a blocking allreduce operation among all 4 processes. To test it in a real multinode environment, compile your file and use the following commands:

cd total_reduce/test
mpirun -f <hostlist> -N 4 python3 test_1payload_inplace.py

• MKL-DNN github: https://github.com/01org/mkl-dnn
• Chainer github: https://github.com/chainer/chainer

MIT License (see LICENSE file).