Comments (15)
from caffe.
hi @heagoo would you be willing to share your work on the merge with only MKL? would be interesting to see the results and performance with intelcaffe. do you have rough performance numbers per frame?
from caffe.
@nickltj86 The performance is not so good (262ms per frame with 32 cores), I think it could be much better after enable MKL2017_AS_DEFAULT_ENGINE, but unfortunately, the result is not correct yet.
from caffe.
Thanks. Good to know the performance. I think even after enabling MKL2017, the performance may not increase too much. From the benchmark, the new layers which are not optimized with MKL or MKL2017 such as the mbox layer will cause the most delays. The performance of the common cnn layers are very optimized and seems like as fast as those running on CUDA. the other non-optimized layers are a different story.
Do you have a fork with the merge? I think the Intel folks will need that to evaluate it as well.
from caffe.
Shared to:
https://github.com/heagoo/intel_caffe_ssd/
from caffe.
Could you please try with MKL2017 engine enabled, but for layers that cause problems explicitly select engine CAFFE?
For reference, you can see here how to select different engine is selected layer:
https://github.com/intel/caffe/blob/master/models/mkl2017_googlenet_v1_knl/train_val.prototxt
We are working on fixes to simplify this process and avoid manual engine selection.
from caffe.
@jdukat Yes, I've already do this, but the result is different from just using MKL, much different, and totally not correct. I tried:
- only add MKL2017 engine to the first conv layer, works. (but seems still call the im2col implementation)
- add MKL2017 to any other conv layers, NOT work.
It may be related with the DNN function. Is there any detail description for the MKL DNN functions?
And, the strange thing is that VGG16 works, do you think the input size matters? (VGG16 is 224x224, and SSD is 300x300 or 500x500)
from caffe.
Input size matters for performance with MKL2017 for sure. It should not matter for correctness and it seems to be a bug. We should take a closer look at this, but at the moment I am not able to put this on top of my priorities.
I'll see what I can do about documentation for MKL DNN functions.
from caffe.
from caffe.
Thanks!
Confirmed, it's a bug of MKL, we can solve the issue by downloading https://github.com/intel-mxnet/mkl-release/releases/download/self_containted_MKLGOLD/mklml_lnx_2017.0.1.20161005.tgz
And now, performance boost to 88ms under the same setting, great!
from caffe.
Great, the same MKL version will be released for Caffe within next few days.
@heagoo do you plan to issue a pull request with your changes for Intel Caffe?
from caffe.
Sure, will do it. @jdukat
from caffe.
Is it confirmed that this bug exists in current master? If so, can we open this issue again to track the bug until it is fixed?
from caffe.
This bug does not exist any more in the latest update with MKL 2017 update 1.
from caffe.
Hey @heagoo
Could you please tell me what intel processor are you using if you don't mind? Thanks :)
from caffe.
Related Issues (20)
- fasterrcnn bug
- How to convert .xml file into train.txt and val.txt for LMDB conversion in caffe training for object detection? HOT 1
- Strangle fault, if investigate ssd.
- Unable to Build caffe with Makefile or CMake HOT 3
- how to set up the test process with intel caffe
- 8bit quantization calibrator and fine-tuning
- pooled_height_ is undefined HOT 1
- Xbyak::Error
- Release Mode: Application Crash
- Failed to Build caffe with Makefile HOT 2
- Failed while compiling matcaffe HOT 1
- cannot find -l1
- Not able to use this caffe version in multi threading environment.
- All Travis CI pull request tests are failing or erroring with the current version of code
- Allow user to control warnings-as-errors behaviour
- CMake bug prevents successful rebuild
- python Net API is Invalid
- memory leak with vaviable input size
- not able to run docker, fails on "caffe": executable file not found in $PATH: unknown.
- how to calculate the mAP with this version of Caffe
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from caffe.