Code Monkey home page Code Monkey logo

openpose_caffe_train's Introduction

OpenPose Caffe Training (Experimental)


Contents

  1. Introduction
  2. Functionality
  3. Testing
  4. Training
  5. Citation
  6. License

Experimental Disclaimer

While OpenPose is highly tested and stable, this training repository is highly experimental and not production ready. Use at your own risk.

This repository was used and tested on Ubuntu 16 with CUDA 8, and it compiles in Ubuntu 20 with WSL2 (Windows 11). It should work with other versions of Ubuntu and up to CUDA 10, but it might require modifications.

Introduction

OpenPose has represented the first real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

It is authored by Ginés Hidalgo, Zhe Cao, Tomas Simon, Shih-En Wei, Yaadhav Raaj, Hanbyul Joo, and Yaser Sheikh. It is maintained by Ginés Hidalgo and Yaadhav Raaj. OpenPose would not be possible without the CMU Panoptic Studio dataset. We would also like to thank all the people who has helped OpenPose in any way.

OpenPose Caffe Training includes the modified Caffe version for training OpenPose. Check the training repository in github.com/CMU-Perceptual-Computing-Lab/openpose_train for all the training details.

This repository and its documentation assumes knowledge of OpenPose. If you have not used OpenPose yet, you must familiare yourself with it before attempting to follow this documentation.

Installation

It depends on your Ubuntu version, but it should look similar to the following:

  1. Make sure OpenPose runs on the machine. This will imply that most Caffe prerequisites are properly installed (including CUDA, Protobuf, etc).
  2. Install all Caffe prerequisites.
  3. Compile OpenPose Caffe Train by running:
mkdir build
cd build
cmake-gui ..
# Configure CMake-GUI from its UI. E.g.,
# - If you are using OpenCV < 4, set USE_OPENCV_LESS_THAN_4 accordingly!
# - If you do not need Python (or if you are getting Pybind errors), disable BUILD_python & BUILD_python_layer
# - If you get an infinite CMake loop (ie error saying "[...]Configure will be re-run [...] CMAKE_CXX_COMPILER= /usr/bin/c++", click "Advanced", and replace "/usr/bin/c++" with "/usr/bin/g++"
# After configuring CMake, press "Configure" and (if/after all configuration errors are gone) "Generate"
# Finally, close CMake and compile the library with:
make -j`nproc`

Citation

Please cite these papers in your publications if it helps your research (the face keypoint detector was trained using the procedure described in [Simon et al. 2017] for hands):

@inproceedings{hidalgo2019singlenetwork,
  author = {Gines Hidalgo and Yaadhav Raaj and Haroon Idrees and Donglai Xiang and Hanbyul Joo and Tomas Simon and Yaser Sheikh},
  booktitle = {ICCV},
  title = {Single-Network Whole-Body Pose Estimation},
  year = {2019}
}

@inproceedings{cao2018openpose,
  author = {Zhe Cao and Gines Hidalgo and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {arXiv preprint arXiv:1812.08008},
  title = {Open{P}ose: realtime multi-person 2{D} pose estimation using {P}art {A}ffinity {F}ields},
  year = {2018}
}

Links to the papers:

License

OpenPose is freely available for free non-commercial use, and may be redistributed under these conditions. Please, see the license for further details. Interested in a commercial license? Check this FlintBox link. For commercial queries, use the Contact section from the FlintBox link and also send a copy of that message to Yaser Sheikh.

openpose_caffe_train's People

Contributors

blgene avatar cdluminate avatar cypof avatar dgolden1 avatar eelstork avatar erictzeng avatar flx42 avatar gineshidalgo99 avatar jamt9000 avatar jeffdonahue avatar jyegerlehner avatar kloudkl avatar longjon avatar lukeyeager avatar mavenlin avatar mohomran avatar nitnelave avatar noiredd avatar philkr avatar qipeng avatar rbgirshick avatar ronghanghu avatar sergeyk avatar sguada avatar shelhamer avatar tnarihi avatar williford avatar willyd avatar yangqing avatar yosinski avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

openpose_caffe_train's Issues

please suggest th dataset for body25 and body25b were lmbd error is not present

Important - read before submitting

Please read the guidelines for contributing before submitting this issue!

Please do not post installation, build, usage, or modeling questions, or other requests for help to Issues.
Use the caffe-users list instead.
This helps developers maintain a clear, uncluttered, and efficient view of the state of Caffe.

Issue summary

Steps to reproduce

Tried solutions

System configuration

  • Operating system:
  • Compiler:
  • CUDA version (if applicable):
  • CUDNN version (if applicable):
  • BLAS:
  • Python version (if using pycaffe):
  • MATLAB version (if using matcaffe):

Issue checklist

  • read the guidelines and removed the first paragraph
  • written a short summary and detailed steps to reproduce
  • explained how solutions to related problems failed (tick if found none)
  • filled system configuration
  • attached relevant logs/config files (tick if not applicable)

when i train experimental model/body 25 iam gettingit coudl not parse scalemin,scale max and maxrotate values

Important - read before submitting

Please read the guidelines for contributing before submitting this issue!

Please do not post installation, build, usage, or modeling questions, or other requests for help to Issues.
Use the caffe-users list instead.
This helps developers maintain a clear, uncluttered, and efficient view of the state of Caffe.

Issue summary

Steps to reproduce

Tried solutions

System configuration

  • Operating system:
  • Compiler:
  • CUDA version (if applicable):
  • CUDNN version (if applicable):
  • BLAS:
  • Python version (if using pycaffe):
  • MATLAB version (if using matcaffe):

Issue checklist

  • read the guidelines and removed the first paragraph
  • written a short summary and detailed steps to reproduce
  • explained how solutions to related problems failed (tick if found none)
  • filled system configuration
  • attached relevant logs/config files (tick if not applicable)

hand keypoint train

Hi @gineshidalgo99
Thanks for your sharing sincerely! I try training hand keypoint model on myself dataset, get into trouble:

Issue summary

  • poseModel.hpp don't define "hand model (only hand21)" that mean the code nonsupport hand train??

  • you share "hand model" in openpose, but in inference it only has right hand, left hand is mirrored to right hand, is there any benefit to training like this???

looking forward to your reply!
thanks!

build with error "/usr/bin/ld cannot find -lopencv_contrib"

Excuse me,
I have an error when I built the openpose_caffe_train with cmake.
However,I have tried several times to rebuild the opencv and openpose and there are no errors in this two projects.
Both of opencv and openpose are working well on my PC.
Could you give me some suggestion?

By the way, I have built caffe from https://caffe.berkeleyvision.org/ .
Could I use it and follow the steps of https://github.com/CMU-Perceptual-Computing-Lab/openpose_train to train my model ?

Hope to get your response,Thank you.

my iteration is getting stoppped in arroud 2600 iteration and getting stopped with caffe internal thread entry which says it is due to lmdb error

Important - read before submitting

Please read the guidelines for contributing before submitting this issue!

Please do not post installation, build, usage, or modeling questions, or other requests for help to Issues.
Use the caffe-users list instead.
This helps developers maintain a clear, uncluttered, and efficient view of the state of Caffe.

Issue summary

Steps to reproduce

Tried solutions

System configuration

  • Operating system:
  • Compiler:
  • CUDA version (if applicable):
  • CUDNN version (if applicable):
  • BLAS:
  • Python version (if using pycaffe):
  • MATLAB version (if using matcaffe):

Issue checklist

  • read the guidelines and removed the first paragraph
  • written a short summary and detailed steps to reproduce
  • explained how solutions to related problems failed (tick if found none)
  • filled system configuration
  • attached relevant logs/config files (tick if not applicable)

poseModel.cpp ----> LMDB_TO_OPENPOSE_KEYPOINTS How was this set of data obtained?

Important - read before submitting

Please read the guidelines for contributing before submitting this issue!

Please do not post installation, build, usage, or modeling questions, or other requests for help to Issues.
Use the caffe-users list instead.
This helps developers maintain a clear, uncluttered, and efficient view of the state of Caffe.

Issue summary

Steps to reproduce

Tried solutions

System configuration

  • Operating system:
  • Compiler:
  • CUDA version (if applicable):
  • CUDNN version (if applicable):
  • BLAS:
  • Python version (if using pycaffe):
  • MATLAB version (if using matcaffe):

Issue checklist

  • read the guidelines and removed the first paragraph
  • written a short summary and detailed steps to reproduce
  • explained how solutions to related problems failed (tick if found none)
  • filled system configuration
  • attached relevant logs/config files (tick if not applicable)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.