Code Monkey home page Code Monkey logo

pose2vec's Introduction

Pose2vec

This repository contains the following:

  • Utilities for various human skeleton preprocessing steps in numpy and tensorflow.
  • Tensorflow model to learn a continuous pose embedding space.

This code has been used to train the PoseGAN (or EnGAN) Model in the paper:
Maharshi Gor*, Jogendra Nath Kundu*, R Venkatesh Babu, "Unsupervised Feature Learning of Human Actions as Trajectories in Pose Embedding Manifold", IEEE Winter Conference on Applications of Computer Vision (WACV), 2019.

It is also used for training pose representations in the paper:
Maharshi Gor*, Jogendra Nath Kundu*, R Venkatesh Babu, "BiHMP-GAN: Bidirectional 3D Human Motion Prediction GAN", Thirty Third AAAI Conference on Artificial Intelligence, 2019.

Citing this work

If you find this work useful in your research, please consider citing:

@article{kundu2018unsupervised,
  title={Unsupervised Feature Learning of Human Actions as Trajectories in Pose Embedding Manifold},
  author={Kundu, Jogendra Nath and Gor, Maharshi and Uppala, Phani Krishna and Babu, R Venkatesh},
  journal={arXiv preprint arXiv:1812.02592},
  year={2018}
}

Data and Pretrained Weights

Use the following command to download the data and pretrained weights.

# For downloading the data. It will be saved in the data/ directory
python -m scripts.download_data

# For downloading the pretrained weights. It will be saved in the pretrained_weights/azimuth/ directory
python -m scripts.download_weights

Qualitative Results:

  • Grid Interpolations

  • Reconstructions (left: Ground Truth, right: Reconstruction)

pose2vec's People

Contributors

maharshi95 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

pose2vec's Issues

Canonical pose representation example

Hi, thanks for this repo! I was wondering whether you could provide an example of the data preprocessing step, i.e., how you arrive at the "canonical pose representation" (described in the paper) from raw xyz positions. I have difficulties seeing how to do this, given the many transformation functions in the repo. Many thanks for considering!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.