Code Monkey home page Code Monkey logo

hpe3d's Introduction

HPE3D

Code for human pose estimation with VAE-GAN hybrid model.

Presentation Thesis

Human Pose Estimation - Literature Study

Concepts

  • Reprojection Error Optimization - 3D human body model is deformed such that it satisfies a reprojection error
  • Direct NN inference - estimate 3D poses directly from images or detected keypoints
  • Kinematic Chain Space (KCS) - Projecting 3D human pose into KCS, a contraint is derived that is based on the assumption that the bone lengths are constant. This can be benificial as giving an additional feature matrix to the network, it doesnt have to learn joint length computation and angular constraints on its own KCS for monocular MoCap
  • Non rigid structure from motion (NRSfM) - aims to obtain the varying 3D structure and camera motion from uncalibrated 2D point tracks NR-SFM video explanation
  • Kinematic Feature updates (in 2D) - encode the kinematic structure via feature updates at coarse resolution RePose
  • Real-time: Casading, Long short skip connections XNect
  • Ordinal Ranking Ordinal+CVAE DRPose3D - Depth Ranking
  • C-VAE Ordinal+CVAE

3D HPE

Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image

[Paper] [Code] [Code] [ICCV 2019] [image-2Dheatmap-3D, absolute pose, multi person, pose depth, cascade]

Unsupervised 3D Pose Estimation with Geometric Self-Supervision

[Paper] [CVPR 2019] [2D-3D, self supervised, discriminator, domain adaptation, temporal consistency]

PoseLifter: Absolute 3D human pose lifting network from a single noisy 2D human pose

[Paper] [2019,2020] [image-2D-3D, project w/ focal length, learn human size, absolute pose, noise, errors, cascade]

RepNet: Weakly Supervised Training of an Adversarial Reprojection Network for 3D Human Pose Estimation

[Paper] [Code] [CVPR 2019] [2D-3D, KCS, weakly supervised, adversial training, GAN]

Distill Knowledge from NRSfM for Weakly Supervised 3D Pose Learning

[Paper] [ICCV 2019] [Image features+2D-3D, NRSfM, teacher student, weakly supervised]

C3DPO: Canonical 3D Pose Networks for Non-Rigid Structure From Motion

[Paper] [Code] [ICCV 2019] [2D-3D, NRSFM, canonicalization network, self-supervised]

Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locations

[Paper] [Code] [2018] [2D-3D, GAN, unsupervised]

Monocular 3D Human Pose Estimation by Generation and Ordinal Ranking

[Paper] [ICCV 2019] [2Dheatmap-3D, ambigious use of 3D GT, C-VAE, ordinal ranking and score, condition on 2d pose]

Occlusion-Aware Networks for 3D Human Pose Estimation in Video

[Paper] [ICCV 2019] [2Dheatmap-3D, reprojection+GT, adversarial, occlusion, video]

Using GT

2D HPE

RePose: Learning Deep Kinematic Priors for Fast Human Pose Estimation

[Paper] [2020] [kinematic priors]

Datasets

More Stuff

hpe3d's People

Contributors

bsridatta avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar

hpe3d's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.