Code Monkey home page Code Monkey logo

arlab-vt / vt-natural-motion-processing Goto Github PK

View Code? Open in Web Editor NEW
18.0 6.0 4.0 347 KB

This repository was written to help analyze the Virginia Tech Natural Motion Dataset. The dataset contains 40 hours of unscripted human motion collected in the open world using XSens MVN Link. The dataset, metadata and more information is available through the Virginia Tech University Libraries: https://data.lib.vt.edu/articles/dataset/Virginia_Tech_Natural_Motion_Dataset/14114054/2.

License: MIT License

Python 49.21% MATLAB 10.05% Shell 1.69% Jupyter Notebook 39.05%
inertial-sensors xsens deep-learning motion-capture daily-life

vt-natural-motion-processing's Introduction

Virginia Tech Natural Motion Processing

This repository was written to help analyze the Virginia Tech Natural Motion Dataset. The dataset contains 40 hours of unscripted human motion collected in the open world using XSens MVN Link. The dataset, metadata and more information is available through the Virginia Tech University Libraries: https://data.lib.vt.edu/articles/dataset/Virginia_Tech_Natural_Motion_Dataset/14114054/2.

Table of Contents

Project Layout

src/                                                                                                  
    common/
    seq2seq/
    transformers                                       
    matlab/

Dependencies

numpy==1.18.1
h5py==2.10.0
matplotlib==3.1.3
torch==1.6.0

Setup

  • Clone the repo locally
  • Setup the conda environment
    • $ conda create -n vt-nmp python=3.7
  • Install requirements
    • $ pip install -r requirements.txt

Conda Environment

An Anaconda environment is used to help with development. The environment's main dependency is PyTorch, which will be installed when setting up the workflow above.

License

Please see the LICENSE for more details. If you use our code or models in your research, please cite our paper:

@article{geissinger2020motion,
  title={Motion inference using sparse inertial sensors, self-supervised learning, and a new dataset of unscripted human motion},
  author={Geissinger, Jack H and Asbeck, Alan T},
  journal={Sensors},
  volume={20},
  number={21},
  pages={6330},
  year={2020},
  publisher={Multidisciplinary Digital Publishing Institute}
}

vt-natural-motion-processing's People

Contributors

aasbeck avatar eltabre avatar jackg0 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

vt-natural-motion-processing's Issues

Orientation for aligning to SMPL

Hi, It is not easy to see an IMU dataset! Thanks for sharing this!

For my use case, I plan to transfer the data to SMPL format so that I can use it with other data in SMPL, like AMASS.
I mapped the Xsens to SMPL by using the joints on the body directly. (Remove L5 joint)
When I used the quaternion to visualize the mesh, the mesh's distorted.
After processing the data by preprocessing.py and quaternion.py before visualization, the distortion disappeared.
However, the motion of the mesh still looks weird. (Limbs are uncoordinated.) Can anyone give me some help or suggestion?

Thanks in advance!

Dataset Related

Hi Dr.Geissinger,

I am a graduate student in Computer Science at McMaster University. I found that Viginia Tech Natural Motion dataset is replicable in the Human Pose Estimation field when reading your paper Motion Inference Using Sparse Inertial Sensors, Self-Supervised Learning, and a New Dataset of Unscripted Human Motion. However, using this link (https://data.lib.vt.edu/articles/dataset/Virginia_Tech_Natural_Motion_Dataset/14114054) will only lead to the h5_P1_Day1 data but no other subjects, and Globus always times out when Retrieving Directory Contents. Could you please introduce other ways to download the complete datasets or check on these two approaches? Thank you so much for the work. Looking forward to seeing the whole dataset!

Xijian

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.