Code Monkey home page Code Monkey logo

shineon-virtual-tryon's Introduction

ShineOn: Illuminating Design Choices for Practical Video-based Virtual Clothing Try-on

[ Paper ] [ Project Page ]

This repository contains the code for our paper accepted at the Generation of Human Behavior Workshop at WACV 2021.

Key Contributions:

  • Scientific experiments built from the ground-up to isolate effects of each method
  • Empirically show DensePose results in better quality than CocoPose
  • Add self-attention layers
  • Find that GeLU show best results

Architecture Overview

image

How To Use This Repository

The point of entry of this repository is train.py and test.py. We have organized our code into these main folders: datasets, models, and options.

The datasets folder contains several custom defined datasets. To create your own custom tryon dataset, please refer to the Documentation IV below.

The models folder contains several models, such as the warp model and U-Net model that we used during virtual try-on work. Inside the networks sub-folder, we include several utility networks that we make use of.

The options folder contains several of the options we use at train and test time. These options allows our code to flexible, and run experiments easily.

Documentation

Results

Qualitative Comparison with FW-GAN and CP-VTON

image

Qualitative Comparison of Pose and Self-Attention

image

Qualitative Comparison of Activation Functions

image

Qualitative Comparison of Optical Flow

image

Acknowledgements and Related Code

  • This code is based in part on Sergey Wong's stellar CP-VTON repository. Thank you very much, Sergey, for your hard work.
  • Thank you Haoye Dong and his team for hosting the VUHCS competition at CVPR 2020, providing the VVT Dataset, and giving access to the FW-GAN reference code.
  • Thank you NVIDIA's team for their work on Vid2Vid and FlowNet2.
  • Credits to David Park's Self-Attention GAN implementation for attention layers reference.
  • Credits to Self-Corrective Human-Parsing for easy parsing of LIP clothing labels.
  • Credits to the detectron2 repository for Densepose annotations.

shineon-virtual-tryon's People

Contributors

andrewjong avatar gauravkuppa avatar sergeywong avatar veralauee avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.