Code Monkey home page Code Monkey logo

clothingtransfer-ncnn's Introduction

ClothingMigration-NCNN

What

  1. CT-Net:CVPR2021上的一个虚拟试穿/服装迁移的工作,该工程就是将CT-Net及其相关依赖网络移植到ncnn
  2. 服装迁移:给定一个人的图A,与另一个人的图B,将A的衣服穿到B的身上

PS

这个工作其实我个人计划做的一个系列,分三步:

  1. 仿妆 —— 已完成
  2. 换衣服 —— 已完成,就是该工程
  3. 换发型 —— 计划中

Introduce

这个没啥好说,看图就完事了,先看换男装的: image 再看女装: image 程序流程分析,假定目标服装图A,目标穿衣人B:

  1. 对A与B都应用OpenPose得到candidate和subset
  2. 对A与B都应用JIP_LPPNet得到segment
  3. 对B应用DensePose得到IUV
  4. 对两个candidate、两个subset、两个segment、一个IUV以及图A、B应用CT-Net即可得到换装后的结果

Resource

  1. 上图的集成了所有功能的exe程序,可以从这里,提取码:6666获取,由于一共集成了4个模型,因此非常大,有1个多G,同时运行也很缓慢,大约要一分钟
  2. 该github工程仅包含代码,实际运行调试需要模型,可以从这里,提取码:6666获取,再放到对应的位置就好了
  3. 知乎分析文章:https://zhuanlan.zhihu.com/p/452366369

Content

将CVPR2021的服装迁移模型CT-Net搬运至NCNN框架上

CT-Net依赖
  1. 依赖OpenPose的人体姿势——pytorch实现
  2. 依赖LIP_JPPNet的的人体解析分割图——Tensorflow实现
  3. 依赖Densepose的人体IUV图——Detectron2实现
待完成&已完成
  • OpenPose的ncnn&c++实现 —— OpenPose文件夹
  • LIP_JPPNet的ncnn&c++实现 —— LIP_JPPNet文件夹
  • Densepose的ncnn&c++实现 —— DensePose文件夹
  • CT-Net的ncnn&c++实现 —— CT-Net文件夹
  • 组合四个模型的ncnn&c++实现 —— Ensemble文件夹
  • QT GUI实现 —— QT文件夹

Reference

  1. CT-Net
  2. OpenPose
  3. LIP_JPPNet
  4. Densepose
  5. Detectron2
  6. DenseSense
  7. ncnn
  8. opencv-mobile

clothingtransfer-ncnn's People

Contributors

edvince avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

clothingtransfer-ncnn's Issues

大神厉害!!!

请问有交流群吗,或者怎么finetune模型,使在自己的数据集上表现更好,我的数据是虚拟人像旗袍服,不知道效果怎么样。谢谢

如何修改模型

tryon.exe能对底层模型进行修改以满足个人的需求吗?

Google Drive Link

HI,

The Baidu link is not accessible, could you please a google drive link to try your software executable?
thanks in advance

ui_mainwindow.h

Hi,
QT\vs2019_ncnn_opencv-mobile_Qt_nanodet,
可以提供 ui_mainwindow.h文件吗?
Ui::MainWindowClass ui; 禁止显示状态
错误(活动) E0135 namespace "Ui" 没有成员 "MainWindowClass"

谢谢!

闪退

大神,Windows程序闪退。
运行环境是win10和win11,求解决方法。
谢谢

效果不太好

作者你好,我也跑了这个代码,用自己找的数据的话效果会非常差,但是用给定的数据集效果就很好,请问你试其他数据了么
image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.