Code Monkey home page Code Monkey logo

avatarify-desktop's Introduction

Avatarify Desktop

Avatarify for desktop with a user friendly interface.

System requirements

  • Windows 10
  • Nvidia GPU: GeForce 1070 or higher is recommended
  • Web camera

Installation

  1. Download Avatarify Desktop (897 Mb).
  2. Double click on the installer. Windows Defender warning screen may pop up telling that the app comes from an unknown source. Click "More info", then "Run anyway".
  3. Follow the instructions of the setup Wizard. You may opt to the default settings.

Running

  1. The app starts automatically after the installation. If that didn't happen, press Windows button and start typing "Avatarify" and select "Avatarify Desktop". Windows Defender warning screen may pop up telling that the app comes from an unknown source. Click "More info", then "Run anyway".
  2. In the Settings section of the main window, choose your web camera in the drop-down menu.
  3. Position your head in the center of the frame and press C to calibrate.
  4. Left-click on any avatar and start driving.

Tip: whenever your avatar screws, press C (or click Calibrate button) to reset the initial pose.

To break into video conferencing with an avatar, set up the Virtual camera.

Virtual camera

This example is for Zoom, but the procedure is similar in the other video-conf apps.

  1. In Zoom, go to Settings -> Video.
  2. In the Camera drop-down menu, choose Avatarify Camera.
  3. You should see your avatar immediately. If you see image from your web camera, go back to Avatarify and left-click on an avatar.

Add new avatar

  1. Click on Open image file in the main window.
  2. Browse to your image with an avatar and open it. Requirements to images: one face, neutral emotion, frontal look.
  3. Crop your image. Using the slider under the window, zoom image so that shoulder are slightly captured. Drag the image using left mouse button and center the head of the avatar. Leave some space between top of the head and image border.
  4. Click on Save button. The new avatar will appear on the left of the avatar reel.

Use overlay

Avatar driving works better when your calibration pose matches the avatar's pose.

  1. If an avatar is selected, left-click on it to switch to the web camera mode.
  2. Right-click on the avatar to make it appear as an overlay on your web camera image.
  3. Use Overlay slider in the Settings section to change opacity of the overlay.
  4. Match your pose and expression with the avatar and press C to calibrate.
  5. Left-click on the avatar to drive it.

Smart crop

The app has a function to automatically track the position of your head. It's useful when your web camera is mounted sidewise and you not appear in the center of the frame.

In the Settings section, switch Smart crop slider. The app will start tracking your head and move it to the center of the frame. When it's done, press C to calibrate.

Controls

Key Action
C Calibrate.
⬅️ ➡️ Switch to previous / next avatar.
F Fullscreen mode

Build from source

Dependencies

  • Qt
  1. Download online installer
  2. Run the installer and on the Select Components page select these components:
    • Qt -> Qt 5.15.2. Deselect all components except MSVC 2019 64bit to save disk space
    • Qt -> Developer and Designer Tools -> OpenSSL 1.1.1d Toolkit
  • libtorch. Library for NN inference. Download library here: https://pytorch.org/ (Stable; Windows; C++/Java; 10.2/None). Direct links: release, debug. Extract files to
    • Release: C:\SDKs\libtorch-win-shared-with-deps-1.6.0
    • Debug: C:\SDKs\libtorch-win-shared-with-deps-debug-1.6.0
      Make sure path C:\SDKs\libtorch-win-shared-with-deps-1.6.0\lib (for release) is correct. Remove extra sub-directories if necessary.

Build project

  • Check that you have libtorch at C:\SDKs\
git clone https://github.com/vlivashkin/avatarify-desktop
cd avatarify-desktop
git submodule update --init --recursive
  • Build the project with Qt Creator. Choose MSVC 2019 64-bit kit and Release configuration.
  • Download additional files from here and unpack to C:\Users\[user]\.avatarify. This folder has the following structure:
    • .avatarify\avatars: avatar pictures
    • .avatarify\models: FOMM and landmark detector model weights
  • Download AkVirtualCamera.plugin from here and unpack to [build]/avatarify. Avatarify will register еру plugin on the first run.

Build installer

(not very clean solution, but at least it works)

  • Build release solution
  • Call make install in cmake-build-release folder. Clean installation files will be located in C:\Program Files\Avatarify
  • Compress folder with 7z and put it in avatarify-desktop\installer\packages\com.avatarify.desktop\data folder
  • You need to make similar archives for models and avatars from C:\Users\[user]\.avatarify and put them to com.avatarify.desktop.models and com.avatarify.desktop.avatars folders
  • Run avatarify-desktop\installer\package_for_windows.bat

avatarify-desktop's People

Contributors

alievk avatar gkorepanov avatar johanar avatar staddy avatar vlivashkin avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

avatarify-desktop's Issues

unable to install

I ' ve downloaded the desktop version,but when installing, it shows that can't extract file from
"installer://com.avatarify.desktop/0.10.0.0deploy_Qt_5_15_1_MSVC2019_64bit_full_torch.7z"
unable to open document"E:2//d3dcomplier_47>dll"

Please help me

Unable to uninstall the app

The app worked great.

However, I am done using it and now want to uninstall. I tried uninstalling from the control panel, however that did not work. Please guide on how should I uninstall it. Just deleting the folder would do the job?

Thanks

Simply doesn't open

When opening the EXE file, it simply does nothing.
I have a Ryzen 7 2700x and RTX 2070
I have open with admin as well as checked task manager and nothing shows forit, it just simply does not do anything, no error message, no nothing, kinda like a dud. Any ideas?

No output from Avatarify Camera

The app itself functions fine, with a visible working preview, but the output from Avatarify Camera is just a gray screen. Makes it pointless to use unless I use some sort of screen streaming software which was one of the biggest annoyances of the command line version.
I'm running it on a GTX 1070 Ti with an Intel i7 2600 and 20 GB of RAM, Windows 10 Build 19041.867

face doesn't sync/move

Hi! Very excited that you have made a windows compatible version of Avatarify! Thank you for that! I have the software installed, and have input faces I would like to use. The problem is that when I calibrate the selected face to my face no actual face movement of the mouth occurs. The eyes bug out and twitterpate, but no actual movement to sync up with mouth movement for speech. The whole face twitches and has mild distortion which looks very 'unrealistic.' This problem occurs also with all the "stock" faces that come with the software install.
I have a 1080TI cuda card.

No preview and Dark Blue output in Zoom, GPU is 2070S

I use my Play Station 3 camera through OBS virtual cam, but when I select OBS virtual camera in the options in the app it shows nothing in the preview, is OBS Virtual Cam not supported? My graphics card is RTX 2070S

Is this normal

attached is how avatarify works on my PC i don't know if this is how it should work or maybe something is missing

bandicam.2021-04-27.00-27-21-614.mp4

Radeon GPU

I know perfectly, that radeon gpu (in my case is rx 570) wont work in here and will be painfully slow, but maybe add some instructions on how to add cloud gpu rendering? I remember do it like that. i just dont want mess around with setting up avatarify itself, only with adding cloud render to your proggram

App does not start. (Nvidia RTX30xx)

I have installed the Software normaly on my PC. I have the newest drivers for my rtx 3070. I have followed the instructions on the Page and my Webcam even turns on. I also get asked if wanted to grant CMD permission but still no Windoes opens. Any Ideas?
Thanks in advance.

Can't remove Avatarify driver from the list of the cameras

Hi, I uninstalled Avatarify Desktop, but whenever I open video call programs they use Avatarify as the default camera. I tried looking for the driver in device manager but I cannot find it anywhere. How should I remove it from the list of the cameras? Please help. Thanks.

Help me out here

Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): done
Solving environment: \

i need help about this please because the conda prompt is still loading over 10 minutes now

can't get app to launch on my machines

Hello! Running windows 10 with latest nvidia drivers on two machines.

One has two 3090s and the other has two a5000s.

I don't get anything to show up at all when i launch the app, but it displays as running in background on ask manager. Any idea what could be wrong?

Thanks!

No Webcam Detected!

I have an i7 pc with 32 gig ram and 1070 gtx
I installed it and the software starts correctly and I can choose the photos but it does not detect any camera...
I've tried Kinect & EOS & Fake Webcam but non working..
O by the way thanks for the answers

Can't open the app at all.

I downloaded and ran the installer, The app appears on my desktop, but every time I try to run it I get this message. I have re-installed it multiple times.
image

7>D:\avatarify-desktop\avatarify\src\vcam\AkVCamBridge.cpp(22,17): error C2039: "connectService": is not"AkVCam::IpcBridge" member

bool AkVCamBridge::allocateDevice() {
m_ipcBridge.connectService(false);
m_ipcBridge.setDriverPaths({QDir::currentPath().toStdWString()});
auto devices = m_ipcBridge.listDevices();
std::cout << "List of devices:" << std::endl;
for (const auto &d : devices) {
std::cout << "\t" << d << std::endl;
}

bool isStarted{false};
if (devices.empty()) {
    qDebug() << "No available devices. Need to create one..." << supportedFormats.size();
    m_ipcBridge.deviceCreate(description, supportedFormats);
    devices = m_ipcBridge.listDevices();
    qDebug() << devices.size();
    if (!devices.empty()) {
        m_device = devices[0];
        qDebug() << m_device.c_str();
        for (int i = 1; i < 4; ++i) {
            QThread::sleep(4 * i);
            if ((isStarted = m_ipcBridge.deviceStart(m_device, format))) {
                break;
            }
        }
        if (!isStarted) {
            return false;
        }
    }
    //m_device = m_ipcBridge.deviceCreate(description, supportedFormats);
    //if (m_device.empty()) { // error during creating the device
    //    std::wstring_convert<std::codecvt_utf8<wchar_t>, wchar_t> converter;
    //    std::cout << "ipcBridge: " << converter.to_bytes(m_ipcBridge.errorMessage()) << std::endl;
    //    return false;
    //}
} else {
    qDebug() << "There are " << devices.size() << " devices. Choose 0...";
    m_device = devices[0];
    //m_ipcBridge.deviceEdit(m_device, L"Avatarify Camera", supportedFormats);
}
if (!isStarted) {
    isStarted = m_ipcBridge.deviceStart(m_device, format);
}
if (isStarted) {
    AmplitudeLogger::log("vcam_ok");
    std::cout << "Success initializing " << m_device << std::endl;
    return true;
} else {
    AmplitudeLogger::log("vcam_fail");
    std::cout << "Error initializing " << m_device << std::endl;
    std::wstring_convert<std::codecvt_utf8<wchar_t>, wchar_t> converter;
    std::cout << "ipcBridge: " << converter.to_bytes(m_ipcBridge.errorMessage()) << std::endl;
    return false;
}

}

Improve output resolution

Hi, amazing app works great, lot of fun to let Einstein talk haha! When is the output resolution going to be improved? Or are there already ways to improve quality or newer technologies to do similar things? Thanks Ali!

How to launch Avatarify.exe ?

How to launch Avatarify.exe ?
It crashes with the APPCRASH error. (I'm running it on windows 7).
The file "Avatarify Desctop" in the folder c:\Users\Scar\Avatarify\ is missing.

Colab doesn't work either.

doesnt work on RTX 2060

E5 2678v3 32GB RAM, RTX 2060
app runs, make calibration, when i click to image below - app crash witn no error.

NO OPEN Avatarify with Nvidia 3060

Good afternoon Yesterday I installed Avatarify and when I turn it on... despite appearing in the task panel as running, the program screen does not appear.
I freaked out growing up that it was some computer problem, I uninstalled everything and did a clean install of windows. Install everything again, and Avatarify... and Not work...
I changed the graphics card for another old 580 and the application works (despite being so slow that nothing can be done...)I would like to know if anyone knows of a solution or if you plan to make an update to be able to use AVATARIFY with the 3060 cards.
It makes me very angry... It is an application that I really want to try.
Many thanks for everything!!

Not using GPU

The app runs fine but is slow.
I checked in my windows Task manager, it's putting all the load on CPU and nothing on my nvidia 960M.
I'm on win 10.
I tried click right on the app name and running using graphics processor but that does not start the process.
If i double click on app, it start the process but it's too slow

Was anyone able to use it with omegle?

how to build from source code?

thanks for your wonderful job firstly. I wanna know if the project can be built and how to do that? I look forward to your reply as soon as possible.Thks

Linux version soon? :)

First of all, thank you for developing this project greatly.
avatarify-python works well as a container but being able to run it quickly on Ubuntu 21.04 would be a blast.
As you're also on Linux, I'm sure you understand.
Have a great day!

Change underlying model

I was wondering what is the underlying model of this desktop version, is it the vox-adv-cpk.pth or another one? And is possible to replace the model easily with another one when running the app?

No overlay slider or virtual cam option.

The tutorial says you can use an overlay slider to calibrate Avatarify, and in a screenshot there's an option to use Avatar as a virtual camera. I don't have the virtual camera option, nor do I have an overlay slider, and there isn't a virtual camera when I look at Discord.
Edit: Nevermind, it works now

AM FACING THE SAME ISSUE

AM FACING THE SAME ISSUE, WHEN I FIRST BOUGHT MY LAPTOP IT WAS WORKING PERFECTLY BUT ALL OF A SUDDEN IT STOP WORKING
Screenshot

Needs Zoom on face function

The original python Avatarify had a zoom feature so you could get close to your face. Without this the software is crap. capture needs to be as close as possible to make it work good. Could someone add this feature? or is the code simple enough i could branch and do it myself? Would be great if the code just grabbed the face better and you didn't need zoom. either way it would improve this app a lot.

p.s. otherwise this is awesome release. Thanks!

ios version support

Is there a version or scheme that runs on ios, or if I want to run on ios, what should I do?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.