Avatarify Python - Avatars for Zoom, Skype and other video-conferencing apps.

Overview

Avatarify Python

Photorealistic avatars for video-conferencing.

Avatarify Python requires manually downloading and installing some dependencies, and is therefore best suited for users who have some experience with command line applications. Avatarify Desktop, which aims to be easier to install and use, is recommended for most users. If you still want to use Avatarify Python, proceed to the install instructions.

Based on First Order Motion Model.

Avatarify Python is not affiliated with Avatarify Inc.

News

  • 7 Mar 2021. Renamed project to Avatarify Python to distinguish it from other versions of Avatarify
  • 14 December 2020. Released Avatarify Desktop. Check it out here.
  • 11 July 2020. Added Docker support. Now you can run Avatarify from Docker on Linux. Thanks to mikaelhg and mintmaker for contribution!
  • 22 May 2020. Added Google Colab mode. Now you can run Avatarify on any computer without GPU!
  • 7 May 2020. Added remote GPU support for all platforms (based on mynameisfiber's solution). Demo. Deployment instructions.
  • 24 April 2020. Added Windows installation tutorial.
  • 17 April 2020. Created Slack community. Please join via invitation link.
  • 15 April 2020. Added StyleGAN-generated avatars. Just press Q and now you drive a person that never existed. Every time you push the button – new avatar is sampled.
  • 13 April 2020. Added Windows support (kudos to 9of9).
Comments
  • Dockerize the

    Dockerize the "Remote GPU" service

    This PR needs some testing before merging, so I'm creating it as a draft.

    Based on my previous contribution to AliaksandrSiarohin/first-order-model#55.

    Building

    docker build -t avatarify .
    

    Running

    docker run -it --rm --gpus=all -p 5557:5557 -p 5558:5558 avatarify
    
    opened by mikaelhg 47
  • Broken pipe

    Broken pipe

    ffmpeg version 4.1.4-1build2 Copyright (c) 2000-2019 the FFmpeg developers
      built with gcc 9 (Ubuntu 9.2.1-4ubuntu1)
      configuration: --prefix=/usr --extra-version=1build2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
      libavutil      56. 22.100 / 56. 22.100
      libavcodec     58. 35.100 / 58. 35.100
      libavformat    58. 20.100 / 58. 20.100
      libavdevice    58.  5.100 / 58.  5.100
      libavfilter     7. 40.101 /  7. 40.101
      libavresample   4.  0.  0 /  4.  0.  0
      libswscale      5.  3.100 /  5.  3.100
      libswresample   3.  3.100 /  3.  3.100
      libpostproc    55.  3.100 / 55.  3.100
    0: ./avatars/mona.jpg
    cam_fomm.py:26: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
      config = yaml.load(f)
    [mjpeg @ 0x561a4d0f8a00] Format mjpeg detected only with low score of 25, misdetection possible!
    Input #0, mjpeg, from 'pipe:0':                                                                                                                           
      Duration: N/A, bitrate: N/A
        Stream #0:0: Video: mjpeg, yuvj420p(pc, bt470bg/unknown/unknown), 640x480 [SAR 1:1 DAR 4:3], 25 tbr, 1200k tbn, 25 tbc
    Stream mapping:
      Stream #0:0 -> #0:0 (mjpeg (native) -> rawvideo (native))
    [swscaler @ 0x561a4d153040] deprecated pixel format used, make sure you did set range correctly
    [video4linux2,v4l2 @ 0x561a4d0fe680] ioctl(VIDIOC_G_FMT): Invalid argument                                                                                
    Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument                                                                
    Error initializing output stream 0:0 --                                                                                                                   
    Conversion failed!                                                                                                                                        
    Traceback (most recent call last):
      File "cam_fomm.py", line 173, in <module>
        sys.stdout.buffer.write(buf)
    BrokenPipeError: [Errno 32] Broken pipe
    Exception ignored in: <_io.TextIOWrapper name='<stdout>' mode='w' encoding='utf-8'>
    BrokenPipeError: [Errno 32] Broken pipe
    
    opened by zuenko 42
  • Error when run

    Error when run "bash run.sh"

    Hi,

    I pull the last commit, executed again the install.sh and tryed run:

    bash run.sh

    But this error occours:

    (avatarify) [email protected]:~/Repository/others/avatarify$ bash run.sh 0: ./avatars/einstein.jpg 1: ./avatars/eminem.jpg 2: ./avatars/jobs.jpg 3: ./avatars/mona.jpg 4: ./avatars/obama.jpg 5: ./avatars/potter.jpg 6: ./avatars/ronaldo.png 7: ./avatars/schwarzenegger.png load checkpoints.. cam_fomm.py:34: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. config = yaml.load(f) Traceback (most recent call last): File "cam_fomm.py", line 231, in stream = pyfakewebcam.FakeWebcam(f'/dev/video{opt.virt_cam}', frame.shape[1], frame.shape[0]) File "/home/eltonnunes/.conda/envs/avatarify/lib/python3.8/site-packages/pyfakewebcam/pyfakewebcam.py", line 54, in init fcntl.ioctl(self._video_device, _v4l2.VIDIOC_S_FMT, self._settings) OSError: [Errno 22] Invalid argument

    Anyone can help ?

    My OS: Linux Mint 19.3 Cinnamon

    opened by eltonnuness 27
  • When run_windows.bat is finished, the two windows do not pop up. (avatarify does not launch)

    When run_windows.bat is finished, the two windows do not pop up. (avatarify does not launch)

    Describe the bug

    To Reproduce

    Info (please complete the following information):

    • OS (e.g., Linux):
    • GPU model:
    • Any other relevant information:

    Screenshots

    Logs

    duplicate 
    opened by board808 19
  • Getting multiple cam windows opened while running run.sh

    Getting multiple cam windows opened while running run.sh

    I am on latest Ubuntu I have installed correctly and updated everything but when I run bash run.sh then it didn't. Run so I run with sudo bash run.sh but so it sometime shows me avatar list to select and sometimes it open webcam and when I press X and configure my face than multiple cam windows start opening and I can't understand what's the issue and how to fix it please help me out

    opened by shwetkanwal24 19
  • Error with run_windows.bat

    Error with run_windows.bat

    RuntimeError: CUDA error: no kernel image is available for execution on the device

    I have a Windows 10 machine with Nvidia GTX Titan card. Nvidia says it supports CUDA 3.5 which I think is the minimum required?

    Also I read in the notes that it should fall to the CPU if the GPU isn't supported? How would I configure that if the card is the problem?

    opened by virtualmonster 17
  • No module named 'sync_batchnorm'

    No module named 'sync_batchnorm'

    Windows 10 system.

    Traceback (most recent call last): File "cam_fomm.py", line 13, in from sync_batchnorm import DataParallelWithCallback ModuleNotFoundError: No module named 'sync_batchnorm'

    opened by newtonke 17
  • Add overlay drawing of landmarks

    Add overlay drawing of landmarks

    Seeing the landmarks of both the current frame and the avatar can make it easier to get a good pose. I also thought it was interesting to expose a little of the underlying techniques

    opened by JohanAR 16
  • How to find the IP address of Google Colab Notebook

    How to find the IP address of Google Colab Notebook

    Hi, I want to run avatarify on macOS, but I need to use google colab... How do I find the IP address of the notebook so I can connect to the server? I tried to put the !curl ipecho.net/plain command in the notebook and I received an IP, but when I use this IP, the terminal is stuck on Receiving from.

    This is the google colab command:

    google_colab_command

    and this is what I see in the terminal: terminal

    opened by tvtr04 16
  • DLL load failed: The specified module could not be found.

    DLL load failed: The specified module could not be found.

    Error when running run_windows.bat

    File "cam_fomm.py", line 11, in import cv2 ImportError: DLL load failed: The specified module could not be found.

    Tried to install different opencv libraries to no avail. Any ideas how to solve this?

    more info needed 
    opened by kratadata 16
  • ModuleNotFoundError: No module named 'yaml'

    ModuleNotFoundError: No module named 'yaml'

    (base) E:\avatarify>run_windows.bat --is-client --in-addr tcp://2.tcp.eu.ngrok.io:10176 --out-addr tcp://0.tcp.eu.ngrok.io:12257 Traceback (most recent call last): File "afy/cam_fomm.py", line 4, in import yaml ModuleNotFoundError: No module named 'yaml'

    opened by fazelukario 15
  • Corrupt vox-adv-cpk.pth.tar

    Corrupt vox-adv-cpk.pth.tar

    Describe the bug

    initially the tar file has a 3 textbook icon but whenever I download it now it shows a regular file icon and that is the problem. Even if you move it into the right directory it’s still gonna show file not found

    Info (please complete the following information):

    • OS (windows 10 home):
    • GPU model: GeForce 1660 ti,windows 10 home, 6gb graphics
    • Any other relevant information:

    Screenshots

    Logs

    opened by Denvercraig 3
  • TROUBLE RUNNING AVATARIFY ON COLAB SERVER FOR MAC

    TROUBLE RUNNING AVATARIFY ON COLAB SERVER FOR MAC

    Hello guys, I really need a bit of help running Avatarify on the Google Colab server since I use a Mac. I already have Miniconda and unpacked the repositories in the Avatarify Folder. I was following the steps for running on google collab, everything was going just about right until the "start the worker" section of the code. Can anyone advise on what to do. I have a screenshot of th result attached to thisScreen Shot 2022-12-29 at 11 04 52 AM

    cloud gpu 
    opened by oveentheproduza 0
  • Avatar folder missing after forced shutdown

    Avatar folder missing after forced shutdown

    Laptop shutdown due to overheating, now I open avatarify.... it’s working fine but I can’t find the avatar folder to add new model or remove existing ones. I’ve search every where but nothing. Pls help.

    opened by Twabor 1
  • Python avatarify

    Python avatarify

    I have a problem, after I give the git clone command and equip it using the cd avatarify python command, I try to compile with the other command and this error returns me "avatarify python failed solving environment",what i do?

    opened by Bitchlinux 0
  • Error any time I try to run windows.bat

    Error any time I try to run windows.bat

    option --use-feature: invalid choice: '2020-resolver' (choose from "fast-deps', 'truststor che')

    I tried installing from scratch as I always does that work fine but now when I try ruining the scripts.windows.bat it gives me this at the end process

    opened by mandontsmile 11
Releases(v0.2.0)
Owner
Ali Aliev
Computer graphics
Ali Aliev
K Closest Points and Maximum Clique Pruning for Efficient and Effective 3D Laser Scan Matching (To appear in RA-L 2022)

KCP The official implementation of KCP: k Closest Points and Maximum Clique Pruning for Efficient and Effective 3D Laser Scan Matching, accepted for p

Yu-Kai Lin 109 Dec 14, 2022
Efficient electromagnetic solver based on rigorous coupled-wave analysis for 3D and 2D multi-layered structures with in-plane periodicity

Efficient electromagnetic solver based on rigorous coupled-wave analysis for 3D and 2D multi-layered structures with in-plane periodicity, such as gratings, photonic-crystal slabs, metasurfaces, surf

Alex Song 17 Dec 19, 2022
Official Pytorch implementation of "Learning Debiased Representation via Disentangled Feature Augmentation (Neurips 2021, Oral)"

Learning Debiased Representation via Disentangled Feature Augmentation (Neurips 2021, Oral): Official Project Webpage This repository provides the off

Kakao Enterprise Corp. 68 Dec 17, 2022
Plato: A New Framework for Federated Learning Research

a new software framework to facilitate scalable federated learning research.

System <a href=[email protected] Lab"> 192 Jan 05, 2023
TAug :: Time Series Data Augmentation using Deep Generative Models

TAug :: Time Series Data Augmentation using Deep Generative Models Note!!! The package is under development so be careful for using in production! Fea

35 Dec 06, 2022
Self-training with Weak Supervision (NAACL 2021)

This repo holds the code for our weak supervision framework, ASTRA, described in our NAACL 2021 paper: "Self-Training with Weak Supervision"

Microsoft 148 Nov 20, 2022
Pytorch implementation for reproducing StackGAN_v2 results in the paper StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks

StackGAN-v2 StackGAN-v1: Tensorflow implementation StackGAN-v1: Pytorch implementation Inception score evaluation Pytorch implementation for reproduci

Han Zhang 809 Dec 16, 2022
Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNs

Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNs ArXiv Abstract Convolutional Neural Networks (CNNs) have become the de f

Philipp Benz 12 Oct 24, 2022
Toolbox of models, callbacks, and datasets for AI/ML researchers.

Pretrained SOTA Deep Learning models, callbacks and more for research and production with PyTorch Lightning and PyTorch Website • Installation • Main

Pytorch Lightning 1.4k Dec 30, 2022
This is the official pytorch implementation for our ICCV 2021 paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering" on VQA Task

🌈 ERASOR (RA-L'21 with ICRA Option) Official page of "ERASOR: Egocentric Ratio of Pseudo Occupancy-based Dynamic Object Removal for Static 3D Point C

Hyungtae Lim 225 Dec 29, 2022
A Comprehensive Empirical Study of Vision-Language Pre-trained Model for Supervised Cross-Modal Retrieval

CLIP4CMR A Comprehensive Empirical Study of Vision-Language Pre-trained Model for Supervised Cross-Modal Retrieval The original data and pre-calculate

24 Dec 26, 2022
Awesome Remote Sensing Toolkit based on PaddlePaddle.

基于飞桨框架开发的高性能遥感图像处理开发套件,端到端地完成从训练到部署的全流程遥感深度学习应用。 最新动态 PaddleRS 即将发布alpha版本!欢迎大家试用 简介 PaddleRS是遥感科研院所、相关高校共同基于飞桨开发的遥感处理平台,支持遥感图像分类,目标检测,图像分割,以及变化检测等常用遥

146 Dec 11, 2022
Personalized Federated Learning using Pytorch (pFedMe)

Personalized Federated Learning with Moreau Envelopes (NeurIPS 2020) This repository implements all experiments in the paper Personalized Federated Le

Charlie Dinh 226 Dec 30, 2022
Provably Rare Gem Miner.

Provably Rare Gem Miner just another random project by yoyoismee.eth useful link main site market contract useful thing you should know read contract

34 Nov 22, 2022
Vertex AI: Serverless framework for MLOPs (ESP / ENG)

Vertex AI: Serverless framework for MLOPs (ESP / ENG) Español Qué es esto? Este repo contiene un pipeline end to end diseñado usando el SDK de Kubeflo

Hernán Escudero 2 Apr 28, 2022
Self-Supervised Learning

Self-Supervised Learning Features self_supervised offers features like modular framework support for multi-gpu training using PyTorch Lightning easy t

Robin 1 Dec 14, 2021
Bayesian Image Reconstruction using Deep Generative Models

Bayesian Image Reconstruction using Deep Generative Models R. Marinescu, D. Moyer, P. Golland For technical inquiries, please create a Github issue. F

Razvan Valentin Marinescu 51 Nov 23, 2022
Reviatalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulation

Reviatalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulation This is the implementation of the approach describ

Taosha Fan 47 Nov 15, 2022
VGG16 model-based classification project about brain tumor detection.

Brain-Tumor-Classification-with-MRI VGG16 model-based classification project about brain tumor detection. First, you can check what people are doing o

Atakan Erdoğan 2 Mar 21, 2022
A benchmark dataset for emulating atmospheric radiative transfer in weather and climate models with machine learning (NeurIPS 2021 Datasets and Benchmarks Track)

ClimART - A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Models Official PyTorch Implementation Using deep le

21 Dec 31, 2022