Code Monkey home page Code Monkey logo

ue4virtualproduction's Introduction

Virtual Production Projects For Unreal Engine

Virtual Production puts real people in a CG background, adds CG people/objects to live video scenes and a lot of other things. Cameras can move and the CG backgrounds can be animated. It is being used in a lot of TV and Movies like Disney's "The Mandalorian" This repository will help you get started using Epic's free Unreal Engine to do Virtual Production yourself.

Below is me doing a product review from a Virtual Set. The output is real-time so you can live stream to YouTube or a video conferencing app like Zoom or Microsoft Teams. Only me and the desk are real, everything else is CG. You can see more examples on my youtube channel.

Virtual Production

Getting Started

Everyone has a different hardware and studio so none of these projects are "plug-and-play" you will need to customize them a bit to work with the hardware you have. There are tutorials on my youtube channel. to help you get started. If you have never used Unreal Engine before you should probably watch a couple of the getting started courses on the Unreal Engine Learning Hub to get familiar with how to use Unreal.

My samples were done using consumer DSLR cameras and VIVE VR gear for tracking. They can be customized for pro quality cameras and camera tracking equipment or can be used with something as simple/cheap as a webcam. Any good 3d gaming PC will work for this.

You will need a free download of Unreal Engine to run these samples.

In This Repository

  • VPStudio -- my Virtual Production sample. All the newer tutorials and samples come from this.
  • UE4VirtualProduction -- not maintained any more I recommend using VPStudio for new work.
  • TrackerTest -- a project that measures tracker jitter and reports it so you can tune your setup for lowest jitter

Goals of this project

Virtual Production is still very new and there isn't much documentation about how to set it up and use it. New features are coming out so quickly that the "official" documentation hasn't caught up yet. I'm working out how to do Virtual Production and am making my projects and tutorials available so more people can use it for things like YouTube content and their own movies.

Other Sources of help

There is a lot of virtual production info on social media, check #virtualproduction to find the latest ones. For good help from experienced people chec this discord channel and this facebook group

Some other applications

Virtual Production can be used to take people from in different places and put them all together on a virtual set, great for press conferences, product announcements and training videos. Unreal Engine can also be used to produce high quality animated productions like this or this very quickly.

The great thing about Unreal Engine virtual production is that the same tools can be used in a small home studio or in huge big budget movie productions.

Free software and 3d models

My examples and the software and CG assets I used to make them are available for free. Almost everything I have used in my demos comes from the "free assets" section of Unreal Marketplace. There is a lot of CG content available there and every month they release more. Unfortunately, Unreal's licensing doesn't allow me to redistribute this content here, but you can grab it yourself from the marketplace and add them to my VPStudio project by following the Use your own sets tutorial on my YouTube channel.

Please Contribute!

These projects will help you get started. You can use them for any purpose. If you use it to produce a video or want to redistribute a project based on this, please credit me and include links back to my Youtube channel. Let me know what you post and I will reference your work on my sites too!

I'm hoping this will get enough people started in Virtual Production to increase the amount of information about it and make it easier for even more people to join in!

ue4virtualproduction's People

Contributors

milomindbender avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.