Code Monkey home page Code Monkey logo

ue4realsenseplugin's Introduction

RealSense Plugin for Unreal Engine 4

Overview

The RealSense Plugin provides support for the Intel RealSense SDK to Unreal Engine 4 developers by exposing features of the SDK to the Blueprints Visual Scripting System.

The plugin is architected as a set of components, each of which encapsulates a specific set of features. Is also makes use of an actor known as the RealSense Session Manager, which manages access to the RealSense SDK functions and maintains the master copy of all RealSense data. It is instantiated automatically when the first RealSense component is created and it allows for the use of multiple instances of the same RealSense component class, easing the process of sharing data between objects.

RealSense processing takes place on its own dedicated thread. On every tick of the game thread, the RealSense Session Manager polls for new RealSense data, and updates the RealSense components accordingly. This separation helps keep the game thread running quickly even when the RealSense thread is doing some heavy lifting.


For more details, you can read this article.

You can also check out these tutorial videos to get started using the RealSense plugin:

https://youtu.be/mrIiBssoI0w

https://youtu.be/WMqG3UZkBTE


Available Cameras

  • SR300 Short-Range RealSense Camera
  • F200 Front-Facing RealSense Camera
  • R200 World-Facing RealSense Camera

Other Hardware Requirements

  • 4th Generation Intel CPU or higher

Software Requirements

  • Intel(R) RealSense(TM) SDK 2016 R1
  • The correct DCM for your camera (found also at the previous link)
  • Unreal Engine 4.8 or higher
  • SR300 - Windows 10 only
  • F200 / R200 - Windows 8.1 or 10

Featured Components

  • Camera Streams - Provides access to raw color and depth image buffers
  • Scan 3D - Supports the scanning of faces and objects into 3D models

In-Progress Components

  • Head Tracking - Provides data for the user's head position and rotation
  • Scene Perception - Supports the scanning of small scenes into 3D models

ue4realsenseplugin's People

Contributors

codergirl42 avatar geoffrey-jon avatar geoffreydouglas-intel avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

ue4realsenseplugin's Issues

Build fails with VS2015

It seems the solution does not build after upgrading to VS 2015 (Community) mostly of undefined identifiers or types in RealSenseImpl.h, f.e.:

  • identifier "PXCFaceConfiguration" is undefined
  • identifier "PXCFaceData" is undefined
  • use of undefined type 'PXCFaceModule'
    Seems a library is missing? I'm quite new to C++ and VS, so maybe I'm overseeing something here?

I had no issues with the previous install of VS, the UE project which I build using this version still runs (in 4.11) without problems, 4.13 wants to rebuild the dll's. Setting up the project from scratch with 4.11 also results in build errors.

Plugin not building with ue4.15

Hi,

I'm trying to install the realsense plugin for ue4.15 but it doesn't build.
realsense camera - R200
ue version - 4.15.3
realsense SDK 2016 R2 (unable to find 2016 R1)
visual studio community 2017.

Please let me know how to get it to build
Thanks

Further development?

Is this plugin being developed? I am eager to get a realsense camera for facial tracking!

Any pulse?

This project has had no pulse since May.

Does Intel or anyone intend to maintain / improve it ?

SenseManager Initialized : -3 error in UE4 4.14

Hello,

I was able to build this plugin using the 2016 R2 SDK and a R200 camera, but when I play a simple BluePrint, that only displays the color stream, I get this error in the UE4 console:

RealSensePlugin:Error: RealSenseImpl::CameraThread() : SenseManager Initialized : -3

How to access the original depth value?

Hello,thank you for developing this plugin.
There is a problem is ,when i use this plugin to get depth value,the depth values get from DepthBuffer is between 0 and 255,with the real distance from low to high,the depth values from 0 to 255 repeat.
It seems like the original depth value has been taken mold by 256.I want to access the original depth value that can reflect the real distance from camera to real scene.
I can't find a solution,could you help me?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.