Code Monkey home page Code Monkey logo

multik2's Introduction

MultiK2

[API preview] Not for production use

Kinect 2 library for UWP and .NET with support for sensors connected over-the-network.

Requirements:

Kinect For Windows v2 (Kinect for Xbox One with adapter) with updated driver (2.2.1610)

Visual Studio 2015 Update 3

Windows 10 Version 1607 (build 10.0.14393)

multik2's People

Contributors

jmarcincin avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

multik2's Issues

Unity UWP xbox One

Hi, your code is integrated in unity (5.4).I working on project for xbox one and kinect. my project work on pc but on the xbox one the sensor not found. I try to find where is the problem and I think is come from the Sensor.GetDefaultAsync() function.
In my search but i'm not sure the xbox haven't a MediaFrameSourceKind.Custom. Are you try this on xbox or am I the only one to have this problem ?

MultiK2 Unity

Hello, bro.
Really good idea. You deserve congratulations!!
It is not an issue, I just wanted to know if there is any prevision for it be available for production.
Also, have you tested to know if the api works with Unity 5? I think it could be a good feature.
I am trying to make it. If I get done I send you the steps.

Cheers!!

Joint data etc

Hey Jan! NPatch from MSDN forums here.

Question: Have you finished the custom data acquisition code for BodyFrame?
If not, are you trying to find the offsets by yourself?

Thing is, I'm in touch with Unity for trying the regular .NET assemblies on Unity 2017.2 with the experimental .NET4.6 profile. And in researching this, I found out that the .NET assembly being loaded in .NET projects is a reference assembly(meaning no code, this only references the true assembly) and the ultimately referenced assembly that contains all the code is the one in the GAC which is a mixed mode C++/CLI assembly. I learnt that using ILSpy on them. But ILSpy can also decompile assemblies and when I tried to decomplile the mixed mode one, I found out :

..
using ;
using System;
using System.Collections.Generic;
using System.Runtime.ExceptionServices;
using System.Runtime.InteropServices;

namespace Microsoft.Kinect
{
public sealed class Body
{
private unsafe IBody* _pNativeBody = pNativeBody;

	private readonly NativeReaderWriterLock _cachedObjectLock = new NativeReaderWriterLock();

	private Dictionary<JointType, Joint> _joints;

	private Dictionary<JointType, JointOrientation> _orientations;

	private Dictionary<Expression, DetectionResult> _expressions;

	private Dictionary<Activity, DetectionResult> _activities;

	private Dictionary<Appearance, DetectionResult> _appearance;

	internal unsafe IBody* NativeBody
	{
		get
		{
			return this._pNativeBody;
		}
	}

	public unsafe TrackingState LeanTrackingState
	{
		get
		{
			TrackingState result = TrackingState.NotTracked;
			IBody* pNativeBody = this._pNativeBody;
			KinectExceptionHelper.CheckHr(calli(System.Int32 modopt(System.Runtime.CompilerServices.IsLong) modopt(System.Runtime.CompilerServices.CallConvStdcall)(System.IntPtr,_TrackingState*), pNativeBody, ref result, *(*(int*)pNativeBody + 72)));
			return result;
		}
	}

	public unsafe PointF Lean
	{
		get
		{
			PointF result = default(PointF);
			IBody* pNativeBody = this._pNativeBody;
			KinectExceptionHelper.CheckHr(calli(System.Int32 modopt(System.Runtime.CompilerServices.IsLong) modopt(System.Runtime.CompilerServices.CallConvStdcall)(System.IntPtr,_PointF*), pNativeBody, ref result, *(*(int*)pNativeBody + 68)));
			return result;
		}
	}

..


If you try it yourself you can get the full files and cross reference the offsets they have, seeing as they are hardcoded.

MultiK2_win32

Hello Jan,

Impressive, really impressive! My only issue so far is that I could not compile MultiK2_win32 and the respective DesktopKinect-client. They reference a Windows-assembly, which is not available in my VS2015. I tried to replace it with references to the existing Windows.Media, Windows.Graphics, Windows.Foundation, etc., but this caused a lot of other errors. What did I do wrong? May Windows be a library coming with more recent OS update?

Greetings!

Little bug in Unproject

I found a little bug in the CameraIntrinsics.UnprojectFromFrame()-method. The last line should be: 'return new Vector3(x, y, depth);', because x & y are already multiplied to 'depth' one line above.

In this regard, one question bugs me for days: Do you know how to unproject a point from the color camera frame to the color space, given that the depth values are related to the depth camera frame? Maybe I'm missing something..

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.