All geek questions in one place

Official Kinect SDK and Unity3d

Does anyone know anything about using Kinect input for Unity3d with the official SDK? I was assigned a project to try to integrate the two, but my super does not want me to use Kinect open source materials. The latest news from the Unity website was that Kinect SDK requires 4.0.NET and Unity3D only takes 3.5

Workarounds? Direct me to resources, if you know anything about this, please.

+6
source share
2 answers

OpenNI communications for Unity is probably the best way. The NITE skeleton is more stable than the Microsoft Kinect SDK, but still requires calibration (PrimeSense mentioned that they will soon have an immortal skeleton).

There are OpenNI bindings from the Kinect SDK that make the Kinect SDK look like a SensorKinect, this module also provides the oil-free KinectSDK skeleton as an OpenNI module:

https://www.assembla.com/code/kinect-mssdk-openni-bridge/git/nodes/

Since KinectSDK also provides ankles and wrists, and OpenNI already supported it (although NITE did not support it), all OpenNI materials, including Unity unitary drilling machines, included ankles and wrists, all work without calibration. KinectSDK binding for OpenNI also supports the use of the NITE skeleton and hand trackers, with one caveat, it seems that NITE gesture detection does not work with the Kinect SDK yet. The job of using KinectSDK with the NITE handGenerator is to use skeleton-free tracking to provide you with a manual point. Unfortunately, you lose the ability to simply track your hands when your body is not visible to the sensor.

However, the NITE skeleton looks more stable and more responsive than KinectSDK.

+7
source

How much raw Kinect data do you need? For a limited problem, for example, just to determine limb membership, you thought about using an agnostic communication scheme like TcpClient . Just create a simple TCP server in .net 4.0, which communicates with the Kinect SDK and downloads packets with the information you need every 30 ms or something like that. Then just write the recipient to Unity. I had a similar problem with another SDK. I have not tried Kinect, although perhaps my offer is too great.

If you need real-time depth / color data, you might need something a little faster, perhaps using Pipes ?

+4
source

Source: https://habr.com/ru/post/891159/

More articles:


All Articles