How to map Kinect joints to a 3D model and embed it to real time video

Category: kinect for windows v1 sdk

Question

Shamitha Silva on Wed, 06 Mar 2013 09:05:25


Hi ,

I'm doing a virtual dressing room project and I could start mapping  .png like files to joints and its working fine. But now I want to know how to map a 3D object (like a 3D shirt) to joints and output it in the same video. ex:-http://www.youtube.com/watch?v=yUroQw_ydw0

The 3D object needs to have the ability to turn itself when the real person turns. But do not know how to get a start for this. Any help is so much appropriated.

Thanks in advance.

Replies

The Thinker on Sun, 24 Mar 2013 23:14:19


Hi ,

I'm doing a virtual dressing room project and I could start mapping  .png like files to joints and its working fine. But now I want to know how to map a 3D object (like a 3D shirt) to joints and output it in the same video. ex:-http://www.youtube.com/watch?v=yUroQw_ydw0

The 3D object needs to have the ability to turn itself when the real person turns. But do not know how to get a start for this. Any help is so much appropriated.

Thanks in advance.

Well theirs a KMotion application in here somewhere by akira. His code is in v1 or higher source code so you could easily take that code and use it in your application with some planning.  I have the nice v1.5 code from chosker in that thread but contact him if you wish for the v1.5 source with improvements. Heres the link:

http://social.msdn.microsoft.com/Forums/en-US/kinectsdk/thread/2bfff4a4-0d2d-40a3-ae65-8299f65bec8c

Carmine Si - MSFT on Tue, 02 Apr 2013 22:32:54


If you don't have much experience in the 3D space this can be a bit of a challenge. Understanding the 3D object space and seeing how the model are moved in a virtual space are going to be key. For starters look at the XNA Skinned Mesh samples. You could use the Avateering sample to get a sense of mapping Kinect coordinates to that same model. Then there are XNA examples of adding objects to a skinned mesh:

http://xbox.create.msdn.com/en-US/education/catalog/sample/skinned_model

http://xbox.create.msdn.com/en-US/education/catalog/tutorial/skinned_model_extensions

Hamza Ameer on Tue, 20 Mar 2018 13:03:15


can you sare youe code for maping .png file to joints? kindly please me at hamzaameeer50@gmail.com