Depth and Color streams are not taken from the same point so they do not correspond to each other perfectly. Also they FOV (field of view) is different. cameras IR/Depth FOV 58.5° x 45.6° Color FOV 62.0° x 48.6° distance between cameras 25mm my corrections for 640×480 resolution for both streams if (valid depth) { … Read more
Also see Jurgeon D’s answer on Kinect SDK player detection, as it deals with skeleton index. @Fixus is also right in that you could use a ID. But if you mean more than 2 people are detected, then only one is detected, that is not programming, that is in the Kinect’s hardware and @FelixK. was … Read more
prologue This answer is based on mine previous answer: Does Kinect Infrared View Have an offset with the Kinect Depth View I manually crop your input image so I separate colors and depth images (as my program need them separated. This could cause minor offset change by few pixels. Also as I do not have … Read more