[Philip Lelyveld comment: Microsoft has 850 researchers working on the project!]

[The Verge]

…

Kinect Fusion is a system that uses the Kinect’s sensors to create an interactive, real-time 3D model of the environment — the demonstration shows virtual balls bouncing around on the objects captured and rendered directly from the real world. (It’s not the first time we’ve seen the Kinect used for 3D modeling, but it’s nice to see an official effort.) Microsoft’s Kevin Schofield is quick to point out that the $150 Kinect sensor can accomplish the same tasks as industrial versions of the technology that cost about $50,000.

Lightspace works in the opposite direction: with a combination of depth cameras and projectors, it can create linked interactive screens on different surfaces. In the video, principal researcher Andy Wilson demonstrates how objects projected on a table can be moved around, re-sized, and even carried to another display using his hands. It’s something you have to see to really understand, so fire up that video.

See the full story and watch the video here: http://www.theverge.com/2011/12/21/2652055/kinect-fusion-lightspace-microsoft-building-99-exclusive-tour