Oregon State University student Alex Wiggins gestures to Kinect, which in turn makes a remote-control toy helicopter take off while teammates Ruma Paul (left) and Fabio Matsui (right) look on. The students took part in a 24-hour Code Camp using the new Kinect SDK for Windows 7 (Photo Credit: Microsoft)

Ready to use your voice and hands to control your PC? How about a virtual orchestra or a flying quadrocopter?

Microsoft Research this morning is officially expanding the Kinect motion sensor beyond its Xbox 360 game console to traditional Windows machines. The company is releasing a development kit that students, researchers and other noncommercial software developers can use to create Windows 7 programs that sense their surroundings and respond to voice commands and gestures.

The beta release of the free Kinect software development kit, or SDK, could fuel the grassroots Kinect applications that have until now been considered hacks. Microsoft says it’s also working on a version of the SDK for commercial software programs.

Over time, the move by Microsoft could help the motion sensor find a place in such settings as kitchens, doctor’s offices or auto repair shops, where grubby hands or sterile gloves make a keyboard and mouse difficult or undesirable to use.

Microsoft Research's Anoop Gupta wearing the Kinect SDK launch shirt

But developers are thinking bigger than that. Examples of applications from a coding marathon that was hosted by Microsoft over the past 24 hours include a virtual orchestra that users can conduct with their hands, and a miniature quadrocopter that can similarly be controlled with gestures.

The programs use the $150 Kinect sensor currently sold for Microsoft’s Xbox 360.

Kinect on Windows will represent “an inflection point” for computing, said Anoop Gupta, Microsoft Research distinguished scientist, in an interview this morning. It will take some time to spread to the hundreds of millions of people who have PCs, but in the evolution of computing “this will be a pretty memorable moment,” he predicted.

Microsoft isn’t giving a timeframe for the release of a commercial version of the SDK, and it isn’t talking about how the sensor could ultimately be integrated into its own PC products. However, it’s not difficult to envision the sensor being used to control the new Windows 8 interface, or working in conjunction with Skype for video conferencing, after Microsoft’s acquisition of Skype is complete.

The SDK is available for download here. A live broadcast about the SDK by Microsoft’s Channel 9 site starts here at 9:30 a.m. Here are the features of the SDK, as detailed by Microsoft …

Raw Sensor Streams. Developers have access to raw data streams from depth sensor, color camera sensor and the four-element microphone array. These will allow them to build upon the low-level streams generated by the Kinect sensor.

Skeletal Tracking. The SDK has the capability to track the skeleton image of one or two people moving within the Kinect field of view, making it possible to create gesture-driven applications.

Advanced Audio Capabilities. Audio processing capabilities include sophisticated noise suppression and echo cancellation, beam formation to identify the current sound source, and integration with the Windows speech recognition API.

Comments

  • Guest

    Congratulations to Microsoft on finding ways to sell even more Kinects than the 10,000,000 already in customers’ hands!

  • Anonymous

    Heck yeah dude thats like totally amazing. Well done.
    web-privacy.no.tc

  • Tim Reha

    Excited to play with Kinect here in the lab and test out soon on our 20X60Ft video cycwall for total immersion experiences…

  • Anonymous

    A sounds really catchy. I have seen the reviews of this sdk which was really bang on. I like the most its audio function and its capabilities. That is wise software which announced by Microsoft.
    Lipo

  • http://twitter.com/cronDavid David Echols

    Please fix your title. The Kinect hacks that existed before Microsoft’s SDK were “legit” as well. Your title infers that it’s illegal to take apart and build on top of things you already own.

    Thanks for being a responsible journalist.

    • Guest

      You own the hardware. You don’t own the OS. You’re licensed to use it subject to accepting the EULA which include a do not modify or tamper clause.

    • Guest

      No, they weren’t. At a minimum they voided your warranty:

      KINECT
      DEVICE. The Kinect device is sold subject to the terms of a
      Warranty and Software License Agreement that allows use of the device solely in
      connection with an Xbox 360 or Xbox 360 S console.

      At a maximum they may have broken DCMA or MS’s software license.

  • mrIT

    “Over time, the move by Microsoft could help the motion sensor find a place in such settings as kitchens, doctor’s offices or auto repair shops, where grubby hands or sterile gloves make a keyboard and mouse difficult or undesirable to use.” If Microsoft doesn’t use this technology then someone will and it would be equal to the loss that xerox had with the mouse

  • Anonymous

    This is very cool…anyone else thinking “Minority Report”?

  • Cksp

    Ever since I saw the demo of PhotoSynth on TED, I’ve felt like MS is actually doing great work again. I hope it continues.

    • Guest

      Photosynth, like Kinect, is based in part on technology from outside (acquired in the former case, licensed in the latter).

      • Scheveningen

        I believe the important elements were invented by MS.  No, they didn’t invent plastics, electricity, camera lenses….

  • Bob

    Don’t they really need a new or extra sensor in the Kinect before most of the apps you’re talking about can be a reality? My understanding is that the current one is optimized for 4-11ft, not <4ft.

  • DeeDeeDee

    good work MS… finally you guys are right on top of the curve…maybe even ahead for once!

    • Guest

      They were ahead on mobile and tablets. They just failed to focus and keep innovating.

  • http://www.facebook.com/Nashblackcat Kevin Groce

    You better read that EULA of the SDK. Might change your mind.

Job Listings on GeekWork