Kinect for Windows SDK Programming Guide

Build motion-sensing applications with Microsoft's Kinect for Windows SDK quickly and easily with this book and ebook.
Preview in Mapt

Kinect for Windows SDK Programming Guide

Abhijit Jana

Build motion-sensing applications with Microsoft's Kinect for Windows SDK quickly and easily with this book and ebook.
Mapt Subscription
FREE
$29.99/m after trial
eBook
$18.90
RRP $26.99
Save 29%
Print + eBook
$44.99
RRP $44.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$18.90
$44.99
$29.99p/m after trial
RRP $26.99
RRP $44.99
Subscription
eBook
Print + eBook
Start 30 Day Trial

Frequently bought together


Kinect for Windows SDK Programming Guide Book Cover
Kinect for Windows SDK Programming Guide
$ 26.99
$ 18.90
Windows Azure programming patterns for Start-ups Book Cover
Windows Azure programming patterns for Start-ups
$ 26.99
$ 18.90
Buy 2 for $35.00
Save $18.98
Add to Cart
Subscribe and access every Packt eBook & Video.
 
  • 5,000+ eBooks & Videos
  • 50+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 

Book Details

ISBN 139781849692380
Paperback392 pages

Book Description

Kinect has been a game-changer in the world of motion games and applications since its first release. It has been touted as a controller for Microsoft Xbox but is much more than that. The developer version of Kinect, Kinect for Windows SDK, provides developers with the tools to develop applications that run on Windows. You can use this to develop applications that make interaction with your computer hands-free.

This book focuses on developing applications using the Kinect for Windows SDK. It is a complete end to end solution using different features of Kinect for Windows SDK with step by step guidance. The book will also help you develop motion sensitive and speech recognition enabled applications. You will also learn about building application using multiple Kinects.

The book begins with explaining the different components of Kinect and then moves into to the setting up the device and getting thedevelopment environment ready. You will be surprised at how quickly the book takes you through the details of Kinect APIs. You will use NUI to use the Kinect for Natural Inputs like skeleton tracking, sensing, speech recognizing.

You will capture different types of stream, and images, handle stream event, and capture frame. Kinect device contains a motorized tilt to control sensor angles, you will learn how to adjust it automatically. The last part of the book teaches you how to build application using multiple Kinects and discuss how Kinect can be used to integrate with other devices such as Windows Phone and microcontroller.

Table of Contents

Chapter 1: Understanding the Kinect Device
Components of Kinect for Windows
Kinect for Windows versus Kinect for Xbox
Where can you use Kinect
Summary
Chapter 2: Getting Started
System requirements for the Kinect for Windows SDK
Evaluation of the Kinect for Windows SDK
Downloading the SDK and the Developer Toolkit
Installing Kinect for Windows SDK
Testing your device
Looking inside the Kinect SDK
Features of the Kinect for Windows SDK
The Kinect for Windows Developer Toolkit
Making your development setup ready
The Coding4Fun Kinect Toolkit
Summary
Chapter 3: Starting to Build Kinect Applications
How applications interact with the Kinect sensor
Kinect Info Box – your first Kinect application
Dealing with the Kinect status
Summary
Chapter 4: Getting the Most out of Kinect Camera
Understanding the Kinect image stream
Different ways of retrieving the color stream from Kinect
KinectCam – a Kinect camera application
Enabling the color stream channel
Looking inside color image stream helpers
Capturing frames on demand
Extending the KinectCam
Applying more effects to the camera
Seeing in low light
Making your application perform better
Using the Coding4Fun toolkit
Summary
Chapter 5: The Depth Data – Making Things Happen
Understanding the depth data stream
Capturing and processing depth data
Looking inside depth image stream helpers
Depth data and distance
Working with depth range
Depth data distribution
Player index with depth data
Getting the depth and player index automatically
A 3D view of depth data
Summary
Chapter 6: Human Skeleton Tracking
How skeleton tracking works
Skeleton tracking with the Kinect SDK
Start tracking skeleton joints
Flow – capturing skeleton data
An intrusion detector camera application
Looking inside skeleton stream helpers
Skeleton-tracking mode
Skeleton tracking in near mode
The Skeleton
Choosing which skeleton to track
The building blocks – Joints and JointCollection
Steps to be followed for joint tracking
Create your own joints data point
Bones – connecting joints
Adjusting the Kinect sensor automatically and giving live feedback to users
Skeleton smoothing – soften the skeleton's movement
Skeleton space transformation
The Advanced Skeleton Viewer application
Debugging the applications
Getting data frames together
Summary
Chapter 7: Using Kinect's Microphone Array
Verifying the Kinect audio configuration
Using the Kinect microphone array with your computer
The Kinect SDK architecture for Audio
Kinect microphone array
Audio signal processing in Kinect
Taking control over the microphone array
Kinect sound recorder – capturing Kinect audio data
Processing the audio data
Sound source localization
Summary
Chapter 8: Speech Recognition
How speech recognition works
Using Kinect with your Windows PC speech recognition
Beginning with Microsoft Speech API (SAPI)
Draw What I Want – a speech-enabled application
Summary
Chapter 9: Building Gesture-controlled Applications
What is a gesture
Approaches for gesture recognition
Basic gesture recognition
Algorithmic gesture recognition
Weighted network gesture recognition
Template-based gesture recognition
Building gesture-enabled controls
The Basic Interaction – a WPF application
Key things to remember
Summary
Chapter 10: Developing Applications Using Multiple Kinects
Setting up the environment for multiple Kinects
Multiple Kinects – how to reduce interference
Detecting multiple Kinects
Developing an application with multiple Kinects
Controlling multiple sensor status changes
Handling a failover scenario using Kinects
Challenges faced in developing applications using multiple Kinects
Applications where multiple Kinects can be used
Summary
Chapter 11: Putting Things Together
Taking Kinect to the Cloud
Remotely using the Kinect with Windows Phone
Using Kinect with a Netduino microcontroller
Augmented reality applications
Working with face tracking
Working with XNA and a 3D avatar
Summary

What You Will Learn

  • Understand the Kinect sensor in terms of a device, different components, and how they work.
  • Step by step installation guide of SDK, troubleshooting tips and development environment setup.
  • Reading the Kinect device information, monitoring and notifying the sensor status change.
  • Automatically adjust the sensor elevation angle
  • Understand different approaches of capturing data stream from Kinect sensor.
  • Learn the uses of color, depth and IR data and how to leverage them in your applications.
  • Use skeleton-tracking for interactive applications and leveraging the applications to gesture-enabled application
  • Understand usages of Microphone array and build speech-enabled applications with Speech API
  • Develop applications using Multiple Kinects
  • Understand how to design cross device application with Kinect

Authors

Table of Contents

Chapter 1: Understanding the Kinect Device
Components of Kinect for Windows
Kinect for Windows versus Kinect for Xbox
Where can you use Kinect
Summary
Chapter 2: Getting Started
System requirements for the Kinect for Windows SDK
Evaluation of the Kinect for Windows SDK
Downloading the SDK and the Developer Toolkit
Installing Kinect for Windows SDK
Testing your device
Looking inside the Kinect SDK
Features of the Kinect for Windows SDK
The Kinect for Windows Developer Toolkit
Making your development setup ready
The Coding4Fun Kinect Toolkit
Summary
Chapter 3: Starting to Build Kinect Applications
How applications interact with the Kinect sensor
Kinect Info Box – your first Kinect application
Dealing with the Kinect status
Summary
Chapter 4: Getting the Most out of Kinect Camera
Understanding the Kinect image stream
Different ways of retrieving the color stream from Kinect
KinectCam – a Kinect camera application
Enabling the color stream channel
Looking inside color image stream helpers
Capturing frames on demand
Extending the KinectCam
Applying more effects to the camera
Seeing in low light
Making your application perform better
Using the Coding4Fun toolkit
Summary
Chapter 5: The Depth Data – Making Things Happen
Understanding the depth data stream
Capturing and processing depth data
Looking inside depth image stream helpers
Depth data and distance
Working with depth range
Depth data distribution
Player index with depth data
Getting the depth and player index automatically
A 3D view of depth data
Summary
Chapter 6: Human Skeleton Tracking
How skeleton tracking works
Skeleton tracking with the Kinect SDK
Start tracking skeleton joints
Flow – capturing skeleton data
An intrusion detector camera application
Looking inside skeleton stream helpers
Skeleton-tracking mode
Skeleton tracking in near mode
The Skeleton
Choosing which skeleton to track
The building blocks – Joints and JointCollection
Steps to be followed for joint tracking
Create your own joints data point
Bones – connecting joints
Adjusting the Kinect sensor automatically and giving live feedback to users
Skeleton smoothing – soften the skeleton's movement
Skeleton space transformation
The Advanced Skeleton Viewer application
Debugging the applications
Getting data frames together
Summary
Chapter 7: Using Kinect's Microphone Array
Verifying the Kinect audio configuration
Using the Kinect microphone array with your computer
The Kinect SDK architecture for Audio
Kinect microphone array
Audio signal processing in Kinect
Taking control over the microphone array
Kinect sound recorder – capturing Kinect audio data
Processing the audio data
Sound source localization
Summary
Chapter 8: Speech Recognition
How speech recognition works
Using Kinect with your Windows PC speech recognition
Beginning with Microsoft Speech API (SAPI)
Draw What I Want – a speech-enabled application
Summary
Chapter 9: Building Gesture-controlled Applications
What is a gesture
Approaches for gesture recognition
Basic gesture recognition
Algorithmic gesture recognition
Weighted network gesture recognition
Template-based gesture recognition
Building gesture-enabled controls
The Basic Interaction – a WPF application
Key things to remember
Summary
Chapter 10: Developing Applications Using Multiple Kinects
Setting up the environment for multiple Kinects
Multiple Kinects – how to reduce interference
Detecting multiple Kinects
Developing an application with multiple Kinects
Controlling multiple sensor status changes
Handling a failover scenario using Kinects
Challenges faced in developing applications using multiple Kinects
Applications where multiple Kinects can be used
Summary
Chapter 11: Putting Things Together
Taking Kinect to the Cloud
Remotely using the Kinect with Windows Phone
Using Kinect with a Netduino microcontroller
Augmented reality applications
Working with face tracking
Working with XNA and a 3D avatar
Summary

Book Details

ISBN 139781849692380
Paperback392 pages
Read More

Read More Reviews

Recommended for You

Mastering OpenCV with Practical Computer Vision Projects Book Cover
Mastering OpenCV with Practical Computer Vision Projects
$ 26.99
$ 5.40
Unity 4.x Cookbook Book Cover
Unity 4.x Cookbook
$ 29.99
$ 21.00
Unity Shaders and Effects Cookbook Book Cover
Unity Shaders and Effects Cookbook
$ 29.99
$ 6.00
Responsive Web Design with HTML5 and CSS3 Book Cover
Responsive Web Design with HTML5 and CSS3
$ 23.99
$ 4.80
Unity 4.x Game AI Programming Book Cover
Unity 4.x Game AI Programming
$ 26.99
$ 18.90
Learning C# by Developing Games with Unity 3D Beginner's Guide Book Cover
Learning C# by Developing Games with Unity 3D Beginner's Guide
$ 29.99
$ 21.00