Kinect-Based IWB

infrared points of light projected from a Kinect

Ever since a $3000 bounty was placed on cracking open Microsoft’s fab new gaming hardware, the motion-sensing Kinect for Xbox, hackers and tinkerers have been putting the open-source drivers to lots of interesting uses on platforms that Microsoft never envisioned.  I’ve written about interesting Kinect hacks before (and before that,) and I’ve written about my experience with the Wii-based $50 Interactive Whiteboard (IWB,) but I haven’t seen a fully-developed Kinect-based Interactive Whiteboard.

Perhaps an Interactive Whiteboard is too narrow a description.  Many of the pieces are in place (see below) to interface with a computer using Kinect.  So, as with the Wii-based IWB, any application you can use on your computer can be controlled by this hardware.  If you connect your computer to a projector, you essentially have an Interactive Whiteboard.

Is the Kinect-based experience different from a Wii-based IWB or a Smartboard?  Almost certainly.  There would be no need to touch the screen at all, but rather to gesture in front of the Kinect to interact with the projection on the screen.  Would this be an improvement?  I’m not sure.  A touch-based IWB is more analogous to traditional whiteboard that uses markers and an eraser.  So, the touchless experience would be quite different.  I need to try it myself to really wrap my head around the opportunities that this motion-sensing interface offers.

I’m not sure if anyone here at Ohio State is working with Kinect as an interface for non-Xbox applications.  But I do know that the Digital Union has a Kinect which could probably be used to see if and how things work.  If anyone else is interested in trying to pull this together, drop me a line or leave a comment.

Multitouch with Kinect

Kinect on a Mac

Multitouch Kinect

Kinect Fingertip Detection

Kinect + PC + Mario = Fun

Advertisements

3 Comments

Filed under Projects

3 responses to “Kinect-Based IWB

  1. Aaron Schwartz

    One of our grad students in the OU linguistics dept. has been working on some various kinect hacks, possibly including a whiteboard. Are you coming down for the CALL Conference next week? He’d probably be happy to share what he has found out.

    • I don’t think I’m going to be able to make it down to Athens next weekI’m hoping to make it down to Athens, Aaron, and I’d love to know more. Thanks for making this connection.

  2. very interesting toughts. If you want to develop a IWB with a Kinect, you should step off the ‘air control’. The ‘touch and feel’ has to be the same as in any ordinary commercioal IWB. Writing in the air is not easy. So contact with your finger with your whiteboard is essential.
    If someone could manage this, the disadvantages of using a Wiimote (the distance between your whiteboard and the visibility of your pen will be solved.
    I’m not a programmer, but a pedagogist in a training centre for teachers. So if someone with programming skills would like to cooperate, I could finetune the educational content.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s