Tag Archives: whiteboard

Kinect-Based IWB

infrared points of light projected from a Kinect

Ever since a $3000 bounty was placed on cracking open Microsoft’s fab new gaming hardware, the motion-sensing Kinect for Xbox, hackers and tinkerers have been putting the open-source drivers to lots of interesting uses on platforms that Microsoft never envisioned.  I’ve written about interesting Kinect hacks before (and before that,) and I’ve written about my experience with the Wii-based $50 Interactive Whiteboard (IWB,) but I haven’t seen a fully-developed Kinect-based Interactive Whiteboard.

Perhaps an Interactive Whiteboard is too narrow a description.  Many of the pieces are in place (see below) to interface with a computer using Kinect.  So, as with the Wii-based IWB, any application you can use on your computer can be controlled by this hardware.  If you connect your computer to a projector, you essentially have an Interactive Whiteboard.

Is the Kinect-based experience different from a Wii-based IWB or a Smartboard?  Almost certainly.  There would be no need to touch the screen at all, but rather to gesture in front of the Kinect to interact with the projection on the screen.  Would this be an improvement?  I’m not sure.  A touch-based IWB is more analogous to traditional whiteboard that uses markers and an eraser.  So, the touchless experience would be quite different.  I need to try it myself to really wrap my head around the opportunities that this motion-sensing interface offers.

I’m not sure if anyone here at Ohio State is working with Kinect as an interface for non-Xbox applications.  But I do know that the Digital Union has a Kinect which could probably be used to see if and how things work.  If anyone else is interested in trying to pull this together, drop me a line or leave a comment.

Multitouch with Kinect

Kinect on a Mac

Multitouch Kinect

Kinect Fingertip Detection

Kinect + PC + Mario = Fun


Filed under Projects

Kinect Development

microsoft kinect hardware

Microsoft recently announced plans to release a software development kit (SDK) for the Kinect.  This should allow academics and enthusiasts to find new ways to connect the motion-sensing Xbox hardware to other platforms, such as desktop and laptop computers, much more easily.  In short, there should be many more Kinect hacks to come.

I’m still not sure how this would directly apply to classroom teaching, although it stands to reason that these applications could someday replace physical interactive whiteboards in the same way that Kinect was originally designed to replace physical videogame controllers for the Xbox.

For more, see my previous post on Kinect Hacks and below for some new examples of how Kinect is being used in new and exciting ways.

Control Windows 7

The touchless multitouch is really nice.  Mice are so 2008.

3D Tetris with Face Tracking

As the user moves his head, the perspective on the screen changes to match so that the 3D perspective is constantly updated.

Kinect Lightsaber

A wooden stick becomes a lightsaber in real time.  This would save hours of  frame-by-frame editing.

Balloon Body

After Kinect scans your body, use your scroll wheel to expand or contract the surface.

Christmas Lights

Use Kinect attached to a bunch of dimmers to control Christmas lights for a very nice effect.

Flying Robot

The 3D capability of connect makes it perfect for a robot that navigates three-dimensional space.

1 Comment

Filed under Inspiration

Click Don’t Scan

camera with large flash bulb

Have you ever taken a picture of the board at the front of your ESL classroom?  It’s actually a pretty good way to capture lots of notes in a hurry, but you won’t be able to edit those notes once the picture is snapped.

Some document scanners have built in text recognition, but it can take a while for the scanner bar to drag across the document.  Sure, it’s only a matter of seconds, but if you have a big stack of documents to put through the scanner one page at a time, it can be a real inconvenience.  In fact, this scanner bar technology (a one-dimensional sensor being dragged across a two-dimensional surface) seems just a bit out of date, doesn’t it?

Enter a new line of scanners described in Popular Science that incorporate digital camera sensors to capture an entire document at one time — no more waiting for the sensor to drag.

But wouldn’t it be nice to snap a picture instead of scanning a document?  Well, it turns out there is an app for that.  Scanner Pro (reviewed by cnet) turns your iPhone into a .pdf-producing document scanner.  Forget trying to find a fax machine when you need to sign a document and send it to someone.  Sign a document, then scan it and email it, all from your phone.  There are other apps available for iPhones and iPods beginning at $0.99 and likely similar options for other flavors of smartphone as well.  The future is here today!

Thanks to the OSU Yammer community for ideas and links used in this post.

Leave a comment

Filed under Uncategorized

Open and Kinect

open kinect

A few days ago, I wrote about how the new Microsoft Kinect has been hacked so that you don’t need an Xbox to use it.  There are now lots of tinkerers and hackers working with this hardware to see what else might be possible.  Although it’s not as easy to see the immediate applications for Kinect in the language classroom as it was for the Wii-based interactive whiteboard, there are obvious parallels.  And this new gaming hardware is more advanced than the Wiimote, which may offer more possibilities.  I’ve posted some examples of some interesting Kinect-based projects below.

How does it work?

Infrared beams, and lots of them.  Here’s how it looks with an infrared / nightvision camera.

Multitouch IWB

Because Kinect can “see” surfaces in 3D, it can be used to create a multitouch interactive whiteboard on multiple surfaces.

Control your browser

Forget your mouse.  Kinect can see the gestures you make in three-dimensional space.  Use gestures to control your browser and more.

Teach it

Teach it to recognize objects.  Obviously, there is a lot more software in use here, but Kinect provides the interface.

Digital puppets

Who wouldn’t want one of these?

Visual camouflage

In 1987, the movie Predator cost $18M.  A significant portion of what was left over after paying Arnold Schwarzenegger was likely spent on the cool alien light-bending camouflage effects.  Just over 20 years later, you can make the same effects on your computer using the $250 Kinect hardware.

3D video

At first glance, this looks like really poor quality video, but stick with it.  Notice the Kinect camera does not move, but with the flick of a mouse, the point of view can be changed as Kinect extrapolates where everything is in the space based on what it can see from where it is.  The black shadows are where Kinect can’t see.

Using 2 Kinects, most of the shadows are filled in.  The effect is like a translation of the real world into a low resolution Second Life-like environment.


Filed under Inspiration

Hacking Kinect

I never really thought much about Microsoft’s Kinect until I saw what hackers were doing with it.  A story in the New York Times outlines how a designer and senior editor at Make magazine posted a $3000 bounty for the first person to post an open-source hack of the Kinect interface.  Huzzah!  In fact, I’m still not that impressed with it — 3D drawings are cool, but will they help me teach English? — but I’m thrilled that hackers big and small are poking around under the hood.

Interestingly, Johnny Chung Lee, who became famous for his TED talk where he described hacking a Wiimote to act like an interactive whiteboard, is involved in the development of Kinect.  Microsoft were so impressed with his skills on the Wii-based IWB and other projects they hired him.  He is reportedly very happy to see hackers taking on Kinect in the way he took on Wii a couple of years ago.  If a hacker can squeeze an interactive whiteboard out of a $40 Wiimote, what will come out of the $150 Kinect system?

Will this technology help us teach ESL and EFL?  It’s not easy to see how, at least not immediately.  But prepare for a giant step forward in how we interface with computers in the next few years.  Interactive whiteboards are just the beginning.  You can always show your students this video and ask them to predict the future (in English).


Filed under Inspiration

Computer Games in ESL

burning pac man

Computer games are a medium that has become as popular as Hollywood movies.  It’s not uncommon for teachers to show movies in class, but how can games be incorporated?  This post will discuss these questions and will serve as the handout to my session at the Ohio TESOL Technology Fair 2010.

Games as a source of English

MMORPGs and other complex, multiplayer games can provide a rich source of English (or many other languages) in which students can choose to immerse themselves.  Also, because these games are almost impossible to solve without teamwork, there are typically

World of Warcraft (WoW) – The granddaddy of all MMORPGs and by far the biggest.  Players create avatars that go on quests and have adventures.   In addition to finding potentially complex communication tasks with other players during the game, the WoW wiki is the second largest wiki on the internet after Wikipedia.  This is also potentially a good source of target language input.

Second Life – Though not exactly a game, per se, Second Life is an online 3D virtual world through which players’ avatars can navigate.  There has been much educational interest in Second Life which means there are several “islands” dedicated to language practice for users to explore.

Analysis of Simulations

Distinguishing between games, serious games and simulations is not as important as how we can use them.  Playing a simulation may not be entirely satisfying because a totally accurate simulation of any complex system is extremely difficult to create.  But this creates an opportunity for students to try them and then critique them.  There are lots of examples listed on Historical Simulations.org.  Some of my favorites are below.

Budget Hero – Where would you increase and / or decrease the federal budget and what ramifications would each decision have on the future?  Lots of information in a very accessible format.

Energyville – See if you can meet the energy needs of a city of almost 6 million people.  Do you think cutting all fossil fuels immediately is the answer?  Not in this simulation.  Does knowing that it was created by Chevron make you question anything about this simulation?  Lots to discuss here.

McDonald’s Video Game – What decisions would you make (have to make?) to keep your franchise humming.  Would you cut corners?  What effects would this have?  And, as with Energyville, above, is this an unbiased view or is there an underlying message in this game?

Group Problem Solving

Even the simplest games can generate complex discussion when played in pairs or as a group.  Two students working at one computer need to negotiate everything starting from who gets to use the mouse.  If you have access to an interactive whiteboard, a larger group can work together to play the game or solve the puzzle much more comfortably.

Samorost 2 – This is a visually compelling game that, at first, does not seem to have a point.  During a brief cartoon introduction, a dog is kidnapped from a tiny planet by space aliens and the protagonist begins his pursuit.  Now what?  By clicking on various items on the screen they can be manipulated.  Puzzles can be solved by finding the appropriate series of manipulations.  I’ve had a half-dozen students working on these puzzles on an interactive whiteboard.  I was worried because when working alone on my desktop, I found the puzzles to be quite challenging and I almost gave up on more than one occasion.  But the power of the group was amazing to see as the students moved quickly through several levels, working together and suggesting new ideas to each other as they went.

Grow Cube – I’ve been intrigued by this game since the first time I discovered it.  It is a puzzle in which the player ten turns to select from ten actions that can be performed on a cube.  Each one has a cute animation that interacts with the others.  Most importantly, some actions require several turns to fully develop.  Others must be performed sequentially to work properly (spoiler alert: place the pot on the cube before lighting the fire or the fire will grow too hot and crack the pot.)  The puzzle typically requires one or two attempts to get a feel for the game before players can really begin to notice the effects that each action has on the others.  Even if the puzzle can not be solved, there is a complete walkthrough available for help.  But do yourself a favor and don’t peek until you’ve given it a few tries.

Other Tips & Suggestions

Some of the most complex games available will also be the most expensive.  Even if that hurdle is overcome (possibly by purchasing older versions, for example), there may be a variety of reasons that prohibit the installation of World of Warcraft in the local computer lab (“You want to play games?!?”).  Fortunately there are a number of online games which are freely available and only require an internet connection to play.  Of course, if you routinely battle a firewall for internet access, you may want to test whether you can access them on the computers you intend to use before you plan to use them.

Ask what your students are playing and see if those games might provide a jumping off point.  Are they addicted to Farmville on Facebook?  Bejeweled?  Can they analyze the game critically?  Can they teach someone else the strategy involved?

Most games have wikis which describe all of the parts of the game as well as strategies that can be used to win.  Is there an undocumented way to win?  Have students contribute their ideas to the wiki.


Filed under Resources

Mischievous Mouses

mouse locked by chain

Unlock your mouse!

I occasionally get emails from people looking for a little exposure for a new product or service.  Excluding the copious spam, I do appreciate the interest in my blog, though most of these messages miss the mark.  I won’t write about something unless I actually see it as useful.  Fortunately, I recently received something useful in my inbox.  From Microsoft.  It’s called Mouse Mischief.

After watching the video on the homepage, I’m intrigued.  Mouse Mischief allows a teacher to connect up to 15 mice to one computer.  If each student has a wireless mouse they can all interact on the screen at the same time.  Each mouse can have a different cursor, so a teacher can ask a question and have students mouse-over the answer.  Students can also perform other mouse functions like drawing and clicking from their seats.  Teachers can even track which students answer correctly as well as how often and how quickly.

I like this idea because it’s a bit like clickers, which give each student the ability to answer a question by pushing a button, and a bit like an interactive whiteboard, which allow students to interact collaboratively with the screen.

Of course, moving a mouse on top of a desk is not the same experience as actually touching a touchscreen.  And wireless mice aren’t free, though Microsoft conveniently links to some which start at about $20 —  plan on about $300 to be fully outfitted, assuming you already have a computer and a projector in your classroom.  Plus the software, which is free to download, only works with certain versions of some of their products (PowerPoint 2007 and 2010, for example).

Microsoft seems to be taking the right path by encouraging teachers to upload their best lesson plans so that teachers can collaborate on the best uses of this technology.  Will it be the next “big thing”?  I’m not sure it will, but it’s an innovative use of an old technology.  And if using one mouse is good, I’d like to see what can be done with 10 or 12 of them.

Leave a comment

Filed under Resources