Getting rid of the mouse: from jazzy to big

The keyboard/mouse combination is fine for primarily typing tasks, but the depth of interaction and expression they offer is pretty poor. The places where we see the most innovation are in music and gaming. Musicians are pushing this because they are coming from a tactile world (keyboards, guitar strings, etc). Gamers are pushing it because it increases the depth of immersion (especially force feedback) and perhaps gives you an edge of your competition.

In the music world, the coolest solution I’ve seen is the Lemur/Dexter by Jazz Mutant, a multi-touch (can use more than one finger at same time) sensitive display with dedicated software for creating virtual input devices (sliders, dials, etc.), outputting midi. The physics model allows for the creation of some unusual input paradigms such as bouncing balls and elastic bands. I’d love to give one of these a spin but the 2,100 € price tag is pretty serious.

Jazz Mutant Lemur

But what about the poor graphic artist? They’re coming from a tactile world too where the finess of how you hold a nd manipulate a brush is intrinsic in your artistic expression. We’re starting to see more pen based laptops but most have a relatively low resolution (typically 1024×768) and require you to sacrifice processing power for the convenience of a pen based input. And besides, what if I already have a computer such as a desktop and just want to swap how I interact?

Enter the Wacom Cintiq, a 21″ 1600×1200 LCD screen with pressure sensitive pen for use with any computer. This looks like a lot of fun. The touch bars provide additional direct input allowing zooming/panning/etc. At $2500US it doesn’t come cheap, but if your world is about doing computer based graphics then it could make sense. One fun bonus is that there is no raised bezel so you can use real world objects (such as french curves) to trace on top of it.

Wacom Cintiq

If you want to go big though, you could consider the Smart Board line. They offer integrated back projected, front projected, or my personal favorite, overlay over existing LCD/plasma screen. An advantage of the Smart Board line is that you can either use one of their digitizing pens or your finger. We’ve played with the front projected version of this, programming music with Ableton Live and found the experience to be extremely fluid and interactive, to the point where we were using the software differently. That’s the true measure of the power of a change in interaction device. The only downside was the rather interesting contortions required to interact without blocking the projector. A close+high mounted projector with wide angle and good keystone control starts to overcome this. To this end, Smart Board has an integrated solution with a boom and projector. Notable mention should go to 3M which has a similar product although I’ve never tried it. Clearly the better solution is the more expensive overlay, although in combination with an 1080p LCD tv could be quite nice.

Smart Board

The ergonomic advantage of all these is clear. The tablet devices require wider motions of the hands and arms, using larger muscle sets in a variety of patterns. That’s a great RSI buster. The most intriguing though is the wall board approach because it forces you to get up out of those crappy chairs and move around! What a wonderful combination when making music.

Its great to see the products coming out but the prices need to become more approachable for us to see any kind of revolution in how we interact with our computers. Eventually though we want to see more and richer multi-touch input devices. Because, after all, we humans have more than one finger!

3 Responses to “Getting rid of the mouse: from jazzy to big”

  1. Francis Bogsanyi Says:

    Handshake VR’s “Haptic Overlay Device” could have added force-feedback to many of these devices - possibly a nice augmentation of the virtual input devices for the Lemur. Sadly, I don’t think it got beyond the prototype stage. http://doi.ieeecomputersociety.org/10.1109/HAPTIC.2004.1287208

  2. Kevin Says:

    Thanks for the cool link Francis, I wasn’t aware of that.

    Yes, lack of tactile feedback is a huge issue for touchscreens and one I personally am not sure I could get over. Interestingly, I was just reading the following forum post discussing the same issue as a reason for why the person sold their Lemur (http://forum.jazzmutant.com/viewtopic.php?t=620).

    I suppose in this regard something like the Wacom Cintiq has a slight advantage in that the pen is pressure sensitive so provides some degree of spring and thus a trivial level of feedback.

  3. Mike Wilson Says:

    I remember reading somewhere about some work that was done with small piezolectric activators attached to the fingertips of a a pair of gloves. As the gloves were moved about a VR space, the activators would fire when you “touched” something. Perhaps something as simple as that would work with the Lemur.

Leave a Reply