From last year researchers started applying a technique known as FTIR (Frustrated total internal reflection), used in biometric for fingerprint image acquisition, to screens permitting to track more than one touch at the same time. A strength of this kind of solution is that it is relatively cheap, a weakness, instead, is that it requires a camera behind the display to capture the touches, so it means that these device can’t be flat. There could be still useful applications and it could be a very good starting point on experimenting with the design and development of software that uses this richer interaction that soon or later could become more portable, especially if it demonstrates its undoubted utility.

The most developed project based on FTIR seen so far is by Jeff Han that shows an incredibly variety of applications with some very interesting ideas for the interactions (look, for instance, how to control a 3D map with 3 fingers).

Different applications by Jeff Han

During his demonstration at TED Jeff is very confident about this new kind of interfaces, and, after seeing how to create and scale a keyboard, it becomes quite difficult not to agree with him.

Another project based on the same technique is tabulaTouch by Natural Interaction. At the moment the guys from Chianti didn’t developed yet softwares advanced like Han’s, but they have clear ideas on how to use it in two different contexts: browsing visual objects archives and viewing 3D maps (a more developed version of tabulaMaps).

tabulaMaps by Natural Interaction

Considering all the projects they did so far, there is no doubt they will come up with other interesting, maybe more developed, stuff soon.

The last project I’d like to talk about is Tangent, the diploma project by Christian Iten and Daniel Lüthi. It seems at a good status of development, considering all the interaction techniques designed. Some of them are based on neat ideas, for instance the “short-cut” to show the keyboard.

tangent by Christian Iten and Daniel Lüthi

It’s interesting also the interaction with physical objects, like the phycon, that reminds me some projects from the Tangible Media Group at M.I.T. Media Lab. I’m wondering which further development could have this project, considering the context where it has been developed.

All the hardware by these projects seems mature enough, despite Jeff Han talked about the possibility of recognizing which finger is which. I can’t imagine yet how it could be possible (maybe controlling the finger prints?), but that would definitely increase the power of an already impressive interface.
Due to the increasing number of researchers interested on this study we can be sure that it won’t take so long to see further developments, especially software-wise if we consider how many designers, me included, would love to play with interfaces like these.

Just watching these videos you realize how two cursors as input can be already very powerful to use a GUI. So I still don’t know why computers after more than 20 years still can’t handle two different mice. Is if for the same reason people never knew about some clever experimental keyboards?