Grasping, Communicating, Understanding: Connecting Reality and Virtuality

Abstract

"Several simulation projects in the area of production and logistics indicated that, although we have sophisticated input and output devices for computer supported modeling, physical models still play an important role for cognition and communication. We therefore introduce the concept of a Graspable User Interface that aims at combining two model worlds, the one inside the computer and a corresponding physical one in the outside world. Sensored user hands will couple physical objects of the real world with virtual objects, thus allowing fairly unrestricted manipulation and expression. In this way modeling with real physical objects can create an abstract virtual model. Some applications of this concept are presented. A further perspective for a new action oriented communication and learning with artifacts is envisioned." [author's abstract]