Cyphone - Mobile multimodal personal augmented reality

Abstract

Advances in multimedia, virtual reality, and immersive environments have expanded human-computer interaction beyond text and vision to include touch, gestures, voice and 3D sound. Although there exist well-developed single modalities for communication, we do not really understand the general problem of designing integrated multimodal systems. Recent advances in mobile communication based on picocellular technologies allow the transmission of high bandwidth of data over personal surrounding networks. The technology offers some more freedom for the design of mobile multimodal 3D user interfaces but does not solve the design problem. In this paper we offer an approach to adding aspects of mobility and augmented reality to multimodal user interfaces, discuss the technology and potential future product concept vision, the CyPhone, and depict the general architecture and integration framework briefly.