Using Kinect for touchless interaction with existing applications

Andrej Černivec, Ciril Bohak

Abstract

In this paper we present a system for touchless interface using Kinect sensor. The system can be used for general purpose interaction with existing applications. We show a case study implementation for use with web-browser where user can interact with the content using gestures. We also present implementation of the game that uses presented system for handling interaction with the user. We also present advantages and disadvantages of such framework and give possible solutions for some of the problems.

[Paper] [Presentation]

Multi-Touch surface based on RGBD camera

Klemen Istenič, Luka Čehovin, Daniel Skočaj

Abstract

The popularity of interactive surfaces is increasing because of their natural and intuitive usage. Adding 3D multi-point interaction capabilities to an arbitrary surface creates numerous additional possibilities in fields ranging from marketing to medicine. Interactive tables are nowadays present in numerous museums, schools and companies. With the advent of low-cost RGBD cameras, thee-dimensional surfaces are slowly emerging as well, attracting even more attention. This paper presents an affordable system for 3D human-computer interaction using a RGBD camera that is capable of detecting and tracking user’s fingertips in 3D space. The system is evaluated in terms of accuracy, response time, CPU usage, and user experience. The results of the evaluation show that such low-cost systems are already a viable alternative to other multi-touch technologies and also present interesting new ways of interaction with a surface-based interfaces.

[Paper] [Presentation]

UX – From theory to practical application – Keynote

Jože Guna, Emilija Stojmenova, Matevž Pogačnik

Abstract

We present the importance and key aspects of the User Experience, Usability and User/Human Centered Design paradigms and approaches. Furthermore, real-life examples are given to illustrate the practical use of these approaches.

There are many definitions of the “user experience”, however the common ground to all is the idea, that the focus should be on the user and his/her needs, wishes and expectations, rather than exclusively on the product or service itself. The main goal is that the product or service in question should not only be functional or usable but also easy, intuitive and fun to use and explore. This is closely connected with the term of “cognitive flow”.

The definition from The User Experience Professionals Association states the user experience as follows: “User experience (UX) is an approach to product development that incorporates direct user feedback throughout the development cycle (human-centered design) in order to reduce costs and create products and tools that meet user needs and have a high level of usability (are easy to use).” This definition emphasizes the users’ role in the process through the User/Human Centered design philosophy. It defines the whole product or service design and development process as a continuous circular process, where user product testing at each phase is very important. In this way problems can be found early on and solved, which allows for a more cost effective approach with a better final product.

Of course, to design something for the “user” one has to know who your users are. To achieve this goal first end target user groups should be defined, and then specific, but single virtual users in a form of personas should be created. Not all users have the same abilities; therefore a special attention should be given to the accessibility issues.

Finally, some general, but golden rules of good design approach exist: the user should always be in control as much as possible, the interface should adapt to the user and reduce the cognitive load as much as possible, the interface should be consistent, and finally, the product or service should be personal and adapt to the users’ needs, and be not only functional, but also easy and intuitive to use.

To illustrate these paradigms, five distinct real-life examples are given, how the UX design approach was used to create a more “human” product, service or content. These examples include lessons learnt from a TVWEB project; a national RTV mobile multimedia application; a project for the national Telecom operator with a goal of designing an interface for the e-health portal; UCD approach used for designing the new university multimedia programme; and finally, the World Usability Day conference event in Slovenia.

[Presentation]

HCI-IS 2014

Today we have successfully completed the HCI-IS 2014 conference. This was the 3rd event organised by the HCI.si community, an international conference on Human Computer Interaction in Information Society. The conference was organised in scope of Information Society Conference organised by Jožef Stefan Institute.

ijsair

(Foto: www.ijs.si)

There were seven contributions accepted to the conference and a keynote talk.

  • UX – From theory to practical application – Keynote
    (Jože Guna, Emilia Stojmenova, Matevž Pogačnik)
  • Multi-Touch surface based on RGBD camera
    (Klemen Istenič, Luka Čehovin, Daniel Skočaj)
  • Using Kinect for touchless interaction with existing applications
    (Andrej Černivec, Ciril Bohak)
  • An improved visualization of LiDAR data using level of details and weighted color mapping
    (Sašo Pečnik, Danijel Žlaus, Domen Mongus, Borut Žalik)
  • Student’ acceptance of animated interactive presentation of sorting algorithms
    (Mario Konecki, Vladimir Mrkela)
  • Use of UX and HCI tools among start-ups
    (Bojan Blažica)
  • Decision support in emergency call service
    (Miha Ristič, Franc Novak)
  • Mobile and responsive web applications
    (Mario Konecki)

Luka Čehovin presenting @ HCI-IS 2014

Evaluation of input devices for view manipulation in 3D space

Few weeks ago there Peter Škrlj has completed his Bachelor Thesis titled: Evaluation of input devices for view manipulation in 3D space.

The thesis is in Slovenian language and is accessible here. Below you can find a short abstract.

Abstract

As part of the thesis we have developed applications for the extension of the vein display with support for two additional navigation devices (3D Connexion Space Navigator Mouse and hand gesture based navigation device Leap Motion) which represented an extension of possible input devices besides the keyboard and a mouse to manipulate the view of 3D model of neck veins. In addition to the implementation of support for the device in the application we carried out a user study in which we assessed the usability and ease of use of devices in the application. The results consisted from data we collected from the users’ experience while they solved various manipulation tasks and the answers received from questionnaires SUS (System Usability Scale) which constitute one of the tools with which we can assess interfaces. Analysis of the results confirmed that the 3D mouse is more useful in such an environment and also highlighted some shortcomings of the hands free navigation device Leap Motion.

Using Leap Motion for touchless navigation in a web browser

In the context of Bachelor Thesis at the Faculty of Computer and Information Science, a student Miloš Vukov has developed a Chrome extension for Leap Motion. In this diploma thesis, a Chrome browser extension for touch-less navigation in a web browser was developed. The ready-made extension uses the Leap Motion sensor and enables internet browsing by navigating through the links and moving along the tabs with the help of gestures.

The results of thesis are available on-line:

For more information one can contact the author.