Improving the usability of online usability surveys with an interactive Stripe scale

Matevž Pesek, Alja Isakovic, Gregor Strle, Matija Marolt
University of Ljubljana, Faculty of Computer and Information Science, Laboratory for Computer graphics and Multimedia, Večna Pot 113, 1000 Ljubljana, Slovenia

Abstract: The paper introduces Stripe, an interactive continuous scale for online surveys that makes it easy to compare multiple answers on a single screen. The Stripe is evaluated as an alternative to the n-point Likert scale, which is commonly used in online usability questionnaires like the System Usability Scale (SUS). The paper presents the results of a user study, which confirmed the validity of results gained with the proposed Stripe interface by applying both the Stripe and the Likert interface to an online SUS questionnaire. Additionally, the results of our study show that the participants favor the Stripe interface in terms of intuitiveness and ease of use, and even perceive the Stripe interface as less time consuming than the standard Likert scaled interface based on radio buttons.


Full paper: link

Redesign of Slovenian Avalanche Bulletin

Vanja Blažica, Janez Jaka Cerar, Aleš Poredoš
Slovenian Environment Agency, Vojkova 1b, 1000 Ljubljana, Slovenia

Abstract: We present the redesign of the Slovenian avalanche bulletin, published regularly during the winter season to warn against avalanche danger and to provide specific information for advanced users. The former version included an estimation of danger on a scale from one to five with supporting text for the whole country, while the new one offers an additional graphical description, specified for several geographical regions. The redesign profoundly influenced the work of avalanche forecasters by introducing a new interface, additional input and database storage. At the same time, users welcomed the additional information, international comparability and user friendliness of the new bulletin.


Full paper: link

The SUS-SI questionnaire

Another article by the members of our community has been published: “A Slovene Translation of the System Usability Scale: The SUS-SI” in the International Journal f Human-Computer Interaction journal.

Abstract: The System Usability Scale (SUS) is a widely adopted and studied questionnaire for usability evaluation. It is technology independent and has been used to evaluate the perceived usability of a broad range of products, including hardware, software, and websites. In this paper we present a Slovene translation of the SUS (the SUS-SI) along with the procedure used in its translation and psychometric evaluation. The results indicated that the SUS-SI has properties similar to the English version. Slovene usability practitioners should be able to use the SUS-SI with confidence when conducting user research.

50 free e-prints available here.

SUS (original questionnaire):

  1. I think that I would like to use this system frequently.
  2. I found the system unnecessarily complex.
  3. I thought the system was easy to use.
  4. I think that I would need the support of a technical person to be able to use this system.
  5. I found the various functions in this system were well integrated.
  6. I thought there was too much inconsistency in this system.
  7. I would imagine that most people would learn to use this system very quickly.
  8. I found the system very cumbersome/awkward to use.
  9. I felt very confident using the system.
  10. I needed to learn a lot of things before I could get going with this system.

The anchors: strongly agree 1 2 3 4 5 strongly disagree

SUS-SI (Slovene translation):

  1. Menim, da bi ta sistem rad pogosto uporabljal.
  2. Sistem se mi je zdel po nepotrebnem zapleten.
  3. Sistem se mi je zdel enostaven za uporabo.
  4. Menim, da bi za uporabo tega sistema potreboval pomoč tehnika.
  5. Različne funkcije tega sistema so se mi zdele dobro povezane v smiselno celoto.
  6. Sistem se mi je zdel preveč nekonsistenten.
  7. Menim, da bi se večina uporabnikov zelo hitro naučila uporabljati ta sistem.
  8. Sistem se mi je zdel neroden za uporabo.
  9. Pri uporabi sistema sem bil zelo suveren.
  10. Preden sem osvojil uporabo tega sistema, sem se moral naučiti veliko stvari.

The anchors: sploh se ne strinjam 1 2 3 4 5 se povsem strinjam

Pre-filled Google forms (SUS and SUS-SI):
In a survey published not long ago, we found out that usability testing is not so widespread as it should be given its importance. So to jump start your usability evaluations, we’ve prepared Google forms with the questionnaires, both English (SUS) and Slovene (SUS-SI). Feel free to use them, just make sure to make your personal copy before (to keep this links clean).

We’d like to thank all who contributed to the translation and validation of the questionnaire with comments and/or filling out the survey. Special thanks goes to James R. Lewis, author of Quantifying the user experience and many influential papers in the areas of usability testing and measurement. He ‘warmly replied to a cold email’ and helped a great deal with the psychometric validation of the translation and co-authored the paper. A truly beautiful academic experience.

Blažica, Bojan, and James R. Lewis. “A Slovene Translation of the System Usability Scale: The SUS-SI.” International Journal of Human-Computer Interaction Vol. 31, Iss. 2, 2015.


Prevod vprašalnika SUS

Rad bi validiral prevod vprašalnika za merjenje uporabniške prijaznosti različnih sistemov – System Usability Scale – za kar potrebujem kup odgovorov, vsaj 200, na spodnjo anketo:

Prosim, če anketo izpolnite v čim večjem številu in jo po možnosti posredujete dalje. Odgovarjajo lahko vsi, ki jim je slovenščina materni jezik in uporabljajo Gmail. Vse skupaj vzame par minut.

Po opravljeni validaciji bo prevod s kratkimi navodili za uporabo dostopen na tej strani.