Please use this identifier to cite or link to this item: http://dx.doi.org/10.14279/depositonce-9363
Main Title: SITbench 1.0: A Novel Switch-Based Interaction Technique Benchmark
Author(s): Esiyok, Cagdas
Albayrak, Sahin
Type: Article
Is Supplemented By: 10.1155/2019/2304970
Language Code: en
Abstract: Evaluation process of a switch-based interaction technique (SIT) requires an interdisciplinary team effort and takes a considerable amount of time. Collecting subjective evaluation data from the users is a very common approach, but the subjective evaluation data alone might be manipulated and unreliable for comparing performances in many cases. Thus, therapists generally cannot succeed in determining the optimum SIT setup (i.e., determining the most appropriate combination of setup variables such as the switch type or switch site) at first attempts since it is hard to evaluate the measurable performance by collecting subjective data instead of objective data. Inevitably, each unsuccessful attempt to reach the optimum SIT setup results in a loss of serious time and effort. On the contrary, a benchmark application is also required to make performance evaluation of SITs by using a number of standard tests and empirical attributes. It is obvious that a quicker and more accurate SIT evaluation process provides a better cost and schedule management considering the increasing number of SIT users in the world. Therefore, we propose a novel benchmark for performance evaluation called SITbench that provides a quicker and more accurate switch evaluation process by collecting and saving the objective data automatically. We conducted a user study with eight participants and demonstrated that the objective data collected via the SITbench helped to determine the optimum SIT setup accurately. Result of a questionnaire applied to evaluate the SITbench itself was also satisfactory. SITbench is expected to help researchers and therapists to make a better evaluation according to any change done in SIT setup variables (switch type, activation method, etc.) with the aim of reaching the optimum SIT setup, which leads to a better cost and schedule management. As the first benchmark application compatible with all SITs, which can emulate keyboard characters or mouse clicks, it can be utilized by assistive technology professionals to make comparisons and evaluations automatically via standardized tests.
URI: https://depositonce.tu-berlin.de/handle/11303/10411
http://dx.doi.org/10.14279/depositonce-9363
Issue Date: 18-Aug-2019
Date Available: 28-Nov-2019
DDC Class: 005 Computerprogrammierung, Programme, Daten
Subject(s): switch-based interaction technique
SIT
SITbench
benchmark
testing
performance evaluation
Sponsor/Funder: DFG, 414044773, Open Access Publizieren 2019 - 2020 / Technische Universität Berlin
License: https://creativecommons.org/licenses/by/4.0/
Journal Title: Journal of Healthcare Engineering
Publisher: Hindawi
Publisher Place: Cairo [u.a.]
Article Number: 5075163
Publisher DOI: 10.1155/2019/5075163
EISSN: 2040-2309
ISSN: 2040-2295
Notes: An erratum for this article has been published in Journal of Healthcare Engineering, Volume 2019, Article ID 2304970, https://doi.org/10.1155/2019/2304970
Eine Korrektur zu diesem Artikel wurde publiziert in Journal of Healthcare Engineering, Volume 2019, Article ID 2304970, https://doi.org/10.1155/2019/2304970
Appears in Collections:FG Agententechnologien in betrieblichen Anwendungen und der Telekommunikation (AOT) » Publications

Files in This Item:
File Description SizeFormat 
5075163.pdfArticle5.41 MBAdobe PDFView/Open
correction.pdfCorrection1.29 MBAdobe PDFView/Open


This item is licensed under a Creative Commons License Creative Commons