Usability evaluation in virtual and real world indoor scenarios.
UAVR, M6 to 46
This WP must, first of all, result in a set of recommendations (guidelines) extracted from the relevant literature concerning usability in multimodal interfaces design which the remaining partners can use as a reference when conducting their design and development tasks. The evaluation scenarios and features to evaluate should then be identified and the evaluation protocols defined, tested and applied. Considering the unpredictable nature of some of the solutions proposed on the other WPs, evaluation scenarios and protocols might need readjustments along the way. The framework that will be provided after WP7 will allow gathering objective data to characterize user attention, reactions and cognitive load and will support its integration in the usability studies.
HCI experts participating in the project will prepare satisfaction questionnaires and conduct the reviews based on performance analyses, in particular, efficiency and effectivity that will be measured through reaction times, gesture analysis where applicable, and eye tracking. The eye tracking data will be collected by a non-intrusive eye tracker. Where applicable, the brain imaging data will be collected by fNIRS optical imaging facility, which is also a non-intrusive data collection equipment. The experimental investigations will aim at developing a Quality of Experience (QoE) model based on objective measures.
All feedback will be collected through questionnaires and non-invasive technologies such as eye-tracking developed and described in WP7.
The participants profile and their level of impairment is going to be defined in WP1 and it is foreseen to have a psychologist reviewing the experimental protocols and monitoring these studies. Regular pauses and short duration sessions, for example, will be considered whenever deemed necessary, so that no mental/physical stress is caused on participants. This is also valuable, in the methodological point of view, since a relaxed and stress free participant is a very important condition to attain better evaluation results. The conducted studies will also be previously approved by ethical committees of each country and comply with national and EU legislation, and FP7 rules.