ABSTRACT
Introduction ......................................................................................................... 134 Overview of Usability Evaluation Methodology ........................................... 135
Process Evaluation of Domain Service ................................................... 136 Evaluation of the Existing Information Systems ................................... 136 Identification of Decision Paths and Actions That Can Benefit
from Increasingly Complex Systems ........................................... 137 Implementation .......................................................................................... 137
Usability Evaluation of Increasingly Complex Systems in Health Care ..... 138 Usability Evaluation Techniques ............................................................. 138 Design of the System ................................................................................. 138 ASUR Model of the System ...................................................................... 140 Overview of Evaluation Results .............................................................. 140
Usability Evaluation in Increasingly Complex Systems for Project Portfolio Management .............................................................................. 142 Tasks and Activities in Project Portfolio Management ......................... 144 Increasingly Complex Systems for Project Portfolio Management .... 145 Continuous Evaluation of PPM Systems ................................................ 146 Experimental Usability Evaluation ......................................................... 149 Assumptions ............................................................................................... 150 Domain Services of an Increasingly Complex PPM System ................ 151 Service Coverage ........................................................................................ 151
Conclusion ........................................................................................................... 153 Reader Take-Aways ............................................................................................ 153 References ............................................................................................................. 154
Current trends in usability evaluation research focus on providing the right mix of empirical and technical methods. This chapter presents an approach for continuous evaluation of increasingly complex systems based on such a mix. The approach is iterative and covers usability aspects continuously throughout the following phases: (1) evaluation of existing tasks and processes within the specific domain service; (2) evaluation of the information systems that currently support the service; (3) identification of decision paths and actions (together with interaction patterns) that can benefit from a more complex system; as well as (4) design and implementation of the complex system, with focus on usability and integration. The verification of the approach was conducted in two complex application domains-health care, more specifically clinical environments, and industrial engineering, more specifically project portfolio management.
