ABSTRACT

This chapter reviews evaluation methods and metrics useful for Human–Systems Integration (HSI). Evaluations require appropriate metrics related to technology, organizations, and people. Metrics should qualify, quantify, measure, and benchmark some kind of performance. HSI metrics are focused on the evaluation of human–machine systems. Systems engineering already provides techniques and organizational setups for technical management. Human-centered design (HCD) and HSI should be included in all processes including requirement engineering, technical planning, interconnectivity, and interoperability management; configuration management; risk management; and data management. Analysis of social and cultural factors requires an architecture model, which entails socio-cognitive and ethnographical evaluation methods and metrics. HSI should be started as early as possible during design and development project. Virtual HCD was already promoted to provide a playground for activity observation and analysis, formative evaluation, prototype refinement, and iteration until a satisfactory solution be found.