Data Reporting and Analysis
Measurement is an essential element of a product’s life cycle and the governance of an organization’s business. For a product, it starts at the initial planning phase and continues beyond the conclusion of development and manufacture of the deliverables. It covers the entire life cycle of a system—from concept to retirement. At the organizational level, it goes on continuously, with periodic reviews to ensure that the measurement program is efficient and effective, providing information that the organization needs to survive and grow. In previous chapters we discussed the identification of measurement goals and objectives and the associated definition of measures that it is necessary to collect. In this chapter we discuss designing a data collection and reporting system for data collected during development and testing, as well as from the field, following product shipment and installation. It expands on the material in Chapter 4 that focused on setting up and implementing a measurement program. The chapter discusses the operation of data reporting systems, the data analysis, the reporting on findings and consequences, and concerns related to product sustainment. * Field data reporting systems, sometimes called 300“field tracking systems” or “product performance surveys,” are discussed with an example in Section 8.5. In this section we also introduce an advanced reporting model based on a Bayesian statistical approach called Bayesian Estimates of the Current Mean (BECM). We conclude with a summary section.