ABSTRACT
The reliable validation and verification of simulation models is a key challenge in computational engineering, especially for complex materials and multi-physics problems. Existing approaches are often computationally intensive and tailored to specific setups, making generalization and objective comparison across models and codes difficult. This paper presents a concept for a reproducible and extensible benchmarking platform designed for any FEM or CFD-based simulation setup, with concrete modeling as a motivating example.
The platform aims to facilitate data exchange between experimentalists and simulation researchers, enable transparent comparison of models and implementations, and support referencing models with quality criteria in engineering standards. Key components include a machine-readable database structure for experimental metadata, standardized calibration procedures, and quality metrics that account for uncertainties. The platform supports integration of open-source constitutive model libraries into commercial codes, promoting interoperability and community-driven benchmarking. A federated database infrastructure enables sharing and publication of experimental and simulation results, with full provenance tracking to ensure reproducibility. Interactive visualization tools allow users to query, explore, and compare models and results.
While the conceptual framework is well developed, a complete implementation is still in progress. Community contributions are needed to realize a broad set of benchmarks and develop tool-agnostic, machine-readable model definitions. The proposed platform aims to advance reproducibility, transparency, and robustness in computational modeling and simulation practice across engineering domains.
