ABSTRACT
Working Group . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103 3.4.5 Beyond WLCG: Data Management Use Cases in EGEE . . . . 104
3.5 Examples of Using File Streaming in Real Applications . . . . . . . . . . . . 105 3.5.1 Robust File Replication in the STAR Experiment . . . . . . . . . . . 105 3.5.2 The Earth System Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
3.6 Conclusions and Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
Dynamic storage space allocation is a feature that was not available for scientific applications. Therefore, scientific researchers usually assume that storage space is preallocated and that the application will have enough space for the input data required and the output data generated by the application. However, in modern computer systems that support large scientific simulations and analysis, this assumption is often false, and application programs often cannot complete the computation as a result of lack of storage space. Increases in computational power have only exacerbated this problem. Although the increased computational power has created the opportunity for new, more precise and complex scientific simulations that can lead to new scientific insights, such simulations and experiments generate ever-increasing volumes of data. The ability to allocate storage dynamically (on demand), to manage the content of the storage space, and to provide sharing of data between users are crucial requirements for conducting modern scientific explorations.
