Today scientific computational tasks are becoming more and more data-intensive and therefore in the Grid computing environment is important to have tools that easily integrate storage resources that provide high capacity, redundancy and scalability. Data movement and replication are also important functions to guarantee optimized access to files. Making storage resources shareable through the Grid middleware technology requires that those systems expose a uniform standard interface. The need for a homogeneous, transparent interface to storage leaded to the definition of the Storage Resource Manager (SRM) interface. Thus, space management for any storage manager implementation looks the same to a client. The StoRM project, a joint collaboration between CNAF/INAF, ICTP Egrid project and CERN, aims at implementing the SRM standard over parallel file systems like GPFS and Lustre. In this talk I will briefly discuss data managements tools developed within the most important European Grid projects and I will shortly present Storm and its features. I finally will discuss typical case studies where large data set produced by ab-initio simulations can be easily handled within computational grids with appropriated tools like the one described before.
Large Data set management tools in European Grid middleware
2005
Abstract
Today scientific computational tasks are becoming more and more data-intensive and therefore in the Grid computing environment is important to have tools that easily integrate storage resources that provide high capacity, redundancy and scalability. Data movement and replication are also important functions to guarantee optimized access to files. Making storage resources shareable through the Grid middleware technology requires that those systems expose a uniform standard interface. The need for a homogeneous, transparent interface to storage leaded to the definition of the Storage Resource Manager (SRM) interface. Thus, space management for any storage manager implementation looks the same to a client. The StoRM project, a joint collaboration between CNAF/INAF, ICTP Egrid project and CERN, aims at implementing the SRM standard over parallel file systems like GPFS and Lustre. In this talk I will briefly discuss data managements tools developed within the most important European Grid projects and I will shortly present Storm and its features. I finally will discuss typical case studies where large data set produced by ab-initio simulations can be easily handled within computational grids with appropriated tools like the one described before.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
