Storage Resource Broker
 | This article may be unbalanced toward certain viewpoints. (May 2009) |
 |
Storage Resource Broker (SRB) is a data grid middleware software system produced by the Data Intensive Cyber Environments group (DICE) and commercialized by Nirvana that is operating in many national and international computational science research projects.
Depending on the "flavor" of the configuration, use patterns, and policies, the SRB creates what is called a data grid, a digital library, persistent archive, and/or distributed file system.
SRB provides a uniform interface to heterogeneous data storage resources over a network. As part of this, it implements a logical namespace (distinct from physical file names) and maintains metadata on data-objects (files), users, groups, resources, collections, and other items in an SRB Metadata Catalog (MCAT) stored in a relational database management system. System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of Unix, Linux, and Microsoft Windows.
The SRB system is middleware in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational database management system, etc) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.
SRB is sometimes used in conjunction with computational grid computing systems, such as Globus Alliance, and can utilize the Globus Alliance Grid Security Infrastructure (GSI) authentication system.
SRB can store and retrieve data in archival storage systems such as HPSS and SAM-FS, on disk file systems (Unix, Linux, or Windows), as Binary Large Objects or tabular data in relational database management systems, and on tape libraries.
The SRB has been used in production since 1997. Globally the SRB is estimated to be managing over two petabytes of data, as of 2008. That number is expected to grow at a rate of one petabyte a year. UCSD is currently managing over 1 petabyte of data in over 200 million files. Many other computer centers and consortia are independently managing additional SRB data collections.
While licensed, SRB source distributions are freely available to academic and non-profit organizations. A commercial version (which diverged from the DICE version in 2001) is also available by Nirvana.
See also
References
- Baru, C. (Nov 30-Dec 3, 1998). "The SDSC Storage Resource Broker". Proc. CASCON'98 Conference. Toronto, Canada: 5.
{{cite journal}}: Check date values in:|date=(help); Unknown parameter|coauthors=ignored (|author=suggested) (help) - Moore, R. (July 2006). "Building Preservation Environments with Data Grid Technology". American Archivist. 69 (1): 139–158.
- Moore, R. (April 2006). "Storage Resource Broker Global Data Grids". Fourteenth NASA Goddard / Twenty-third IEEE Conference on Mass Storage Systems and Technologies. NASA / IEEE MSST2006.
{{cite journal}}: Unknown parameter|coauthors=ignored (|author=suggested) (help) - Rajasekar, A. (May 2006). "A Prototype Rule-based Distributed Data Management System". HPDC workshop on Next Generation Distributed Data Management. Paris, France.
{{cite journal}}: Unknown parameter|coauthors=ignored (|author=suggested) (help) - Rajasekar, A. (March 2009). "Event Processing in Policy Oriented Data Grids". Proceedings of Intelligent Event Processing AAAI Spring Symposium. Stanford, California: 61–66.
{{cite journal}}: Unknown parameter|coauthors=ignored (|author=suggested) (help)