Jump to content

Storage Resource Broker

Add links
From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Khazar2 (talk | contribs) at 01:26, 27 June 2013 (removing POV tag with no active discussion per Template:POV). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Storage Resource Broker (SRB) is a Data Grid Management System (DGMS) operating in many U.S. and international computational science research projects. SRB is a logical distributed file system based on a client-server architecture which presents users with a single global logical namespace or file hierarchy.[1]

Depending on the "flavor" of the configuration, use patterns, and policies, the SRB creates what is called a data grid, a digital library, persistent archive, and/or distributed file system.

SRB provides a uniform interface to heterogeneous data storage resources over a network. As part of this, it implements a logical namespace (distinct from physical file names) and maintains metadata on data-objects (files), users, groups, resources, collections, and other items in an SRB Metadata Catalog (MCAT) stored in a relational database management system. System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of Unix, Linux, and Microsoft Windows.

The SRB system is middleware in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational database management system, etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.

SRB is sometimes used in conjunction with computational grid computing systems, such as Globus Alliance, and can utilize the Globus Alliance Grid Security Infrastructure (GSI) authentication system.

SRB can store and retrieve data in archival storage systems such as HPSS and SAM-FS, on disk file systems (Unix, Linux, or Windows), as binary large objects or tabular data in relational database management systems, and on tape libraries.

The SRB has been used in production since 1997. Globally the SRB is estimated to be managing over two petabytes of data, as of 2008. That number is expected to grow at a rate of one petabyte a year. UCSD is currently managing over 1 petabyte of data in over 200 million files. Many other computer centers and consortia are independently managing additional SRB data collections.

While licensed, SRB source distributions are freely available to academic and non-profit organizations. Nirvana SRB, a commercial version of SRB, features capabilities specifically adapted to government and commercial use.[2]

The integrated Rule-based Data management System (iRODS) is a follow-on project of the SDSC SRB team (which is now the Data Intensive Cyber Environments (DICE) group), and now largely replaces the use SDSC SRB in research and academic communities. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable Rule Engine at its core and is fully open source.

History

SRB development began in 1995, through the cooperative efforts of General Atomics, the Data Intensive Cyber Environments Group (DICE), and the San Diego Supercomputer Center (SDSC) at the University of California, San Diego (UCSD) with the support of the National Science Foundation (NSF).

SRB software, or middleware, builds on the work of Dr. Reagan Moore. Dr. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, has been with the San Diego Supercomputer Center since its inception.[3]

In 2003, General Atomics was granted an exclusive license from UCSD to further develop the capabilities of SRB for use in commercial applications.[4]

See also

References

  1. ^ "SRB web site", accessed 22 Feb 2010
  2. ^ "Nirvana Storage web site", accessed 22 Feb 2010"
  3. ^ "San Diego Business Journal", 29 Sept 2003
  4. ^ "General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software, "SRB"", 22 Sep 2003"
  • Baru, C. (Nov 30-Dec 3, 1998). "The SDSC Storage Resource Broker". Proc. CASCON'98 Conference. Toronto, Canada: 5. {{cite journal}}: Check date values in: |date= (help); Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Moore, R. (July 2006). "Building Preservation Environments with Data Grid Technology". American Archivist. 69 (1): 139–158.
  • Moore, R. (April 2006). "Storage Resource Broker Global Data Grids". Fourteenth NASA Goddard / Twenty-third IEEE Conference on Mass Storage Systems and Technologies. NASA / IEEE MSST2006. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Rajasekar, A. (May 2006). "A Prototype Rule-based Distributed Data Management System". HPDC workshop on Next Generation Distributed Data Management. Paris, France. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Rajasekar, A. (March 2009). "Event Processing in Policy Oriented Data Grids". Proceedings of Intelligent Event Processing AAAI Spring Symposium. Stanford, California: 61–66. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
Retrieved from "https://en.wikipedia.org/enwiki/w/index.php?title=Storage_Resource_Broker&oldid=561757283"