Jump to content

Storage Resource Broker: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
start phrasing in past tense?
start on citations
Line 1: Line 1:
{{Multiple issues|technical = September 2011|refimprove = May 2009}}
{{Multiple issues|technical = September 2011|refimprove = May 2009}}


'''Storage Resource Broker (SRB)''' was a [[Data Grid]] Management System (DGMS) used in [[computational science]] research projects. SRB is a logical distributed file system based on a client-server architecture which presents users with a single global logical namespace or file hierarchy.<ref>[http://www.sdsc.edu/srb/index.php/What_is_the_SRB "SRB web site", accessed 22 Feb 2010]</ref>
'''Storage Resource Broker (SRB)''' was [[data grid]] management [[computer software]] used in [[computational science]] research projects. SRB is a logical distributed [[file system]] based on a [[client-server architecture]] which presents users with a single global logical namespace or file hierarchy.<ref>{{Cite web |title= What is the SRB |url= http://www.sdsc.edu/srb/index.php/What_is_the_SRB |work= SRB wiki |date= 16 May 2006 |accessdate= 17 July 2013 }}</ref>

SRB creates what is called a [[data grid]], a [[digital library]], persistent archive, and/or distributed [[file system]].


==Description==
==Description==
SRB provides a uniform interface to heterogeneous data storage resources over a network. As part of this, it implements a logical [[Namespace (computer science)|namespace]] (distinct from physical file names) and maintains metadata on data-objects (files), users, groups, resources, collections, and other items in an SRB Metadata Catalog (MCAT) stored in a relational [[database management system]]. System and user-defined [[metadata (computing)|metadata]] can be queried to locate files based on attributes as well as by name. SRB runs on various versions of [[Unix]], [[Linux]], and [[Microsoft Windows]].
SRB provides a uniform interface to heterogeneous [[computer data storage]] resources over a network. As part of this, it implements a logical [[Namespace (computer science)|namespace]] (distinct from physical file names) and maintains [[metadata]] on data-objects (files), users, groups, resources, collections, and other items in an SRB Metadata Catalog (MCAT) stored in a relational [[database management system]]. System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of [[Unix]], [[Linux]], and [[Microsoft Windows]].


The SRB system is [[middleware]] in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational [[database management system]], etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.
The SRB system is [[middleware]] in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational [[database management system]], etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.
Line 21: Line 19:
SRB development began in 1995, through the cooperative efforts of [[General Atomics]], the Data Intensive Cyber Environments Group (DICE), and the [[San Diego Supercomputer Center]] (SDSC) at the [[University of California, San Diego]] (UCSD) with the support of the [[National Science Foundation]] (NSF).
SRB development began in 1995, through the cooperative efforts of [[General Atomics]], the Data Intensive Cyber Environments Group (DICE), and the [[San Diego Supercomputer Center]] (SDSC) at the [[University of California, San Diego]] (UCSD) with the support of the [[National Science Foundation]] (NSF).


SRB software, or middleware, builds on the work of Reagan Moore. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, has been with the San Diego Supercomputer Center since its inception.<ref>[http://findarticles.com/p/articles/mi_hb5247/is_39_24/ai_n29033639/ "San Diego Business Journal", 29 Sept 2003]</ref>
SRB builds on the work of Reagan Moore. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, joined the San Diego Supercomputer Center at its inception.<ref>[http://findarticles.com/p/articles/mi_hb5247/is_39_24/ai_n29033639/ "San Diego Business Journal", 29 September 2003]{{Dead link |date= July 2013}}</ref>
A project for a distributed object computation testbed was funded by [[DARPA]] and the [[US Patent and Trademark Office]] in 1998 and 1999.<ref>{{Cite web |title= Digging Into Data: Q&A with Reagan Moore |work= SDSC web site |url= http://www.sdsc.edu/profile/rmoore.html |accessdate= 17 July 2013 }}</ref>


In 2003, [[General Atomics]] was granted an exclusive license from UCSD to further develop the capabilities of SRB for use in commercial applications.<ref>[http://www.ga.com/news.php?read=1&id=135&page=9 "General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software, "SRB"", 22 Sep 2003"]</ref>
In 2003, [[General Atomics]] was granted an exclusive license from UCSD to develop SRB for commercial applications.<ref>[http://www.ga.com/news.php?read=1&id=135&page=9 "General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software, "SRB"", 22 Sep 2003"]</ref>


The integrated Rule-based Data management System (iRODS) is a follow-on project of the SDSC SRB team (which became the Data Intensive Cyber Environments group), and largely replaced the use of SRB. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable rule engine at its core and is fully open source.
The integrated Rule-based Data management System (iRODS) is a follow-on project of the SDSC SRB team (which became the Data Intensive Cyber Environments group), and largely replaced the use of SRB. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable rule engine at its core and is fully open source.
Line 39: Line 38:
*[http://srb.diceresearch.org DICE Storage Resource Broker (SRB)]
*[http://srb.diceresearch.org DICE Storage Resource Broker (SRB)]
*[http://www.nirvanastorage.com Nirvana Storage Resource Broker (SRB)]
*[http://www.nirvanastorage.com Nirvana Storage Resource Broker (SRB)]
*[http://www.sun.com/storagetek/management_software/data_management/sam/index.xml Sun StorageTek SAM-FS]
*[http://www.hpss-collaboration.org High Performance Storage System HPSS]
*[http://www.hpss-collaboration.org High Performance Storage System HPSS]
*[https://www.irods.org/index.php/iRODS_V1.0 iRODS: integrated Rule-based Data System, based on SDSC SRB concepts]
*[https://www.irods.org/index.php/iRODS_V1.0 iRODS: integrated Rule-based Data System, based on SDSC SRB concepts]

Revision as of 22:15, 17 July 2013

Storage Resource Broker (SRB) was data grid management computer software used in computational science research projects. SRB is a logical distributed file system based on a client-server architecture which presents users with a single global logical namespace or file hierarchy.[1]

Description

SRB provides a uniform interface to heterogeneous computer data storage resources over a network. As part of this, it implements a logical namespace (distinct from physical file names) and maintains metadata on data-objects (files), users, groups, resources, collections, and other items in an SRB Metadata Catalog (MCAT) stored in a relational database management system. System and user-defined metadata can be queried to locate files based on attributes as well as by name. SRB runs on various versions of Unix, Linux, and Microsoft Windows.

The SRB system is middleware in the sense that it is built on top of other major software packages (various storage systems, real-time data sources, a relational database management system, etc.) and it has callable library functions that can be utilized by higher level software. However, it is more complete than many middleware software systems as it implements a comprehensive distributed data management environment, including various end-user client applications. It has features to support the management and collaborative (and controlled) sharing, publication, replication, transfer, and preservation of distributed data collections.

SRB is sometimes used in conjunction with computational grid computing systems, such as Globus Alliance, and can utilize the Globus Alliance Grid Security Infrastructure (GSI) authentication system.

SRB can store and retrieve data in archival storage systems such as HPSS and SAM-FS, on disk file systems (Unix, Linux, or Windows), as binary large objects or tabular data in relational database management systems, and on tape libraries.

SRB was used since 1997. In 2008 the SRB was estimated to be managing over two petabytes of data.

While licensed, SRB source distributions are freely available to academic and non-profit organizations. Nirvana SRB, a commercial version of SRB, features capabilities specifically adapted to government and commercial use.[2]

History

SRB development began in 1995, through the cooperative efforts of General Atomics, the Data Intensive Cyber Environments Group (DICE), and the San Diego Supercomputer Center (SDSC) at the University of California, San Diego (UCSD) with the support of the National Science Foundation (NSF).

SRB builds on the work of Reagan Moore. Moore, a doctorate in plasma physics from UCSD and former computational plasma physicist at General Atomics, joined the San Diego Supercomputer Center at its inception.[3] A project for a distributed object computation testbed was funded by DARPA and the US Patent and Trademark Office in 1998 and 1999.[4]

In 2003, General Atomics was granted an exclusive license from UCSD to develop SRB for commercial applications.[5]

The integrated Rule-based Data management System (iRODS) is a follow-on project of the SDSC SRB team (which became the Data Intensive Cyber Environments group), and largely replaced the use of SRB. iRODS is based on SRB concepts but was completely re-written, includes a highly-configurable rule engine at its core and is fully open source.

References

  1. ^ "What is the SRB". SRB wiki. 16 May 2006. Retrieved 17 July 2013.
  2. ^ "Nirvana Storage web site", accessed 22 Feb 2010"
  3. ^ "San Diego Business Journal", 29 September 2003[dead link]
  4. ^ "Digging Into Data: Q&A with Reagan Moore". SDSC web site. Retrieved 17 July 2013.
  5. ^ "General Atomics Acquires Exclusive License from UCSD for Commercialization of Unique Data Management Software, "SRB"", 22 Sep 2003"
  • Baru, C. (Nov 30-Dec 3, 1998). "The SDSC Storage Resource Broker". Proc. CASCON'98 Conference. Toronto, Canada: 5. {{cite journal}}: Check date values in: |date= (help); Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Moore, R. (July 2006). "Building Preservation Environments with Data Grid Technology". American Archivist. 69 (1): 139–158.
  • Moore, R. (April 2006). "Storage Resource Broker Global Data Grids". Fourteenth NASA Goddard / Twenty-third IEEE Conference on Mass Storage Systems and Technologies. NASA / IEEE MSST2006. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Rajasekar, A. (May 2006). "A Prototype Rule-based Distributed Data Management System". HPDC workshop on Next Generation Distributed Data Management. Paris, France. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Rajasekar, A. (March 2009). "Event Processing in Policy Oriented Data Grids". Proceedings of Intelligent Event Processing AAAI Spring Symposium. Stanford, California: 61–66. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)