Jump to content

Data farming: Difference between revisions

From Wikipedia, the free encyclopedia
Browse history interactively
← Previous editNext edit →
Content deleted Content added
VisualWikitext
Pjsanchez (talk | contribs)
14 edits
m →History: Added link to Maui HPCC
Yobot (talk | contribs)
Bots
4,733,870 edits
m WP:CHECKWIKI error fixes using AWB
Line 5: Line 5:
Miners seek valuable nuggets of ore buried in the earth, but have no control over what is out there or how hard it is to extract the nuggets from their surroundings. ... Similarly, data miners seek to uncover valuable nuggets of information buried within massive amounts of data. Data-mining techniques use statistical and graphical measures to try to identify interesting correlations or clusters in the data set.
Miners seek valuable nuggets of ore buried in the earth, but have no control over what is out there or how hard it is to extract the nuggets from their surroundings. ... Similarly, data miners seek to uncover valuable nuggets of information buried within massive amounts of data. Data-mining techniques use statistical and graphical measures to try to identify interesting correlations or clusters in the data set.


Farmers cultivate the land to maximize their yield. They manipulate the environment to their advantage using irrigation, pest control, crop rotation, fertilizer, and more. Small-scale designed experiments let them determine whether these treatments are effective. Similarly, data farmers manipulate simulation models to their advantage, using large-scale designed experimentation to grow data from their models in a manner that easily lets them extract useful information. ...the results can reveal root cause-and-effect relationships between the model input factors and the model responses, in addition to rich graphical and statistical views of these relationships.<ref>{{cite journal|last1=Lucas|first1=T. W.|last2=Kelton|first2=W. D.|last3=Sanchez|first3=P. J.|last4=Sanchez|first4=S. M.|last5=Anderson|first5=B. L.|title=Changing the Paradigm: Simulation, Now a Method of First Resort|journal=Naval Research Logistics|date=2015|volume=62|issue=4|pages=293-305|doi=10.1002/nav.21628}}</ref>
Farmers cultivate the land to maximize their yield. They manipulate the environment to their advantage using irrigation, pest control, crop rotation, fertilizer, and more. Small-scale designed experiments let them determine whether these treatments are effective. Similarly, data farmers manipulate simulation models to their advantage, using large-scale designed experimentation to grow data from their models in a manner that easily lets them extract useful information. ...the results can reveal root cause-and-effect relationships between the model input factors and the model responses, in addition to rich graphical and statistical views of these relationships.<ref>{{cite journal|last1=Lucas|first1=T. W.|last2=Kelton|first2=W. D.|last3=Sanchez|first3=P. J.|last4=Sanchez|first4=S. M.|last5=Anderson|first5=B. L.|title=Changing the Paradigm: Simulation, Now a Method of First Resort|journal=Naval Research Logistics|date=2015|volume=62|issue=4|pages=293–305|doi=10.1002/nav.21628}}</ref>
</blockquote>
</blockquote>


A NATO modeling and simulation task group has documented the data farming process in the [https://www.cso.nato.int/Pubs/rdp.asp?RDP=STO-TR-MSG-088 Final Report of MSG-088].
A NATO modeling and simulation task group has documented the data farming process in the [https://www.cso.nato.int/Pubs/rdp.asp?RDP=STO-TR-MSG-088 Final Report of MSG-088].
Here, data farming uses collaborative processes in combining rapid scenario prototyping, simulation modeling, design of experiments, high performance computing, and analysis and visualization in an iterative [http://www.datafarming.org/Data_Farming/Welcome.html loop-of-loops].
Here, data farming uses collaborative processes in combining rapid scenario prototyping, simulation modeling, design of experiments, high performance computing, and analysis and visualization in an iterative [http://www.datafarming.org/Data_Farming/Welcome.html loop-of-loops].


==History==
==History==
The science of [[Design of Experiments]] (DOE) has been around for over a century, pioneered by [[R.A. Fisher]] for agricultural studies. Many of the classic experiment designs can be used in simulation studies. However, computational experiments have far fewer restrictions than do real-world experiments, in terms of costs, number of factors, time required, ability to replicate, ability to automate, etc. Consequently, a framework specifically oriented toward large-scale simulation experiments is warranted.
The science of [[Design of Experiments]] (DOE) has been around for over a century, pioneered by [[R.A. Fisher]] for agricultural studies. Many of the classic experiment designs can be used in simulation studies. However, computational experiments have far fewer restrictions than do real-world experiments, in terms of costs, number of factors, time required, ability to replicate, ability to automate, etc. Consequently, a framework specifically oriented toward large-scale simulation experiments is warranted.


People have been conducting computational experiments for as long as computers have been around. The term “data farming” is more recent, coined in 1998<ref>{{cite journal|last1=Brandstein|first1=A.|last2=Horne|first2=G.|title=Data Farming: A Meta-Technique for Research in the 21<sup>st</sup> Century|journal=Maneuver Warfare Science|date=1998|publisher=Marine Corps Combat Development Command|location=Quantico, VA}}</ref> in conjunction with the Marine Corp’s [http://projectalbert.org Project Albert], in which small agent-based distillation models (a type of stochastic simulation) were created to capture specific military challenges. These models were run thousands or millions of times at the [https://www.mhpcc.hpc.mil/ Maui High Performance Computer Center] and other facilities. Project Albert analysts would work with the military subject matter experts to refine the models and interpret the results.
People have been conducting computational experiments for as long as computers have been around. The term “data farming” is more recent, coined in 1998<ref>{{cite journal|last1=Brandstein|first1=A.|last2=Horne|first2=G.|title=Data Farming: A Meta-Technique for Research in the 21st Century|journal=Maneuver Warfare Science|date=1998|publisher=Marine Corps Combat Development Command|location=Quantico, VA}}</ref> in conjunction with the Marine Corp’s [http://projectalbert.org Project Albert], in which small agent-based distillation models (a type of stochastic simulation) were created to capture specific military challenges. These models were run thousands or millions of times at the [https://www.mhpcc.hpc.mil/ Maui High Performance Computer Center] and other facilities. Project Albert analysts would work with the military subject matter experts to refine the models and interpret the results.


Initially, the use of brute-force [[Factorial experiment|full factorial]] (gridded) designs meant that the simulations needed to run very quickly and the studies required [[high-performance computing]]. Even so, only a small number of factors (at a limited number of levels) could be investigated, due to the [[curse of dimensionality]].
Initially, the use of brute-force [[Factorial experiment|full factorial]] (gridded) designs meant that the simulations needed to run very quickly and the studies required [[high-performance computing]]. Even so, only a small number of factors (at a limited number of levels) could be investigated, due to the [[curse of dimensionality]].


The [http://harvest.nps.edu SEED Center for Data Farming] at the [http://www.nps.edu/ Naval Postgraduate School] also worked closely with Project Albert in model generation, output analysis, and the creation of new [[Design of experiments|experimental designs]] to better leverage the computing capabilities at Maui and other facilities. Recent breakthroughs in designs specifically developed for data farming can be found in
The [http://harvest.nps.edu SEED Center for Data Farming] at the [http://www.nps.edu/ Naval Postgraduate School] also worked closely with Project Albert in model generation, output analysis, and the creation of new [[Design of experiments|experimental designs]] to better leverage the computing capabilities at Maui and other facilities. Recent breakthroughs in designs specifically developed for data farming can be found in
<ref>{{cite journal|last1=Kleijnen|first1=J. P. C.|last2=Sanchez|first2=S. M.|last3=Lucas|first3=T. W.|last4=Cioppa|first4=T. M.|title=A User's Guide to the Brave New World of Designing Simulation Experiments|journal=INFORMS Journal on Computing|date=2005|volume=17|issue=3|pages=263-289}}</ref>
<ref>{{cite journal|last1=Kleijnen|first1=J. P. C.|last2=Sanchez|first2=S. M.|last3=Lucas|first3=T. W.|last4=Cioppa|first4=T. M.|title=A User's Guide to the Brave New World of Designing Simulation Experiments|journal=INFORMS Journal on Computing|date=2005|volume=17|issue=3|pages=263–289}}</ref>
<ref>{{cite journal|last1=Sanchez|first1=S. M.|last2=Wan|first2=H.|title=Work Smarter, Not Harder: A Tutorial on Designing and Conducting Simulation Experiments|journal=Proceedings of the 2015 Winter Simulation Conference|date=2015|pages=1795-1809|url=http://www.informs-sim.org/wsc15papers/187.pdf|publisher=Institute of Electrical and Electronic Engineers, Inc.|location=Piscataway, NJ}}</ref>,
,<ref>{{cite journal|last1=Sanchez|first1=S. M.|last2=Wan|first2=H.|title=Work Smarter, Not Harder: A Tutorial on Designing and Conducting Simulation Experiments|journal=Proceedings of the 2015 Winter Simulation Conference|date=2015|pages=1795–1809|url=http://www.informs-sim.org/wsc15papers/187.pdf|publisher=Institute of Electrical and Electronic Engineers, Inc.|location=Piscataway, NJ}}</ref>
among others.
among others.


==Workshops==
==Workshops==
A series of [http://www.datafarming.org/Data_Farming/Workshops.html data farming workshops] have been held since the late 1990s, under various names and sponsorships .
A series of [http://www.datafarming.org/Data_Farming/Workshops.html data farming workshops] have been held since the late 1990s, under various names and sponsorships .


==References==
==References==
Line 35: Line 35:
* An article summarizing data farming in the [http://www.afcea.org/signal/articles/templates/SIGNAL_Article_Template.asp?articleid=975&zoneid=158 June 2005 issue of SIGNAL]
* An article summarizing data farming in the [http://www.afcea.org/signal/articles/templates/SIGNAL_Article_Template.asp?articleid=975&zoneid=158 June 2005 issue of SIGNAL]
* [http://www.informs-sim.org/wsc04papers/100.pdf MITRE Corporation research paper on data farming]
* [http://www.informs-sim.org/wsc04papers/100.pdf MITRE Corporation research paper on data farming]






{{DEFAULTSORT:Data Farming}}
{{DEFAULTSORT:Data Farming}}

Revision as of 07:51, 22 October 2016

Data farming is the process of using designed computational experiments to “grow” data, which can then be analyzed using statistical and visualization techniques to obtain insight into complex systems. These methods can be applied to any computational model.

Data farming differs from Data mining, as the following metaphors indicate:

Miners seek valuable nuggets of ore buried in the earth, but have no control over what is out there or how hard it is to extract the nuggets from their surroundings. ... Similarly, data miners seek to uncover valuable nuggets of information buried within massive amounts of data. Data-mining techniques use statistical and graphical measures to try to identify interesting correlations or clusters in the data set.

Farmers cultivate the land to maximize their yield. They manipulate the environment to their advantage using irrigation, pest control, crop rotation, fertilizer, and more. Small-scale designed experiments let them determine whether these treatments are effective. Similarly, data farmers manipulate simulation models to their advantage, using large-scale designed experimentation to grow data from their models in a manner that easily lets them extract useful information. ...the results can reveal root cause-and-effect relationships between the model input factors and the model responses, in addition to rich graphical and statistical views of these relationships.[1]

A NATO modeling and simulation task group has documented the data farming process in the Final Report of MSG-088. Here, data farming uses collaborative processes in combining rapid scenario prototyping, simulation modeling, design of experiments, high performance computing, and analysis and visualization in an iterative loop-of-loops.

History

The science of Design of Experiments (DOE) has been around for over a century, pioneered by R.A. Fisher for agricultural studies. Many of the classic experiment designs can be used in simulation studies. However, computational experiments have far fewer restrictions than do real-world experiments, in terms of costs, number of factors, time required, ability to replicate, ability to automate, etc. Consequently, a framework specifically oriented toward large-scale simulation experiments is warranted.

People have been conducting computational experiments for as long as computers have been around. The term “data farming” is more recent, coined in 1998[2] in conjunction with the Marine Corp’s Project Albert, in which small agent-based distillation models (a type of stochastic simulation) were created to capture specific military challenges. These models were run thousands or millions of times at the Maui High Performance Computer Center and other facilities. Project Albert analysts would work with the military subject matter experts to refine the models and interpret the results.

Initially, the use of brute-force full factorial (gridded) designs meant that the simulations needed to run very quickly and the studies required high-performance computing. Even so, only a small number of factors (at a limited number of levels) could be investigated, due to the curse of dimensionality.

The SEED Center for Data Farming at the Naval Postgraduate School also worked closely with Project Albert in model generation, output analysis, and the creation of new experimental designs to better leverage the computing capabilities at Maui and other facilities. Recent breakthroughs in designs specifically developed for data farming can be found in [3] ,[4] among others.

Workshops

A series of data farming workshops have been held since the late 1990s, under various names and sponsorships .

References

  1. ^ Lucas, T. W.; Kelton, W. D.; Sanchez, P. J.; Sanchez, S. M.; Anderson, B. L. (2015). "Changing the Paradigm: Simulation, Now a Method of First Resort". Naval Research Logistics. 62 (4): 293–305. doi:10.1002/nav.21628.
  2. ^ Brandstein, A.; Horne, G. (1998). "Data Farming: A Meta-Technique for Research in the 21st Century". Maneuver Warfare Science. Quantico, VA: Marine Corps Combat Development Command.
  3. ^ Kleijnen, J. P. C.; Sanchez, S. M.; Lucas, T. W.; Cioppa, T. M. (2005). "A User's Guide to the Brave New World of Designing Simulation Experiments". INFORMS Journal on Computing. 17 (3): 263–289.
  4. ^ Sanchez, S. M.; Wan, H. (2015). "Work Smarter, Not Harder: A Tutorial on Designing and Conducting Simulation Experiments" (PDF). Proceedings of the 2015 Winter Simulation Conference. Piscataway, NJ: Institute of Electrical and Electronic Engineers, Inc.: 1795–1809.
Retrieved from "https://en.wikipedia.org/enwiki/w/index.php?title=Data_farming&oldid=745622154"