Jump to content

Design-based research: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
Wesn (talk | contribs)
Related works: cronbach & snow added
AnomieBOT (talk | contribs)
m Dating maintenance tags: {{Cn}}
 
(48 intermediate revisions by 31 users not shown)
Line 1: Line 1:
{{Short description|Research approach in the learning sciences}}
{{Unreferenced|date=March 2009}}
{{Multiple issues|
'''Design-based research''' (DBR) is a type of [[research methodology]] commonly used by researchers in the [[Learning Sciences]]. Within Design-Based Research methodology, interventions are conceptualized and then implemented in natural settings in order to test the ecological validity of dominant theory and to generate new theories and frameworks for conceptualizing learning, instruction, design processes, and educational reform.
{{More footnotes|date=October 2013}}
{{Confusing|date=October 2013}}
{{Technical|date=October 2013}}
}}
'''Design-based research''' (DBR) is a type of [[research methodology]] used by researchers in the [[Learning Sciences|learning sciences]], which is a sub-field of education. The basic process of DBR involves developing solutions (called "interventions") to problems. Then, the interventions are put to use to test how well they work. The iterations may then be adapted and re-tested to gather more data. The purpose of this approach is to generate new theories and frameworks for conceptualizing learning, instruction,<ref>Johnson, C., Hill, L., Lock, J., Altowairiki, N., Ostrowski, C., da Rosa dos Santos, L., & Liu, Y. (2017). "Using design-based research to develop meaningful online discussions in undergraduate field experience courses". ''International Review of Research in Open and Distributed Learning, 18''(6). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2901/4373</ref> design processes, and educational reform. Data analysis often takes the form of iterative comparisons.


== Role of design-based research within the learning sciences ==
== Role within the learning sciences ==


Methodologically, the [[Learning Sciences]] is distinguished from other fields that study learning in humans in its [[methodological]] treatment of the subjects of its study, learners, their localities, and their communities. The Design-Based Research methodology is often employed by Learning Scientists in their inquiries because this [[methodological framework]] considers the subject of study to be a [[complex system]] involving [[emergent properties]] that arise from the interaction of more variables than are initially known to researchers, including variables stemming from the researchers themselves (Brown, 1992). As such rather than attempting to isolate all the various factors that impact learning as in traditional research, the learning sciences employ design based research methodologies which appeal to an approach to the study of learning – in particular human learning both inside and outside of school – that embraces the [[complex system]] nature of learning systems. Learning Scientists often look at the interactions amongst variables as key components to study yet, acknowledge that within learning environments the interactions are often too complex to study all or completely understand. This stance has been validated by the findings of [[Lee Cronbach|Cronbach]] and [[Richard E. Snow|Snow]] (1977) which suggest that [[Aptitude-Treatment Interactions]], where variables are isolated in effort to determine what factors “most” influence learning, will not be informative but rather inaccurate and potentially misleading if used as a ground for educational decisions or educational research of complex learning situations such as those characteristic of human beings in their lived experiences.
Methodologically, the [[Learning Sciences|learning sciences]] differs from other fields in educational research. It focuses on the study of learners, their localities, and their communities. The design-based research methodology is often used by learning scientists in their inquiries because this [[methodological framework]] considers the subject of study to be a [[complex system]] involving [[emergent properties]] that arise from the interaction of more variables than are initially known to researchers, including variables stemming from the researchers themselves (Brown, 1992). Rather than attempting to isolate all the various factors that impact learning as in traditional research, the learning sciences employ design based research methodologies which appeal to an approach to the study of learning – in particular human learning both inside and outside of school – that embraces the [[complex system]] nature of learning systems. Learning scientists often look at the interactions amongst variables as key components to study, yet acknowledge that within learning environments the interactions are often too complex to study all or completely understand. This stance has been validated by the findings of [[Lee Cronbach|Cronbach]] and [[Richard E. Snow|Snow]] (1977) which suggest that Aptitude-Treatment Interactions, where variables are isolated in an effort to determine what factors "most" influence learning, will not be informative but rather inaccurate and potentially misleading if used as a ground for educational decisions or educational research of complex learning situations such as those characteristic of human beings in their lived experiences.{{cn|date=April 2024}}


== Controversy ==
== History and controversy ==


The method was first proposed as design-experiments by Allan Collins in 1990 and Ann Brown in 1992. Collins originally proposed design-experiments as contributing to a 'design science', like aeronautics or artificial intelligence, rather than analytic science that seeks to explain natural phenomena. In the mid-1990s, a group called the National Design Experiment Consortium was founded by the late Jan Hawkins, then of Educational Development Corporation, to refine the method. In 1999, Christopher Hoadley founded the Design-Based Research Collective, funded by the Spencer Foundation, and coined the modern term for the method.{{cn|date=April 2024}}
Design-Based research methodologies are often viewed as "non-scientific" by circles in the [[post-positivist]] leaning research tradition due to the ongoing changes and interactions that are made by researchers who neither do purely [[empirical]] observational [[ethnographic]] [[research]] or purely empirical experimental research in which "fixed and isolated variables" will be measured and not tinkered with mid-experiment but rather use "quasi-experimental methods" in which the experimental design is always going through changes and modifications during the middle of "experimental" interventions. Ann Brown famously defended these “[[quasi-experimental]]” methods in her final, seminal deathbed paper which outlines the rationale for Design Based Methodologies.

Design-based research methodologies are often viewed as non-scientific by traditional experimental psychologists because design-based research does not follow formal definitions of scientific method. In 2000, Charles Desforges famously called design experiments 'neither designed, nor experiments'.{{Citation needed|date=October 2020}} Design-based research is viewed as an outgrowth of product development processes rather than scientific research. Critics see "design science" as an application of science to develop products or instructional interventions rather than scientific research.{{Citation needed|date=October 2020}} Some researchers question whether design-based research is primarily useful as an exploratory research method geared towards producing designed artifacts, or whether it can validly test robust theories that are contingent on designed artifacts or interventions.{{Citation needed|date=October 2020}}


==Varieties and forms of design-based research methodologies==
==Varieties and forms of design-based research methodologies==


As mentioned in the conclusion to the 2008 ICLS keynote([http://www.isls.org/icls2008/]), there are several forms of Design based research now in use in education research. These are associated with papers from:
As mentioned in the conclusion to the 2008 ICLS keynote([http://www.isls.org/icls/2008/]), there are several forms of design based research now in use in education research. These are associated with papers from:
*[[Ann Brown|Brown]] and [[Allan Collins (education)|Collins]]
* [[Ann Brown|Brown]] and [[Allan Collins (education)|Collins]]
*[[Paul Cobb|Cobb]]
* Cobb
*Hmelo-Silver
* Hmelo-Silver
*Kelly & [[Richard Lesh|Lesh]]
* Kelly & [[Richard Lesh|Lesh]]


==Related works==
==Related works==
* Anderson, T., & Shattuck, J. (2012). "Design-based research: A decade of progress in education research?" ''Educational Researcher'', 41(1), 16–25. {{doi|10.3102/0013189X11428813}}

* Bannan-Ritland, B. (2003). "The role of design in research: The integrative learning design framework". ''Educational Researcher''. 32(1) 21–24.
* Cronbach, L. J. & R. E. Snow (1977): Aptitudes and instructional methods: a handbook for research on interactions. New York: Irvington.
* Cronbach, L. J. & R. E. Snow (1977): ''Aptitudes and instructional methods: a handbook for research on interactions''. New York: Irvington.{{ISBN?}}
* Brown, A.L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The Journal of the Learning Sciences, 2(2), 141-178.
* Brown, A.L. (1992). "Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings". ''The Journal of the Learning Sciences'', 2(2), 141–178. {{doi|10.1207/s15327809jls0202_2}}
*Collins, A. (1990). Toward a design science of education. New York, NY: Center for Technology in Education.
*Collins, A. (1992). Toward a Design Science of Education. In E. Lagemann and L. Shulman (Eds) p. (15-22)
* Collins, A. (1990). "Toward a Design Science of Education". New York: Center for Technology in Education. http://cct2.edc.org/ccthome/reports/tr1.html
* Collins, A. (1992). "Toward a Design Science of Education". In E. Scanlon & T. O'Shea (Eds.), ''New directions in educational technology'' (pp.&nbsp;15–22). New York: Springer-Verlag.{{ISBN?}}
*Cobb, P., Confrey, J. diSessa, A., Lehrer, R. and Schauble, L. (2003). Design Experiments in Educational Research. Educational Researcher. 32(1) 9-13.
* Cobb, P., Confrey, J. diSessa, A., Lehrer, R. and Schauble, L. (2003). "Design Experiments in Educational Research". ''Educational Researcher''. 32(1) 9–13.
*diSessa, A. (2006). Designed-Based Research Theory2 and Practice. Presented at the London Knowledge Lab. 2 November 2006. http://www.lkl.ac.uk/video/disessa1106.html
* Deforges, C. (2000). "Familiar challenges and new approaches: necessary advances in theory and methods in research on teaching and learning". Paper presented at the Desmond Nuttall/Carfax Memorial Lecture. Cardiff, UK.
*Hoadley, C. interview: http://projects.coe.uga.edu/dbr/expertinterview.htm
* Design-Based Research Collective. (2003). "Design-based research: An emerging paradigm for educational inquiry." ''Educational Researcher'', 32(1), 5–8, 35–37. http://www.designbasedresearch.org/reppubs/DBRC2003.pdf
*Kelly, A. E. (2004). Design research in education: Yes, but is it methodological? Journal of the Learning Sciences, 13(1), 115-128.
* Hoadley, C. (2002). "Creating context: Design-based research in creating and understanding CSCL". In G. Stahl (Ed.), ''Computer Support for Collaborative Learning'' 2002 (pp.&nbsp;453–462). Mahwah, NJ: Lawrence Erlbaum Associates.{{ISBN?}}
*Reeves, T., Herrington, J. and Oliver, R. (2005) Design Research: A Socially Responsible Approach to Instructional Technology Research in Higher Education. Journal of Computing in Higher Education, 16(2), 97-116.
* Kelly, A. E. (2004). "Design research in education: Yes, but is it methodological?" ''The Journal of the Learning Sciences'', 13(1), 115–128. {{doi|10.1207/s15327809jls1301_6}}
*Reeves, T. interview: http://projects.coe.uga.edu/dbr/expertinterview.htm
* Mor, Y. (2010) '[http://www.yishaymor.org/phd A Design Approach to Research in Technology Enhanced Mathematics Education]', PhD thesis, Institute of Education, University of London
*Sandoval, W. interview: http://projects.coe.uga.edu/dbr/expertinterview.htm
*Shavelson, R. J. and Towne, L. (Eds.) (2002) Scientific Research in Education. National Academy Press. Washington D.C.
* Reeves, T., Herrington, J. and Oliver, R. (2005) "Design Research: A Socially Responsible Approach to Instructional Technology Research in Higher Education". ''Journal of Computing in Higher Education'', 16(2), 97–116.
*Shavelson, R. J., Phillips, D. C., Towne, L., & Feuer, M. J. (2003). On the science of educational design studies. Educational Researcher, 32(1), 25-28.
* Shavelson, R. J. and Towne, L. (Eds.) (2002) ''Scientific Research in Education''. National Academy Press. Washington D.C.{{ISBN?}}
* Shavelson, R. J., Phillips, D. C., Towne, L., & Feuer, M. J. (2003). "On the science of educational design studies". ''Educational Researcher'', 32(1), 25–28.
*[http://www.designbasedresearch.org/reppubs/DBRC2003.pdf Paper from the Design based research collective]
* Mor, Yishay (2010) '[http://www.yishaymor.org/phd A Design Approach to Research in Technology Enhanced Mathematics Education]', PhD thesis, Institute of Education, University of London


== See also ==
== See also ==
*[[Design Science (methodology)|Design Science Methodology]]
* [[Design Science (methodology)|Design Science Methodology]]
* [[Design-based learning]]

==References==
{{Reflist}}


==External links==
==External links==
*[http://edutechwiki.unige.ch/en/Design-based_research Edu-Tech Wiki]
* [http://edutechwiki.unige.ch/en/Design-based_research Edu-Tech Wiki]
*[http://projects.coe.uga.edu/dbr/expertinterview.htm Interviews with Design-Based Research Experts from University of Georgia]
* [https://web.archive.org/web/20090218181124/http://projects.coe.uga.edu/dbr/expertinterview.htm Interviews with design-based research experts] (videos) AERA International Convention, 2006.
* [https://web.archive.org/web/20071117074801/http://www.lkl.ac.uk/video/disessa1106.html Designed-Based research] (video) DiSessa, A. (2006). Presented at the London Knowledge Lab.
*[http://cider.athabascau.ca/CIDERSIGs/DesignBasedSIG/dbrreferences Bibliography of Design-Based Research - Theory & Description]


[[Category:Methodology]]
[[Category:Research methods]]
[[Category:Research]]

Latest revision as of 14:18, 26 April 2024

Design-based research (DBR) is a type of research methodology used by researchers in the learning sciences, which is a sub-field of education. The basic process of DBR involves developing solutions (called "interventions") to problems. Then, the interventions are put to use to test how well they work. The iterations may then be adapted and re-tested to gather more data. The purpose of this approach is to generate new theories and frameworks for conceptualizing learning, instruction,[1] design processes, and educational reform. Data analysis often takes the form of iterative comparisons.

Role within the learning sciences

[edit]

Methodologically, the learning sciences differs from other fields in educational research. It focuses on the study of learners, their localities, and their communities. The design-based research methodology is often used by learning scientists in their inquiries because this methodological framework considers the subject of study to be a complex system involving emergent properties that arise from the interaction of more variables than are initially known to researchers, including variables stemming from the researchers themselves (Brown, 1992). Rather than attempting to isolate all the various factors that impact learning as in traditional research, the learning sciences employ design based research methodologies which appeal to an approach to the study of learning – in particular human learning both inside and outside of school – that embraces the complex system nature of learning systems. Learning scientists often look at the interactions amongst variables as key components to study, yet acknowledge that within learning environments the interactions are often too complex to study all or completely understand. This stance has been validated by the findings of Cronbach and Snow (1977) which suggest that Aptitude-Treatment Interactions, where variables are isolated in an effort to determine what factors "most" influence learning, will not be informative but rather inaccurate and potentially misleading if used as a ground for educational decisions or educational research of complex learning situations such as those characteristic of human beings in their lived experiences.[citation needed]

History and controversy

[edit]

The method was first proposed as design-experiments by Allan Collins in 1990 and Ann Brown in 1992. Collins originally proposed design-experiments as contributing to a 'design science', like aeronautics or artificial intelligence, rather than analytic science that seeks to explain natural phenomena. In the mid-1990s, a group called the National Design Experiment Consortium was founded by the late Jan Hawkins, then of Educational Development Corporation, to refine the method. In 1999, Christopher Hoadley founded the Design-Based Research Collective, funded by the Spencer Foundation, and coined the modern term for the method.[citation needed]

Design-based research methodologies are often viewed as non-scientific by traditional experimental psychologists because design-based research does not follow formal definitions of scientific method. In 2000, Charles Desforges famously called design experiments 'neither designed, nor experiments'.[citation needed] Design-based research is viewed as an outgrowth of product development processes rather than scientific research. Critics see "design science" as an application of science to develop products or instructional interventions rather than scientific research.[citation needed] Some researchers question whether design-based research is primarily useful as an exploratory research method geared towards producing designed artifacts, or whether it can validly test robust theories that are contingent on designed artifacts or interventions.[citation needed]

Varieties and forms of design-based research methodologies

[edit]

As mentioned in the conclusion to the 2008 ICLS keynote([1]), there are several forms of design based research now in use in education research. These are associated with papers from:

[edit]
  • Anderson, T., & Shattuck, J. (2012). "Design-based research: A decade of progress in education research?" Educational Researcher, 41(1), 16–25. doi:10.3102/0013189X11428813
  • Bannan-Ritland, B. (2003). "The role of design in research: The integrative learning design framework". Educational Researcher. 32(1) 21–24.
  • Cronbach, L. J. & R. E. Snow (1977): Aptitudes and instructional methods: a handbook for research on interactions. New York: Irvington.[ISBN missing]
  • Brown, A.L. (1992). "Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings". The Journal of the Learning Sciences, 2(2), 141–178. doi:10.1207/s15327809jls0202_2
  • Collins, A. (1990). "Toward a Design Science of Education". New York: Center for Technology in Education. http://cct2.edc.org/ccthome/reports/tr1.html
  • Collins, A. (1992). "Toward a Design Science of Education". In E. Scanlon & T. O'Shea (Eds.), New directions in educational technology (pp. 15–22). New York: Springer-Verlag.[ISBN missing]
  • Cobb, P., Confrey, J. diSessa, A., Lehrer, R. and Schauble, L. (2003). "Design Experiments in Educational Research". Educational Researcher. 32(1) 9–13.
  • Deforges, C. (2000). "Familiar challenges and new approaches: necessary advances in theory and methods in research on teaching and learning". Paper presented at the Desmond Nuttall/Carfax Memorial Lecture. Cardiff, UK.
  • Design-Based Research Collective. (2003). "Design-based research: An emerging paradigm for educational inquiry." Educational Researcher, 32(1), 5–8, 35–37. http://www.designbasedresearch.org/reppubs/DBRC2003.pdf
  • Hoadley, C. (2002). "Creating context: Design-based research in creating and understanding CSCL". In G. Stahl (Ed.), Computer Support for Collaborative Learning 2002 (pp. 453–462). Mahwah, NJ: Lawrence Erlbaum Associates.[ISBN missing]
  • Kelly, A. E. (2004). "Design research in education: Yes, but is it methodological?" The Journal of the Learning Sciences, 13(1), 115–128. doi:10.1207/s15327809jls1301_6
  • Mor, Y. (2010) 'A Design Approach to Research in Technology Enhanced Mathematics Education', PhD thesis, Institute of Education, University of London
  • Reeves, T., Herrington, J. and Oliver, R. (2005) "Design Research: A Socially Responsible Approach to Instructional Technology Research in Higher Education". Journal of Computing in Higher Education, 16(2), 97–116.
  • Shavelson, R. J. and Towne, L. (Eds.) (2002) Scientific Research in Education. National Academy Press. Washington D.C.[ISBN missing]
  • Shavelson, R. J., Phillips, D. C., Towne, L., & Feuer, M. J. (2003). "On the science of educational design studies". Educational Researcher, 32(1), 25–28.

See also

[edit]

References

[edit]
  1. ^ Johnson, C., Hill, L., Lock, J., Altowairiki, N., Ostrowski, C., da Rosa dos Santos, L., & Liu, Y. (2017). "Using design-based research to develop meaningful online discussions in undergraduate field experience courses". International Review of Research in Open and Distributed Learning, 18(6). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2901/4373
[edit]