Jump to content

Talk:Learning analytics: Difference between revisions

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia
Content deleted Content added
Cab938 (talk | contribs)
Assessment: banner shell, Psychology (Rater)
 
(10 intermediate revisions by 8 users not shown)
Line 1: Line 1:
{{WikiProject banner shell|class=
=Pointer to 'general introduction' at start of article?=
B|1=

{{WikiProject Statistics}}
{{WikiProject Computer science}}
{{WikiProject Systems}}
{{WikiProject Marketing & Advertising}}
{{WikiProject Psychology}}
{{WikiProject Education}}
{{WikiProject Technology}}
{{WikiProject Internet}}
}}

== Pointer to 'general introduction' at start of article? ==
I've added a "general introduction" link to the start of the article: "For a general audience introduction, see the UNESCO "Learning Analytics Policy Brief" (2012)[2]". IF anyone thinks it's not appropriate in that position, please move it/discuss here. I should point out it was written by one of my supervisors. It's the most recent, comprehensive, and general purpose paper on it so I don't see a COI - but as more literature is released it may want relocating. [[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 12:42, 22 January 2013 (UTC)
I've added a "general introduction" link to the start of the article: "For a general audience introduction, see the UNESCO "Learning Analytics Policy Brief" (2012)[2]". IF anyone thinks it's not appropriate in that position, please move it/discuss here. I should point out it was written by one of my supervisors. It's the most recent, comprehensive, and general purpose paper on it so I don't see a COI - but as more literature is released it may want relocating. [[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 12:42, 22 January 2013 (UTC)


== Definition ==
=External links=
I might be a good idea to distinguish "learning analytics" from formative and summative learning assessment. If anyone can. Let me remind readers that the definition of learning assessment is to provide data to support educational decisions.[[User:Robotczar|Robotczar]] ([[User talk:Robotczar|talk]]) 19:59, 4 March 2015 (UTC)

After thorough research on related literature, I've detected some defects in the content, structure and presentation of the information. The most important one is that the definition of LA is still in dispute, so many definitions have been attempted. The section now tries to approach this reality to the reader, providing the most important definitions in the field. The section was completely revised, corrected, organized and extended. [[User:Pagonol|Pagonol]] ([[User talk:Pagonol|talk]]) 10:55, 11 January 2019 (UTC)

== History ==
After careful reading of previous version of this section and further research on related literature, the conclusion was that it was still poorly developed. There are 2 main reasons for this opinion. On the one hand, a section about history of anything must provide a sense of progress through time, sequences of phases or chains of events. This was not the case. On the other hand, Learning Analytics, as a field, has multiple disciplinary roots, and therefore the history of LA must be told by explaining how those roots converged and gave rise to LA as a new field. The section was not being explained following this structure and I believe that, in this case, is a must. [[User:Pagonol|Pagonol]] ([[User talk:Pagonol|talk]]) 10:55, 11 January 2019 (UTC)

== Applications ==
This is a capital aspect of the field and it was missing in the wiki, so was added. It is far from being completed, but it's a decent start. [[User:Pagonol|Pagonol]] ([[User talk:Pagonol|talk]]) 10:55, 11 January 2019 (UTC)

== External links ==
Many of the 'external links' look like they ought to be cited in text and added as references rather than external links - I'll try to address this but if anyone else is looking and has time this should be a fairly easy task. [[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 13:57, 22 January 2013 (UTC)
Many of the 'external links' look like they ought to be cited in text and added as references rather than external links - I'll try to address this but if anyone else is looking and has time this should be a fairly easy task. [[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 13:57, 22 January 2013 (UTC)


Line 20: Line 44:
* Duval, E. [https://lirias.kuleuven.be/bitstream/123456789/315113/1/la2.pdf Attention please! Learning analytics for visualization and recommendation], Proceedings of LAK11: 1st International Conference on Learning Analytics and Knowledge, Banff, Canada, 27 February - 1 March 2011
* Duval, E. [https://lirias.kuleuven.be/bitstream/123456789/315113/1/la2.pdf Attention please! Learning analytics for visualization and recommendation], Proceedings of LAK11: 1st International Conference on Learning Analytics and Knowledge, Banff, Canada, 27 February - 1 March 2011
* Richards, G., [http://www.academia.edu/779650/Measuring_Engagement_Learning_Analytics_in_Online_Learning Measuring Engagement: Learning Analytics in Online Learning], Proceedings of Electronic Kazan 2011, Russian Federation. 26 April 2011.
* Richards, G., [http://www.academia.edu/779650/Measuring_Engagement_Learning_Analytics_in_Online_Learning Measuring Engagement: Learning Analytics in Online Learning], Proceedings of Electronic Kazan 2011, Russian Federation. 26 April 2011.

[[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 17:17, 24 January 2013 (UTC)
[[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 17:17, 24 January 2013 (UTC)

== External links modified ==

Hello fellow Wikipedians,

I have just modified 2 external links on [[Learning analytics]]. Please take a moment to review [[special:diff/816111842|my edit]]. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit [[User:Cyberpower678/FaQs#InternetArchiveBot|this simple FaQ]] for additional information. I made the following changes:
*Added archive https://web.archive.org/web/20130502234323/http://publications.cetis.ac.uk/wp-content/uploads/2012/12/Institutional-Readiness-for-Analytics-Vol1-No8.pdf to http://publications.cetis.ac.uk/wp-content/uploads/2012/12/Institutional-Readiness-for-Analytics-Vol1-No8.pdf
*Added archive https://web.archive.org/web/20130502234313/http://publications.cetis.ac.uk/wp-content/uploads/2012/11/Legal-Risk-and-Ethical-Aspects-of-Analytics-in-Higher-Education-Vol1-No6.pdf to http://publications.cetis.ac.uk/wp-content/uploads/2012/11/Legal-Risk-and-Ethical-Aspects-of-Analytics-in-Higher-Education-Vol1-No6.pdf

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

{{sourcecheck|checked=false|needhelp=}}

Cheers.—[[User:InternetArchiveBot|'''<span style="color:darkgrey;font-family:monospace">InternetArchiveBot</span>''']] <span style="color:green;font-family:Rockwell">([[User talk:InternetArchiveBot|Report bug]])</span> 10:25, 19 December 2017 (UTC)



== Purposes/functions of analytics - new section? ==
== Purposes/functions of analytics - new section? ==
Line 28: Line 66:
A possible sub section could be on analytics for understanding research (E.g. the CETIS Analytics Series Vol 1. No 4. Analytics for Understanding Research, Mark van Harmelen Hedtek Ltd, Serial Number: ISSN 2051-9214 Vol 1, No 4, ISSN: 2051-9214, which is CC-BY licensed too). [[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 18:28, 8 February 2013 (UTC)
A possible sub section could be on analytics for understanding research (E.g. the CETIS Analytics Series Vol 1. No 4. Analytics for Understanding Research, Mark van Harmelen Hedtek Ltd, Serial Number: ISSN 2051-9214 Vol 1, No 4, ISSN: 2051-9214, which is CC-BY licensed too). [[User:Sjgknight|Sjgknight]] ([[User talk:Sjgknight|talk]]) 18:28, 8 February 2013 (UTC)


I added a differentiation between LA and EDM in the intro section, but am open to having it moved if there are objections.
:I added a differentiation between LA and EDM in the intro section, but am open to having it moved if there are objections.
[[User:Cab938|Cab938]] ([[User talk:Cab938|talk]]) 13:07, 9 April 2013 (UTC)
[[User:Cab938|Cab938]] ([[User talk:Cab938|talk]]) 13:07, 9 April 2013 (UTC)

::Looks good to me [[User:Cab938]]. I wrote some stuff on another wiki (http://www.edfutures.net/index.php?title=Learning_Analytics#Learning_Analytics_and_Educational_Data_Mining_.E2.80.93_What.E2.80.99s_the_Difference.3F) which might be transferable (CC-By licensed, and it was summaries of research) - I've added some bits from that article anyway so slightly reluctant to add it myself, but it may be useful to just straight transfer the below or adapt it to this article? I'm not sure what emphasis to place on this distinction either - I'd hate to see the rest of the article swamped by excessive coverage of this bit!

::Many researchers in both EDM and LA do work which crosses between the two. Ferguson <ref name="Ferguson"></ref> summarised it thus:

* Educational data mining was primarily focused on the technical challenge: How can we extract value from these big sets of learning-related data?
*Learning analytics was primarily focused on the educational challenge: How can we optimise opportunities for learning?
*Academic (and action) analytics were focused on the political/economic challenge: How can we substantially improve learning opportunities and educational results at national or international levels?

While Siemens and Baker <ref name="Siemens and Baker">Siemens, G., and R. S. J. Baker. “Learning Analytics and Educational Data Mining: Towards Communication and Collaboration.” In ''Proceedings of the 2nd International Conference on Learning Analytics and Knowledge'', 252–254, 2012. [http://dl.acm.org/citation.cfm?id=2330661 http://dl.acm.org/citation.cfm?id=2330661]</ref> highlight some key differences between LA and EDM as in the table.

{| class="prettytable"
|-
|


|
'''LA'''

|
'''EDM'''

|-
|
'''Discovery'''

|
The end goal is to facilitate human judgement, automated models play a part in helping humans make judgements

|
The end goal is automated models, humans play a part in setting these up

|-
|
'''Reduction & Holism'''

|
“Stronger emphasis on understanding systems as wholes, in their full complexity”

|
“Stronger emphasis on reducing to components and analysing individual components and relationships between them”

|-
|
'''Origins'''

|
Stronger origins in understanding learning materials and learners using computational methods

|
Stronger origins in modelling outcomes, and software to track this

|-
|
'''Adaptation & Personalization'''

|
“Greater focus on informing and empowering instructors and learners”

|
“Greater focus on automated adaption (e.g. by the computer with no human in the loop)”

|-
|
'''Techniques & Models'''

|
Social network analysis, sentiment analysis, influence analytics, discourse analysis, learner success prediction, concept analysis, sensemaking models

|
Classification, clustering, Bayesian modelling, relationship mining, discovery models, visualization

|}
Table adapted from <ref name="Siemens and Baker"></ref>

{{reflist-talk}}


== Some 'to do' in each section ==
== Some 'to do' in each section ==

Latest revision as of 17:43, 26 August 2024

Pointer to 'general introduction' at start of article?

[edit]

I've added a "general introduction" link to the start of the article: "For a general audience introduction, see the UNESCO "Learning Analytics Policy Brief" (2012)[2]". IF anyone thinks it's not appropriate in that position, please move it/discuss here. I should point out it was written by one of my supervisors. It's the most recent, comprehensive, and general purpose paper on it so I don't see a COI - but as more literature is released it may want relocating. Sjgknight (talk) 12:42, 22 January 2013 (UTC)[reply]

Definition

[edit]

I might be a good idea to distinguish "learning analytics" from formative and summative learning assessment. If anyone can. Let me remind readers that the definition of learning assessment is to provide data to support educational decisions.Robotczar (talk) 19:59, 4 March 2015 (UTC)[reply]

After thorough research on related literature, I've detected some defects in the content, structure and presentation of the information. The most important one is that the definition of LA is still in dispute, so many definitions have been attempted. The section now tries to approach this reality to the reader, providing the most important definitions in the field. The section was completely revised, corrected, organized and extended. Pagonol (talk) 10:55, 11 January 2019 (UTC)[reply]

History

[edit]

After careful reading of previous version of this section and further research on related literature, the conclusion was that it was still poorly developed. There are 2 main reasons for this opinion. On the one hand, a section about history of anything must provide a sense of progress through time, sequences of phases or chains of events. This was not the case. On the other hand, Learning Analytics, as a field, has multiple disciplinary roots, and therefore the history of LA must be told by explaining how those roots converged and gave rise to LA as a new field. The section was not being explained following this structure and I believe that, in this case, is a must. Pagonol (talk) 10:55, 11 January 2019 (UTC)[reply]

Applications

[edit]

This is a capital aspect of the field and it was missing in the wiki, so was added. It is far from being completed, but it's a decent start. Pagonol (talk) 10:55, 11 January 2019 (UTC)[reply]

[edit]

Many of the 'external links' look like they ought to be cited in text and added as references rather than external links - I'll try to address this but if anyone else is looking and has time this should be a fairly easy task. Sjgknight (talk) 13:57, 22 January 2013 (UTC)[reply]

After seeing another link appear in that list which ought to be an in-text citation I've removed a load. I understand people may be trying to avoid citing their own work in text - and this is good practice - but listing articles which aren't general audience articles or collections, etc. in the external links is confusing and detracts from other work there. If anyone is unsure about how to integrate work into the text, or they're citing things where there is potential for COI or NPOV issues then please list them on the talk page. The list I've just removed is below - if you integrate them in to the text please delete them from here.

Sjgknight (talk) 17:17, 24 January 2013 (UTC)[reply]

[edit]

Hello fellow Wikipedians,

I have just modified 2 external links on Learning analytics. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

This message was posted before February 2018. After February 2018, "External links modified" talk page sections are no longer generated or monitored by InternetArchiveBot. No special action is required regarding these talk page notices, other than regular verification using the archive tool instructions below. Editors have permission to delete these "External links modified" talk page sections if they want to de-clutter talk pages, but see the RfC before doing mass systematic removals. This message is updated dynamically through the template {{source check}} (last update: 5 June 2024).

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—InternetArchiveBot (Report bug) 10:25, 19 December 2017 (UTC)[reply]


Purposes/functions of analytics - new section?

[edit]

This section could explain some of the differences between EDM, LA and academic analytics before moving on to some of the ways it is being used. A possible sub section could be on analytics for understanding research (E.g. the CETIS Analytics Series Vol 1. No 4. Analytics for Understanding Research, Mark van Harmelen Hedtek Ltd, Serial Number: ISSN 2051-9214 Vol 1, No 4, ISSN: 2051-9214, which is CC-BY licensed too). Sjgknight (talk) 18:28, 8 February 2013 (UTC)[reply]

I added a differentiation between LA and EDM in the intro section, but am open to having it moved if there are objections.

Cab938 (talk) 13:07, 9 April 2013 (UTC)[reply]

Looks good to me User:Cab938. I wrote some stuff on another wiki (http://www.edfutures.net/index.php?title=Learning_Analytics#Learning_Analytics_and_Educational_Data_Mining_.E2.80.93_What.E2.80.99s_the_Difference.3F) which might be transferable (CC-By licensed, and it was summaries of research) - I've added some bits from that article anyway so slightly reluctant to add it myself, but it may be useful to just straight transfer the below or adapt it to this article? I'm not sure what emphasis to place on this distinction either - I'd hate to see the rest of the article swamped by excessive coverage of this bit!
Many researchers in both EDM and LA do work which crosses between the two. Ferguson [1] summarised it thus:
  • Educational data mining was primarily focused on the technical challenge: How can we extract value from these big sets of learning-related data?
  • Learning analytics was primarily focused on the educational challenge: How can we optimise opportunities for learning?
  • Academic (and action) analytics were focused on the political/economic challenge: How can we substantially improve learning opportunities and educational results at national or international levels?

While Siemens and Baker [2] highlight some key differences between LA and EDM as in the table.


LA

EDM

Discovery

The end goal is to facilitate human judgement, automated models play a part in helping humans make judgements

The end goal is automated models, humans play a part in setting these up

Reduction & Holism

“Stronger emphasis on understanding systems as wholes, in their full complexity”

“Stronger emphasis on reducing to components and analysing individual components and relationships between them”

Origins

Stronger origins in understanding learning materials and learners using computational methods

Stronger origins in modelling outcomes, and software to track this

Adaptation & Personalization

“Greater focus on informing and empowering instructors and learners”

“Greater focus on automated adaption (e.g. by the computer with no human in the loop)”

Techniques & Models

Social network analysis, sentiment analysis, influence analytics, discourse analysis, learner success prediction, concept analysis, sensemaking models

Classification, clustering, Bayesian modelling, relationship mining, discovery models, visualization

Table adapted from [2]

References

  1. ^ Cite error: The named reference Ferguson was invoked but never defined (see the help page).
  2. ^ a b Siemens, G., and R. S. J. Baker. “Learning Analytics and Educational Data Mining: Towards Communication and Collaboration.” In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, 252–254, 2012. http://dl.acm.org/citation.cfm?id=2330661

Some 'to do' in each section

[edit]

See also the other comments, but this is just some obvious things which ought to be addressed. Someone might find it useful as a starting point. Mark/discuss as you edit.

  • Introduction Needs expanding, list better placed in "External Links" & references but referred to in text.
  • What is Learning Analytics? I think a simple, broad definition from a good soruce would be better here
  • History; Context There is more history than is given here (although this summary is probably ok), a link to EDM might be good. Incorporating 'tools' also useful.
  • History; Techniques No links or citations, unclear relationship to LA. Might be better in lower section?
  • Criticism The definition debate is wider than this, it should perhaps be moved to this section (from the first section) and expanded. The ethics issues also need expanding and I'm sure there are recent sources as well as other concerns re: big data, quantification, etc.
  • Methods - Could do with some general intro to methods. Also methods section is a slightly odd mixture of things which could perhaps be related better.
  • Methods; The particular 'methods' need expanding and citations adding. Linking to particular software, or examples of use might also be useful
  • Software Expand
  • See also Expand
  • External links This is too much of a list. Some of these things look like they belong as references to the main text, others could probably be removed. This would be a good place for general articles and discussion areas (inc. SoLAR) but these are swamped at the moment

Sjgknight (talk) 14:05, 5 March 2013 (UTC)[reply]

New Section - Ethics

[edit]

There is a rich discussion around the ethics of leraning analytics. In part this has been collected by George Siemens, etc. from discussion group posts, but there are also good articles including: Learning analytics: ethical issues and dilemmas. Slade, Sharon and Prinsloo, Paul (2013). Learning analytics: ethical issues and dilemmas. American Behavioral Scientist (In press). http://oro.open.ac.uk/36594/ Which gives 6 principles which could easily be brought in. Paralleling boyd & Crawford's big data provocations I wrote http://people.kmi.open.ac.uk/knight/2013/01/six-provocations-for-learning-analytics/ it may not be useful (and I'm certainly not going to add it myself) but there may be something there or a useful parallel to draw with the original boyd & Crawford article. I'll try and a) find some more good sources and b) begin a section skeleton asap. — Preceding unsigned comment added by Sjgknight (talkcontribs) 17:43, 15 March 2013 (UTC) Sjgknight (talk) 17:46, 15 March 2013 (UTC)[reply]