Jump to content

WikiTrust: Difference between revisions

From Wikipedia, the free encyclopedia
Browse history interactively
← Previous edit
Content deleted Content added
VisualWikitext
Chealer (talk | contribs)
10,808 edits
m comment on outdated template
m →top: Clean up spacing around commas and other punctuation fixes, replaced: ] ,[ → ], [
 
(33 intermediate revisions by 27 users not shown)
Line 1: Line 1:
{{short description|Software to assist in detecting vandalism and dubious edits}}
{{Update|date=July 2014}}<!-- The Firefox plug-in is in development as of 2014. Version 0.4 is apparently broken on my machine. Chealer -->
{{Infobox software
{{Infobox software
| name = WikiTrust
| name = WikiTrust
| logo = [[File:WikiTrustLogo.png|250px|center]]
| logo = WikiTrustLogo.png
| logo size = 250px
| screenshot = [[File:WikiTrust Beispiel Zeigerpflanzen.png|250px|center]]
| screenshot = WikiTrust Beispiel Zeigerpflanzen.png
| caption = An example of a WikiTrust screenshot
| caption = An example of a WikiTrust screenshot
| developer = [[University of California, Santa Cruz|UCSC]] Online Collaboration Lab
| developer = [[University of California, Santa Cruz|UCSC]] Online Collaboration Lab
| latest release version = v2.12
| latest release date = November 19, 2008 <ref>[http://wikitrust.soe.ucsc.edu/index.php?title=WikiTrust_Release_History&diff=12&oldid=6 WikiTrust Release History] from the UCSC Online Collaboration Lab</ref>
| latest release version = v2.12
| latest release date = November 19, 2008<ref>[http://wikitrust.soe.ucsc.edu/index.php?title=WikiTrust_Release_History&diff=12&oldid=6 WikiTrust Release History] from the UCSC Online Collaboration Lab</ref>
| latest preview version = v3.0.pre1
| latest preview version = v3.0.pre1
| latest preview date = August 21, 2009 <ref>[http://github.com/collaborativetrust/WikiTrust/tree/master Browse Files for WikiTrust] on [[GitHub]]</ref>
| latest preview date = August 21, 2009<ref>[https://github.com/collaborativetrust/WikiTrust/tree/master Browse Files for WikiTrust] on [[GitHub]]</ref>
| operating_system = [[Cross-platform]]
| operating_system =
| platform = [[Firefox|FireFox]], [[MediaWiki]]
| programming language = [[PHP]], [[OCaml]] <ref>[http://wikitrust.soe.ucsc.edu/index.php/Installation_Advice Installation Advice] from the UCSC Online Collaboration Lab</ref>
| programming language = [[PHP]], [[OCaml]]<ref>[http://wikitrust.soe.ucsc.edu/index.php/Installation_Advice Installation Advice] {{Webarchive|url=https://web.archive.org/web/20090213030351/http://wikitrust.soe.ucsc.edu/index.php/Installation_Advice |date=2009-02-13 }} from the UCSC Online Collaboration Lab</ref>
| database = [[MySQL]]
| status =
| status =
| genre = [[MediaWiki]] [[Plug-in (computing)|plug-in]]
| genre = [[MediaWiki]] [[Plug-in (computing)|plug-in]]
| license = [[BSD License|BSD]], [[GNU General Public License|GPL]] <ref>[http://github.com/collaborativetrust/WikiTrust WikiTrust] on GitHub</ref>
| license = [[BSD License|BSD]], [[GNU General Public License|GPL]]<ref>[https://github.com/collaborativetrust/WikiTrust WikiTrust] on GitHub</ref>
| website = [http://wikitrust.soe.ucsc.edu/ wikitrust.soe.ucsc.edu]
| website = {{URL|wikitrust.soe.ucsc.edu}}
}}
}}


'''WikiTrust''' was a [[software product]], available as a Firefox Plugin, which aimed to assist editors in detecting vandalism and dubious edits by highlighting the "untrustworthy" text with a yellow or orange background. As of September 2017, the server is offline,<ref name="mainucsc"/> but the code is still available for download.
⚫
'''WikiTrust''' is a [[software product]] that assesses the credibility of content and author reputation of [[wiki]] articles using an automated [[algorithm]]. WikiTrust is a [[Plug-in (computing)|plug-in]] for servers using the [[MediaWiki]] platform, such as [[Wikipedia]]. When installed on a [[MediaWiki]] website it is designed to enable users of that website to obtain information about the author, origin, and reliability of that website's wiki text.<ref name="mainucsc"/> Content that is stable, based on an analysis of article history, should be displayed in normal black-on-white type, and content that is not [[stable]] is highlighted in varying shades of yellow or orange.


⚫
When the UCSC server was active, WikiTrust assessed the credibility of content and author reputation of [[wiki]] articles using an automated [[algorithm]]. WikiTrust provides a [[Plug-in (computing)|plug-in]] for servers using the [[MediaWiki]] platform, such as [[Wikipedia]]. When installed, it was designed to enable users of that website to obtain information about the author, origin, and reliability of that website's wiki text.<ref name="mainucsc"/> Content that is stable, based on an analysis of article history, should be displayed in normal black-on-white type, and content that is not stable is highlighted in varying shades of yellow or orange. It was formerly available for several language versions of Wikipedia.
⚫
WikiTrust on Wikipedia was a project undertaken by the Online Collaboration Lab at the [[University of California, Santa Cruz]], in response to a [[Wikipedia:Meta]] [[meta:Wikiquality/Portal|quality initiative]] sponsored by the [[Wikimedia Foundation]].<ref name="mainucsc">[http://wikitrust.soe.ucsc.edu/index.php/Main_Page Main Page] from the UCSC Online Collaboration Lab</ref> The project, discussed at [[Wikimania 2009]], was one of a number of quality/rating tools for Wikipedia content that the Wikimedia Foundation was considering.<ref>[http://www.informationweek.com/news/internet/security/showArticle.jhtml?articleID=219500669 Wikipedia Considers Coloring Untested Text], an August 31, 2009 article from ''[[Information Week]]''</ref> [[Communications of the ACM]] (August 2011) had an article on it.<ref>CACM 54 No. 8 ''Reputation Systems for Open Collaboration'' Luca De Alfaro, Ashutosh Kulshreshtha, Ian Pye, B. Thomas Adler pp 81-7</ref> WikiTrust is designed for English and German use via the Wiki-Watch pagedetails for Wikipedia articles,<ref>Wiki-Watch.org:'' [http://blog.wiki-watch.de/?p=497 Wiki-Watch.org: a new tool to evaluate the quality of Wikipedia’s articles]'' January 13, 2011.</ref> in several languages via a [[Mozilla Firefox|Firefox]] plugin or it can be installed in any MediaWiki configuration.<ref>WikiTrust: [http://wikitrust.soe.ucsc.edu/index.php/Main_Page Wikitrust.soe.ucsc.edu]</ref> As of 2012, WikiTrust appears to be an inactive project.<ref>Andrew G. West (25 November 2012). [http://en.wikipedia.org/enwiki/w/index.php?title=Wikipedia:Village_pump_%28technical%29&oldid=525214639#WikiTrust "WikiTrust"] Wikipedia:Village pump (technical).</ref>

⚫
WikiTrust on Wikipedia was undertaken by the Online Collaboration Lab at the [[University of California, Santa Cruz]], in response to a [[Wikimedia Foundation#Infrastructure and coordination projects|Meta-wiki]] quality initiative sponsored by the [[Wikimedia Foundation]].<ref name="mainucsc">[http://wikitrust.soe.ucsc.edu/home Main Page] from the UCSC Online Collaboration Lab</ref> The project, discussed at [[Wikimania 2009]], was one of a number of quality/rating tools for Wikipedia content that the Wikimedia Foundation was considering.<ref>[http://www.informationweek.com/news/internet/security/showArticle.jhtml?articleID=219500669 Wikipedia Considers Coloring Untested Text], an August 31, 2009 article from ''[[Information Week]]''</ref> [[Communications of the ACM]] (August 2011) had an article on it.<ref>CACM 54 No. 8 ''Reputation Systems for Open Collaboration'' Luca De Alfaro, Ashutosh Kulshreshtha, Ian Pye, B. Thomas Adler pp 81-7</ref> WikiTrust is designed for English and German use via the Wiki-Watch pagedetails for Wikipedia articles,<ref>Wiki-Watch.org:'' [http://blog.wiki-watch.de/?p=497 Wiki-Watch.org: a new tool to evaluate the quality of Wikipedia’s articles]'' January 13, 2011.</ref> in several languages via a [[Mozilla Firefox|Firefox]] plugin or it can be installed in any MediaWiki configuration.<ref>WikiTrust: [http://wikitrust.soe.ucsc.edu/home Wikitrust.soe.ucsc.edu]</ref> By 2012, WikiTrust appeared to be inactive.<ref>Andrew G. West (25 November 2012). [http://en.wikipedia.org/enwiki/w/index.php?title=Wikipedia:Village_pump_%28technical%29&oldid=525214639#WikiTrust "WikiTrust"] Wikipedia:Village pump (technical).</ref>


== Software application ==
== Software application ==

=== Computing reliability ===
=== Computing reliability ===
WikiTrust computes, for each word, three pieces of information:
WikiTrust computes, for each word, three pieces of information:
Line 29: Line 33:
* The revision where the word (and the immediately surrounding text) was inserted. By clicking on a word, visitors are sent to the revision where the word originated.
* The revision where the word (and the immediately surrounding text) was inserted. By clicking on a word, visitors are sent to the revision where the word originated.
* The "trust" of the word, indicated by the word background coloring (orange for "untrusted" text, white for "trusted" text).
* The "trust" of the word, indicated by the word background coloring (orange for "untrusted" text, white for "trusted" text).
The trust of the word is computed according to how much the word, and the surrounding text, have been revised by users that WikiTrust considers of "high reputation". To decide which users have high reputation, WikiTrust uses sophisticated "data mining" algorithms that assess the credibility of editors (users that make changes to a wikis content) by tracking their contributions.<ref name="ACRLog">{{cite web|url=http://acrlog.org/2007/08/15/computing-wikipedias-authority/|title=Computing Wikipedia's Authority|publisher=Association of College & Research Libraries|work=ACRLog}}</ref><ref name="project page">''See'' {{cite web|url=http://trust.cse.ucsc.edu/|title=UCSC Wiki Lab}}</ref> This project is still in a beta test stage.<ref name="project page" /><ref name="CBC" />
The trust of the word is computed according to how much the word, and the surrounding text, have been revised by users that WikiTrust considers of "high authority."<ref name="ACRLog">{{cite web|url=http://acrlog.org/2007/08/15/computing-wikipedias-authority/|title=Computing Wikipedia's Authority|publisher=Association of College & Research Libraries|work=ACRLog}}</ref><ref name="project page">''See'' {{cite web|url=http://trust.cse.ucsc.edu/|title=UCSC Wiki Lab|access-date=2009-09-26|archive-date=2009-09-20|archive-url=https://web.archive.org/web/20090920205721/http://trust.cse.ucsc.edu/|url-status=dead}}</ref> This project is still in a beta test stage.<ref name="project page" /><ref name="CBC" />


=== Criticism ===
=== Criticism ===
The criticism has been raised<ref name="ACRLog" /> that "the software doesn’t really measure trustworthiness, and the danger is that people will trust the software to measure something that it does not." Generally, users whose content persists for a long time without being "[[WP:REVERT|reverted]]" by other editors are deemed more trustworthy by the software.<ref name="project page" /><ref name="CBC">{{cite news|url=http://www.cbc.ca/technology/story/2007/09/06/tech-wiki-software.html|title=Software tests accuracy of Wikipedia entries|publisher=Canadian Broadcasting Corporation | date=September 6, 2007}}</ref> This may mean that users who edit controversial articles subject to frequent reversion may be found to be less trustworthy than others.<ref name="CBC" /> The software uses a variation of [[Levenshtein distance]] to measure how much of user's edit is kept or rearranged, so that users can receive "partial credit" for their work.<ref>B. Adler and L. de Alfaro. A Content-Driven Reputation System for the Wikipedia. ''In'' WWW 2007, Proceedings of the 16th International World Wide Web Conference, ACM Press, 2007.</ref>
The criticism has been raised<ref name="ACRLog"/> that "the software doesn’t really measure trustworthiness, and the danger is that people will trust the software to measure something that it does not." Generally, users whose content persists for a long time without being "reverted" by other editors are deemed more trustworthy by the software.<ref name="project page" /><ref name="CBC">{{cite news|url=https://www.cbc.ca/news/science/software-tests-accuracy-of-wikipedia-entries-1.678697|title=Software tests accuracy of Wikipedia entries|publisher=[[Canadian Broadcasting Corporation]] | date=September 6, 2007}}</ref> This may mean that users who edit controversial articles subject to frequent reversion may be found to be less trustworthy than others.<ref name="CBC" /> The software uses a variation of [[Levenshtein distance]] to measure how much of user's edit is kept or rearranged, so that users can receive "partial credit" for their work.<ref>B. Adler and L. de Alfaro. A Content-Driven Reputation System for the Wikipedia. ''In'' WWW 2007, Proceedings of the 16th International World Wide Web Conference, ACM Press, 2007.</ref>


=== Community bias ===
=== Community bias ===
The software has also been described as measuring the amount of consensus in an article.<ref name="Wired">[http://www.wired.com/wiredscience/2009/08/wikitrust/ Wikipedia to Color Code Untrustworthy Text], an August 30, 2009 article from ''[[Wired News]]''</ref> The community of editors collaborate on articles and revise each other until agreement is reached. Users who make edits which are more similar to the final agreement will receive more reputation. The point is also made that consensus revolves around the beliefs of the community, so that the reputation computed is also a reflection of the community.
The software has also been described as measuring the amount of consensus in an article.<ref name="Wired">[https://www.wired.com/wiredscience/2009/08/wikitrust/ Wikipedia to Color Code Untrustworthy Text], an August 30, 2009 article from ''[[Wired News]]''</ref> The community of editors collaborate on articles and revise each other until agreement is reached. Users who make edits which are more similar to the final agreement will receive more reputation. The point is also made that consensus revolves around the beliefs of the community, so that the reputation computed is also a reflection of the community.


==See also== <!-- These need to be integrated into the text, references permitting -->
==See also==
<!-- These need to be integrated into the text, references permitting -->
* [[Artificial intelligence in Wikimedia projects]]
* [[Flagged revisions]]
* [[Flagged Revisions]]
* [[Reliability of Wikipedia]]
* [[Reliability of Wikipedia]]


Line 46: Line 52:
==External links==
==External links==
* {{Official website|http://www.wikitrust.net/}}
* {{Official website|http://www.wikitrust.net/}}
* [http://github.com/collaborativetrust/WikiTrust Source code repository]
* [https://github.com/collaborativetrust/WikiTrust Source code repository]


{{DEFAULTSORT:Wikitrust}}
{{DEFAULTSORT:Wikitrust}}
[[Category:Wikipedia reliability]]
[[Category:Wikipedia reliability]]
[[Category:MediaWiki extensions]]

Latest revision as of 02:45, 26 November 2024

WikiTrust
Developer(s)UCSC Online Collaboration Lab
Stable release
v2.12 / November 19, 2008[1]
Preview release
v3.0.pre1 / August 21, 2009[2]
Written inPHP, OCaml[3]
PlatformFireFox, MediaWiki
TypeMediaWiki plug-in
LicenseBSD, GPL[4]
Websitewikitrust.soe.ucsc.edu

WikiTrust was a software product, available as a Firefox Plugin, which aimed to assist editors in detecting vandalism and dubious edits by highlighting the "untrustworthy" text with a yellow or orange background. As of September 2017, the server is offline,[5] but the code is still available for download.

When the UCSC server was active, WikiTrust assessed the credibility of content and author reputation of wiki articles using an automated algorithm. WikiTrust provides a plug-in for servers using the MediaWiki platform, such as Wikipedia. When installed, it was designed to enable users of that website to obtain information about the author, origin, and reliability of that website's wiki text.[5] Content that is stable, based on an analysis of article history, should be displayed in normal black-on-white type, and content that is not stable is highlighted in varying shades of yellow or orange. It was formerly available for several language versions of Wikipedia.

WikiTrust on Wikipedia was undertaken by the Online Collaboration Lab at the University of California, Santa Cruz, in response to a Meta-wiki quality initiative sponsored by the Wikimedia Foundation.[5] The project, discussed at Wikimania 2009, was one of a number of quality/rating tools for Wikipedia content that the Wikimedia Foundation was considering.[6] Communications of the ACM (August 2011) had an article on it.[7] WikiTrust is designed for English and German use via the Wiki-Watch pagedetails for Wikipedia articles,[8] in several languages via a Firefox plugin or it can be installed in any MediaWiki configuration.[9] By 2012, WikiTrust appeared to be inactive.[10]

Software application

[edit]

Computing reliability

[edit]

WikiTrust computes, for each word, three pieces of information:

  • The author of the word.
  • The revision where the word (and the immediately surrounding text) was inserted. By clicking on a word, visitors are sent to the revision where the word originated.
  • The "trust" of the word, indicated by the word background coloring (orange for "untrusted" text, white for "trusted" text).

The trust of the word is computed according to how much the word, and the surrounding text, have been revised by users that WikiTrust considers of "high authority."[11][12] This project is still in a beta test stage.[12][13]

Criticism

[edit]

The criticism has been raised[11] that "the software doesn’t really measure trustworthiness, and the danger is that people will trust the software to measure something that it does not." Generally, users whose content persists for a long time without being "reverted" by other editors are deemed more trustworthy by the software.[12][13] This may mean that users who edit controversial articles subject to frequent reversion may be found to be less trustworthy than others.[13] The software uses a variation of Levenshtein distance to measure how much of user's edit is kept or rearranged, so that users can receive "partial credit" for their work.[14]

Community bias

[edit]

The software has also been described as measuring the amount of consensus in an article.[15] The community of editors collaborate on articles and revise each other until agreement is reached. Users who make edits which are more similar to the final agreement will receive more reputation. The point is also made that consensus revolves around the beliefs of the community, so that the reputation computed is also a reflection of the community.

See also

[edit]

References

[edit]
  1. ^ WikiTrust Release History from the UCSC Online Collaboration Lab
  2. ^ Browse Files for WikiTrust on GitHub
  3. ^ Installation Advice Archived 2009-02-13 at the Wayback Machine from the UCSC Online Collaboration Lab
  4. ^ WikiTrust on GitHub
  5. ^ a b c Main Page from the UCSC Online Collaboration Lab
  6. ^ Wikipedia Considers Coloring Untested Text, an August 31, 2009 article from Information Week
  7. ^ CACM 54 No. 8 Reputation Systems for Open Collaboration Luca De Alfaro, Ashutosh Kulshreshtha, Ian Pye, B. Thomas Adler pp 81-7
  8. ^ Wiki-Watch.org: Wiki-Watch.org: a new tool to evaluate the quality of Wikipedia’s articles January 13, 2011.
  9. ^ WikiTrust: Wikitrust.soe.ucsc.edu
  10. ^ Andrew G. West (25 November 2012). "WikiTrust" Wikipedia:Village pump (technical).
  11. ^ a b "Computing Wikipedia's Authority". ACRLog. Association of College & Research Libraries.
  12. ^ a b c See "UCSC Wiki Lab". Archived from the original on 2009-09-20. Retrieved 2009-09-26.
  13. ^ a b c "Software tests accuracy of Wikipedia entries". Canadian Broadcasting Corporation. September 6, 2007.
  14. ^ B. Adler and L. de Alfaro. A Content-Driven Reputation System for the Wikipedia. In WWW 2007, Proceedings of the 16th International World Wide Web Conference, ACM Press, 2007.
  15. ^ Wikipedia to Color Code Untrustworthy Text, an August 30, 2009 article from Wired News
[edit]
Retrieved from "https://en.wikipedia.org/enwiki/w/index.php?title=WikiTrust&oldid=1259613929"