Talk:Future of Wikipedia: Difference between revisions

From Cyberlaw: Difficult Issues Winter 2010
Jump to navigation Jump to search
No edit summary
(Inadvertent Deletions? Undo revision 751 by Brunomagrani (Talk))
Line 1: Line 1:
'''Meta info:'''
== Background ==


We welcome external participation in our wiki. We are already grateful for the contributions people have been doing especially in the sorts of problems Wikipedia is facing. We have been reading some of [http://wikipediareview.com/index.php?showtopic=28144 the comments some people are making about our course] and we would like to have everybody's help giving feedback on some of the ideas we had to address the problems listed.
* [http://wikipediareview.com/index.php?showtopic=25352 Wikipedia Timeline]
* [http://mywikibiz.com/Wikipedia_scandals Wikipedia Scandals]
* [http://mywikibiz.com/Wikipedia_Vandalism Wikipedia Vandalism]


Our first challenge is to pick a manageable set of problems to work. If we don't focus we run the risk of not achieving anything by trying to solve too many issues. Tonight and tomorrow we'll be posting our ideas of what issues we'd like to tackle and what the potential solutions would look like. Your feedback here would be more than welcome.
== Potential Problems to be Explored ==


==Final list of Problems for the Group==
===Unsafe @ Any Speed?===
*To be defined


==Background on Wikipedia==
* Need to consider the very real possibility that Wikipedia is an inherently defective social-technical product that cannot be fixed by any means even remotely feasible given the present conditions of its existence.
* Technical infrastructure needs to be improved


Wikipedia was formally launched on January 15, 2001, by Jimmy Wales and Larry Sanger.<ref name="History of Wikipedia">[http://en.wikipedia.org/wiki/History_of_Wikipedia],History of Wikipedia.</ref> It represented a new development in the collaborative, web-based creation of bodies of knowledge.  Initially it was a complement to the expert-written encyclopedia project “Nupedia,”<ref name="Nupedia">[http://en.wikipedia.org/wiki/Nupedia], Wikipedia Entry on Nupedia.</ref>  in order to provide an additional source of articles.  Wikipedia soon outpaced Nupedia and grew to be arguably the most successful example of collaborative content creation.  Today Wikipedia boasts that it contains several million articles and pages in hundreds of languages worldwide contributed by millions of users.
===Critical Reflective Self-Study and Institutional Research?===


Wikipedia is arguably the most successful online collaboration but it is not the first.  One early predecessor was Interpedia, initiated in 1993,<ref name="Interpedia">[http://en.wikipedia.org/wiki/Interpedia], Wikipedia Entry on Interpedia</ref> although the project never fully left the planning stages.<ref name="Joseph Reagle Article on Interpedia & Wikipedia Background">[http://reagle.org/joseph/2005/historical/digital-works.html#heading5], Joseph Reagle Article on Interpedia & Wikipedia Background.</ref> Free Software Foundation’s Richard Stallman described the need for a free universal encyclopedia in 1999, although the Free Software Foundation didn’t launch its GNUPedia to compete with Nupedia until January 17, 2001, two days after the start of Wikipedia.<ref name="The Free Universal Encyclopedia and Learning Resource">[http://www.gnu.org/encyclopedia/free-encyclopedia.html],The Free Universal Encyclopedia and Learning Resource.</ref>  And Wikipedia itself grew out of Nupedia, an online collaborative encyclopedia.  On January 10, 2001, Wales and Sanger created the first Nupedia wiki, but reputedly Nupedia’s expert volunteers did not want to participate, so Wikipedia was established as a separate site.<ref name="History of Wikipedia">[http://en.wikipedia.org/wiki/History_of_Wikipedia], History of Wikipedia.</ref>  Wikipedia’s vision: ''Imagine a world in which every single human being can freely share in the sum of all knowledge. That’s our commitment.''<ref name="Wikimedia Foundation">[http://wikimediafoundation.org/wiki/Home], Wikimedia Foundation</ref>   
* The difficulties, if not impossibilities, of continuous quality improvement in a system that is hostile to critical feedback and resistant to the principles of learning organizations.  It would be possible to make a very long list of previous efforts along these lines that have been aborted or gutted by the prevailing dynamics of the Wikipedian subculture.


===Growth of Wikipedia===
* If crowdsourcing is so great, why does the Wikimedia Foundation need to hire professional strategic planning ''cum'' public representation agencies like the Bridgespan Group to do its institutional research?


The growth of Wikipedia depended on the contribution of numerous lay users, a departure from the Nupedia tradition of using expert contributors.  Nupedia was founded upon the use of highly qualified expert contributors and a multi-step peer review process, but despite its interested editors, the process was slow, and only 12 articles were written in the first year.<ref name="Early History of Nupedia">[http://features.slashdot.org/article.pl?sid=05/04/18/164213&tid=95&tid=149&tid=9], The Early History of Nupedia and Wikipedia: A Memoir - Part I" and "Part II", Slashdot, April 2005.</ref>  Wikipedia, in contrast, generated over 1,000 articles in its first month of operation and over 20,000 articles in its first year—a rate of 1,500 articles per month.<ref name="History of Wikipedia">[http://en.wikipedia.org/wiki/History_of_Wikipedia], History of Wikipedia.</ref>  In March, 2001, Wikipedia expanded into multilingual sites, beginning the development of Wikipedias for all major languages.<ref>http://lists.wikimedia.org/pipermail/wikipedia-l/2001-March/000049.html</ref>
=== The Laborious Way That Decisions Are Made? ===


===Wikimedia===
* Process vs. Substance


Initially, Wikipedia was managed by Bomis, a commercial web portal headed by Jimmy Wales.  In March 2002, during the dot-com bust, Bomis withdrew funding for Wikipedia.<ref name="Schiff, Stacy">[http://www.newyorker.com/fact/content/articles/060731fa_fact].(July 31, 2006). Schiff, Stacy. "Know It All". The New Yorker.</ref>  At that time, Larry Sanger left both Nupedia and Wikipedia. He returned briefly to academia, then joined the Digital Universe Foundation and founded Citizendium, an alternative open encyclopedia that uses real names for contributors to discourage vandalism and expert guidance to ensure accuracy of information.<ref name="Anderson, Nate">[http://arstechnica.com/articles/culture/citizendium.ars], Anderson, Nate (February 25, 2007). "Citizendium: building a better Wikipedia". Ars Technica.</ref> 
=== Newbies? Editing Interface ===


Meanwhile, after substantial consultation with Alex Roshuk, Jimmy Wales created the Wikimedia Foundation (WMF), a non-profit charitable organization headquartered in St. Petersburg, FL, later moved to San Francisco, CA.<ref name="Wikimedia Foundation">[http://wikimediafoundation.org/wiki/Home], Wikimedia Foundation.</ref>  Announced on June 20, 2003, the WMF serves as an umbrella body that includes several other types of wiki collaborative information sharing sites:
:* Is maintaining a higher complexity level in the editing interface a mechanism for quality control?  (e.g. users needs to be at least nominally computer literate to be able to edit/operate within wikipedia)
:* Breaking through the glass ceiling - how can newbies be encouraged to contribute?


* Wikipedia
=== Demographics and Gender Issues===
* [http://www.wiktionary.org/ Wiktionary]
* [http://www.wikiquote.org/ Wikiquote]
* [http://en.wikibooks.org/wiki/Main_Page Wikibooks] (including [http://en.wikibooks.org/wiki/Wikijunior Wikijunior])
* [http://wikisource.org/wiki/Main_Page Wikisource]
* [http://commons.wikimedia.org/ Wikimedia Commons]
* [http://species.wikimedia.org/ Wikispecies]
* [http://en.wikinews.org/ Wikinews]
* [http://en.wikiversity.org/ Wikiversity]
* [http://incubator.wikimedia.org/ Wikimedia Incubator]
* [http://meta.wikimedia.org/ Meta-Wiki]


The foundation's by-laws declare a statement of purpose of collecting and developing educational content and to disseminate it effectively and globally.<ref name="Wikimedia Foundation bylaws">[http://wikimediafoundation.org/w/index.php?title=Wikimedia_Foundation_bylaws&oldid=20641#ARTICLE_II_-_STATEMENT_OF_PURPOSE], Wikimedia Foundation bylaws. Archived from the original on 2007-04-20.</ref>  Wikimedia is managed by a Board of Trustees.   The Foundation and a team of local volunteers also organize [http://wikimania2009.wikimedia.org/wiki/Portal Wikimania] every year, a conference for users of the Wikimedia Foundation projects.
* Numerous discussions of Population Models can be found among the articles and comments at the [http://asc-parc.blogspot.com/search/label/wikipedia Augmented Social Cognition Blog # Wikipedia].


==Academic Studies of Wikipedia==
* It is extremely doubtful that meaningful statistics about demographics can be derived from database records and self-reports that maintain no real accountability of Person Data.


Academic studies of Wikipedia have mainly used Wikipedia as a tool to analyze other phenomena.  The users on Wikipedia provide a large database of subjects which the researchers use to test their hypotheses or as a social network which can be manipulated and observed.  The majority of studies focus on either semantic relatedness<ref>M Strube et al,[http://www.aaai.org/Papers/AAAI/2006/AAAI06-223.pdf WikiRelate!], Computer Semantic Relatedness Using Wikipedia, Proceedings of the National Conference on Artificial Intelligence (2006)</ref><ref>E Gabrilovich et al, [http://www.aaai.org/Papers/IJCAI/2007/IJCAI07-259.pdf Computing Semantic Relatedness Using Wikipedia-Based Explicit Semantic Analysis](2007)</ref><ref>Zesch et al, Analyzing and Accessing WIkipedia as a Lexical Semantic Resource, Data Structures for Linguistic Resources (2007).</ref> or online coordination and conflict resolution techniques.<ref name="Coordination">Viegas et al, [[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.84.6907&rep=rep1&type=pdf Talk Before You Type: Coordination in Wikipedia], Hawaii International Conference on System Sciences (2007)</ref><ref name ="Kittur">Kittur et al, [http://portal.acm.org/citation.cfm?id=1240624.1240698 He Says, She Says; Conflict and Coordination in Wikipedia], Proceedings of the SIGCHI Conference on Human Computing (2007)</ref><ref name="Wilkonson">D Wilkonson & B Huberman, [http://arxiv.org/abs/cs/0702140 Assessing the Value of Cooperation in Wikipedia, Computers and Society], arXiv:cs/0702140v1 [cs.DL] (2007).</ref>
* Horror stories of massive deception in this arena can be compiled and multiplied at will.


There is a persistent and widespread failure of academic studies to address the realities of Wikipedia, as opposed to the wishful pipe-dreams of armchair speculators and the uncritical recycling of Wikipedian promotional claims.  There is a pressing need for the application of disciplined field study methods and qualitative research based on systematic participant observation.
=== The View (or lack thereof) of Wikipedia in Institutions and to the General Public? ===


==Academic Reflections on Wikipedia==
:* Fleshing out references to bolster things?
:* There has been a decrease in volume of editor base and outreach initiatives have historically not been a priority


* Cummings, Robert E. (12 Mar 2009), "Are We Ready to Use Wikipedia to Teach Writing?", ''Inside Higher Ed''.  [http://www.insidehighered.com/views/2009/03/12/cummings Online].
=== Not using all of its potential? ===


* Jaschik, Scott (26 Jan 2007), "A Stand Against Wikipedia", ''Inside Higher Ed''.  [http://www.insidehighered.com/news/2007/01/26/wiki Online].
=== The Quality Issue? ===
:* Deletionism and inclusionism in Wikipedia
:* Using Mechanical Turks for editing
:* Gate keepers
:* [http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1502759 Wikipedia in Court: When and How Citing Wikipedia and Other Consensus Websites is Appropriate]


* Lih, Andrew (16 Dec 2009), "Ron Livingston, Growth, and Wikipedia".  [http://www.andrewlih.com/blog/2009/12/16/ron-livingston-growth-and-wikipedia/ Online].
=== Online harassment or defamation problem in Wikipedia? ===


* Matetsky, Ira (May 2009), "Thoughts on Wikipedia", ''The Volokh Conspiracy''.  [http://volokh.com/posts/chain_1242098183.shtml Online].
* Ron LIvingston v. Mark Binmore
* Star Wars Kid
* ReputationDefender
** Maybe this is not a problem of Wikipedia, this is a problem in the internet generally


* Schumacher, Mary Louise (30 Apr 2009), "Deconstructing Wikipedia", ''Milwaukee Journal Sentinel''.  [http://www.jsonline.com/blogs/entertainment/44035017.html Online].
== Solutions Looking for Problems ==


* Wilson, Mark A. (01 Apr 2008), "Professors Should Embrace Wikipedia", ''Inside Higher Ed''.  [http://www.insidehighered.com/views/2008/04/01/wilson Online].
=== Getting Educational Institutions to Explicitly Participate ===


* Partnership Program w/ Schools-Teachers?
*:Need to identify what benefits, if any, would accrue to teachers, students, or Wikipedia by such a partnership.
*:: zing! [http://www.insidehighered.com/views/2009/03/12/cummings Are We Ready to Use Wikipedia to Teach Writing?]
::: [http://www.insidehighered.com/views/2009/03/12/cummings#Comments Just be sure to read all the comments, too].
::: From the standpoint of the purpose identified in the Cummings blogicle, I question whether teaching students how to succeed in Wikipedia's dysfunctional rhetorical environment, or learning Wikipedia's preferred style of authorship, which is difficult to distinguish from organized, sanctioned plagiarism, is of any benefit to students or to teachers.  Wikipedia also has a tendency to be resistant to such efforts; I recall several instances of students having been assigned to edit Wikipedia and subsequently being blocked on the grounds that their assignment created a "conflict of interest" (a term of art within Wikipedia's idiosyncratic jargon which means something other than what an ordinary person would think it means). [[User:Kelly Martin|Kelly Martin]] 17:53, 13 January 2010 (UTC)
*:: so "Partnership" was thrown around incredibly loosely
* Getting students to flag hotspots (see flagging proposal)
* Getting students to learn about how projects like Wikipedia work
*: A proper study of how Wikipedia works, and more importantly how Wikipedia fails, could possibly be of interest for students in social psychology, abnormal psychology, political science, marketing, and other related fields.  Marketing people, especially, should be very interested in learning how to exploit Wikipedia more effectively.  [[User:Kelly Martin|Kelly Martin]] 17:53, 13 January 2010 (UTC)
** Clarifying how '''not''' to use Wikipedia
** Addressing institutions' views on sources, primary and secondary
** Addressing Wikipedian's concerns on newbies
**: A recent attempt at a quality control study (the "NEWT project") on the treatment of editors perceived to be newbies by managers of Wikipedia's speedy deletion process was met with strong disapproval by the community.  Wikipedia's community actively resists efforts, either internal or external, to examine its internal processes and behaviors, except when the purpose is clearly structured from the beginning to be adulatory.
* Keeping in mind all of this: [http://en.wikipedia.org/wiki/Schools_and_universities_project Wikipedia school and university projects]


==List of Potential Problems and discussion==
=== Flagging for Engagement, Second Look ===
* Newbies who see flagrantly wrong or misleading content (within their knowledge base) may feel more compelled to make corrections and participate in Wikipedia.  How do we make this connection?


===Difficult Problems : Three Big Questions===
=== Zittrain's highlighting proposal ===
:Firefox Add-on like DisputeFinder?


This section addresses the following questions:
== Meta!Meta! Time Frame ==


# What is the mission of the Wikipedia project?
=== HW due Jan. 13, 2010 ===
# What are the methods of the Wikipedia project?
# Are the methods adequate to the mission?


====What is the Mission?====
*Go get your hands dirty in Wikipedia
*Rank biggest Problems
*Get Wikipedia Review guys to give us their thoughts
**Hello and Welcome!


=====Education=====
=== In-Class Presentation Thurs. Jan 21, 2010 ===
 
======Aspects of Education======
 
* Education in Citizenship
 
* Education in Scholarship
 
======Issues in Education======
 
What are the effects of the Wikipedia environment on the critical thinking, information literacy, and research skills of its participants?
 
'''Critical Reflective Thinking'''
 
'''Balancing Content and Process'''
 
Too much commentary on what students learn from Wikipedia stops with the content of articles and fails to examine what students learn from participating in the culture of Wikipedia.  Educators know that education is as much about process as it is about product.  They understand that students “learn by doing”, by taking part in communities of practice.  What do students learn by playing the Wikipedia online game?
 
=====Information=====
 
* The role of an informed citizenry in democratic societies
 
=====Socialization=====
 
* The preservation and transmission of culture
 
====What are the Methods?====
 
====Are the Methods Adequate to the Mission?====
 
===Difficult Problems : Effects of Wikipedia Subculture on the External Society===
 
What are the effects of the Wikipedia environment on the critical thinking, information literacy, and research skills of its participants?
 
Too much commentary on what students learn from Wikipedia stops with the content of articles and fails to examine what students learn from participating in the culture of Wikipedia.
 
Educators know that education is as much about process as it is about product.  They understand that students “learn by doing”, by taking part in communities of practice.  What do students learn by playing the Wikipedia online game?
 
The effects of using Wikipedia as a source of information is a research question.
 
The effects of participating more broadly in Wikipedian activities, from the editing game to the policy-making game, is another research question.
 
Even a bad source of information and a bad guide to the norms of research methodology can serve the ends of critical thinking and information literacy &mdash; '''''if''''' the user is afforded the opportunity to reflect on its deficiencies.
 
Whether Wikipedia helps or hinders the user in gaining that capacity is yet another research question.
 
Educators are aware that learners have many different paths to knowledge. Among the most obvious are these:
 
# Learning by being told.
# Learning by doing things for oneself.
# Learning by watching what others do.
 
What do people learn from participating in the full range of activities provided by the Wikipedia website, considered with regard to each of these modes?
 
Some of the questions that educational researchers would naturally think to ask about the Wikipedia experience are these:
 
# What do people learn about the ethical norms of journalism, research, and scholarship?
# What do people learn about the intellectual norms of journalism, research, and scholarship?
 
For example, questions that one might ask under the indicated headings are these:
 
# What do people learn about the relative values of primary and secondary sources from reading the relevant policy pages in Wikipedia?
# What do people learn about plagiarism from watching what others do in Wikipedia?
 
===Difficult Problems : The Bridgespan Strategy===
 
Following Wikimania 2009, the Wikimedia Foundation (in cooperation with The Bridgespan Group) created a [http://strategy.wikimedia.org/wiki/Main_Page strategy wiki] that identifies major concerns for the future of the WMF and its projects, and this wiki permits users to contribute and comment on proposed solutions, so long as the contributions meet with approval.  A number of contributors have been blocked.<ref>[http://strategy.wikimedia.org/w/index.php?title=Special:Log&limit=100&type=block&user=Philippe&month=&year= Block log] of coordinator Philippe Beaudette</ref>  The problems presented below have been highlighted as the most significant and challenging problems facing the WMF and its projects.
 
====Identity and Growth of the Contributing Community====
 
There are three main concerns relating to the contributing community that sustains Wikipedia:
 
# Size of the contributing community &mdash; is it sustainable and is it sufficient?
# Identity of the contributing community &mdash; does population bias create content bias?
# Inequality within contributing community &mdash; does Wikipedia really represent contributions of the many, or is it moving towards an elite system?
 
It needs to be appreciated that no statement about the demographics of Wikipedia editors is verifiable according to the usual standards of statistical research.  The relationship between real people and editor accounts is known to be many-to-many, but the extent of its deviation from a one-to-one correspondence is simply not assessable on the grounds rules of the site.
 
=====Size=====
 
Several studies and articles have suggested that Wikipedia's contributing community has slowed growth, stopped growing, or is even declining (see [http://prawo.uni.wroc.pl/~kwasnicki/EkonLit6/WikipediaSoul.pdf Battle for Wikipedia's Soul]"; "[http://asc-parc.blogspot.com/2009/07/part-1-slowing-growth-of-wikipedia-some.html Slowing Growth of Wikipedia]"; or "[http://www.resourceshelf.com/2009/11/23/wsj-volunteers-log-off-as-wikipedia-ages/ Volunteers Log Off as Wikipedia Ages]" for a sample).  Others, such as Oded Nov, have looked at [http://drop.io/cyberlaw_winter10 "What Motivates Wikipedians"] and concluded that the majority are motivated by fun.  But is Wikipedia "fun" enough to maintain its contributing community?  A [http://asc-parc.blogspot.com/2009/07/part-1-slowing-growth-of-wikipedia-some.html study] by the Palo Alto Research Centre found that the number of new articles added per month flatlined at 60,000 in 2006 and has since declined by a third. Wikimedia Australia's Vice-President, Liam Wyatt explains this: "Because the project is much more filled out and more complete, it's increasingly harder for new users to be able to add something without some level of expertise."
 
=====Identity and Bias=====
 
Studies on Wikipedia's contributing population determine that the majority are white males (Oded Nov says 92.7% male, another [http://blogs.wsj.com/digits/2009/08/31/only-13-of-wikipedia-contributors-are-women-study-says/ 87%]). If this is the case, does Wikipedia truly represent an unbiased cross-section of global (or even American) knowledge? How does the identity of the contributing community bias Wikipedia regarding politics? Consider claims that Wikipedia needs to be further censored or is being [http://state-ethics.blogspot.com/2009/07/censoring-wikipedia-2.html manipulated by Nazis] seeking to control the flow of information in Germany, or that its editors are [http://www.conservapedia.com/Conservapedia:How_Conservapedia_Differs_from_Wikipedia far more liberal than the American public].
 
=====Inequality=====
 
Within the Wikipedia contributing community, there has been a rapid divide between "contributors" and "editors", with editors determining much of the style, tone and occasionally content of articles. One study found that “elite users” were pushing out new contributors, with 25% of occasional wiki editors’ changes being erased or reverted by established editors. This was up from 10% in 2003.<ref>[http://www2.computer.org/portal/web/csdl/doi/10.1109/HICSS.2008.333 Editors as Elite Users]</ref>.
 
Once again, Wikipedia has editor accounts only.  It is possible to predicate properties of editor accounts based on their contribution histories, but it is not possible to extrapolate those predicates to real persons with any degree of verifiability.  The accountability of the distinction claimed above is thoroughly undermined by the fact the same person may be editing under many accounts and many persons may be editing under the same account.
 
====Quality Control : Perceived and Actual====
 
It is important to distinguish between concerns about the actual quality of Wikipedia articles and concerns about the perceived quality of the articles.  The one should be approached as a contributor and technical problem, and the other should be addressed as a publicity problem.  Also, the concept of quality is intentionally broad and includes everything from accuracy of information, to degree of citation provided, to the quality of images and prose.
 
=====Actual Quality of Wikipedia=====
 
On October 24, 2005, ''The Guardian'' published an article entitled  "Can you trust Wikipedia?" where a panel of experts were asked to critically review seven entries related to their fields.<ref name="Guardian">[http://technology.guardian.co.uk/opinion/story/0,16541,1599325,00.html], Can you trust Wikipedia?, ''The Guardian'', 2008.</ref> One article was deemed to have made "every value judgement &hellip; wrong", the others receiving marks from 5 to 8 out of a notional ten. Of the other six articles reviewed and critiqued, the most common criticisms were:
 
# Poor prose, or ease-of-reading issues (3 mentions)
# Omissions or inaccuracies, often small but including key omissions in some articles (3 mentions)
# Poor balance, with less important areas being given more attention and vice versa (1 mention)
The most common praises were:
# Factually sound and correct, no glaring inaccuracies (4 mentions)
# Much useful information, including well-selected links, making it possible to "access much information quickly" (3 mentions)
 
''Nature'' reported in 2005 that science articles in Wikipedia were comparable in accuracy to those on ''Encyclopedia Britannica'''s web site. Out of 42 articles, only 4 serious errors were found in Wikipedia, and 4 in ''Encyclopedia Britannica'', although more than a hundred lesser errors and omissions were found in each and Wikipedia's articles were often "poorly structured."<ref>P.D. Magnus, [http://www.britannica.com/bps/additionalcontent/18/36449903/On-Trusting-WIKIPEDIA On Trusting Wikipedia], Britannica.</ref>
 
On March 24, 2006, ''Britannica'' provided a rebuttal of this article, labeling it "fatally flawed",<ref name="Nature Flawed BE">[http://en.wikinews.org/wiki/Journal_Nature_study_%27fatally_flawed%27%2C_says_Britannica], Journal Nature study "fatally flawed" says Britannica, March 24, 2006, Wikinews. </ref> to which ''Nature'' responded.<ref name="Nature Responds">[http://www.nature.com/press_releases/Britannica_response.pdf], Encyclopedia Britannica and Nature: A Response, March 23, 2006.</ref>
 
Among Britannica's criticisms were that excerpts rather than the full texts of some of their articles were used, that Nature composited parts of different Britannica texts to make a text for review in one case, that Nature did not check the factual assertions of its reviewers, and that many points which the reviewers labeled as errors were differences of editorial opinion. Nature responded that any errors on the part of its reviewers were not biased in favor of either encyclopedia, that in some cases it used excerpts of articles from both encyclopedias, and that Britannica did not share particular concerns with Nature before publishing its "open letter" rebuttal.
 
Three subsequent studies -- a 2006 web-based survey,<ref>[http://bpastudio.csudh.edu/fac/lpress/wikieval], Larry Press, Survey of Wikipedia accuracy and completeness, Professor of Computer Information Systems, California State University (2006)</ref> a 2004 comparison of ''Brockhaus Multimedial'', ''Microsoft Encarta'', and the German Wikipedia, <ref>Michael Kurzidim: Wissenswettstreit. Die kostenlose Wikipedia tritt gegen die Marktführer Encarta und Brockhaus an, in: ''c't'' 21/2004, October 4, 2004, S. 132-139.</ref> (repeated in 2007 <ref>Dorothee Wiegand: "Entdeckungsreise. Digitale Enzyklopädien erklären die Welt." c't 6/2007, March 5, 2007, p. 136-145.</ref>), and a 2007 review by Australian magazine ''PC Authority''<ref>[http://www.pcauthority.com.au/Feature/93908,wikipedia-uncovered.aspx/1], PC Authority:'Wikipedia Uncovered'.</ref> -- concluded that Wikipedia was generally as reliable as other traditional encyclopedias.
 
However, Wikipedia may not be as reliable in technical or specialized fields. A peer-reviewed 2008 study<ref>[http://www.theannals.com/cgi/reprint/aph.1L474v1.pdf] KA Clauson et al., Scope, completeness, and accuracy of drug Iinformation in Wikipedia, 42 Annals Pharmacotheraphy 1814 (2008).</ref>examined 80 Wikipedia drug entries. The research team  found few factual errors but determined that these articles were often missing important information, like contraindications and drug interactions. One of the researchers noted that "If people went and used this as a sole or authoritative source without contacting a health professional...those are the types of negative impacts that can occur." The researchers also compared Wikipedia to Medscape Drug Reference (MDR), by looking for answers to 80 different questions covering eight categories of drug information, including adverse drug events, dosages, and mechanism of action. They have determined that MDR provided answers to 82.5 percent of the questions, while Wikipedia could only answer 40 percent, and that answers were less likely to be complete for Wikipedia as well. None of the answers from Wikipedia were determined factually inaccurate, while they found four inaccurate answers in MDR. But the researchers found 48 errors of omission in the Wikipedia entries, compared to 14 for MDR. The study noted that Wikipedia articles improved significantly over time. The lead investigator concluded: "I think that these errors of omission can be just as dangerous [as inaccuracies]", and he pointed out that drug company representatives have been caught deleting information from Wikipedia entries that make their drugs look unsafe.
 
Another informal but systematic study of one calendar quarter's worth of edits to Wikipedia's one hundred articles about the 100 senators of the United States determined that these articles were interspersed with incorrect information or defamation about 6.8% of the time.<ref>[http://www.mywiki​biz.com/Wikipedia_Vandalism_Study Vandalism study of U.S. senators], analyzing data from 4th Quarter, 2007.</ref>
 
In addition to these potential omissions (or purposeful deletions), the structure of Wikipedia lends itself to several [http://en.wikipedia.org/wiki/Reliability_of_Wikipedia#cite_note-50 potential vulnerabilities]:
 
#Information citation loops
#Vandalism
#Anonymity of authors lending to false information (see e.g. the [http://ascii.textfiles.com/archives/1062 Essjay controversy])
 
In 2007, XKCD created a humorous [http://xkcd.org/285/ comic] illustrating a feature (references and citations) designed to ensure greater accuracy in articles.
 
=====Perceived Quality of Wikipedia=====
 
Whether or not Wikipedia actually is accurate, its reception as a trusted source has been plagued by doubts regarding the trustworthiness of its content as the product of mass collaboration by anonymous authors. 
 
Years ago, the perception of Wikipedia in the average population was relatively high.  In a web-based survey conducted in spring 2006, fifty participants rated Wikipedia articles: 76% agreed that the article was accurate, and 46% agreed it was complete. The same survey compared Wikipedia to Encyclopedia Britannica: of 18 responses, 6 favored Britannica, 7 favored Wikipedia, and 11 found Wikipedia more complete.<ref>Larry Press, "[http://bpastudio.csudh.edu/fac/lpress/wikieval/ Survey of Wikipedia accuracy and completeness]," Professor of Computer Information Systems, California State University (2006).</ref>
 
However, Wikipedia's '''reception by academia''' has been less than stellar, and current popular perception of the compendium is on the decline.  (Note the January 10 [http://en.wikipedia.org/wiki/Love_Rollercoaster_%28The_Cleveland_Show%29 episode] of ''The Cleveland Show'', where Cleveland Brown, Jr. asks his sister (disguised as "Tyra Obama") if it's true "you guys can clap your breasts together like a seal", and when she says "No", he deadpans to the camera, "Thanks a lot, Wikipedia".)
 
Even if Wikipedia itself doesn’t intend to be used as a course for academic works, it is often used by students and researchers as a starting point.  However, the open-source collaborative and anonymous efforts that produce Wikipedia have led to wide-spread skepticism of its accuracy.  Most of the angry responses targeted at Wikipedia have been aimed at its claim to be an encyclopedia. Such claims are thought to establish greater expectations of accuracy than are or possibly can be achieved by non-expert collaboration. Academics have also criticized Wikipedia for its perceived failure as a reliable source, and because Wikipedia editors may not have degrees or other credentials generally recognized in academia.
 
Robert McHenry, a former editor-in-chief for the Encyclopedia Britannica, describes Wikipedia as the “Faith-Based Encyclopedia.”  He describes the “crucial and entirely faith-based step” in the Wikipedia process: “Some unspecified quasi-Darwinian process will assure that those writings and editings by contributors of greatest expertise will survive; articles will eventually reach a steady state that corresponds to the highest degree of accuracy.” This step, he argues, is a completely unwarranted leap of faith. Rather, “Contrary to the faith, the article has, in fact, been edited into mediocrity.”<ref name=McHenry>[http://www.tcsdaily.com/article.aspx?id=111504A], Robert McHenry, The Faith-Based Encyclopedia Blinks, Dec 14, 2005 (2008).</ref>
 
Andrew Orlowski accuses Wikipedia of being a “vanity exercise” for calling itself an encyclopedia, and writes that the use of the term "encyclopedia" to describe Wikipedia may lead users into believing it is more reliable than it may be.  He points out (describing a libel case against Wikipedia) that “If what we today know as "Wikipedia" had started life as something called, let's say - "Jimbo's Big Bag O'Trivia" - we doubt if it would be the problem it has become.”  The public begins to expect trustworthy information from Wikipedia and instead gets a “king-sized cocktail” of bureaucracy and “spontaneous graffiti.” <ref>[http://www.theregister.co.uk/2005/12/12/wikipedia_no_responsibility/page2.html], Andrew Orlowski, "Who's responsible for Wikipedia?" The Register, Dec 12, 2005.</ref>
 
Middlebury College went so far as to [http://www.historycooperative.org/journals/jah/93.1/rosenzweig.html?pr=jah931 ban the citation of Wikipedia] in papers in its history department.  On this note, however, consider the fact that Wikipedia itself states in its guidelines that Wikipedia is not suitable for academic citation because Wikipedia, like any encyclopedia, is a tertiary source.  The use of Wikipedia is not accepted in many schools and universities in writing a formal paper, and some educational institutions have banned it as a primary source while others have limited its use to only a pointer to external sources.<ref name=Duke>[http://media.www.dukechronicle.com/media/storage/paper884/news/2007/03/28/News/Several.Colleges.Push.To.Ban.Wikipedia.As.Resource-2809247.shtml], Lysa Chen, "Several colleges push to ban Wikipedia as resource," Duke Chronicle, March 28, 2007</ref><ref>"[http://www.insidehighered.com/news/2007/01/26/wiki A Stand Against Wikipedia]", ''Inside Higher Ed'' (January 26, 2007). Retrieved on January 27, 2007.</ref><ref name=McHenry>
 
Some academic journals do refer to Wikipedia articles, but do not elevate it to the same level as traditional references.  For instance, Wikipedia articles have been referenced as "enhanced perspectives" provided on-line in the journal Science.  The publisher of Science states that these enhanced perspectives "include hypernotes - which link directly to websites of other relevant information available online - beyond the standard bibliographic references."<ref>[http://www.aaas.org/publications/books_reports/CCLI/PDFs/01_D_Perspectives.pdf], Yolanda S. George & Shirley S.Malcolm, "Perspectives from AAAS|publisher=American Association for the Advancement of Science."</ref>
 
=====Improving Wikipedia's Perceived Accuracy=====
One study presented at the 2008 ACM Conference on Computer Supported Work explored whether a visualizations system could improve readers’ perceptions of trustworthiness in a wiki by exposing hidden article information.<ref>
Kittur, Suh & Chi, Can You Ever Trust a Wiki?: Impacting Perceived Trustworthiness in Wikipedia, in PROCEEDINGS OF THE ACM 2008 CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK (2008) 477-480. [http://portal.acm.org/citation.cfm?id=1460639&dl=GUIDE&coll=GUIDE&CFID=56978117&CFTOKEN=87505552Abstract].</ref> The results suggest that surfacing information that is relevant to the stability of the article and patterns of editor behavior can have a significant impact on users’ trust.  This should be considered in conjunction for proposals on color-coding articles by age, editing contribution etc that are being considered to improve article accuracy.
 
Other suggestions include:
 
*Reputation-based text coloring. Each article could display a button labeled "check text reputation": upon clicking the button, a user would be led to a copy of the page, where the text background color reflects the reputation of the author of each portion of text, as well as the reputation of authors who vetted the text, editing the page while leaving the text in place.  The appeal of this method is that reputation is displayed in an anonymous way, associated to the article text. This avoids placing blame or praise directly on the authors: the impersonal character of this feedback could be well-suited to a collaborative forum such as the Wikipedia.<ref>T. Cross. Puppy smoothies: Improving the reliability of open, collaborative wikis. First Monday, 11(9), September 2006.</ref>
*Restricting edits. Highly controversial articles could be protected, so that only authors with sufficiently high reputation are able to edit them.  This is currently employed by Wikipedia as part of its [http://en.wikipedia.org/wiki/Protection_policy Protection Policy] but it could be expanded.
*Reputation-based alert system.  Wikipedia Editors keep a watchful eye on most controversial articles, and in fact, on a large portion of the Wikipedia, improving content and undoing poor-quality revisions. A reputation system could be used to alert them whenever a crucial or controversial article is modified by a low-reputation author.  A reputation system provides an incentive for high-quality contributions. A reputation system could provide an additional incentive for authors to provide high quality contributions to the Wikipedia.<ref>P. Resnick, R. Zeckhauser, E. Friedman, and K. Kiwabara. Reputation systems. Comm. ACM, 43(12):45{48, 2000. C. Dellarocas. The digitization of word-ofmouth: Promises and challenges of online reputation systems. Management Science, October 2003.</ref>
*Content-Driven Reputation system. Study by Adler & de Alfaro proposes a content-driven reputation system for Wikipedia to allow readers to determine reliability of an article based on the reputation of the contributors and editors.  The reputation of authors would be based on how their contribution to Wikipedia fares: the longer an article or edit remains un-edited or un-altered, the better the author’s reputation.  This can be, however, much less accurate than a user-driven reputation system. Author contributions can be deleted for a variety of reasons, including reorganizations and thorough rewrites of the articles.  Alder & Alfaro address these issues in that the reputation of authors whose edits are reverted to the original text suffers; reputation of authors whose edits are further refined later on do not suffer.<ref>B. Thomas Adler & Luca de Alfaro, [http://works.bepress.com/cgi/viewcontent.cgi?article=1002&context=luca_de_alfaro A Content-Driven Reputation System for the Wikipedia].</ref> 
*Zeng et al. also propose a mechanism wherein the revision history of the Wikipedia article is used to compute a trust value for the article.<ref>H. Zeng, M.A. Alhoussaini, L. Ding, R. Fikes, and D.L. McGuinness. Computing trust from revision history. In Intl. Conf. on Privacy, Security and Trust, 2006.</ref> 
 
* It could also prove interesting to explore combinations of user and content reputation devices.
 
====Sustainability of the Wikimedia Model====
 
The strategy discussions at Wikimania 2009 raised the question of whether Wikimedia, as it stands today, is sustainable: both from a technological and organizational standpoint. 
 
* Is a platform that both supports numerous users and serves less tech savvy contributors possible?
 
* How can Wikimedia ensure its financial stability?
 
* How can Wikimedia re-structure its institutional organization to allow oversight without creating too many levels of hierarchy such that the bureaucracy becomes ungainly?
 
=====Emerging Strategic Priorities=====
 
* Optimize Wikimedia’s operations
 
* Identify roles volunteers are best suited to perform and what are the most effective uses of paid staff
 
* Create alliances and partnerships with other institutions and organizations to advance the mission: also, what are the necessary preconditions to such alliances? How support similar projects?
 
=====Obstacles to Sustainability=====
 
* Persistent lack of accountability
 
* Inability to respond to widespread critical feedback
 
====Expansion and Questions of Scope====
 
Since the founding of Wikipedia in 2001, there has been substantial growth in user-generated online content.<ref>Geist, M. Mapping the digital future. OECD: Organisation for Economic Cooperation and Development 254 (2006), 36–37.</ref><ref>Dunn, J., Byrd, D., Notess, M., Riley, J., and Scherle, R. Variations2: Retrieving and using music in an academic setting. Commun. ACM 49, 8 (Aug. 2006) 53–58.</ref> According to one Nielsen rating, user-generated content drives 50% of the top fastest growing internet brands.<ref>Nielsen NetRating. [www.nielsen-netratings.com/pr/PR_060810.PDF User-generated content drives half of U.S. top 10 fastest growing Web brands], (Aug. 10, 2006).</ref>  Consider just the popularity of collaborative site such as YouTube, Flickr, or Slashdot.org.  Traditional media outlets such as BBC News.com have also added areas for collaboration.<ref>Eltringham, M. [http://news.bbc.co.uk/newswatch/ukfs/hi/newsid_4900000/newsid_4900400/4900444.stm Citizen journalists challenge BBC], BBC NewsWatch (2006).</ref> User-generated content appears to be the way forward – but is Wikipedia a good model upon which to base that progress?  Can the system used for Wikipedia be applied in other scenarios?
 
==Lay Questions for Scholars Concerned with the Role of Law in Society==
 
The Law of any given Land is frequently out of sync &mdash; now leading, now lagging &mdash; the collective common sense of what it takes to constitute a just society.  With that in mind, let us address the questions of justification:
 
# What is and what should be the obligations of interactive media site owners and interactive media site participants toward their fellow citizens, toward the larger communities of inquiry from which they derive their justification, and toward the world at large?
# It is possible to debate the current dictates of the Law at great length &mdash; this has already been done at great length and will no doubt continue to be done at even greater length.  But the ordinary citizen in danger of becoming roadkill on the Internet Autobahn will be concerned with the broader horizon, longer haul issues of where the Law is bound to go if it is designed to achieve and maintain a just society.
 
===Freedom of Speech, False Witness, Truth in Advertising===
 
===Legal and Social Justification for Tax Incentives===
 
==Resources==
 
* [http://akahele.org/ Akahele]
 
* [http://asc-parc.blogspot.com/ Augmented Social Cognition Blog]
 
* The Wikipedia Review : [http://wikipediareview.com/ Forum], [http://wikipediareview.com/blog/ Op-Ed Blog]
 
==References==
<references/>

Revision as of 22:00, 13 January 2010

Background

Potential Problems to be Explored

Unsafe @ Any Speed?

  • Need to consider the very real possibility that Wikipedia is an inherently defective social-technical product that cannot be fixed by any means even remotely feasible given the present conditions of its existence.
  • Technical infrastructure needs to be improved

Critical Reflective Self-Study and Institutional Research?

  • The difficulties, if not impossibilities, of continuous quality improvement in a system that is hostile to critical feedback and resistant to the principles of learning organizations. It would be possible to make a very long list of previous efforts along these lines that have been aborted or gutted by the prevailing dynamics of the Wikipedian subculture.
  • If crowdsourcing is so great, why does the Wikimedia Foundation need to hire professional strategic planning cum public representation agencies like the Bridgespan Group to do its institutional research?

The Laborious Way That Decisions Are Made?

  • Process vs. Substance

Newbies? Editing Interface

  • Is maintaining a higher complexity level in the editing interface a mechanism for quality control? (e.g. users needs to be at least nominally computer literate to be able to edit/operate within wikipedia)
  • Breaking through the glass ceiling - how can newbies be encouraged to contribute?

Demographics and Gender Issues

  • It is extremely doubtful that meaningful statistics about demographics can be derived from database records and self-reports that maintain no real accountability of Person Data.
  • Horror stories of massive deception in this arena can be compiled and multiplied at will.

The View (or lack thereof) of Wikipedia in Institutions and to the General Public?

  • Fleshing out references to bolster things?
  • There has been a decrease in volume of editor base and outreach initiatives have historically not been a priority

Not using all of its potential?

The Quality Issue?

Online harassment or defamation problem in Wikipedia?

  • Ron LIvingston v. Mark Binmore
  • Star Wars Kid
  • ReputationDefender
    • Maybe this is not a problem of Wikipedia, this is a problem in the internet generally

Solutions Looking for Problems

Getting Educational Institutions to Explicitly Participate

Just be sure to read all the comments, too.
From the standpoint of the purpose identified in the Cummings blogicle, I question whether teaching students how to succeed in Wikipedia's dysfunctional rhetorical environment, or learning Wikipedia's preferred style of authorship, which is difficult to distinguish from organized, sanctioned plagiarism, is of any benefit to students or to teachers. Wikipedia also has a tendency to be resistant to such efforts; I recall several instances of students having been assigned to edit Wikipedia and subsequently being blocked on the grounds that their assignment created a "conflict of interest" (a term of art within Wikipedia's idiosyncratic jargon which means something other than what an ordinary person would think it means). Kelly Martin 17:53, 13 January 2010 (UTC)
  • so "Partnership" was thrown around incredibly loosely
  • Getting students to flag hotspots (see flagging proposal)
  • Getting students to learn about how projects like Wikipedia work
    A proper study of how Wikipedia works, and more importantly how Wikipedia fails, could possibly be of interest for students in social psychology, abnormal psychology, political science, marketing, and other related fields. Marketing people, especially, should be very interested in learning how to exploit Wikipedia more effectively. Kelly Martin 17:53, 13 January 2010 (UTC)
    • Clarifying how not to use Wikipedia
    • Addressing institutions' views on sources, primary and secondary
    • Addressing Wikipedian's concerns on newbies
      A recent attempt at a quality control study (the "NEWT project") on the treatment of editors perceived to be newbies by managers of Wikipedia's speedy deletion process was met with strong disapproval by the community. Wikipedia's community actively resists efforts, either internal or external, to examine its internal processes and behaviors, except when the purpose is clearly structured from the beginning to be adulatory.
  • Keeping in mind all of this: Wikipedia school and university projects

Flagging for Engagement, Second Look

  • Newbies who see flagrantly wrong or misleading content (within their knowledge base) may feel more compelled to make corrections and participate in Wikipedia. How do we make this connection?

Zittrain's highlighting proposal

Firefox Add-on like DisputeFinder?

Meta!Meta! Time Frame

HW due Jan. 13, 2010

  • Go get your hands dirty in Wikipedia
  • Rank biggest Problems
  • Get Wikipedia Review guys to give us their thoughts
    • Hello and Welcome!

In-Class Presentation Thurs. Jan 21, 2010

Retrieved from "http://cyber.harvard.edu/cyberlaw_winter10/?title=Talk:Future_of_Wikipedia&oldid=760"