Wikimedia blog

News from inside the Wikimedia Foundation.org

Archive for June, 2010

New Wikipedia Interface Rollout Continues

The User Experience team is continuing to work with the community to roll out the new Wikipedia interface.  As you may know, starting April 2010, we began introducing the new interface on Wikimedia sites.  We began with Wikimedia Commons and have since rolled out the interface to 10 Wikipedias.  In the next phase of the roll-out, we are planning to target as many of the remaining Wikipedia projects as we can.  The potential list is long (there are over 250 Wikipedia language editions), so we have a lot of work ahead of us. We are targeting June 30 for deployment.

We want to make sure that the Wikipedias that get the new interface are adequately translated before the features are introduced by default.  So we are doing a translation push to get the messages in the new interface translated in as many languages as possible.  Wikipedia language editions that have at least 80% of their user interface messages translated by June 28 will be included in the next phase of the roll-out.  As of today, there are approximately 60 Wikipedia language editions that meet that threshold. Wikipedia language editions that do not meet this translation threshold will get the new features in the final phase (currently scheduled for the end of July). The final phase will also include Wikimedia’s remaining sister projects.

We’ve created a landing page for people interested in helping with the roll-out.  There are four ways to help:

  1. Become an Ambassador: During Phase III, volunteer Ambassadors helped coordinate the roll-out effort.  Responsibilities include coordinating the translation effort, consolidating feedback, communicating with the community, and serving as a liaison between the community and the Foundation.  These Ambassadors were very helpful and we encourage people to volunteer.
  2. Translations:  We currently have approximately 80 languages that have not met the translation threshold.  We’ve reached out to the translation community to help with the translations, but we welcome anyone to join the effort
  3. Identifying bugs:  The more eyes, the better! Identifying bugs on individual projects would be a huge help for our team.
  4. General feedback: Your feedback is always appreciated.
We’re excited to continue rolling out the new interface to more projects and will keep everyone posted.  In the meantime, let us know what you think!

Howie Fung, User Experience

Update: On June 30, we deployed the new interface to 56 Wikipedia Projects.  We also included 27 “backstage” projects such as Meta and Mediawiki.org.  The list of projects may be found here.  Thanks to everyone for their help in making this rollout a success!

WikiDashboard Revisited

Ed Chi, Principal Scientist, Area Manager of Augmented Social Cognition(ASC) at Palo Alto Research Center is a prominent pioneer in social computing and a prolific researcher in the underlying mechanisms in online social systems such as Wikipedia and social tagging sites. Ed gave the keynote talk on Modeling Social Media at the Hypertext 2010 conference a few days ago.

Last October, I had the privilege to share the panel with Ed at BayCHI, where he presented the findings from his joint research, “The Singularity is Not Near: Slowing Growth of Wikipedia”. In addition to the discussion about the possible reasons behind the slow growth, Ed described Wikipedia as “knowledge-ware”, “people-ware” and “tool-ware” in his presentation. This prompted me to reflect on the focus beyond the Wikipedia Usability Initiative. The objective of the Wikipedia Usability Initiative supported by Stanton Foundation was to improve the usability of the editing tools for novice editors.

I had been struggling with competing priorities. Often times investing in future opportunities was postponed due to immediate problems. When the Stanton Wikipedia Usability Initiative approached its project end, I visited Ed with Erik Zachte and Howie Fung to discuss the next user experience endeavor of how to make Wikipedia a more social place. Ed shared his wisdom and suggested to focus on optimizing resources rather than focusing on growth. Growth cannot be expected when resources are not optimized. We also need to know how resources are allocated before optimizing them.

WikiDashboard
was developed by the ASC team almost three years ago. It is a great tool to provide dynamic visualization of Wikipedia editing activities. For example, you can see the editing activity of the relatively new article about the Deepwater Horizon oil spill in the Gulf of Mexico, by editor and number of edits over time, at a glance. You can also find out about edit activities by a certain editor by clicking the editors’ user name. Wikidashboard’s social transparency helps readers to see who is writing what, and editors can discover the most active contributors visually before diving into the details listed in the history page.

WikiDashboard in a Wikipedia article

Facebook implemented Community Pages, a concept of using articles as catalysts to connect people. Community Pages embed Wikipedia articles from the publicly available MediaWiki API into Facebook to connect people to their interests, and they create links inside the user’s profile. Facebook users can discover people with common interests whether they are in their friends network or not.

Wikimedia projects draw over 375 million unique visitors and roughly 100,000 editors edit articles more than five times monthly. Detailed monthly reports can be found here. This huge gap indicates that we are not succeeding in converting visitors to editors. It requires certain skills to write an encyclopedia article, so connecting people over the same interests can be a first step to introduce new contributors into the existing Wikimedia editor community.

Wikimedia projects are about collecting knowledge to share with everyone on the planet. Connecting people with similar interests can help enrich both the reading and the editing experience of this process.

Naoko Komura, User Experience Programs, Wikimedia Foundation

Pending Changes for Wikipedia

Over the next few days, English language Wikipedia users may notice a small change on some articles: a little magnifying glass where a lock once was. The icon, on the upper right corner of the article, represents an important step that Wikipedia volunteers have taken to open up articles that were previously protected from editing. Starting Tuesday at 11pm UTC, the English Wikipedia community will begin a two-month trial of a new tool called “Pending Changes” (formerly known as Flagged Protection).

Articles that are frequently subjected to malicious edits have long been locked, sometimes for years, and protected from editing by new and anonymous users. Over the last year, the Wikimedia Foundation and volunteers from the community have been working to develop Pending Changes, a softer alternative to these editing restrictions. At present, only about 0.1 percent of the 3.3 million articles on the English Wikipedia are under edit protection. This tool should help reduce disruptive edits or errors to articles while maintaining open, collaborative editing from anyone who wants to contribute.

When Pending Changes is applied to an article, the article will be open for editing by anyone, including anonymous and new users. When edits are made by new or anonymous users, changes will be reviewed before they appear on the main version of the article. Anyone can view these proposed edits by clicking on the “Pending Changes” tab alongside the “Edit” and the “History” tabs. In addition, by scrolling over the magnifying glass icon, you can quickly see exactly how many changes are pending review.

During this trial, the community will select which articles will use Pending Changes, with an initial 2,000 page maximum. If you’re interested in learning more about how Pending Changes works, or to test it out yourself, you can read our Q&A and the community-written help pages or check it out in Wikimedia Labs.

Moka Pantages
Communications

Usability: Why Did We Move The Search Box?

On May 13th, we changed the default appearance of the English Wikipedia to use the new look developed as part of the Wikimedia Usability Initiative. On June 9th, we unveiled the new look in the remaining top 9 languages (by access volume). Other languages will follow in the coming weeks.

The key elements of the new design had been in public beta testing for many months, and hundreds of thousands of users had already adopted the new look. But, nothing compares to the real thing, and we tried to make the switch as painless as possible — by offering a quick way back to the old layout, by explaining our reasoning, observing and listening to comments carefully, fixing bugs and implementing changes quickly.

The single most frequently expressed concern about the changes we’ve made is the relocation of the search box from the left sidebar to the top right corner. This blog post will give an extended explanation of why we made the change, the other changes we made to the search, and what we’re planning to do next.

The old search box location

The default location of the search box in MediaWiki, the software used by Wikipedia, is below the “navigation” box in the top left corner. This was also the location in the English language Wikipedia, as well as many other language editions. Some language editions, including the German one, had customized the location of the search box, and moved it directly below the logo.

What do we know about search usability?

There are essentially three factors that influenced our decision to relocate the search box:

  • common user expectations regarding the placement of the search box on web pages, as determined by the preexisting body of usability research;
  • usability research regarding ideal search box width, and implications for the search box placement in our layout;
  • ability of our test subjects to locate and use the Wikipedia search box, as determined by Wikimedia usability tests in a research lab.

There are several scientific studies that have examined the ideal placement of common objects on web pages. One early study by Michael Bernard conducted in 2001 by surveying participants regarding the expected placement of web objects such as internal links, external links, and search found that both new and experienced web users “generally expected internal search engines to be located in the upper and bottom-center of a web page. A smaller number expected it to be located at the top right of the page.”

This study was followed up five years later by A. Dawn Shaikh and Keisi Lenz (”Where’s the Search? Re-examining User Expectations of Web Objects”) in a survey of 142 participants. The study found that expectations had changed significantly, especially regarding the placement of the site search engine. The figure below illustrates the areas where participants expected the search to be found:

Expected location of site search engine

As the authors speculate and as seems intuitively plausible, early expectations of the placement of the search box were likely driven by the fact that search was commonly associated only with search engines of the time like AltaVista, not with site-specific searches. As more and more sites developed internal search functions, those were increasingly placed in slightly less exclusive screen real estate than the top center, shifting users’ expectations to look for search features in the top right corner.

Another factor that may have influenced user expectations is the common placement of search engine features in the top right corner of the web browser window.

There are practical advantages of positioning the search in the top right. As summarized in this research paper, several usability studies have pointed out a key advantage of navigational elements being placed on the right: it gives immediate access to the browser scrollbar. This is particularly valuable when a) scrolling up and down a list of search results, b) scrolling up and down an article you’ve just called up for information.

Search box width, and placement implications

A separate body of research examines the question what width makes a search box user-friendly. A search box that is too narrow obscures the user’s query while typing, inhibiting their ability to complete their search quickly. Usability luminary Jakob Nielsen recommends an ideal width of 27 characters.

The old search box is approximately 20 characters wide, the new search box accommodates 24 characters. More importantly, due to the placement of the old search box in the sidebar of the layout, widening the search was impossible without either relocating it or widening the sidebar.

The search box placement in the top right allows us to maintain a fixed standard width from one page to the next, while giving us maximum flexibility as to what that width should be. To make it even easier for users, we are experimenting with an expandable search, which is currently deployed in our sandbox 3. When you click the box, it will expand significantly to the left.  We may or may not end up deploying this feature as we continue to look at ways to make search more accessible and user-friendly.

Our own research

In the course of the usability and user experience work since last year, we have so far completed a total of three usability studies, all of which are documented on the usability wiki:

These studies included both remote and San Francisco based participants. While the primary focus of our studies were obstacles people encountered when editing, finding search in the navigation was clearly one of them, and our test subjects tended to resort to common web search engines to navigate Wikipedia instead of using the site’s own search. With the new search box placement, users’ ability to find and use the site search was markedly improved.  One user intuitively used the search box in its new location and then consciously realized that it had been moved.  To see videos of the other subjects finding and using the search box with ease, please see here.

For those unfamiliar with usability testing, it’s important to note that small samples and agile, iterative tests are commonly understood to be an effective method for discovering most key user interface issues. Our sample sizes were actually larger than strictly necessary, and more diverse than typical due to our use of remote testing methods.

With that said, we didn’t test the English Wikipedia against other languages which had placed the search box directly below the logo, and we recognize that this alternative placement is already an improvement to match user expectations. However, based on the cited research above, as well as the design reasons for moving the search box to the top right, we still believe that the overall case for moving the search is compelling even for those languages, if slightly less so.

So .. why did you move the search box? I liked it where it was!

In sum, we moved the search box to a) match web practices and user expectations, b) make it possible to widen it consistent with common usability recommendations, c) in response to actual observed problems of test subjects when using the old search.

We also recognize that millions of Wikipedia users had adjusted to the old placement, and will now have to re-adjust to the new placement. However, Wikipedia’s global audience grows by tens of millions of users every year (it is currently at 375 million unique visitors/month world-wide), and we hope to grow it by hundreds of millions in this decade. That will require that we adapt to common user expectations, rather than expecting every new user to adapt to us.

This will unfortunately inconvenience those who have adapted to the old placement. Do we absolutely know that to be the correct decision? No, but the fact that existing users are temporarily inconvenienced by it is not at all indicative that it is not.

Other search changes we made

It’s worth noting that the search box placement isn’t the only thing we changed about the search function. Perhaps most notably, the old search had two buttons (”Go” and “Search” in English). If you asked even an experienced user what the difference between those buttons was, you would get wildly different answers, and bug 577 had been open since 2004 because of this.

To answer the mystery: the “Go” button attempts to find an article with the same title as the entered search term and, if it fails, runs a full-text search of all articles.  “Search” will always run the full-text search.  “Search” is necessary where you want to search for a word instead of displaying the article of that title (say, you want to search for instances of “George W. Bush” all across Wikipedia).

In the new design, the less common case (search all across Wikipedia for a phrase, regardless of exact match) can be accessed using the “containing …” option in the drop-down menu. We believe this is both a more discoverable implementation, and it reduces overall clutter and complexity of the search.

Measures and coming changes

We are monitoring overall search volume. In the first week since the deployment, we have observed neither a statistically significant increase nor a decrease in search volume, but it’s too early to draw conclusions. There are also confounding variables. As noted above, the search box has changed not just in placement, but also in appearance and behavior. Finally, search volume isn’t the only interesting metric: search convenience (how long does it take users to, on average, find the search) is another one.

We’ll try to get our hands on solid metrics, but we’ll also continue to look for ways to make search more user-friendly (such as the auto-expansion), fix bugs, and so forth. In continuing our efforts to improve the user experience of all our projects, both for new and experienced users,  we’ll try to share our thoughts with you frequently, and work with you to figure out the right answer. And, if you just can’t get used to the new search — you can always switch back to the old layout, which will continue to be there for you.

Warmly,
the User Experience Team
Wikimedia Foundation

Wikimedia gears up for classes

I’m excited to announce that the Wikimedia Foundation’s new Public Policy Initiative is underway. We have hired four new staff members to get the project going: Annie Lin, LiAnna Davis, Sage Ross, and Amy Roth.

Annie, LiAnna, Sage, and Amy are already hard at work on the initiative that will help inform how to best engage new contributors in the improvement of subject-specific articles on Wikipedia. We’re in the process of lining up additional professors to participate in the program for the fall semester and preparing materials to make the pilot project (funded generously by the Stanton Foundation) a success.

As the Campus Team Coordinator, Annie Lin will work closely with university professors, students, and Wikipedia Campus Ambassadors to facilitate our outreach and in-classroom training efforts. Annie has a degree in Sociology from the University of California at Berkeley, and brings her diverse teaching and team development experiences to her new Public Policy Initiative role.

LiAnna Davis steps into the Communications Associate role with a background in online writing and editing, including experience in university communications and nonprofit issue advocacy. LiAnna will be the voice of the Public Policy Initiative, responsible for communication with professors and the Wikipedia community, including on this blog. She has an undergraduate degree in Communication Studies from the University of Puget Sound and a master’s degree in Communication, Culture, and Technology from Georgetown University.

As the former editor-in-chief of the Signpost and a longstanding contributor to Wikipedia, Sage Ross joins the team as the Online Facilitator. He has been campaigning for academic experts to get more involved with Wikipedia since joining, and he has led several Wikipedia assignments for courses at Yale University. He is an avid photographer and Wikimedia Commons contributor as well. Sage is bringing his extensive knowledge of the platform and community to recruit volunteers and facilitate communication between the existing editors and stakeholders in the project. He holds a bachelor’s degree in Chemistry from the University of Oklahoma and master’s degrees in History and in the History of Science and Medicine from Yale University.

As the Research Analyst, Amy Roth will take the lead role in evaluating the process and outcomes of the project, suggesting areas for improvement along the way. Amy’s extensive experience in data analysis will enable her to ensure the initiative develops best practices through feedback from students, professors, and Wikipedia’s volunteer community. She received her bachelor’s degree in Biology and Animal Science from California Polytechnic State University and her master’s in Public Policy and Administration from California State University at Sacramento.

We look forward to keeping you updated on what we learn from the Public Policy Initiative. Keep checking the blog for regular updates on our progress.

Rod Dunican, Education Programs Manager

Upcoming code changes for Flagged Revisions

As mentioned in this post in January, the English Wikipedia will be trying out the Flagged Revisions extension, using a configuration we’re calling Pending Changes.

This new configuration requires new features, which in turn required substantial code changes to Flagged Revisions. For technical reasons, we can’t release that code just to the English Wikipedia, so we will upgrade all copies of Flagged Revisions in use on Wikimedia Foundation projects. Happily, that will result in a number of minor improvements for all Flagged Revisions users.

We’ll be rolling this code out on Monday, June 14th, around 23:00 UTC. We believe this won’t cause any trouble, but if bugs do crop up, we’d like to hear about them. Our team will be standing by, prepared to fix any small issues immediately, or roll back if there are any big problems. The best way to contact us will be via the wikimedia-tech IRC channel or our issues page. (If you happen to read this blog and are a participant in a wiki that uses Flagged Revisions, we’d appreciate you checking your local Village Pump around then, so as to minimize language issues.)

For more information on the rollout of Pending Changes for the English Wikipedia, keep an eye on the main Wikimedia Foundation blog for an upcoming post, and check out the Pending Changes help page and the details of the trial.

Wikimedia announces two new executive roles

Earlier today we announced two important new Chief Executive roles at the Wikimedia Foundation – our new Chief Community Officer (CCO) Zack Exley and our new Chief Global Development Officer (CGDO) Barry Newstead.

These are two brand new roles for the Wikimedia Foundation.  The CCO will oversee and lead the development of our relationships with key stakeholders of the Foundation and our global projects: donors, readers, and volunteer editor/contributors. The CGDO’s work will focus on leading the Foundation projects’ reach and growth globally, but with a particular focus on the Global South, a key goal of the Foundation’s upcoming five-year business plan.

We’re thrilled to welcome Barry and Zack to the Foundation – two highly experienced leaders and advocates who bring new capacity and energy to our movement.

Jay Walsh, Communications

New Wikipedia interface to nine more languages

We’d like to thank users for all the feedback and comments about the new user interface which was enabled to English Wikipedia on May 13, 2010. The summary of feedback will be published soon.

I’d like to address a few of the points you’ve made here: a lot of you reported that the location of the search field is disorienting and it should be placed back at the left navigation bar. We understand your frustration when something you use every day is moved around and you have to get used to the new location. The decision to move the search from the left navigation bar to the top-right hand corner was made based on the usability study.  Study participants interacted with Wikipedia’s search over the browser’s search a lot more frequently when it was placed in the right-hand corner. We are looking at the volume of search queries to monitor how this change is affecting the overall users, and we will publish the findings in a couple of weeks.

We had a few problems with the behavior of the search system during the first week, which was unfortunate. It went through numerous bug fixes and updates, and it should be stable now. We hope you find the new search interaction intuitive and easy to use. We are still looking for a way to expand the search field without compromising the space for tab navigation interaction, which is crucial user flow for both readers and editors.

Within the two week time period after the new interface was introduced to English Wikipedia, we observed approximately 18,000 users returning to the previous Wikipedia interface, called “monobook”. There are about 137,000 unique users who had some activities in Recent changes including account creation. Roughly 87,000 users either edited, uploaded files, or conducted administrative task during the same period. The opt-out rate is estimated from 13% to 22% depending on whether user creation is included as a user activity. This aligns with the opt-out rate of the beta program, but we hope to continue to incorporate the needs of various user groups, such as readers, casual editors, active editors, and administrators.

The roll-out of the new Wikipedia interface has so far only taken place on the English version of Wikipedia, just one of over 250 distinct Wikipedias in other languages.

As a next step, we are preparing for the interface switch of the following nine languages, Japanese, Spanish, German, French, Russian, Italian, Polish, Portuguese, and Dutch. The translation of the software for those languages is ready, thanks to the volunteer translators of translatewiki.net. We do have quite a bit of translation work to be completed and we want to recruit user experience ambassadors who will help the user experience team to communicate to the language communities effectively and understand the language specific needs and feedbacks. If you are willing to take part this role, please contact us here. We are targeting to make this switch happen in the week of June 7th.

Thanks,

Naoko Komura, User Experience Programs