Wikimedia blog

News from inside the Wikimedia Foundation.org

Archive for September, 2009

FlaggedRevs test wiki awaits you!

Apparently due to some miscommunications, a lot of people didn’t realize that the FlaggedRevs labs test wiki has been active and waiting for people to poke at it for a month, since just before Wikimania!

We need interested people to be get up as local administrators to try out the the per-page stabilization settings (accessed via the ‘protect’ tab); by default most pages do not activate FlaggedRevs in the configuration we’re testing for English Wikipedia.

I’ve added a couple quick notes to this affect on the main page.

Update: We’re collecting some folks to be bureaucrats and help set up more test admins so we can get things going quick!

Announce: Brion moving to StatusNet

I’d like to share some exciting news with you all… After four awesome years working for the Wikimedia Foundation full-time, next month I’m going to be starting a new position at StatusNet, leading development on the open-source microblogging system which powers identi.ca and other sites.

I’ve been contributing to StatusNet (formerly Laconica) as a user, bug reporter, and patch submitter since 2008, and I’m really excited at the opportunity to get more involved in the project at this key time as we gear up for a 1.0 release, hosted services, and support offerings.

StatusNet was born in the same free-culture and free-software community that brought me to Wikipedia; many of you probably already know founder Evan Prodromou from his longtime work in the wiki community, launching the awesome Wikitravel and helping out with MediaWiki development on various fronts. The “big idea” driving StatusNet is rebalancing power in the modern social web — pushing data portability and open protocols to protect your autonomy from siloed proprietary services… People need the ability to control their own presence on the web instead of hoping Facebook or Twitter always treat you the way you want.

This does unfortunately mean that I’ll have less time for MediaWiki as I’ll be leaving my position as Wikimedia CTO sooner than originally anticipated, but that doesn’t mean I’m leaving the Wikimedia community or MediaWiki development!

Just as I was in the MediaWiki development community before Wikimedia hired me, you’ll all see me in the same IRC channels and on the same mailing lists… I know this is also a busy time with our fundraiser coming up and lots of cool ongoing developments, so to help ease the transition I’ve worked out a commitment to come into the WMF office one day a week through the end of December to make sure all our tech staff has a chance to pick my brain as we smooth out the code review processes and make sure things are as well documented as I like to think they are. ;)

We’ve got a great tech team here at Wikimedia, and we’ve done so much with so little over the last few years. A lot of really good work is going on now, modernizing both our infrastructure and our user interface… I have every confidence that Wikipedia and friends will continue to thrive!

I’ll start full-time at StatusNet on October 12. My key priorities until then are getting some of our key software rollouts going, supporting the Usability Initiative’s next scheduled update and getting a useful but minimally-disruptive Flagged Revisions configuration going on English Wikipedia. I’m also hoping to make further improvements to our code review process, based on my experience with our recent big updates as well as the git-based workflow we’re using at StatusNet — I’ve got a lot of great ideas for improving the CodeReview extension…

Erik Moeller will be the primary point of contact for WMF tech management issues starting October 12, until the new CTO is hired. I’ll support the hiring process as much as I can, and we’re hoping to have a candidate in the door by the end of the year.

– brion vibber (brion @ wikimedia.org)
CTO, Wikimedia Foundation
San Francisco

Update: Evan’s announce is up on the StatusNet blog.

Theora 1.1 Released

Theora 1.1 has been released

Theora 1.1 has been released

Theora 1.1 has been released. This release reflects the efforts of xiph.org developers who over the past year have done incredible work to greatly improve the core free codec video library. This effort has been support by Mozilla Foundation, Red Hat and others. These improvements include:

  • Better-looking videos or
  • Smaller files at the same quality.
  • Much faster decoder.
  • Two-pass mode for making files just the size you want them.
  • Rigid bitrate controls trade off quality for the needs of live streaming applications.
  • Chris Blizzard from Mozilla has a detailed blog post about the improvements and what they mean for open video creators, distributors and viewers. Wikimedia foundation makes exclusive use free/open formats and has been a long time supporter of ogg theora and makes use of the free codec in its websites. Wikimedia also helped organize some improvements by administrating a theora improvement grant from Mozilla earlier this year.

    Also a new version of ffmpeg2thora has been released using this new codebase making it easy to take advantage of these new features. If you would like to give the new encoder a spin you try it out with the web based firefogg encoding app.

    LocalisationUpdate in testing

    Ok, we still need to complete automation of update runs for LocalisationUpdate, but it seems to be working!

    It’s not the most glamorous of extensions, but you can see here an updated message (“Den här sidan” where the current deployed message file says “Denna sidan har”)!

    – brion

    Server Donation Entry Period Ending

    Just to let folks know, we have had quite a large interest in our donation of some of our decommissioned servers.  In fact, I have way too many emails!

    So to be fair, rather than just stop today, we will stop accepting submissions for this next Monday, September 28th.  That means if you want your proposal/request in the running, you have to have it emailed to servers@wikimedia.org by Midnight GMT this coming Sunday, Sept. 27th.

    For ease of reference, here is a copy of the post from the start of this process:

    It is that time again.  We have approx 35 servers to donate to a good home.  These are servers that Wikimedia has used on the projects for 3+ years, so they are out of warranty and just not fast enough for us to keep using on the cluster.

    The servers will go out to homes for folks who are willing to pay for the freight.  They are as follows:

    • Dual CPU 2.5 GHz AMD
    • 3-4GB RAM Each
    • Most have 80 GB or larger HDD

    Disclaimers: The Wikimedia Foundation does not guarantee the operation or use of these servers in any shape or form.  They are old, some may have dying fans, bad hdd sectors, and the like.  Servers have been wiped of information, and they ran through that, but no promises on function!

    If you would like to receive some of these servers for your NONPROFIT use, please email servers@wikimedia.org.  Please include in your email how you will be using the servers, and the address they would be shipped to.  We will review all requests and try to fairly pick out where they go.  (Selection process may be refined, but it also may just include throwing darts at a board to break up ties.)

    Additions: Due to request, the servers are indeed located in Tampa, FL USA.  Zip code 33602 for shipping purposes.  This means that if you are international, shipping this hardware is really not cost effective for you.  If you want to be in the running still, and are comfortable with personally handing all customs, duties, export, and tax issues, go ahead and email us.

    Correction: Dates were off.

    LocalisationUpdate and ProofreadPage second try tomorrow; Collection too

    Updates are coming back for LocalisationUpdate and ProofreadPage extensions, which we tested then pulled Tuesday due to performance problems.

    Roan’s redone LU to store the message updates in serialized files instead of the database, which we can sync locally to web servers and should perform much better; I’ll also do a more gradual test rollout so we can scale it back more gracefully if we have problems again.

    ThomasV has fixed up some bad queries in ProofreadPage, and it should be ready to go again; the updated version has much more advanced index support and looks pretty spiffy. :)

    And if we’ve got time between other things, I’ll roll out the updated Collection as well — this makes big improvements to the UI for building a multi-page book, and leaves the sidebar much less cluttered when you’re not using it.

    – brion

    Commonist, CommonsHelper fixed

    I’ve put in a fix for uploader tools and bots that have been broken since the last update — these bot tools didn’t expect the upload form to change, so they don’t pass in new required fields such as the edit token which was added to the form in the latest update.

    Since the edit token isn’t actually required for web uploads (it’s a protection against a class of attacks which, as it happens, can’t forge file uploads) I’ve relaxed the check. I’ve confirmed that it fixes Commonist and have a report that CommonsHelper is also fixed.

    Most other bots and tools that were affected are probably also fixed; please test them and let us know if anything’s still broken!

    LocalisationUpdate deployment delayed

    Problem #1 — causes huge increase in CPU load on web servers

    Problem #2 — completely kills THE ENTIRE SITE when you DISABLE it because serialized LUDependency objects in the message cache can’t be reinstantiated.

    broke

    Sigh… Why can’t life be easy :)

    Update 2009-09-23 16:30: Roan is starting work on replacing the database storage layer with a flat-file which should be more efficient for our use case.

    Wikimedia and OneWebDay!

    Today is One Web Day!

    Founded by Susan Crawford in 2006, One Web Day aims to highlight the critical importance of protecting the values and principles of an open, participatory web. From the official site:

    OneWebDay was founded by Susan Crawford, cyberlaw scholar, former Board Member of the Internet Corporation for Assigned Names and Numbers, and current technology policy advisor to President Obama. According to Ms. Crawford, “Earth Day was the model when I founded OneWebDay in 2006. In 1969, one man asked the people to do what their elected representatives would not: take the future of the environment into their own hands.” Today, a worldwide citizens’ movement has put the environment front and center politically. According to Crawford, “peoples’ lives now are as dependent on the Internet as they are on the basics like roads, energy supplies and running water. We can no longer take that for granted, and we must advocate for the Internet politically and support its vitality personally.”

    This is a cause any Wikimedian can appreciate and understand – they live it every day.  Millions of people access Wikipedia and the Foundation’s sister projects daily, and hundreds of thousands of small (or large) edits pile up thanks to the tireless work of editors and volunteers from all over the world.  By increasing the overall amount of high quality information, in hundreds of languages, Wikimedians are working to reduce the digital divide and provide high quality, free information.

    Although editing Wikipedia or its sister projects can be easy, the act itself is nothing short of brave.  Millions around the world still cannot edit or access our projects. Thousands of volunteers are building language projects for their peers who are otherwise unable to author or contribute due to internet access barriers or due to political censorship.  And Wikipedians are never shy to tackle the toughest and most challenging topics in human history, not to mention the task of writing neutral, high quality information about emerging news.

    On this One Web Day we are especially excited to recognize our enormous volunteer force, and the millions of other brave contributors to free knowledge around the world.  We thank them, and we’re looking forward to an infinite number of One Web Days in the future.

    Jay Walsh
    Communications

    Feature deployment updates

    Quick note for those who have been asking — we’re starting to maintain a list of feature & extension deployments that we’re rolling out in the very near future and their status on the Wikitech wiki.

    Note that some things like the English Wikipedia FlaggedRevs deployment aren’t on there yet; we’ll start prepping something for these in the next round in a couple weeks.

    – brion