http://blog.wikimedia.org/2008/04/29/robotstxt/ News from inside the Wikimedia Foundation.org Mon, 23 Nov 2009 05:30:27 +0000 http://wordpress.org/?v=2.8.5 hourly 1 http://blog.wikimedia.org/2008/04/29/robotstxt/comment-page-1/#comment-288 Dcoetzee Fri, 30 May 2008 11:06:04 +0000 http://blog.wikimedia.org/?p=28#comment-288 There have been recent proposals to noindex all talk pages on the English Wikipedia - I'm opposed to this on the general principle that it's best to let the search engines index as much as possible and sort out relevance on their own (determining relevance of webpages is what search engines do, after all). As long as talk pages aren't misleadingly portrayed as sources of factual information, rather than opinions of individuals, I don't think there's a problem - and a forum interface for talk pages will go a long way towards cementing that impression. There have been recent proposals to noindex all talk pages on the English Wikipedia – I’m opposed to this on the general principle that it’s best to let the search engines index as much as possible and sort out relevance on their own (determining relevance of webpages is what search engines do, after all). As long as talk pages aren’t misleadingly portrayed as sources of factual information, rather than opinions of individuals, I don’t think there’s a problem – and a forum interface for talk pages will go a long way towards cementing that impression.

]]> http://blog.wikimedia.org/2008/04/29/robotstxt/comment-page-1/#comment-149 David Gerard Wed, 30 Apr 2008 16:17:30 +0000 http://blog.wikimedia.org/?p=28#comment-149 @thewub: If you follow <a href="http://lists.wikimedia.org/pipermail/wikitech-l/2008-April/thread.html" rel="nofollow">wikitech-l lately</a>, you'll see there's a lot of active ongoing work on the internal search - it's noticeably better of late. @thewub: If you follow wikitech-l lately, you’ll see there’s a lot of active ongoing work on the internal search – it’s noticeably better of late.

]]> http://blog.wikimedia.org/2008/04/29/robotstxt/comment-page-1/#comment-139 the wub Tue, 29 Apr 2008 21:37:33 +0000 http://blog.wikimedia.org/?p=28#comment-139 Perhaps the Foundation could concentrate some developer time and funding on improving our own search system. This would reduce reliance on external sites, and allow broader exclusion of "working" pages from Google etc. Perhaps the Foundation could concentrate some developer time and funding on improving our own search system. This would reduce reliance on external sites, and allow broader exclusion of “working” pages from Google etc.

]]> http://blog.wikimedia.org/2008/04/29/robotstxt/comment-page-1/#comment-137 NonvocalScream Tue, 29 Apr 2008 16:56:13 +0000 http://blog.wikimedia.org/?p=28#comment-137 Very informative. Thank you. Very informative. Thank you.

]]>