Comments on: Wikipedia page counters

By: Tomukas

Tomukas — Fri, 24 Jun 2011 13:53:51 +0000

Labas Domas, labai ačiū for this great service. Do you know anyone who holds copies of the files that have already been deleted here? And: Why don’t you publish them on a daily basis (and instead: for a longer time)? Best wishes.

By: Jane

Jane — Fri, 10 Jun 2011 16:18:48 +0000

My guess is that these are the sister projects Wikibooks, Wiktionary, Wikinews, Wikiquotes, Wikisource, and Wikiversity.

By: hamm

hamm — Tue, 07 Jun 2011 10:52:46 +0000

I also want to know why there is en.b, en.d, en.n, en.q, en.s, en.v?

By: Alvin

Alvin — Tue, 26 Apr 2011 22:13:00 +0000

Hi,

Thanks for putting this together. It’s very useful. I was wondering if anybody could help me clarify the meaning of the projectcode?

From what I understand, each line has four fields: projectcode, pagename, pageviews, bytes, and so a projectcode of “en” refers to the English Wikipedia collection. However, I’m having trouble figuring out what en.b, en.d, en.n, en.q, en.s, en.v, and en2 stand for and how they relate to the en projectcode?

Thanks!
Alvin

By: Peter Bodik

Peter Bodik — Mon, 15 Jun 2009 21:22:29 +0000

Domas,
is there any way to obtain these files with 1 minute granularity (instead of one hour)? At UC Berkeley we’re working on a storage system and we’d like to evaluate how well it handles changes in data popularity. Using the wikipedia page counts with 1 minute granularity would be a great way to test it.

If the amount of data would be a problem, we could download the data to our servers and you can delete them. Also, we don’t need a whole year of data, several days or weeks would be enough.

Thanks!
Peter

By: Pete Skomoroch

Pete Skomoroch — Wed, 10 Jun 2009 07:08:41 +0000

Domas, I finally posted that AWS Public dataset. It contains the last 3 months of 2008 if that helps the other commenters: http://developer.amazonwebservices.com/connect/entry.jspa?externalID=2596 Having the data mirrored on Amazon might also take some load off your servers ;) I also posted source code for a Trending Topics site I built using the data: http://www.trendingtopics.org Thanks again for making this available. Good to know about the duplicates, I noticed that as well - will have to delete the dupes. -Pete

By: Domas Mituzas

Domas Mituzas — Mon, 25 May 2009 06:38:32 +0000

if you find one, tell me

By: Kapil Dalwani

Kapil Dalwani — Sat, 23 May 2009 22:45:24 +0000

Hey Domas,

they are gone? :(
Is there a way to get it back..I really need them for some research. ..

is there any other source for this?

By: Domas Mituzas

Domas Mituzas — Sat, 23 May 2009 20:53:42 +0000

well, if they’re gone, they’re gone :)

By: Kapil Dalwani

Kapil Dalwani — Sat, 23 May 2009 09:56:50 +0000

Where can I find the dumps for 2008?