Downloading Wikipedia

Question

How can I download a specific set of the Wikipedia database? In particular, I'm interested in downloading all articles that fall under the mathematics portal and possibly the computer science portal. How can I do that?

ssssteffff · Answer 1 · 2013-07-11T12:45:10.380

3

You can use a software called Kiwix, which is really easy to use.

EDIT

Wikipedia provide a tool to extract a subset of its content. You can search for "Mathematics" here, and then export every article within this category. You'll get a .xml file which you can browse using one of the listed tools here.

edited Jul 11 '13 at 12:45

answered Jul 11 '13 at 12:24

ssssteffff

2,549

Tobi · Answer 2 · 2013-07-11T12:20:34.277

2

You could use the Media Wiki API.

edited Jul 11 '13 at 12:20

answered Jul 11 '13 at 10:06

Tobi

189

score 2 · Answer 3 · answered Oct 11 '13 at 13:26

You can take the *-pages-articles.xml.bz2 from Wikimedia backup dumps site and process them with WikiTaxi(download in upper left corner). Wikitaxi Import tool will create a .taxi(around 15Gb for Wikipedia) file out of the .bz2 file. That file will be used by WikiTaxi program to search through articles. The experience is very similar to the browser experience, with all articles available to the time of the dump, but without the images.

Or you can use Kiwix faster to setup because has the database is already made (but quite old), but WikiTaxi has the advantage that you can have the latest updated content.

score 1 · Answer 4 · answered May 20 '14 at 17:27

go to en.wikipedia.org on the left sidebar, under "tools", click on "special pages".

in the new page, under "page tools" click on "export pages".

on the new page, type the name of each category you want. for example type mathematics (as shown in the picture below) and hit add.

enter image description here

then you should install Mediawiki and go to similar path and select "import pages".

Downloading Wikipedia

4 Answers4