SourceWatch:Database download

All SourceWatch content is licensed under the GNU Free Documentation License; see SourceWatch:Copyrights for more info.

See also MediaWiki to get the software to run the wiki. If you're just looking for the database schema, it's described in schema.doc (a text file, not Microsoft Word; IE users beware).

Weekly Database dumps
SQL database dumps of the SourceWatch are updated daily. Warning: The filesize of the database is more than 95 megabytes, so downloading it can take awhile. These SQL dumps be read into a MySQL relational database for leisurely analysis, testing of the MediaWiki software, and with appropriate preprocessing, perhaps offline reading. The decompressed size as of 2005-06-22 is 617Mb. Please email bob AT sourcewatch.org to request a copy of the weekly SQL database dump file.

The database schema is explained in schema.doc. The cur tables contain the current revisions of all pages; the old tables contain the prior edit history. Approximate file sizes are given for the compressed dumps; uncompressed they'll be significantly larger.

Please do not use a web crawler
Please do not use a web crawler to download large amounts of articles. Aggressive crawling of the server can cause a dramatic slow-down of SourceWatch.

Note: This article is adapted from Wikipedia database download page. Further helpful information may be found there.