Commit Graph

1133 Commits (master)
 

Author SHA1 Message Date
emijrp bc24877a72 uploader
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@736 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 1d972d10d8 git-svn-id: https://wikiteam.googlecode.com/svn/trunk@731 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95 12 years ago
Hydriz bbffb24a0c (Issue 34) XML integry check inside the code
An attempt to integrate a XML integrity checker into the script. If
the dump integrity check fails, the script will be redumped from the
start.


git-svn-id: https://wikiteam.googlecode.com/svn/trunk@710 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 7e083de24b Partial revert of r675: the script was always downloading only the last revision, as reported by Hydriz... *facepalms*
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@709 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 821bdaf974 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@705 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 080670ca48 duuplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@704 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a62117ed28 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@703 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a1eb913d9d duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@702 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 11c977582a duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@701 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 79c9223e77 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@700 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis c46a8c7b90 done
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@699 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 979fa84ac3 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@698 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 79a4d81e06 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@686 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 61897f76c6 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@685 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis da005e6c88 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@684 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 8d8a9e3dcc duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@683 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis e132dcf1c7 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@682 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis f28242a57b duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@681 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 26cd289ba1 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@680 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis cac6130ea1 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@679 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis d6d13e1047 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@678 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz 8cad43dfb6 Does not compress, but still, moving %s-images.txt to the fulldump compressing command as it rightfully belongs there
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@676 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 9f58ca6a9b Fix Issue 26: Error loop "XML for ... is wrong"
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@675 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 260f4e6be2 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@674 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 373208b92f duplicate (without www. and without www.en.)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@673 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis f6992312bc duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@672 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 9a067bbe35 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@671 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4a5597865f duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@670 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a8479f9936 Get namespaces and images info from API. Code badly copied around, we should probably use modules such as http://packages.python.org/simplemediawiki/ to use API. Tested, seems to work.
Fixed some typos.

git-svn-id: https://wikiteam.googlecode.com/svn/trunk@668 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz b8b2dbcf4a Moving the collection parameter to the top of the script so as to allow the user to easily configure that setting.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@666 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 78a07544ed Per emijrp, removing config.txt from archive.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@662 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a28d9d1929 duplicates or done
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@660 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 143d7fba7c duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@659 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis ccfd566a36 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@658 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 114ec7db8c duplicate and one huge downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@657 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis be5a4173fe duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@656 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis d86c58e8d6 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@655 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis cc459f1685 identifier pattern for the record
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@653 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 6c68a2f5e8 Undefined variable sometimes (for instance if no index.php has been found).
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@651 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4f0f1160a3 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@650 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4e94d76578 Added simple check before compression, seems to work.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@648 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz a8f2cb283b Adding comments and making file look nicer. The response to archive.org's S3 is okay though
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1f93442d49 wikifon down and downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@645 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis ac65d8c2c6 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@640 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fbf1d0d3c1 duplicates [also, s23.org quite big and downloaded already, but ok]
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@638 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1aebf77afa error
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fd219ecb8d Some missing apex; more comments.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 35699e328d Remove http://soldir.solutionsadvancing.com/wiki/api.php : test wiki with a mirror of old Wikipedia content, heavily spammed.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@627 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 2e907a6272 katlas.math.toronto.edu has 1.6 million pages, too huge (the other one is the same)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@624 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 53f075c089 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@617 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago