Commit Graph

465 Commits (b74d6f79ceb3680bb9407c8e563197ecac7c6682)
 

Author SHA1 Message Date
nemobis 26cd289ba1 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@680 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis cac6130ea1 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@679 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis d6d13e1047 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@678 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz 8cad43dfb6 Does not compress, but still, moving %s-images.txt to the fulldump compressing command as it rightfully belongs there
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@676 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 9f58ca6a9b Fix Issue 26: Error loop "XML for ... is wrong"
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@675 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 260f4e6be2 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@674 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 373208b92f duplicate (without www. and without www.en.)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@673 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis f6992312bc duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@672 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 9a067bbe35 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@671 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4a5597865f duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@670 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a8479f9936 Get namespaces and images info from API. Code badly copied around, we should probably use modules such as http://packages.python.org/simplemediawiki/ to use API. Tested, seems to work.
Fixed some typos.

git-svn-id: https://wikiteam.googlecode.com/svn/trunk@668 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz b8b2dbcf4a Moving the collection parameter to the top of the script so as to allow the user to easily configure that setting.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@666 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 78a07544ed Per emijrp, removing config.txt from archive.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@662 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a28d9d1929 duplicates or done
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@660 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 143d7fba7c duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@659 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis ccfd566a36 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@658 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 114ec7db8c duplicate and one huge downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@657 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis be5a4173fe duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@656 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis d86c58e8d6 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@655 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis cc459f1685 identifier pattern for the record
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@653 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 6c68a2f5e8 Undefined variable sometimes (for instance if no index.php has been found).
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@651 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4f0f1160a3 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@650 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4e94d76578 Added simple check before compression, seems to work.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@648 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
Hydriz a8f2cb283b Adding comments and making file look nicer. The response to archive.org's S3 is okay though
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1f93442d49 wikifon down and downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@645 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis ac65d8c2c6 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@640 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fbf1d0d3c1 duplicates [also, s23.org quite big and downloaded already, but ok]
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@638 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1aebf77afa error
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fd219ecb8d Some missing apex; more comments.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 35699e328d Remove http://soldir.solutionsadvancing.com/wiki/api.php : test wiki with a mirror of old Wikipedia content, heavily spammed.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@627 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 2e907a6272 katlas.math.toronto.edu has 1.6 million pages, too huge (the other one is the same)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@624 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 53f075c089 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@617 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 55c44d45b4 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@616 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 7a510850e5 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@615 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 7cdf391b74 working on the uploader to Internet Archive S3; launcher.py now do not explore subdirectories, just the current one '.'
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@613 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 83ff174888 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@612 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 06d0ffc32e working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@611 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp c73a535ea7 adding &templates param for Special:Export, useful when other software use getXML() function to export wiki pages, e.g.: WikiEvidens
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@610 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 7d487e71ca Reduce CPU usage to create archives, don't create -wikidump if there's no images directory.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@594 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 12a6e5d9c4 spaces
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@592 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 5f0e414ae5 Added a couple basic checks of the archives' content. No action follows, as for everything else here.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@589 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 721eb8c596 Added link to api.php or index.php being checked, so that if you called the script via another script you can understand something.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@588 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fac6c33846 google, not gmail; upload docs
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@572 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 8763bdf045 typo
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@571 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1a07d35f3f WMF wiki
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@562 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 086e9e6573 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@560 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 54e8b1ed91 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@559 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp b7a015a458 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@516 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp e7696d8554 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@515 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp f0e63e6187 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@514 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago