Commit Graph

293 Commits (4e94d76578a315bfd297c36795ec8f241f9218fd)
 

Author SHA1 Message Date
nemobis 4e94d76578 Added simple check before compression, seems to work.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@648 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
Hydriz a8f2cb283b Adding comments and making file look nicer. The response to archive.org's S3 is okay though
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 1f93442d49 wikifon down and downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@645 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis ac65d8c2c6 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@640 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis fbf1d0d3c1 duplicates [also, s23.org quite big and downloaded already, but ok]
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@638 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 1aebf77afa error
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis fd219ecb8d Some missing apex; more comments.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 35699e328d Remove http://soldir.solutionsadvancing.com/wiki/api.php : test wiki with a mirror of old Wikipedia content, heavily spammed.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@627 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 2e907a6272 katlas.math.toronto.edu has 1.6 million pages, too huge (the other one is the same)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@624 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 53f075c089 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@617 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 55c44d45b4 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@616 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 7a510850e5 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@615 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 7cdf391b74 working on the uploader to Internet Archive S3; launcher.py now do not explore subdirectories, just the current one '.'
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@613 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 83ff174888 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@612 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 06d0ffc32e working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@611 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp c73a535ea7 adding &templates param for Special:Export, useful when other software use getXML() function to export wiki pages, e.g.: WikiEvidens
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@610 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 7d487e71ca Reduce CPU usage to create archives, don't create -wikidump if there's no images directory.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@594 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 12a6e5d9c4 spaces
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@592 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 5f0e414ae5 Added a couple basic checks of the archives' content. No action follows, as for everything else here.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@589 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 721eb8c596 Added link to api.php or index.php being checked, so that if you called the script via another script you can understand something.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@588 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis fac6c33846 google, not gmail; upload docs
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@572 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 8763bdf045 typo
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@571 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
nemobis 1a07d35f3f WMF wiki
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@562 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 086e9e6573 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@560 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 54e8b1ed91 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@559 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp b7a015a458 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@516 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp e7696d8554 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@515 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp f0e63e6187 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@514 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 2893df1b40 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@513 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp bfae2e703a moving wikifarms directories into batchdownload path
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@512 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp a607b67536 removing old launchers
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@511 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 5344294127 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@508 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 7dbf7f752d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@507 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
Hydriz b680b07709 Fixing sentence to avoid having 2 commas too close to each other
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@506 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 155189fc95 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@505 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp dd4351849d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@504 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 085b05a19d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@503 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp bae6687752 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@502 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp bc86e0a900 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@501 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 2e8755d4c9 prefix generator in launcher
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@500 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 5057a8c239 wow, stupid error, lists contain /api.php in urls, not needed here
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@498 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp d31828dfaa mediawikis pavlo
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@464 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 0fd8d1e3c2 lists for taskforce
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@463 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 7e0ebdbff4 link to doc
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@461 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp c10942aba8 removing ../
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@451 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 2df1ffa9a0 launcher for batch downloads
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@446 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 657577cc37 checkalive for wiki lists
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@439 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 030b9f9721 status bar msg
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@408 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 2891c5c36a blocking
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@407 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago
emijrp 91e5fce225 block var when downloading
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@406 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
13 years ago