Commit Graph

93 Commits (master)

Author SHA1 Message Date
nemobis f6992312bc duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@672 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 9a067bbe35 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@671 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4a5597865f duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@670 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 78a07544ed Per emijrp, removing config.txt from archive.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@662 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis a28d9d1929 duplicates or done
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@660 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 143d7fba7c duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@659 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis ccfd566a36 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@658 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 114ec7db8c duplicate and one huge downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@657 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis be5a4173fe duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@656 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis d86c58e8d6 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@655 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 6c68a2f5e8 Undefined variable sometimes (for instance if no index.php has been found).
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@651 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4f0f1160a3 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@650 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 4e94d76578 Added simple check before compression, seems to work.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@648 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1f93442d49 wikifon down and downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@645 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis ac65d8c2c6 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@640 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis fbf1d0d3c1 duplicates [also, s23.org quite big and downloaded already, but ok]
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@638 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 35699e328d Remove http://soldir.solutionsadvancing.com/wiki/api.php : test wiki with a mirror of old Wikipedia content, heavily spammed.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@627 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 2e907a6272 katlas.math.toronto.edu has 1.6 million pages, too huge (the other one is the same)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@624 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 7cdf391b74 working on the uploader to Internet Archive S3; launcher.py now do not explore subdirectories, just the current one '.'
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@613 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 7d487e71ca Reduce CPU usage to create archives, don't create -wikidump if there's no images directory.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@594 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 12a6e5d9c4 spaces
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@592 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 5f0e414ae5 Added a couple basic checks of the archives' content. No action follows, as for everything else here.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@589 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 8763bdf045 typo
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@571 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
nemobis 1a07d35f3f WMF wiki
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@562 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 086e9e6573 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@560 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 54e8b1ed91 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@559 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp b7a015a458 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@516 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp e7696d8554 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@515 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp f0e63e6187 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@514 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 2893df1b40 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@513 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp bfae2e703a moving wikifarms directories into batchdownload path
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@512 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 5344294127 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@508 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 7dbf7f752d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@507 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 155189fc95 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@505 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp dd4351849d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@504 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 085b05a19d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@503 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp bae6687752 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@502 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp bc86e0a900 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@501 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 2e8755d4c9 prefix generator in launcher
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@500 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 5057a8c239 wow, stupid error, lists contain /api.php in urls, not needed here
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@498 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 0fd8d1e3c2 lists for taskforce
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@463 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp c10942aba8 removing ../
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@451 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago
emijrp 2df1ffa9a0 launcher for batch downloads
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@446 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
12 years ago