2
0
mirror of https://github.com/WikiTeam/wikiteam synced 2024-11-18 21:27:45 +00:00
Commit Graph

455 Commits

Author SHA1 Message Date
nemobis
a8479f9936 Get namespaces and images info from API. Code badly copied around, we should probably use modules such as http://packages.python.org/simplemediawiki/ to use API. Tested, seems to work.
Fixed some typos.

git-svn-id: https://wikiteam.googlecode.com/svn/trunk@668 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-20 08:08:28 +00:00
Hydriz
b8b2dbcf4a Moving the collection parameter to the top of the script so as to allow the user to easily configure that setting.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@666 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-11 03:56:27 +00:00
nemobis
78a07544ed Per emijrp, removing config.txt from archive.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@662 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-06 08:06:03 +00:00
nemobis
a28d9d1929 duplicates or done
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@660 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 21:58:52 +00:00
nemobis
143d7fba7c duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@659 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 21:57:28 +00:00
nemobis
ccfd566a36 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@658 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 21:55:51 +00:00
nemobis
114ec7db8c duplicate and one huge downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@657 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 21:54:00 +00:00
nemobis
be5a4173fe duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@656 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 21:50:53 +00:00
nemobis
d86c58e8d6 duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@655 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 21:48:38 +00:00
nemobis
cc459f1685 identifier pattern for the record
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@653 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 14:05:31 +00:00
nemobis
6c68a2f5e8 Undefined variable sometimes (for instance if no index.php has been found).
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@651 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 11:14:12 +00:00
nemobis
4f0f1160a3 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@650 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 11:06:46 +00:00
nemobis
4e94d76578 Added simple check before compression, seems to work.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@648 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-05 10:37:25 +00:00
Hydriz
a8f2cb283b Adding comments and making file look nicer. The response to archive.org's S3 is okay though
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@647 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-04 13:18:52 +00:00
nemobis
1f93442d49 wikifon down and downloaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@645 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-05-03 21:27:08 +00:00
nemobis
ac65d8c2c6 duplicate
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@640 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-26 14:58:48 +00:00
nemobis
fbf1d0d3c1 duplicates [also, s23.org quite big and downloaded already, but ok]
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@638 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-25 19:03:30 +00:00
nemobis
1aebf77afa error
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@632 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-22 09:01:59 +00:00
nemobis
fd219ecb8d Some missing apex; more comments.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@631 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-22 09:00:19 +00:00
nemobis
35699e328d Remove http://soldir.solutionsadvancing.com/wiki/api.php : test wiki with a mirror of old Wikipedia content, heavily spammed.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@627 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-22 07:33:35 +00:00
nemobis
2e907a6272 katlas.math.toronto.edu has 1.6 million pages, too huge (the other one is the same)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@624 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-21 13:14:51 +00:00
emijrp
53f075c089 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@617 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 21:57:25 +00:00
emijrp
55c44d45b4 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@616 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 21:32:08 +00:00
emijrp
7a510850e5 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@615 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 21:14:46 +00:00
emijrp
7cdf391b74 working on the uploader to Internet Archive S3; launcher.py now do not explore subdirectories, just the current one '.'
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@613 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 20:57:36 +00:00
emijrp
83ff174888 working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@612 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 20:37:31 +00:00
emijrp
06d0ffc32e working on the uploader to Internet Archive S3
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@611 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 20:19:40 +00:00
emijrp
c73a535ea7 adding &templates param for Special:Export, useful when other software use getXML() function to export wiki pages, e.g.: WikiEvidens
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@610 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-20 20:03:54 +00:00
nemobis
7d487e71ca Reduce CPU usage to create archives, don't create -wikidump if there's no images directory.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@594 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-15 12:39:45 +00:00
emijrp
12a6e5d9c4 spaces
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@592 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-15 08:44:27 +00:00
nemobis
5f0e414ae5 Added a couple basic checks of the archives' content. No action follows, as for everything else here.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@589 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-13 20:43:39 +00:00
nemobis
721eb8c596 Added link to api.php or index.php being checked, so that if you called the script via another script you can understand something.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@588 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-13 20:42:01 +00:00
nemobis
fac6c33846 google, not gmail; upload docs
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@572 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-09 10:03:32 +00:00
nemobis
8763bdf045 typo
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@571 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-09 10:00:29 +00:00
nemobis
1a07d35f3f WMF wiki
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@562 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 22:52:17 +00:00
emijrp
086e9e6573 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@560 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 19:42:04 +00:00
emijrp
54e8b1ed91 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@559 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 19:41:17 +00:00
emijrp
b7a015a458 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@516 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 13:22:26 +00:00
emijrp
e7696d8554 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@515 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 13:21:06 +00:00
emijrp
f0e63e6187 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@514 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 13:19:42 +00:00
emijrp
2893df1b40 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@513 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 13:03:09 +00:00
emijrp
bfae2e703a moving wikifarms directories into batchdownload path
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@512 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 12:28:20 +00:00
emijrp
a607b67536 removing old launchers
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@511 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 12:14:59 +00:00
emijrp
5344294127 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@508 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 11:15:50 +00:00
emijrp
7dbf7f752d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@507 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 11:08:33 +00:00
Hydriz
b680b07709 Fixing sentence to avoid having 2 commas too close to each other
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@506 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 11:07:00 +00:00
emijrp
155189fc95 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@505 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 09:47:30 +00:00
emijrp
dd4351849d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@504 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 09:30:58 +00:00
emijrp
085b05a19d launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@503 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 09:25:41 +00:00
emijrp
bae6687752 launcher.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@502 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2012-04-08 09:25:15 +00:00