2
0
mirror of https://github.com/WikiTeam/wikiteam synced 2024-11-16 21:27:46 +00:00
Commit Graph

148 Commits

Author SHA1 Message Date
emijrp
d408c06b77 randomtitle = 'Main_Page' #previously AMF5LKE43MNFGHKSDMRTJ
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@225 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-15 18:07:50 +00:00
emijrp
76897b09b2 retries for image list retrieve;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@224 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 21:32:48 +00:00
emijrp
31ed2aff33 moving some more GET requests to POST;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@223 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 21:11:51 +00:00
emijrp
60f7fa88a1 \n
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@222 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:47:34 +00:00
emijrp
e933c780b5 doc
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@221 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:45:41 +00:00
emijrp
fb4aa9e9dd doc
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@220 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:38:10 +00:00
emijrp
d1b2c2cd96 doc
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@219 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:37:56 +00:00
emijrp
2caf754ef4 moving getImageFilenamesURL() from GET to POST; some comments;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@218 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:36:46 +00:00
emijrp
0746f49db0 moving some GET requests to POST: index.php check and namespaces get
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@217 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:17:22 +00:00
emijrp
a865564713 .lower()
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@216 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 20:01:34 +00:00
emijrp
e61f1ef974 doc
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@215 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 19:58:14 +00:00
emijrp
6c42144f89 adding --force parameter to skip wiki[mp]edia projects alert
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@214 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-14 19:54:14 +00:00
emijrp
13dfc9be88 adding empty docstrings;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@200 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-12 16:54:37 +00:00
emijrp
c489de6533 issue #14
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@197 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-09 18:43:06 +00:00
emijrp
df3bd03336 prints
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@194 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-09 18:24:31 +00:00
emijrp
b25bf51a59 prints
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@193 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-09 18:17:04 +00:00
emijrp
42640f3781 image limit errors improved
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@192 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-09 17:47:04 +00:00
emijrp
4a0fb86751 index.php detector improved
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@191 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-09 17:39:03 +00:00
emijrp
de29904341 adding shoutwiki.com wikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@190 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-08 06:33:24 +00:00
emijrp
f3c35d6692 uploadedwikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@189 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-07-08 06:04:43 +00:00
emijrp
ab64c8f1c8 skiping option
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@171 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-28 21:27:29 +00:00
emijrp
ec6a8718eb improved fail download management;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@170 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-28 13:44:50 +00:00
emijrp
f94a04562f fixed for enwiki which uses several chunks for big files;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@168 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-26 12:48:26 +00:00
emijrp
5254085eb4 wikipedia dumps downloader;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@167 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-25 22:24:41 +00:00
emijrp
502d3a3d22 more wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@166 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-13 22:28:10 +00:00
emijrp
778a8ad7ae adding support to download images on old mediawikis; regexp4;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@165 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-13 20:19:13 +00:00
emijrp
5b7674edb7 params in main() to call it from external scripts (using import dumpgenerator; dumpgenerator.main(params=params))
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@161 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-10 14:29:30 +00:00
emijrp
e4d0de09d6 params in main() to call it from external scripts (using import dumpgenerator; dumpgenerator.main(params=params))
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@160 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-10 14:25:04 +00:00
emijrp
852d6658ad more wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@159 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-05 14:40:58 +00:00
emijrp
da6c4d1468 print error output when splitters error occurs; 5000 -> 500 in image list parser
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@158 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-06-04 11:10:45 +00:00
emijrp
c5b6b8a866 md5.new->md5; new uploaded wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@157 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-30 20:31:32 +00:00
emijrp
11420962f5 print
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@156 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-08 16:00:07 +00:00
emijrp
2acd8415c7 removing dupes;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@155 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-08 15:52:16 +00:00
emijrp
835158b79b more wikis; md5 or hashlib
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@154 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-07 22:04:00 +00:00
emijrp
59fe050558 more wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@153 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-06 22:29:08 +00:00
emijrp
c7b511ee38 more wikis; new content spliter;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@152 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-05 21:46:48 +00:00
emijrp
9a20327939 undoHTMLEntities for titles when scrapped from Allpages; protocol http https;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@150 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-04 16:53:17 +00:00
emijrp
af64c6b6c5 http or https
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@149 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-04 09:26:20 +00:00
emijrp
5cd7be9987 removing old code in wikiadownloader;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@148 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-03 21:40:21 +00:00
emijrp
e9f379b888 fixing print;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@147 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-03 21:07:17 +00:00
emijrp
1b7fa4c994 help
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@146 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-01 18:26:41 +00:00
emijrp
b26a86cdd5 verbose false for imagedump;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@144 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-01 16:50:38 +00:00
emijrp
896393016d getting date from index.json (wikia);
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@143 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-01 16:48:25 +00:00
emijrp
523ae5c983 months;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@142 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-01 14:54:18 +00:00
emijrp
4e19191cc2 wikia downloader;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@141 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-05-01 09:52:21 +00:00
emijrp
17235cffd9 better comments;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@140 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-04-30 19:44:02 +00:00
emijrp
6e45398878 when full history fails, retrieve only the last version; various server errors handled
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@139 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-04-30 18:53:35 +00:00
emijrp
e4b233cc37 print verbose; seconds numbers to variables;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@138 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-04-30 17:05:59 +00:00
emijrp
7b85e243b0 :
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@137 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-04-30 14:38:11 +00:00
emijrp
3c49a30764 fixing issue #12 and issue #13;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@136 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2011-04-30 14:37:15 +00:00