emijrp
|
835158b79b
|
more wikis; md5 or hashlib
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@154 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-07 22:04:00 +00:00 |
|
emijrp
|
59fe050558
|
more wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@153 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-06 22:29:08 +00:00 |
|
emijrp
|
c7b511ee38
|
more wikis; new content spliter;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@152 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-05 21:46:48 +00:00 |
|
emijrp
|
9a20327939
|
undoHTMLEntities for titles when scrapped from Allpages; protocol http https;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@150 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-04 16:53:17 +00:00 |
|
emijrp
|
af64c6b6c5
|
http or https
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@149 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-04 09:26:20 +00:00 |
|
emijrp
|
5cd7be9987
|
removing old code in wikiadownloader;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@148 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-03 21:40:21 +00:00 |
|
emijrp
|
e9f379b888
|
fixing print;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@147 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-03 21:07:17 +00:00 |
|
emijrp
|
1b7fa4c994
|
help
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@146 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-01 18:26:41 +00:00 |
|
emijrp
|
b26a86cdd5
|
verbose false for imagedump;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@144 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-01 16:50:38 +00:00 |
|
emijrp
|
896393016d
|
getting date from index.json (wikia);
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@143 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-01 16:48:25 +00:00 |
|
emijrp
|
523ae5c983
|
months;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@142 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-01 14:54:18 +00:00 |
|
emijrp
|
4e19191cc2
|
wikia downloader;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@141 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-05-01 09:52:21 +00:00 |
|
emijrp
|
17235cffd9
|
better comments;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@140 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 19:44:02 +00:00 |
|
emijrp
|
6e45398878
|
when full history fails, retrieve only the last version; various server errors handled
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@139 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 18:53:35 +00:00 |
|
emijrp
|
e4b233cc37
|
print verbose; seconds numbers to variables;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@138 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 17:05:59 +00:00 |
|
emijrp
|
7b85e243b0
|
:
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@137 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 14:38:11 +00:00 |
|
emijrp
|
3c49a30764
|
fixing issue #12 and issue #13;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@136 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 14:37:15 +00:00 |
|
emijrp
|
3388c7e83b
|
print
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@135 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 12:43:16 +00:00 |
|
emijrp
|
101cd62e3d
|
print
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@134 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 12:40:02 +00:00 |
|
emijrp
|
46303d780d
|
fixing issue #11;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@133 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 12:37:54 +00:00 |
|
emijrp
|
1f91b4c63e
|
fixing issue #11;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@132 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-30 12:21:50 +00:00 |
|
emijrp
|
220896ccac
|
more wikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@131 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-29 18:34:04 +00:00 |
|
emijrp
|
8bd90b4cde
|
more wikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@127 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-29 09:02:08 +00:00 |
|
emijrp
|
e13b4a6428
|
removing http/https for file prefixes;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@126 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-29 08:59:13 +00:00 |
|
emijrp
|
0f3f7d51f5
|
more wikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@124 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-27 23:16:46 +00:00 |
|
emijrp
|
d0cd9aa646
|
more wikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@123 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-27 23:04:17 +00:00 |
|
emijrp
|
79f961aef5
|
more wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@122 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-27 22:23:15 +00:00 |
|
emijrp
|
2c0d8b97b0
|
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@121 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-27 15:51:46 +00:00 |
|
emijrp
|
2bac6cf3f0
|
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@120 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-26 23:48:51 +00:00 |
|
emijrp
|
d6c1a773a0
|
removing some old #fix comments; moving TODO to Issues section at Google Code;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@119 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-23 21:55:31 +00:00 |
|
emijrp
|
88cbc0e871
|
removing some old #fix comments;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@118 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-23 21:54:03 +00:00 |
|
emijrp
|
23c9a06a31
|
removing some old #fix comments;removing thread option not implemented and better not to be done;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@117 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-23 21:52:13 +00:00 |
|
emijrp
|
05d1fb97c4
|
sorting titles; fixing issue #9;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@116 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-23 21:45:57 +00:00 |
|
emijrp
|
06b6f79989
|
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@113 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-23 16:44:37 +00:00 |
|
emijrp
|
bc36eb0f85
|
uploaded wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@110 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-18 21:02:40 +00:00 |
|
emijrp
|
e1cf136a97
|
wikia list, > 200000 wikis
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@104 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-17 23:21:13 +00:00 |
|
emijrp
|
d4bc4cba9a
|
readme for wikilists
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@103 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-17 23:18:49 +00:00 |
|
emijrp
|
24ea30f29f
|
scribblewiki
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@101 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-17 22:55:51 +00:00 |
|
emijrp
|
eb6f7c2639
|
adding some more empty lists to do
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@100 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-17 22:36:54 +00:00 |
|
emijrp
|
f920be3e3c
|
adding some more to wiki-site; have to remove domain dupes '.a'
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@99 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-17 22:32:14 +00:00 |
|
emijrp
|
db0af570c5
|
sorting
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@98 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-17 22:15:01 +00:00 |
|
emijrp
|
39fc6d2bf4
|
adding lists of wikis;
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@94 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-16 22:03:32 +00:00 |
|
emijrp
|
10f1e9f998
|
new wikis uploaded
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@92 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-16 18:21:23 +00:00 |
|
emijrp
|
200baf406c
|
fixing ampersand & and ' issues while retrieving XML (issue #2)
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@91 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-16 14:51:48 +00:00 |
|
emijrp
|
727e4dbd7c
|
pause and reload xml when no </siteinfo> is found
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@90 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-16 13:54:00 +00:00 |
|
emijrp
|
6c69e5b718
|
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@86 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-15 21:16:15 +00:00 |
|
emijrp
|
6cb2575b1b
|
empty lines
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@85 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-15 20:53:57 +00:00 |
|
emijrp
|
f7d5519757
|
issue #4
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@83 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-15 13:47:44 +00:00 |
|
emijrp
|
d580f53e00
|
file reading performance: f.read() -> for l in f:
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@82 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-15 13:24:16 +00:00 |
|
emijrp
|
ff42a64776
|
xml file reading performance
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@81 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
|
2011-04-15 12:26:23 +00:00 |
|