2
0
mirror of https://github.com/WikiTeam/wikiteam synced 2024-11-15 00:15:00 +00:00
Commit Graph

592 Commits

Author SHA1 Message Date
Emilio J. Rodríguez-Posada
767123e89d updating wiki-site.com list 2014-07-04 22:06:38 +02:00
Emilio J. Rodríguez-Posada
28643cd5fc adding more tests: titles 2014-07-04 20:45:21 +02:00
Emilio J. Rodríguez-Posada
89e3c3e462 standarize getImage* functions names 2014-07-04 20:40:14 +02:00
Emilio J. Rodríguez-Posada
78f04a4bcd adding more tests for image lists 2014-07-04 19:45:34 +02:00
Emilio J. Rodríguez-Posada
aaa1822759 improving image list downloader 2014-07-04 19:44:01 +02:00
Emilio J. Rodríguez-Posada
88c9468c0e improving image list downloader 2014-07-04 19:39:48 +02:00
Emilio J. Rodríguez-Posada
53802bd8b8 Merge pull request #151 from balr0g/flake8-cleanup
Cleanups and error fixes suggested by flake8 (pep8 + pyflakes)
2014-07-04 19:36:49 +02:00
balr0g
3929e4eb9c Cleanups and error fixes suggested by flake8 (pep8 + pyflakes) 2014-07-04 11:40:59 -04:00
Hydriz Scholz
421df6d4bb Spliting rewrite files into a separate branch 2014-07-04 22:16:13 +08:00
Emilio J. Rodríguez-Posada
c07b527e5d adding session to getWikiEngine() 2014-07-03 19:33:09 +02:00
Emilio J. Rodríguez-Posada
30c153ce1f chg: using 'with open' for files 2014-07-03 19:24:28 +02:00
Emilio J. Rodríguez-Posada
10d269deb0 Merge branch 'balr0g-requests' 2014-07-03 19:06:37 +02:00
balr0g
1391cf893b Update requirements file 2014-07-03 12:40:12 -04:00
balr0g
9aa3c4a0e1 Removed all traces of urllib except for encode/decode; more bugs fixed. 2014-07-03 12:35:40 -04:00
balr0g
c8e11a949b Initial port to Requests 2014-07-03 12:32:27 -04:00
Emilio J. Rodríguez-Posada
9553e3550c adding wiki engine detector 2014-07-03 18:17:02 +02:00
Emilio J. Rodríguez-Posada
eb97cf1adf version 0.2.2 and tiny bits in --help 2014-07-03 16:02:11 +02:00
Emilio J. Rodríguez-Posada
fc2ed3ed0d Merge pull request #138 from balr0g/argparse
Initial port to argparse
2014-07-03 15:44:05 +02:00
Emilio J. Rodríguez-Posada
636c6a91df adding spider for neoseeker, updating list, adding info file 2014-07-02 16:19:49 +02:00
Emilio J. Rodríguez-Posada
514d5fea0e removing unused modules 2014-07-02 15:57:15 +02:00
Emilio J. Rodríguez-Posada
a3e69666fe adding spider for orain wikifarm, updating list too 2014-07-02 15:55:13 +02:00
Emilio J. Rodríguez-Posada
374cf83c54 adding info file for orain.org wikifarm list 2014-07-02 15:45:12 +02:00
balr0g
32fded6e8a Add requirements file 2014-07-01 14:05:23 -04:00
Emilio J. Rodríguez-Posada
7c76b77842 revamping image list tests 2014-07-01 18:31:28 +02:00
Emilio J. Rodríguez-Posada
3a8fa1f0cc adding test for getImageFilenamesURL(), the image scraper 2014-07-01 17:29:07 +02:00
Emilio J. Rodríguez-Posada
5f0ca74d87 adding simple test for delay(), 0 and 3 seconds 2014-07-01 17:22:27 +02:00
balr0g
50b011f90d Initial port to argparse 2014-06-30 19:41:03 -04:00
Emilio J. Rodríguez-Posada
09be8b5f22 prints 2014-06-30 23:09:13 +02:00
Emilio J. Rodríguez-Posada
3da6bc222f ignoring .pyc files 2014-06-30 22:57:09 +02:00
Emilio J. Rodríguez-Posada
d04c0e5bce first test 2014-06-30 22:55:29 +02:00
Emilio J. Rodríguez-Posada
568deef081 adding comments for clarification 2014-06-30 20:09:36 +02:00
Emilio J. Rodríguez-Posada
d4eed1f738 fixing #127 and #134 , now works with APIs that returns 'name' field for images and those that don't do it (in this case we unquote over ascii); also fixing bug that re-download image list when it was completed previously 2014-06-30 20:03:32 +02:00
Emilio J. Rodríguez-Posada
005de23c1d adding gzip to siteinfo downloader 2014-06-29 13:26:06 +02:00
Emilio J. Rodríguez-Posada
d79ea64d41 fixing issue #97 pretty siteinfo json saving, indenting 4 chars 2014-06-29 10:46:26 +02:00
Emilio J. Rodríguez-Posada
3854a344fe Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-29 10:01:25 +02:00
Emilio J. Rodríguez-Posada
1c1f0dbb86 replacing XML with JSON in image downloading 2014-06-29 10:01:09 +02:00
Emilio J. Rodríguez-Posada
6bbdf42ed0 Merge pull request #125 from balr0g/check-for-disabled-api
Don't try to download sites with disabled API
2014-06-28 10:35:31 +02:00
balr0g
481323c7f7 Don't try to download sites with disabled API 2014-06-27 15:19:54 -04:00
Emilio J. Rodríguez-Posada
084ccc6456 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 18:52:46 +02:00
nemobis
1933db8a94 Merge pull request #124 from balr0g/scraper-unicode-title-fix
Fix scraper for sites with Unicode titles
2014-06-27 18:06:51 +02:00
balr0g
62be069026 Fix scraper for sites with Unicode titles 2014-06-27 11:50:59 -04:00
nemobis
dbfc1b598a Ask Wikimedia Commons reseed 2014-06-27 17:41:20 +02:00
nemobis
c41cc5235c Fix typo, add balrog
Because he always saves wikiteam from my silly mistakes, helping out on #wikiteam.
2014-06-27 17:39:50 +02:00
nemobis
62d961fa97 Fix typo, unused variable spotted by balrog 2014-06-27 17:33:29 +02:00
Emilio J. Rodríguez-Posada
7d00cfa0de adding list info file for tropicalwikis 2014-06-27 17:07:37 +02:00
Emilio J. Rodríguez-Posada
ecd539f1ae adding scribblewiki list info file 2014-06-27 17:06:17 +02:00
Emilio J. Rodríguez-Posada
e95d8ba6e1 sort list 2014-06-27 17:04:59 +02:00
Emilio J. Rodríguez-Posada
c420d4d843 adding spider for wikkii, updating the list (10 diff wikis, 2 new, 8 dead), adding info for list 2014-06-27 16:59:12 +02:00
Emilio J. Rodríguez-Posada
c7fc194f0d add info file for wikkii.com list 2014-06-27 16:48:02 +02:00
Emilio J. Rodríguez-Posada
29a64507c2 last update date 2014-06-27 16:42:50 +02:00