Archives/wikiteam
2
0
Fork 0
mirror of https://github.com/WikiTeam/wikiteam synced 2024-11-15 00:15:00 +00:00
Code Issues Projects Releases Wiki Activity
583 Commits 3 Branches 0 Tags 56 MiB
c07b527e5d
Commit Graph

583 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Emilio J. Rodríguez-Posada
c07b527e5d adding session to getWikiEngine() 2014-07-03 19:33:09 +02:00
Emilio J. Rodríguez-Posada
30c153ce1f chg: using 'with open' for files 2014-07-03 19:24:28 +02:00
Emilio J. Rodríguez-Posada
10d269deb0 Merge branch 'balr0g-requests' 2014-07-03 19:06:37 +02:00
balr0g
1391cf893b Update requirements file 2014-07-03 12:40:12 -04:00
balr0g
9aa3c4a0e1 Removed all traces of urllib except for encode/decode; more bugs fixed. 2014-07-03 12:35:40 -04:00
balr0g
c8e11a949b Initial port to Requests 2014-07-03 12:32:27 -04:00
Emilio J. Rodríguez-Posada
9553e3550c adding wiki engine detector 2014-07-03 18:17:02 +02:00
Emilio J. Rodríguez-Posada
eb97cf1adf version 0.2.2 and tiny bits in --help 2014-07-03 16:02:11 +02:00
Emilio J. Rodríguez-Posada
fc2ed3ed0d Merge pull request #138 from balr0g/argparse 
Initial port to argparse
 2014-07-03 15:44:05 +02:00
Emilio J. Rodríguez-Posada
636c6a91df adding spider for neoseeker, updating list, adding info file 2014-07-02 16:19:49 +02:00
Emilio J. Rodríguez-Posada
514d5fea0e removing unused modules 2014-07-02 15:57:15 +02:00
Emilio J. Rodríguez-Posada
a3e69666fe adding spider for orain wikifarm, updating list too 2014-07-02 15:55:13 +02:00
Emilio J. Rodríguez-Posada
374cf83c54 adding info file for orain.org wikifarm list 2014-07-02 15:45:12 +02:00
balr0g
32fded6e8a Add requirements file 2014-07-01 14:05:23 -04:00
Emilio J. Rodríguez-Posada
7c76b77842 revamping image list tests 2014-07-01 18:31:28 +02:00
Emilio J. Rodríguez-Posada
3a8fa1f0cc adding test for getImageFilenamesURL(), the image scraper 2014-07-01 17:29:07 +02:00
Emilio J. Rodríguez-Posada
5f0ca74d87 adding simple test for delay(), 0 and 3 seconds 2014-07-01 17:22:27 +02:00
balr0g
50b011f90d Initial port to argparse 2014-06-30 19:41:03 -04:00
Emilio J. Rodríguez-Posada
09be8b5f22 prints 2014-06-30 23:09:13 +02:00
Emilio J. Rodríguez-Posada
3da6bc222f ignoring .pyc files 2014-06-30 22:57:09 +02:00
Emilio J. Rodríguez-Posada
d04c0e5bce first test 2014-06-30 22:55:29 +02:00
Emilio J. Rodríguez-Posada
568deef081 adding comments for clarification 2014-06-30 20:09:36 +02:00
Emilio J. Rodríguez-Posada
d4eed1f738 fixing #127 and #134 , now works with APIs that returns 'name' field for images and those that don't do it (in this case we unquote over ascii); also fixing bug that re-download image list when it was completed previously 2014-06-30 20:03:32 +02:00
Emilio J. Rodríguez-Posada
005de23c1d adding gzip to siteinfo downloader 2014-06-29 13:26:06 +02:00
Emilio J. Rodríguez-Posada
d79ea64d41 fixing issue #97 pretty siteinfo json saving, indenting 4 chars 2014-06-29 10:46:26 +02:00
Emilio J. Rodríguez-Posada
3854a344fe Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-29 10:01:25 +02:00
Emilio J. Rodríguez-Posada
1c1f0dbb86 replacing XML with JSON in image downloading 2014-06-29 10:01:09 +02:00
Emilio J. Rodríguez-Posada
6bbdf42ed0 Merge pull request #125 from balr0g/check-for-disabled-api 
Don't try to download sites with disabled API
 2014-06-28 10:35:31 +02:00
balr0g
481323c7f7 Don't try to download sites with disabled API 2014-06-27 15:19:54 -04:00
Emilio J. Rodríguez-Posada
084ccc6456 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 18:52:46 +02:00
nemobis
1933db8a94 Merge pull request #124 from balr0g/scraper-unicode-title-fix 
Fix scraper for sites with Unicode titles
 2014-06-27 18:06:51 +02:00
balr0g
62be069026 Fix scraper for sites with Unicode titles 2014-06-27 11:50:59 -04:00
nemobis
dbfc1b598a Ask Wikimedia Commons reseed 2014-06-27 17:41:20 +02:00
nemobis
c41cc5235c Fix typo, add balrog 
Because he always saves wikiteam from my silly mistakes, helping out on #wikiteam.
 2014-06-27 17:39:50 +02:00
nemobis
62d961fa97 Fix typo, unused variable spotted by balrog 2014-06-27 17:33:29 +02:00
Emilio J. Rodríguez-Posada
7d00cfa0de adding list info file for tropicalwikis 2014-06-27 17:07:37 +02:00
Emilio J. Rodríguez-Posada
ecd539f1ae adding scribblewiki list info file 2014-06-27 17:06:17 +02:00
Emilio J. Rodríguez-Posada
e95d8ba6e1 sort list 2014-06-27 17:04:59 +02:00
Emilio J. Rodríguez-Posada
c420d4d843 adding spider for wikkii, updating the list (10 diff wikis, 2 new, 8 dead), adding info for list 2014-06-27 16:59:12 +02:00
Emilio J. Rodríguez-Posada
c7fc194f0d add info file for wikkii.com list 2014-06-27 16:48:02 +02:00
Emilio J. Rodríguez-Posada
29a64507c2 last update date 2014-06-27 16:42:50 +02:00
Emilio J. Rodríguez-Posada
d90127e9cc adding details to shoutwiki info 2014-06-27 16:16:14 +02:00
Emilio J. Rodríguez-Posada
90c442a5b7 updating shoutwiki list and uploading basic spider 2014-06-27 16:15:29 +02:00
Emilio J. Rodríguez-Posada
75e2234c2c adding details to referata list 2014-06-27 16:15:00 +02:00
Emilio J. Rodríguez-Posada
db9bcb68ca adding license to referata-spider.py 2014-06-27 16:14:44 +02:00
Emilio J. Rodríguez-Posada
fa6f603fe8 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 15:33:10 +02:00
Emilio J. Rodríguez-Posada
eaec1afa83 adding info about shoutwiki list 2014-06-27 15:32:57 +02:00
nemobis
95bc2dec38 Link GitHub issue tracker 2014-06-27 15:25:28 +02:00
Emilio J. Rodríguez-Posada
a917a68020 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 15:24:48 +02:00
Emilio J. Rodríguez-Posada
1befbabb02 updating info for referata list 2014-06-27 15:23:48 +02:00