2
0
mirror of https://github.com/WikiTeam/wikiteam synced 2024-11-10 13:10:27 +00:00
Commit Graph

555 Commits

Author SHA1 Message Date
balr0g
481323c7f7 Don't try to download sites with disabled API 2014-06-27 15:19:54 -04:00
Emilio J. Rodríguez-Posada
084ccc6456 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 18:52:46 +02:00
nemobis
1933db8a94 Merge pull request #124 from balr0g/scraper-unicode-title-fix
Fix scraper for sites with Unicode titles
2014-06-27 18:06:51 +02:00
balr0g
62be069026 Fix scraper for sites with Unicode titles 2014-06-27 11:50:59 -04:00
nemobis
dbfc1b598a Ask Wikimedia Commons reseed 2014-06-27 17:41:20 +02:00
nemobis
c41cc5235c Fix typo, add balrog
Because he always saves wikiteam from my silly mistakes, helping out on #wikiteam.
2014-06-27 17:39:50 +02:00
nemobis
62d961fa97 Fix typo, unused variable spotted by balrog 2014-06-27 17:33:29 +02:00
Emilio J. Rodríguez-Posada
7d00cfa0de adding list info file for tropicalwikis 2014-06-27 17:07:37 +02:00
Emilio J. Rodríguez-Posada
ecd539f1ae adding scribblewiki list info file 2014-06-27 17:06:17 +02:00
Emilio J. Rodríguez-Posada
e95d8ba6e1 sort list 2014-06-27 17:04:59 +02:00
Emilio J. Rodríguez-Posada
c420d4d843 adding spider for wikkii, updating the list (10 diff wikis, 2 new, 8 dead), adding info for list 2014-06-27 16:59:12 +02:00
Emilio J. Rodríguez-Posada
c7fc194f0d add info file for wikkii.com list 2014-06-27 16:48:02 +02:00
Emilio J. Rodríguez-Posada
29a64507c2 last update date 2014-06-27 16:42:50 +02:00
Emilio J. Rodríguez-Posada
d90127e9cc adding details to shoutwiki info 2014-06-27 16:16:14 +02:00
Emilio J. Rodríguez-Posada
90c442a5b7 updating shoutwiki list and uploading basic spider 2014-06-27 16:15:29 +02:00
Emilio J. Rodríguez-Posada
75e2234c2c adding details to referata list 2014-06-27 16:15:00 +02:00
Emilio J. Rodríguez-Posada
db9bcb68ca adding license to referata-spider.py 2014-06-27 16:14:44 +02:00
Emilio J. Rodríguez-Posada
fa6f603fe8 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 15:33:10 +02:00
Emilio J. Rodríguez-Posada
eaec1afa83 adding info about shoutwiki list 2014-06-27 15:32:57 +02:00
nemobis
95bc2dec38 Link GitHub issue tracker 2014-06-27 15:25:28 +02:00
Emilio J. Rodríguez-Posada
a917a68020 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 15:24:48 +02:00
Emilio J. Rodríguez-Posada
1befbabb02 updating info for referata list 2014-06-27 15:23:48 +02:00
nemobis
fb02da7f4d Merge pull request #122 from balr0g/gzip
Add Content-Encoding: gzip support
2014-06-27 15:09:29 +02:00
balr0g
d60e560571 Add Content-Encoding: gzip support 2014-06-27 09:02:35 -04:00
Emilio J. Rodríguez-Posada
7a6ef18339 add more wikis to referata list; uploading basic referata-spider.py 2014-06-27 14:51:05 +02:00
Emilio J. Rodríguez-Posada
d97c46afd1 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 13:39:39 +02:00
Emilio J. Rodríguez-Posada
a988968e7e adding info for referata list 2014-06-27 13:39:23 +02:00
Emilio J. Rodríguez-Posada
a1a76ac198 issue #111 2014-06-27 12:58:03 +02:00
nemobis
4ef1d45e35 Merge pull request #119 from nemobis/2014/siteinfo
Issue 97: Add new siteinfo.json to the archived 7z
2014-06-26 11:14:11 +02:00
Federico Leva
f46b60a4b6 Issue 97: Add new siteinfo.json to the archived 7z 2014-06-26 11:11:19 +02:00
Emilio J. Rodríguez-Posada
5261811fa4 only if api exists 2014-06-26 10:39:45 +02:00
Emilio J. Rodríguez-Posada
610764619a add saveSiteInfo() to download meta=siteinfo data from API to a file 2014-06-26 10:38:59 +02:00
Emilio J. Rodríguez-Posada
d395433513 comments and newlines 2014-06-26 10:26:57 +02:00
Emilio J. Rodríguez-Posada
5eff4bd072 comments and tabs 2014-06-26 10:17:00 +02:00
Emilio J. Rodríguez-Posada
0b0c40f5da adding more user-agents, but keeps the first as default by now 2014-06-26 10:13:59 +02:00
Emilio J. Rodríguez-Posada
81468c4a7c using JSON to retrieve namespaces via API 2014-06-25 23:54:05 +02:00
Emilio J. Rodríguez-Posada
703eb9011b improving checkAPI() using JSON properly loaded 2014-06-25 23:17:39 +02:00
Emilio J. Rodríguez-Posada
44d3fe1e36 Merge pull request #117 from nemobis/bug/48
Issue 48: Check that API actually works
2014-06-25 23:12:29 +02:00
Emilio J. Rodríguez-Posada
fc80556d8a merging... 2014-06-25 22:57:56 +02:00
Emilio J. Rodríguez-Posada
f474deb71f now we use JSON properly in getPageTitlesAPI(), instead of XML; fixing some wrong prints, now support utf-8 2014-06-25 22:53:46 +02:00
nemobis
85c2e5b20a Merge pull request #118 from nemobis/bug/46
Issue 46: dumpgenerator should follow redirects
2014-06-25 21:45:50 +02:00
Federico Leva
997276110c Issue 46: dumpgenerator should follow redirects
Patch by @balr0g from libsonic (GPLv3+).
2014-06-25 21:33:02 +02:00
Federico Leva
a8e1575879 Issue 48: Check that API actually works 2014-06-25 20:35:36 +02:00
Emilio J. Rodríguez-Posada
c9aa165504 fixing header with the new year, info and documentation link 2014-06-25 18:08:33 +02:00
Emilio J. Rodríguez-Posada
31827f61f7 Update README.md 2014-06-25 17:57:18 +02:00
Emilio J. Rodríguez-Posada
7ae9a01f58 Update README.md 2014-06-25 17:56:34 +02:00
Emilio J. Rodríguez-Posada
893afd5c8f Update README.md 2014-06-25 17:46:49 +02:00
Emilio J. Rodríguez-Posada
f4da88a072 Update README.md 2014-06-25 17:44:27 +02:00
Emilio J. Rodríguez-Posada
59c24ddfb0 Update README.md 2014-06-25 17:39:46 +02:00
Emilio J. Rodríguez-Posada
1f585b7fd4 Update README.md 2014-06-25 17:38:15 +02:00