PiRSquared17
56c2177106
Add (incomplete) list of dokuwikis
2014-09-22 23:56:53 -04:00
PiRSquared17
03ddde3702
Move wiki lists to mediawiki subdirectory
2014-09-22 23:23:40 -04:00
Emilio J. Rodríguez-Posada
43a105335b
Merge pull request #185 from PiRSquared17/fix-tests
...
Relax delay() test by 10 ms, add test for allpages
2014-09-21 13:06:11 +02:00
PiRSquared17
4ceb9ad72e
Preserve default headers, fixing openwrt test
2014-09-20 20:07:49 -04:00
PiRSquared17
d7e43f92c7
Relax delay() test by 10 ms, add test for allpages
2014-09-20 12:14:43 -04:00
nemobis
f52051f8ae
Merge pull request #184 from PiRSquared17/fix-tests
...
Fix tox.ini and clean up/update tests, avoid a loop to make tests pass
2014-09-20 17:54:16 +02:00
PiRSquared17
b4818d2985
Avoid infinite loop in getImageNamesScraper
2014-09-20 11:41:57 -04:00
PiRSquared17
f2b7716e72
Fix tox.ini and clean up/update tests
2014-09-20 11:36:24 -04:00
nemobis
8a9b50b51d
Merge pull request #183 from PiRSquared17/patch-7
...
Retry on ConnectionError in getXMLPageCore
2014-09-19 21:08:52 +02:00
nemobis
9828cbec3c
Add PiRSquared17 to credits
2014-09-19 09:46:17 +02:00
nemobis
19c48d3dd0
Merge pull request #180 from PiRSquared17/patch-2
...
Get as much information from siteinfo as possible
2014-09-19 09:43:07 +02:00
nemobis
d8360393da
Merge pull request #182 from PiRSquared17/patch-6
...
AllPages API fix for old MediaWiki versions
2014-09-19 09:07:31 +02:00
Pi R. Squared
f7187b7048
Retry on ConnectionError in getXMLPageCore
...
Previously it just gave a fatal error.
2014-09-18 20:21:01 -04:00
Pi R. Squared
f31e4e6451
Dict not hashable, also not needed
...
Quick fix.
2014-09-18 17:56:22 -04:00
Pi R. Squared
399f609d70
AllPages API hack for old versions of MediaWiki
...
New API format: http://www.mediawiki.org/w/api.php?action=query&list=allpages&apnamespace=0&apfrom=!&format=json&aplimit=500
Old API format: http://wiki.damirsystems.com/api.php?action=query&list=allpages&apnamespace=0&apfrom=!&format=json
2014-09-18 17:53:38 -04:00
nemobis
b3e77fe006
Merge pull request #181 from PiRSquared17/patch-4
...
Try getting index.php from siteinfo API
2014-09-18 11:07:19 +02:00
nemobis
9beda42385
Merge pull request #137 from hashar/tests-with-tox-and-nose
...
Easily run tests in a virtualenv with tox and nose
2014-09-16 13:54:50 +02:00
Pi R. Squared
498b64da3f
Try getting index.php from siteinfo API
...
Fixes #49
2014-09-14 11:59:17 -04:00
Pi R. Squared
ff0d230d08
Get as much information from siteinfo as possible
...
Properly fixes #74 .
Algorithm:
1. Try all siteinfo props. If this gives an error, continue. Otherwise, stop.
2. Try MediaWiki 1.11-1.12 siteinfo props. If this gives an error, continue. Otherwise, stop.
3. Try minimal siteinfo props. Stop.
Not using sishowalldb=1 to avoid possible error (by default), since this data is of little use anyway.
2014-09-14 11:10:43 -04:00
nemobis
ac1a7defae
Merge pull request #178 from PiRSquared17/patch-1
...
Encode title using UTF-8 before printing
2014-09-14 15:06:24 +02:00
Pi R. Squared
322604cc23
Encode title using UTF-8 before printing
...
This fixes #170 and closes #174 .
2014-09-14 09:03:44 -04:00
nemobis
11368310ee
Merge pull request #173 from nemobis/issue/131
...
Fix #131 : ValueError: No JSON object could be decoded
2014-08-23 19:28:26 +03:00
nemobis
2c027adba0
Merge pull request #171 from seanyeh/fix-delay
...
Fix argument parsing to accept delay as a number
2014-08-23 19:25:59 +03:00
Nemo bis
026c2a9a25
Issue 131: ValueError: No JSON object could be decoded
2014-08-23 19:08:14 +03:00
Sean Yeh
38e73c1cf7
Fix argument parsing to accept delay as a number
2014-08-22 22:19:11 -05:00
nemobis
92d8106122
FOUC are bad
2014-07-31 09:30:22 +02:00
nemobis
27f61429fe
wikimediacommons update: 10 TB more with all 2013
2014-07-31 09:28:58 +02:00
nemobis
41555e5fb1
Merge pull request #166 from nemobis/2014/66
...
Issue #66 : try your.org first
2014-07-26 16:31:26 +02:00
nemobis
7313928447
Wrong else: missing indentation, endless loop
2014-07-22 11:03:21 +02:00
Federico Leva
eb9677fb13
Issue #66 : try your.org first
...
It's rather pointless to try to get a sensible error management with
os calls; just rely on wget -c to download the missing/incomplete files,
even though this will cause some additional connections.
2014-07-21 10:39:08 +02:00
Emilio J. Rodríguez-Posada
faf10078b5
Merge pull request #164 from etesp/master
...
Add tropicalwiki APIs from WikiApiary
2014-07-20 16:46:36 +02:00
etesp
1309e89d45
Added information
2014-07-20 12:36:25 +01:00
etesp
dab53ea491
Added WikiApiary tropicalwiki api urls
2014-07-20 12:33:41 +01:00
nemobis
18b85ae859
Merge pull request #163 from nemobis/master
...
Issue 161: add shodan export
2014-07-17 18:56:29 +02:00
Federico Leva
c1e6c0ead3
Merge remote-tracking branch 'upstream/master'
2014-07-17 18:54:44 +02:00
Federico Leva
86c65fc9be
Issue 161: add shodan export
2014-07-17 18:47:05 +02:00
Emilio J. Rodríguez-Posada
6419160973
tiny bit
2014-07-13 13:04:46 +02:00
Emilio J. Rodríguez-Posada
5616b920d7
updating instructions for using just the domain name
2014-07-13 13:03:46 +02:00
Emilio J. Rodríguez-Posada
a2efca27b8
improving API/Index calculate
2014-07-13 12:52:48 +02:00
Emilio J. Rodríguez-Posada
4bc43a1c0f
improved help messages
2014-07-13 12:39:54 +02:00
Emilio J. Rodríguez-Posada
386c6be036
added test_mwGetAPIAndIndex; commented slow/404 error wikis;
2014-07-13 12:34:09 +02:00
Emilio J. Rodríguez-Posada
51806f5a3d
fixed #160 ; improved args parsing and --help; improved API/Index estimate from URL;
2014-07-13 12:32:49 +02:00
Emilio J. Rodríguez-Posada
c168097205
adding more wikis to test
2014-07-11 20:58:08 +02:00
Emilio J. Rodríguez-Posada
dd7df0cc01
Merge branch 'master' of https://github.com/WikiTeam/wikiteam
2014-07-11 20:44:39 +02:00
Emilio J. Rodríguez-Posada
f3b388fc79
a first approach to auto-detect API/Index.php using URL to the Main_Page
2014-07-11 20:44:25 +02:00
Emilio J. Rodríguez-Posada
6882e80c2c
Merge pull request #159 from Erkan-Yilmaz/master
...
fix non-working link for tutorial
2014-07-11 19:35:35 +02:00
Erkan Yilmaz
44b80ceb88
fix link for tutorial
2014-07-11 19:31:51 +02:00
nemobis
0f00da341d
Merge pull request #157 from balr0g/requests-session-fix
...
Pass session
2014-07-11 17:54:40 +02:00
balr0g
8485a5004d
Pass session
2014-07-11 11:24:15 -04:00
Emilio J. Rodríguez-Posada
11b346a960
spliting requirements
2014-07-11 15:51:50 +02:00