nemobis
e0f8e36bf4
Merge pull request #190 from PiRSquared17/api-allpages-disabled
...
Fallback to getPageTitlesScraper() if API allpages disabled
2014-09-28 16:34:24 +02:00
nemobis
a7e1b13304
Merge pull request #193 from mrshu/mrshu/readme-fix-wording
...
readme: Fix wording
2014-09-28 16:32:56 +02:00
nemobis
3fc7dcb5de
Add some more doku.php URLs
2014-09-26 23:55:57 +02:00
mr.Shu
54c373e9a0
readme: Fix wording
...
* Made a few wording changes to make the README.md more clear.
Signed-off-by: mr.Shu <mr@shu.io>
2014-09-25 18:55:00 +02:00
Marek Šuppa
40d863fb99
README: update working
...
* Updated wording to make the README more clear.
2014-09-25 18:54:36 +02:00
Emilio J. Rodríguez-Posada
87ce2d4540
Merge pull request #192 from mrshu/mrshu/add-travis-image
...
update: Add TravisCI image to README
2014-09-25 16:05:42 +02:00
mr.Shu
7b0b54b6e5
update: Add TravisCI image to README
...
* Added TravisCI image which specifies whether the tests are passing or
not to Developers section.
Signed-off-by: mr.Shu <mr@shu.io>
2014-09-25 11:59:47 +02:00
Emilio J. Rodríguez-Posada
5c8e316e67
Merge pull request #189 from PiRSquared17/get-wiki-engine
...
Improve getWikiEngine()
2014-09-25 11:58:26 +02:00
Emilio J. Rodríguez-Posada
086415bc00
Merge pull request #191 from mrshu/mrshu/setup-travis
...
tests: Add .travis.yml and Travis CI
2014-09-25 11:55:02 +02:00
mr.Shu
14c62c6587
tests: Add .travis.yml and Travis CI
...
* Added .travis.yml to enable Travis CI
Signed-off-by: mr.Shu <mr@shu.io>
2014-09-23 23:12:40 +02:00
PiRSquared17
757019521a
Fallback to scraper if API allpages disabled
2014-09-23 15:53:51 -04:00
PiRSquared17
4b3c862a58
Comment debugging print, fix test
2014-09-23 15:10:06 -04:00
PiRSquared17
7a1db0525b
Add more wiki engines to getWikiEngine
2014-09-23 15:04:36 -04:00
nemobis
40c406cd00
Merge pull request #188 from PiRSquared17/wikiengine-lists
...
Add subdirectories to listsofwikis for different wiki engines
2014-09-23 07:19:43 +02:00
PiRSquared17
56c2177106
Add (incomplete) list of dokuwikis
2014-09-22 23:56:53 -04:00
PiRSquared17
03ddde3702
Move wiki lists to mediawiki subdirectory
2014-09-22 23:23:40 -04:00
Emilio J. Rodríguez-Posada
43a105335b
Merge pull request #185 from PiRSquared17/fix-tests
...
Relax delay() test by 10 ms, add test for allpages
2014-09-21 13:06:11 +02:00
PiRSquared17
d7e43f92c7
Relax delay() test by 10 ms, add test for allpages
2014-09-20 12:14:43 -04:00
nemobis
f52051f8ae
Merge pull request #184 from PiRSquared17/fix-tests
...
Fix tox.ini and clean up/update tests, avoid a loop to make tests pass
2014-09-20 17:54:16 +02:00
PiRSquared17
b4818d2985
Avoid infinite loop in getImageNamesScraper
2014-09-20 11:41:57 -04:00
PiRSquared17
f2b7716e72
Fix tox.ini and clean up/update tests
2014-09-20 11:36:24 -04:00
nemobis
8a9b50b51d
Merge pull request #183 from PiRSquared17/patch-7
...
Retry on ConnectionError in getXMLPageCore
2014-09-19 21:08:52 +02:00
nemobis
9828cbec3c
Add PiRSquared17 to credits
2014-09-19 09:46:17 +02:00
nemobis
19c48d3dd0
Merge pull request #180 from PiRSquared17/patch-2
...
Get as much information from siteinfo as possible
2014-09-19 09:43:07 +02:00
nemobis
d8360393da
Merge pull request #182 from PiRSquared17/patch-6
...
AllPages API fix for old MediaWiki versions
2014-09-19 09:07:31 +02:00
Pi R. Squared
f7187b7048
Retry on ConnectionError in getXMLPageCore
...
Previously it just gave a fatal error.
2014-09-18 20:21:01 -04:00
Pi R. Squared
f31e4e6451
Dict not hashable, also not needed
...
Quick fix.
2014-09-18 17:56:22 -04:00
Pi R. Squared
399f609d70
AllPages API hack for old versions of MediaWiki
...
New API format: http://www.mediawiki.org/w/api.php?action=query&list=allpages&apnamespace=0&apfrom=!&format=json&aplimit=500
Old API format: http://wiki.damirsystems.com/api.php?action=query&list=allpages&apnamespace=0&apfrom=!&format=json
2014-09-18 17:53:38 -04:00
nemobis
b3e77fe006
Merge pull request #181 from PiRSquared17/patch-4
...
Try getting index.php from siteinfo API
2014-09-18 11:07:19 +02:00
nemobis
9beda42385
Merge pull request #137 from hashar/tests-with-tox-and-nose
...
Easily run tests in a virtualenv with tox and nose
2014-09-16 13:54:50 +02:00
Pi R. Squared
498b64da3f
Try getting index.php from siteinfo API
...
Fixes #49
2014-09-14 11:59:17 -04:00
Pi R. Squared
ff0d230d08
Get as much information from siteinfo as possible
...
Properly fixes #74 .
Algorithm:
1. Try all siteinfo props. If this gives an error, continue. Otherwise, stop.
2. Try MediaWiki 1.11-1.12 siteinfo props. If this gives an error, continue. Otherwise, stop.
3. Try minimal siteinfo props. Stop.
Not using sishowalldb=1 to avoid possible error (by default), since this data is of little use anyway.
2014-09-14 11:10:43 -04:00
nemobis
ac1a7defae
Merge pull request #178 from PiRSquared17/patch-1
...
Encode title using UTF-8 before printing
2014-09-14 15:06:24 +02:00
Pi R. Squared
322604cc23
Encode title using UTF-8 before printing
...
This fixes #170 and closes #174 .
2014-09-14 09:03:44 -04:00
nemobis
11368310ee
Merge pull request #173 from nemobis/issue/131
...
Fix #131 : ValueError: No JSON object could be decoded
2014-08-23 19:28:26 +03:00
nemobis
2c027adba0
Merge pull request #171 from seanyeh/fix-delay
...
Fix argument parsing to accept delay as a number
2014-08-23 19:25:59 +03:00
Nemo bis
026c2a9a25
Issue 131: ValueError: No JSON object could be decoded
2014-08-23 19:08:14 +03:00
Sean Yeh
38e73c1cf7
Fix argument parsing to accept delay as a number
2014-08-22 22:19:11 -05:00
nemobis
92d8106122
FOUC are bad
2014-07-31 09:30:22 +02:00
nemobis
27f61429fe
wikimediacommons update: 10 TB more with all 2013
2014-07-31 09:28:58 +02:00
nemobis
41555e5fb1
Merge pull request #166 from nemobis/2014/66
...
Issue #66 : try your.org first
2014-07-26 16:31:26 +02:00
nemobis
7313928447
Wrong else: missing indentation, endless loop
2014-07-22 11:03:21 +02:00
Federico Leva
eb9677fb13
Issue #66 : try your.org first
...
It's rather pointless to try to get a sensible error management with
os calls; just rely on wget -c to download the missing/incomplete files,
even though this will cause some additional connections.
2014-07-21 10:39:08 +02:00
Emilio J. Rodríguez-Posada
faf10078b5
Merge pull request #164 from etesp/master
...
Add tropicalwiki APIs from WikiApiary
2014-07-20 16:46:36 +02:00
etesp
1309e89d45
Added information
2014-07-20 12:36:25 +01:00
etesp
dab53ea491
Added WikiApiary tropicalwiki api urls
2014-07-20 12:33:41 +01:00
nemobis
18b85ae859
Merge pull request #163 from nemobis/master
...
Issue 161: add shodan export
2014-07-17 18:56:29 +02:00
Federico Leva
c1e6c0ead3
Merge remote-tracking branch 'upstream/master'
2014-07-17 18:54:44 +02:00
Federico Leva
86c65fc9be
Issue 161: add shodan export
2014-07-17 18:47:05 +02:00
Emilio J. Rodríguez-Posada
6419160973
tiny bit
2014-07-13 13:04:46 +02:00