emijrp
fea6ab3b86
more
2016-07-27 17:53:08 +02:00
emijrp
01ccacd138
first version of wikispaces spider
2016-07-27 17:39:31 +02:00
emijrp
82e84d59ad
Merge branch 'master' of https://github.com/WikiTeam/wikiteam
2016-07-27 15:57:44 +02:00
emijrp
7aff4f25df
Spanish version of paper
2016-07-27 15:57:04 +02:00
emijrp
d3e9442a09
botflag
2016-07-27 15:56:47 +02:00
Emilio J. Rodríguez-Posada
71deeb20db
Merge pull request #273 from Alexia/patch-1
...
Update gamepedia.com wikis.
2016-04-08 11:19:59 +02:00
Eli Clemente Gordillo Foster
aa12e91123
Ignore .org as well.
...
I noticed that .org files were being registered as Org. Not even sure what that is, but I know it's wrong.
2016-04-07 16:55:44 -07:00
Eli Clemente Gordillo Foster
641228083f
Fix erroneous linguistics.
...
Ignore com extensions, as they were being registered as DCL, which is wrong.
2016-04-07 16:51:28 -07:00
Alexia E. Smith
cb766de5ff
Update gamepedia.com wikis.
...
This is current as of 2016-04-07 and is correct at 1,120 wikis.
2016-04-07 17:18:42 -05:00
Emilio J. Rodríguez-Posada
6cf1e01ea6
Merge pull request #271 from davidabian/patch-1
...
Update Commons host
2016-03-26 18:26:39 +01:00
David Abián
98353d2e2b
Update host
2016-03-26 15:43:42 +01:00
nemobis
f43b7389a0
Merge pull request #270 from nemobis/master
...
When we have a working index.php, do not require api.php
2016-02-28 09:14:45 +01:00
Federico Leva
480d421d7b
When we have a working index.php, do not require api.php
...
We work well without api.php. this was a needless suicide.
Especially as sometimes sysadmins like to disable the API for no
reason and then index.php is our only option to archive the wiki.
2016-02-27 21:10:02 +01:00
emijrp
7b9c51a368
print
2016-01-31 00:20:04 +01:00
emijrp
c1b6ba5071
removing dead site in testing
2016-01-29 17:20:18 +01:00
emijrp
15223eb75b
Parsing more image names from HTML Special:Allimages
2016-01-29 17:19:15 +01:00
emijrp
e138d6ce52
New API params to continue in Allimages
2016-01-29 16:55:44 +01:00
emijrp
d51d23e5c5
removing failing test
2016-01-29 16:39:06 +01:00
emijrp
2c0f54d73b
new HTML regexp for Special:Allpages
2016-01-29 16:38:31 +01:00
emijrp
4ef665b53c
In recent MediaWiki versions, API continue is a bit different
2016-01-29 16:14:34 +01:00
emijrp
e09e194825
removing skip, replacing before }}
2016-01-29 15:34:40 +01:00
emijrp
51c7563a83
pick biggest and more recent dump
2016-01-29 15:30:18 +01:00
emijrp
336d22fac0
only save when there are changes
2016-01-29 15:04:29 +01:00
emijrp
6dabef5980
wikiapiary bots
2016-01-29 15:00:33 +01:00
emijrp
5db991bfbb
now it updates the metadata
2016-01-29 13:02:18 +01:00
emijrp
1a5955e373
uploader and dumpgenerator in batchdownload, avoiding dupe files
2016-01-29 13:02:02 +01:00
emijrp
99a1b3e0e3
wrong path
2016-01-29 13:01:01 +01:00
emijrp
e67c68b64f
now it updates the metadata
2016-01-29 12:59:50 +01:00
emijrp
42bba237f2
restoring some liens
2016-01-29 12:45:57 +01:00
emijrp
4e8e9dad85
ignoring keys.txt
2016-01-29 12:44:04 +01:00
emijrp
8785d11b6a
adding main() and minor changes
2016-01-29 10:59:16 +01:00
emijrp
6651618def
2016, link to tutorial, print
2016-01-29 10:58:17 +01:00
Emilio J. Rodríguez-Posada
bbd999da33
Update README.md
2016-01-03 14:22:22 +01:00
Emilio J. Rodríguez-Posada
3d6ab1f5c2
November 002015
2015-11-01 09:51:23 +01:00
nemobis
679dee9901
Merge pull request #263 from DanielOaks/fix-oom-better
...
Avoid out-of-memory error in two extra places
2015-10-22 16:48:42 +02:00
Daniel Oaks
376e8a11a3
Avoid out-of-memory error in two extra places
2015-10-22 23:19:50 +10:00
Emilio J. Rodríguez-Posada
1fa4f15e45
Update README.md
2015-10-21 14:00:42 +02:00
emijrp
dde7eb90ba
wiki.wiki info
2015-10-07 16:12:21 +02:00
emijrp
8048b92029
adding wiki.wiki wikifarm list
2015-10-07 16:11:17 +02:00
emijrp
e30cd44384
new wikifarm list of wikis
2015-10-07 15:57:06 +02:00
emijrp
d44db951c2
update date
2015-10-07 13:21:31 +02:00
emijrp
64c30f2b50
updating neoseeker list and sorting, +1 new wiki
2015-10-07 13:15:37 +02:00
nemobis
b2d3239027
Merge pull request #254 from Southparkfan/master
...
Add Miraheze wiki farm
2015-09-29 20:37:12 +02:00
Southparkfan
ebffb99f48
Add Miraheze wiki farm
2015-09-29 19:43:37 +02:00
Hydriz Scholz
cf8a27b52f
Merge pull request #248 from TimSC/retry
...
Improve retry logic
2015-08-15 20:59:42 +08:00
Hydriz Scholz
1550d3755d
Update orain.org wiki list
2015-08-08 12:39:52 +08:00
Tim
9453f67e59
Fix tests
2015-08-08 01:13:57 +01:00
Tim
8d07d48e44
Merged
2015-08-07 23:28:29 +01:00
Tim Sheerman-Chase
877b736cd2
Merge branch 'retry' of https://github.com/TimSC/wikiteam into retry
2015-08-07 23:15:58 +01:00
Tim Sheerman-Chase
6716ceab32
Fix tests
2015-08-07 23:07:13 +01:00