2
0
mirror of https://github.com/WikiTeam/wikiteam synced 2024-11-15 00:15:00 +00:00
Commit Graph

93 Commits

Author SHA1 Message Date
Emilio J. Rodríguez-Posada
91cb7bef0c adding info file for wiki-site list 2014-07-04 22:09:14 +02:00
Emilio J. Rodríguez-Posada
603f1aefad adding spider for wiki-site 2014-07-04 22:06:50 +02:00
Emilio J. Rodríguez-Posada
767123e89d updating wiki-site.com list 2014-07-04 22:06:38 +02:00
Emilio J. Rodríguez-Posada
636c6a91df adding spider for neoseeker, updating list, adding info file 2014-07-02 16:19:49 +02:00
Emilio J. Rodríguez-Posada
514d5fea0e removing unused modules 2014-07-02 15:57:15 +02:00
Emilio J. Rodríguez-Posada
a3e69666fe adding spider for orain wikifarm, updating list too 2014-07-02 15:55:13 +02:00
Emilio J. Rodríguez-Posada
374cf83c54 adding info file for orain.org wikifarm list 2014-07-02 15:45:12 +02:00
Emilio J. Rodríguez-Posada
7d00cfa0de adding list info file for tropicalwikis 2014-06-27 17:07:37 +02:00
Emilio J. Rodríguez-Posada
ecd539f1ae adding scribblewiki list info file 2014-06-27 17:06:17 +02:00
Emilio J. Rodríguez-Posada
e95d8ba6e1 sort list 2014-06-27 17:04:59 +02:00
Emilio J. Rodríguez-Posada
c420d4d843 adding spider for wikkii, updating the list (10 diff wikis, 2 new, 8 dead), adding info for list 2014-06-27 16:59:12 +02:00
Emilio J. Rodríguez-Posada
c7fc194f0d add info file for wikkii.com list 2014-06-27 16:48:02 +02:00
Emilio J. Rodríguez-Posada
29a64507c2 last update date 2014-06-27 16:42:50 +02:00
Emilio J. Rodríguez-Posada
d90127e9cc adding details to shoutwiki info 2014-06-27 16:16:14 +02:00
Emilio J. Rodríguez-Posada
90c442a5b7 updating shoutwiki list and uploading basic spider 2014-06-27 16:15:29 +02:00
Emilio J. Rodríguez-Posada
75e2234c2c adding details to referata list 2014-06-27 16:15:00 +02:00
Emilio J. Rodríguez-Posada
db9bcb68ca adding license to referata-spider.py 2014-06-27 16:14:44 +02:00
Emilio J. Rodríguez-Posada
eaec1afa83 adding info about shoutwiki list 2014-06-27 15:32:57 +02:00
Emilio J. Rodríguez-Posada
1befbabb02 updating info for referata list 2014-06-27 15:23:48 +02:00
Emilio J. Rodríguez-Posada
7a6ef18339 add more wikis to referata list; uploading basic referata-spider.py 2014-06-27 14:51:05 +02:00
Emilio J. Rodríguez-Posada
d97c46afd1 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 2014-06-27 13:39:39 +02:00
Emilio J. Rodríguez-Posada
a988968e7e adding info for referata list 2014-06-27 13:39:23 +02:00
Emilio J. Rodríguez-Posada
a1a76ac198 issue #111 2014-06-27 12:58:03 +02:00
Emilio J. Rodríguez-Posada
6442b8734d renaming 2014-06-25 16:05:11 +02:00
scottdb56
9b8673768f mediawikis_2013_byothers.txt have been filtered
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@974 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-04-24 03:03:16 +00:00
scottdb56
ac60918e7b Uploaded BHW-alive_wikis.txt
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@972 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-04-04 04:07:42 +00:00
nemobis
0b2875756f Updated alive list from other 2013 sources
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@971 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-03-23 21:44:17 +00:00
scottdb56
1b0949ce7b other.list has been filtered and added as other-alive_wikis.list
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@970 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-03-06 05:37:37 +00:00
scottdb56
ab1e13207f Filtered out duplicates from mediawikis_2013-alive.txt
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@968 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-03-05 05:57:32 +00:00
scottdb56
17bc29b66f mediawikis_2013.txt filtered by checkalive.pl
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@967 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-03-03 05:05:45 +00:00
scottdb56
b9be07936a A major update - checkalive.pl now checks for api.php and writes it to the list if found.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@965 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-27 05:50:28 +00:00
nemobis
ac4c93c12a Issue 85: more cross-platform shebang on all scripts
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@962 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-26 23:22:53 +00:00
nemobis
7eba594a2c Use api.php URLs where we found them to be working, step 2
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@959 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-16 18:50:47 +00:00
nemobis
92f77ab085 Use api.php URLs where we found them to be working
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@958 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-16 17:14:41 +00:00
nemobis
395408e5a6 Also neoseeker and sourceforge
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@956 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-15 08:42:51 +00:00
nemobis
3fde888394 Remove dome wikifarms wikis and a couple duplicates
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@955 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-15 08:08:55 +00:00
nemobis
04e55c6622 Remove a hundred index.php redundant with api.php URLs
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@954 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-15 07:54:05 +00:00
nemobis
18a7f42086 Update with last raw list and checkalive.py
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@953 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-15 07:51:49 +00:00
nemobis
cbd0905cba Add 2k more URLs from another crawl
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@950 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-14 19:04:40 +00:00
nemobis
eb60580e91 New URLs from Incola
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@946 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-11 12:29:00 +00:00
nemobis
a1c89623a4 Another intermediate update with results from one more run
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@943 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-02-03 08:52:59 +00:00
nemobis
2bb3fd7a50 Add neoseeker.com, from mutante's wikistats farm list
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@937 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-31 12:18:41 +00:00
nemobis
43074360b7 Experience shows 30 seconds is a more realistic timeout
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@932 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-29 10:47:15 +00:00
nemobis
8cf60a3285 Re-updated pavlo list with 30 s timeout
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@930 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-28 06:53:54 +00:00
nemobis
e2956e60a0 Replace some index.php with api.php where available
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@929 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-27 22:38:18 +00:00
scottdb56
57da61aac6 a minor syntax-error fix in checkalive.pl
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@928 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-27 22:10:27 +00:00
nemobis
8da3f15b35 Some manual filtering
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@927 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-27 20:53:11 +00:00
nemobis
84a2f9d6dc Add index.php discovery and other fixes, update checked lists consequently; bad input makes it spit ugly errors but it keeps going
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@926 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-27 20:47:14 +00:00
nemobis
eba5f2d54e More gamepedia from their homepage
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@925 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-27 14:14:36 +00:00
scottdb56
51ee9e9847 added a user-agent and another search string
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@924 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
2014-01-27 13:41:29 +00:00