Commit Graph

108 Commits (362309a2daf80edfc652bf344d9426a8f25f4d1b)

Author SHA1 Message Date
Federico Leva 8cf4d4e6ea Add 30k domains from another crawler
11011 were found alive by checkalive.py (though there could be more
if one checks more subdomains and subdirectories), some thousands
more by checklive.pl (but mostly or all false positives).

Of the alive ones, about 6245 were new to WikiApiary!
https://wikiapiary.com/wiki/Category:Oct_2014_Import
10 years ago
Federico Leva 7e0071ae7f Add some UseModWiki-looking domains 10 years ago
nemobis 6b11cef9dc A few thousands more doku.php URLs from own scraping 10 years ago
Southparkfan 8ca9eb8757 Update date of Orain wikilist 10 years ago
Southparkfan 2e2fe9b818 Update list of Orain wikis 10 years ago
nemobis 23a60fa850 MediaWiki CamelCase 10 years ago
nemobis 31112b3a80 checkalive.py: more checks before accessing stuff 10 years ago
nemobis 225c3eb478 A thousand more doku.php URLs from search 10 years ago
nemobis 3fc7dcb5de Add some more doku.php URLs 10 years ago
PiRSquared17 56c2177106 Add (incomplete) list of dokuwikis 10 years ago
PiRSquared17 03ddde3702 Move wiki lists to mediawiki subdirectory 10 years ago
etesp 1309e89d45 Added information 10 years ago
etesp dab53ea491 Added WikiApiary tropicalwiki api urls 10 years ago
Federico Leva c1e6c0ead3 Merge remote-tracking branch 'upstream/master' 10 years ago
Federico Leva 86c65fc9be Issue 161: add shodan export 10 years ago
Emilio J. Rodríguez-Posada 91cb7bef0c adding info file for wiki-site list 10 years ago
Emilio J. Rodríguez-Posada 603f1aefad adding spider for wiki-site 10 years ago
Emilio J. Rodríguez-Posada 767123e89d updating wiki-site.com list 10 years ago
Emilio J. Rodríguez-Posada 636c6a91df adding spider for neoseeker, updating list, adding info file 10 years ago
Emilio J. Rodríguez-Posada 514d5fea0e removing unused modules 10 years ago
Emilio J. Rodríguez-Posada a3e69666fe adding spider for orain wikifarm, updating list too 10 years ago
Emilio J. Rodríguez-Posada 374cf83c54 adding info file for orain.org wikifarm list 10 years ago
Emilio J. Rodríguez-Posada 7d00cfa0de adding list info file for tropicalwikis 10 years ago
Emilio J. Rodríguez-Posada ecd539f1ae adding scribblewiki list info file 10 years ago
Emilio J. Rodríguez-Posada e95d8ba6e1 sort list 10 years ago
Emilio J. Rodríguez-Posada c420d4d843 adding spider for wikkii, updating the list (10 diff wikis, 2 new, 8 dead), adding info for list 10 years ago
Emilio J. Rodríguez-Posada c7fc194f0d add info file for wikkii.com list 10 years ago
Emilio J. Rodríguez-Posada 29a64507c2 last update date 10 years ago
Emilio J. Rodríguez-Posada d90127e9cc adding details to shoutwiki info 10 years ago
Emilio J. Rodríguez-Posada 90c442a5b7 updating shoutwiki list and uploading basic spider 10 years ago
Emilio J. Rodríguez-Posada 75e2234c2c adding details to referata list 10 years ago
Emilio J. Rodríguez-Posada db9bcb68ca adding license to referata-spider.py 10 years ago
Emilio J. Rodríguez-Posada eaec1afa83 adding info about shoutwiki list 10 years ago
Emilio J. Rodríguez-Posada 1befbabb02 updating info for referata list 10 years ago
Emilio J. Rodríguez-Posada 7a6ef18339 add more wikis to referata list; uploading basic referata-spider.py 10 years ago
Emilio J. Rodríguez-Posada d97c46afd1 Merge branch 'master' of https://github.com/WikiTeam/wikiteam 10 years ago
Emilio J. Rodríguez-Posada a988968e7e adding info for referata list 10 years ago
Emilio J. Rodríguez-Posada a1a76ac198 issue #111 10 years ago
Emilio J. Rodríguez-Posada 6442b8734d renaming 10 years ago
scottdb56 9b8673768f mediawikis_2013_byothers.txt have been filtered
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@974 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
scottdb56 ac60918e7b Uploaded BHW-alive_wikis.txt
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@972 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 0b2875756f Updated alive list from other 2013 sources
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@971 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
scottdb56 1b0949ce7b other.list has been filtered and added as other-alive_wikis.list
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@970 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
scottdb56 ab1e13207f Filtered out duplicates from mediawikis_2013-alive.txt
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@968 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
scottdb56 17bc29b66f mediawikis_2013.txt filtered by checkalive.pl
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@967 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
scottdb56 b9be07936a A major update - checkalive.pl now checks for api.php and writes it to the list if found.
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@965 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis ac4c93c12a Issue 85: more cross-platform shebang on all scripts
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@962 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 7eba594a2c Use api.php URLs where we found them to be working, step 2
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@959 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 92f77ab085 Use api.php URLs where we found them to be working
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@958 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago
nemobis 395408e5a6 Also neoseeker and sourceforge
git-svn-id: https://wikiteam.googlecode.com/svn/trunk@956 31edc4fc-5e31-b4c4-d58b-c8bc928bcb95
10 years ago