10 Commits

Author	SHA1	Message	Date
Urban Guacamole	bf19077ad9	Fix inability to crawl TPB; TLDR TPB has idiotic devs	2022-01-01 12:47:06 +01:00
Urban Guacamole	0bbf642143	Fix nonexistent error handling crawlrss	2021-12-03 13:13:37 +01:00
Urban Guacamole	fa8357a0bc	Update crawling intervals	2021-04-09 20:08:48 +02:00
Urban Guacamole	716b0b036b	Update EZTV RSS URL	2020-12-30 16:05:04 +01:00
Urban Guacamole	a6715616fb	Fix DoS if refreshing of matview takes too long ... Refreshing the view after many changes (such as the 8 million new torrents in 2.0) can take, if the disk is a bottleneck, take longer than 60 min.	2020-07-19 22:38:46 +02:00
Urban Guacamole	b8932f1dd0	Add TPB recent video to crawl-rss	2020-07-10 10:23:10 +02:00
Urban Guacamole	8fdc8d6508	Add crawl of TPB 48h top to crawl-rss ... I still miss most of the trending torrents because I source new torrents mainly from the DHT.	2020-07-05 12:31:28 +02:00
Urban Guacamole	6f9f970979	Add eztv.io to crawl-rss	2020-07-04 14:48:26 +02:00
Urban Guacamole	26a2d1a2ad	Add automatic DB index refresh to crawl-rss ... Since this is the only service that runs a simple timer, I decided to add it there.	2020-03-29 14:06:41 +02:00
Urban Guacamole	240d7d48fc	Add RSS crawl service ... To provide more fresh content, starting with YIFY/YTS.	2020-03-29 13:38:48 +02:00