2
0
mirror of https://github.com/urbanguacamole/torrent-paradise synced 2024-10-31 21:20:13 +00:00
Go to file
2019-02-22 15:25:35 +01:00
import-tpb-dump Initial commit 2019-01-13 15:10:54 +01:00
index-generator Further automate index updates 2019-02-22 15:25:35 +01:00
spider Clean up 2019-01-31 13:51:03 +01:00
tracker-scraper Initial commit 2019-01-13 15:10:54 +01:00
website Further automate index updates 2019-02-22 15:25:35 +01:00
.gitignore Clean up 2019-01-31 13:51:03 +01:00
README.md Clean up 2019-01-31 13:51:03 +01:00
update-index.sh Further automate index updates 2019-02-22 15:25:35 +01:00

About

What is this?

This is a repository of all the tools I use to build and run torrent-paradise.ml. Some people asked for a source, so I'm just putting this out here. I did make some effort to clean it up. The 'code name' of the project is nextgen (next gen torrent search), so don't be surprised if it comes up somewhere.

Can you help me?

Maybe, open an issue. Be sure to demonstrate an effort that you tried to solve the problem yourself.

This is a big mess. Fix it maybe?

WIP ❤️

Setup

Here's what the setup looks like rn:

  • VPS, Debian Stretch, 2 GB RAM
    • PostgreSQL 9.6. pg_hba.conf contains this:

      local   all             all                                      peer
      # IPv4 local connections:
      host    nextgen         nextgen          localhost               md5
      
    • IPFS v0.4.18

    • user with username nextgen on the server

  • my laptop w/ Linux
    • Go toolchain installed
    • node v10.9.0 & npm

Schema for the database is sth like this (taken from index-generator/README, runs on sqlite, probably also on pg.)

CREATE TABLE peercount ( infohash char(40), tracker varchar, seeders int, leechers int, completed int, scraped timestamp);

CREATE TABLE torrent( infohash char(40), name varchar, length bigint, added timestamp);

What I did first after getting the server up and running was importing the TPB dump. Download https://thepiratebay.org/static/dump/csv/torrent_dump_full.csv.gz to the import-tpb-dump directory and run go run.

I probably forgot sth. Open an issue!

Usage

Generate the index

This is a half-broken process that is partially described in update-index.sh. Read the script to understand what it does.

Spider the DHT

Run go build in spider/ to compile and scp the binary it to the server. You can use the systemd service file in spider/spider.service to start the spider on boot.

Contributing

Before working on something, open an issue to ask if it would be okay. I would love to KISS.