Kevin Lynx
|
ff338f2c9b
|
fix cache_indexer state not saved correctly
|
11 years ago |
|
Kevin Lynx
|
c85e216951
|
fix cache_indexer
|
11 years ago |
|
Kevin Lynx
|
1ed66b3863
|
fix memory leak for hash_reader (message queue keep increasing), set http search result to 50
|
11 years ago |
|
Kevin Lynx
|
ff85af0806
|
try to fix high cpu usage when no hash and no wait_download
|
11 years ago |
|
Kevin Lynx
|
c5db7ae966
|
restore `top' cache
|
11 years ago |
|
Kevin Lynx
|
31a1bd04c0
|
to avoid there's no hash and no wait_download, the hash reader may stop working
|
11 years ago |
|
Kevin Lynx
|
d81d6a2fd2
|
integrate cache_index to hash_reader, default is disabled
|
11 years ago |
|
Kevin Lynx
|
0f24428faa
|
add cache_indexer progress displaying
|
11 years ago |
|
Kevin Lynx
|
5153568dc9
|
add cache_indexer, not integrated now, see src/cache_indexer/readme.md
|
11 years ago |
|
Kevin Lynx
|
0579304407
|
change hash_reader read hash/wait_download using findAndModify, to avoid the read/delete two operations
|
11 years ago |
|
Kevin Lynx
|
552dcb9983
|
fix name_segger
|
11 years ago |
|
Kevin Lynx
|
8d71c043bb
|
fix name_seger tool
|
11 years ago |
|
Kevin Lynx
|
40bdebc5b4
|
change name_seger tool to multi-processes
|
11 years ago |
|
Kevin Lynx
|
86665cb93b
|
only build torrent name indexes
|
11 years ago |
|
Kevin Lynx
|
a1fc6ec3c0
|
add text segment config for hash_reader (text_seg), the default is simple
|
11 years ago |
|
Kevin Lynx
|
59b54380c8
|
minor fix on name_seger
|
11 years ago |
|
Kevin Lynx
|
81e184c396
|
remove debug info
|
11 years ago |
|
Kevin Lynx
|
269584c708
|
add rmmseg, to segment chinese texts, add a tool to convert the existing torrent file names
|
11 years ago |
|
Kevin Lynx
|
676d354515
|
disable numid for sphinx default
|
11 years ago |
|
Kevin Lynx
|
6ddb9447ac
|
Merge branch 'master' of github.com:kevinlynx/dhtcrawler2
Conflicts:
ebin/dhtcrawler.app
ebin/tor_download.beam
|
11 years ago |
|
Kevin Lynx
|
f5965304f7
|
add torrent download stats for hash reader
|
11 years ago |
|
Kevin Lynx
|
1320002674
|
integrate torrent downloader monitor, change http today_top to show the today request count, instead total request count, remove ibrowse initial config
|
11 years ago |
|
Kevin Lynx
|
5a0b21c7b0
|
chang http top query, add a new database to map date to hashes, to support query by date range
|
11 years ago |
|
Kevin Lynx
|
cda02229ad
|
add tor_download req monitor, not integrated yet
|
11 years ago |
|
Kevin Lynx
|
42b32810c6
|
torbuilder(importer) fix badarith bug when there're invalid name torrent
files
|
11 years ago |
|
Kevin Lynx
|
4adc0a7df4
|
change http start to pass dbpool size
|
11 years ago |
|
Kevin Lynx
|
9982141e7b
|
change hash_reader shell startup script
|
11 years ago |
|
Kevin Lynx
|
164c0f0f21
|
change inc_announce response fileds to empty (only _id)
|
11 years ago |
|
Kevin Lynx
|
aa7e8bb18a
|
use safe insert in torrent importer
|
11 years ago |
|
Kevin Lynx
|
40dbbeb581
|
fix hash_reader stop working bug when there's only wait_download hash
|
11 years ago |
|
Kevin Lynx
|
03f98c35be
|
update torrent importer, save process state so that can launch next time
|
11 years ago |
|
Kevin Lynx
|
0c6097f130
|
separate embedded css style to page.temp
|
11 years ago |
|
Kevin Lynx
|
00cfa07d88
|
add a tool to add local torrents to database
|
11 years ago |
|
Kevin Lynx
|
b42a85e929
|
fix hash_reader stop bug (send a wrong message)
|
11 years ago |
|
Kevin Lynx
|
d17d78ec08
|
add config to control whether load torrents from database cache
|
11 years ago |
|
Kevin Lynx
|
cedd378fa6
|
IMPORTANT: add number id to torrent database
|
11 years ago |
|
Kevin Lynx
|
01f7fd1aaf
|
stats nice print
|
11 years ago |
|
Kevin Lynx
|
48022521c9
|
change torrent path config name
|
11 years ago |
|
Kevin Lynx
|
ad8c931c80
|
stats on torrent cache used
|
11 years ago |
|
Kevin Lynx
|
dc8cab211f
|
fix torrent download memory leak bug
|
11 years ago |
|
Kevin Lynx
|
7c777f64b6
|
add torrent downloader
|
11 years ago |
|
Kevin Lynx
|
b598fb02ea
|
add torrent cache, not tested now
|
11 years ago |
|
Kevin Lynx
|
7b811ddd32
|
add http short keyword checking
|
11 years ago |
|
Kevin Lynx
|
0fcf9f8dda
|
make the cache updating process only one, and make stats to cache
|
11 years ago |
|
Kevin Lynx
|
10c11df943
|
fix http cache bug
|
11 years ago |
|
Kevin Lynx
|
d82839ad27
|
async update cache
|
11 years ago |
|
Kevin Lynx
|
4ca1885320
|
update http cache in a process
|
11 years ago |
|
Kevin Lynx
|
c1f99eccd5
|
add http search cache
|
11 years ago |
|
Kevin Lynx
|
494c658aec
|
readme
|
11 years ago |
|
Kevin Lynx
|
603336cfd7
|
update readme
|
11 years ago |