Kevin Lynx
|
45ee021ebb
|
optimize highlight for http
|
11 years ago |
|
Kevin Lynx
|
b1869dd122
|
add http search result highlight
|
11 years ago |
|
Kevin Lynx
|
7f7045883e
|
fix stats 1970 bug
|
11 years ago |
|
Kevin Lynx
|
ddaa44e6e8
|
add sphinx config doc
|
11 years ago |
|
Kevin Lynx
|
2da984b5f9
|
update readme
|
11 years ago |
|
Kevin Lynx
|
b0428a1e5e
|
fix sphinx builder query range bug; improve sphinx builder db query performance, to avoid `getmore' command and the 4M useless response
|
11 years ago |
|
Kevin Lynx
|
4b48c8aed2
|
log bug
|
11 years ago |
|
Kevin Lynx
|
395d73b000
|
build date index at startup
|
11 years ago |
|
Kevin Lynx
|
ac0116a5b3
|
daman! fix crawler initiali id generation bug (not set random seed)
|
11 years ago |
|
Kevin Lynx
|
04a20c177d
|
add some debug log to sphinx_builder, test sphinx_builder when there's no hashes there and got new hashes
|
11 years ago |
|
Kevin Lynx
|
5fa961bc9a
|
add log level config for sphinx_builder
|
11 years ago |
|
Kevin Lynx
|
cd1fab1ecb
|
change sphinx_builder, query from mongodb by `skip' really don't work well, build a date index to query by date range
|
11 years ago |
|
Kevin Lynx
|
55ac362bf1
|
update to the newest kdht, to fix some invalid message error bug
|
11 years ago |
|
Kevin Lynx
|
917c222b16
|
http ui stuff
|
11 years ago |
|
Kevin Lynx
|
a76f6e5d46
|
http ui adjust
|
11 years ago |
|
Kevin Lynx
|
e8e3142235
|
modify `giza' library so that i can get sphinx search stats, and because of this, i can add a more detailed page navigation
|
11 years ago |
|
Kevin Lynx
|
44464b40b3
|
add a new config `search_method', if set to `sphinx', hash reader will not create name_array, also add config for httpd, to config the search method
|
11 years ago |
|
Kevin Lynx
|
e816757fef
|
add a new config to head_reader `use_sphinx', when this flag is true, the reader will not create `name_array' for torrent document; now http use sphinx search
|
11 years ago |
|
Kevin Lynx
|
15f398023c
|
log disable
|
11 years ago |
|
Kevin Lynx
|
6b1c0a0a26
|
change sphinx torrent loading using an existing cursor
|
11 years ago |
|
Kevin Lynx
|
bc00e03b33
|
fix sphinx xml utf8 related issure, filter these unicode control characters, only backup delta file if the operation failed
|
11 years ago |
|
Kevin Lynx
|
5e9c36f787
|
add sphinx search stats
|
11 years ago |
|
Kevin Lynx
|
0bdac737ad
|
add a simple page navigation for sphinx_search
|
11 years ago |
|
Kevin Lynx
|
40f2bae9b8
|
fix sphinx_build memory leak bug, caused by mongo_cursor
|
11 years ago |
|
Kevin Lynx
|
149f10724e
|
sphinx worker call infinity
|
11 years ago |
|
Kevin Lynx
|
18edffc2a1
|
fix some sphinx related bugs, now it can be used to build sphinx index, still in experiment stage, add `giza' library to query sphinx in http_fontend
|
11 years ago |
|
Kevin Lynx
|
60472bd731
|
add LICENSE.txt, lincensed by MIT
|
11 years ago |
|
Kevin Lynx
|
0c67e46e5c
|
fix daterange issure which not only record today torrents, not it only show the today inserted torrents
|
11 years ago |
|
Kevin Lynx
|
28acbdaa45
|
adjust http stats display
|
11 years ago |
|
Kevin Lynx
|
94a2ac34bc
|
system stats adjust, add more stats to http front-end
|
11 years ago |
|
Kevin Lynx
|
6fbd0cb218
|
add a new force to string log func, add log to httpd, it can log unicode characters to logfiles
|
11 years ago |
|
Kevin Lynx
|
928798ed28
|
complete all http uri to json api
|
11 years ago |
|
Kevin Lynx
|
13d35a44c1
|
add query stats for new hash_writer
|
11 years ago |
|
Kevin Lynx
|
070e97e826
|
add hash filter stats to the new hash_reader
|
11 years ago |
|
Kevin Lynx
|
5d211c3f14
|
add `size' function to hash_download_cache, to debug
|
11 years ago |
|
Kevin Lynx
|
3864940905
|
fix hash_download startup bug
|
11 years ago |
|
Kevin Lynx
|
67ff84adaa
|
fix hash_download_cache startup bug
|
11 years ago |
|
Kevin Lynx
|
e5b35e58ed
|
NOTE: rewrite hash_reader, config changed, dht_hash database changed, require to remove existed dht_hash database
|
11 years ago |
|
Kevin Lynx
|
72c35be437
|
change default config
|
11 years ago |
|
Kevin Lynx
|
d00c84135b
|
fix cache_indexer message leak bug
|
11 years ago |
|
Kevin Lynx
|
d9deb8dfc9
|
add simple `get' json api, fix http search space decode
|
11 years ago |
|
Kevin Lynx
|
ba92e9cd77
|
fix hash_date
|
11 years ago |
|
Kevin Lynx
|
28fe69d141
|
hash_date only record today new inserted torrents
|
11 years ago |
|
Kevin Lynx
|
45ca7d584e
|
config max download task per hash-reader,
|
11 years ago |
|
Kevin Lynx
|
35a131fa8f
|
nothing
|
11 years ago |
|
Kevin Lynx
|
976740ea57
|
hash_writer write cache hashes 100 by 100, not all caches
|
11 years ago |
|
Kevin Lynx
|
928fc86934
|
recompile
|
11 years ago |
|
Kevin Lynx
|
f5655ba0f3
|
fix hash_reader stop working bug
|
11 years ago |
|
Kevin Lynx
|
810464330d
|
NOTE: big change! Need to delete config files. The crawler will cache hashes and merge duplicated queries.
|
11 years ago |
|
Kevin Lynx
|
629e92115d
|
fix cache_indexer download bug
|
11 years ago |