91 Commits (e8e3142235d50acb2a2ee27eb628c93c9010be58)
 

Author SHA1 Message Date
Kevin Lynx e8e3142235 modify `giza' library so that i can get sphinx search stats, and because of this, i can add a more detailed page navigation 11 years ago
Kevin Lynx 44464b40b3 add a new config `search_method', if set to `sphinx', hash reader will not create name_array, also add config for httpd, to config the search method 11 years ago
Kevin Lynx e816757fef add a new config to head_reader `use_sphinx', when this flag is true, the reader will not create `name_array' for torrent document; now http use sphinx search 11 years ago
Kevin Lynx 15f398023c log disable 11 years ago
Kevin Lynx 6b1c0a0a26 change sphinx torrent loading using an existing cursor 11 years ago
Kevin Lynx bc00e03b33 fix sphinx xml utf8 related issure, filter these unicode control characters, only backup delta file if the operation failed 11 years ago
Kevin Lynx 5e9c36f787 add sphinx search stats 11 years ago
Kevin Lynx 0bdac737ad add a simple page navigation for sphinx_search 11 years ago
Kevin Lynx 40f2bae9b8 fix sphinx_build memory leak bug, caused by mongo_cursor 11 years ago
Kevin Lynx 149f10724e sphinx worker call infinity 11 years ago
Kevin Lynx 18edffc2a1 fix some sphinx related bugs, now it can be used to build sphinx index, still in experiment stage, add `giza' library to query sphinx in http_fontend 11 years ago
Kevin Lynx 60472bd731 add LICENSE.txt, lincensed by MIT 11 years ago
Kevin Lynx 0c67e46e5c fix daterange issure which not only record today torrents, not it only show the today inserted torrents 11 years ago
Kevin Lynx 28acbdaa45 adjust http stats display 11 years ago
Kevin Lynx 94a2ac34bc system stats adjust, add more stats to http front-end 11 years ago
Kevin Lynx 6fbd0cb218 add a new force to string log func, add log to httpd, it can log unicode characters to logfiles 11 years ago
Kevin Lynx 928798ed28 complete all http uri to json api 11 years ago
Kevin Lynx 13d35a44c1 add query stats for new hash_writer 11 years ago
Kevin Lynx 070e97e826 add hash filter stats to the new hash_reader 11 years ago
Kevin Lynx 5d211c3f14 add `size' function to hash_download_cache, to debug 11 years ago
Kevin Lynx 3864940905 fix hash_download startup bug 11 years ago
Kevin Lynx 67ff84adaa fix hash_download_cache startup bug 11 years ago
Kevin Lynx e5b35e58ed NOTE: rewrite hash_reader, config changed, dht_hash database changed, require to remove existed dht_hash database 11 years ago
Kevin Lynx 72c35be437 change default config 11 years ago
Kevin Lynx d00c84135b fix cache_indexer message leak bug 11 years ago
Kevin Lynx d9deb8dfc9 add simple `get' json api, fix http search space decode 11 years ago
Kevin Lynx ba92e9cd77 fix hash_date 11 years ago
Kevin Lynx 28fe69d141 hash_date only record today new inserted torrents 11 years ago
Kevin Lynx 45ca7d584e config max download task per hash-reader, 11 years ago
Kevin Lynx 35a131fa8f nothing 11 years ago
Kevin Lynx 976740ea57 hash_writer write cache hashes 100 by 100, not all caches 11 years ago
Kevin Lynx 928fc86934 recompile 11 years ago
Kevin Lynx f5655ba0f3 fix hash_reader stop working bug 11 years ago
Kevin Lynx 810464330d NOTE: big change! Need to delete config files. The crawler will cache hashes and merge duplicated queries. 11 years ago
Kevin Lynx 629e92115d fix cache_indexer download bug 11 years ago
Kevin Lynx ff338f2c9b fix cache_indexer state not saved correctly 11 years ago
Kevin Lynx c85e216951 fix cache_indexer 11 years ago
Kevin Lynx 1ed66b3863 fix memory leak for hash_reader (message queue keep increasing), set http search result to 50 11 years ago
Kevin Lynx ff85af0806 try to fix high cpu usage when no hash and no wait_download 11 years ago
Kevin Lynx c5db7ae966 restore `top' cache 11 years ago
Kevin Lynx 31a1bd04c0 to avoid there's no hash and no wait_download, the hash reader may stop working 11 years ago
Kevin Lynx d81d6a2fd2 integrate cache_index to hash_reader, default is disabled 11 years ago
Kevin Lynx 0f24428faa add cache_indexer progress displaying 11 years ago
Kevin Lynx 5153568dc9 add cache_indexer, not integrated now, see src/cache_indexer/readme.md 11 years ago
Kevin Lynx 0579304407 change hash_reader read hash/wait_download using findAndModify, to avoid the read/delete two operations 11 years ago
Kevin Lynx 552dcb9983 fix name_segger 11 years ago
Kevin Lynx 8d71c043bb fix name_seger tool 11 years ago
Kevin Lynx 40bdebc5b4 change name_seger tool to multi-processes 11 years ago
Kevin Lynx 86665cb93b only build torrent name indexes 11 years ago
Kevin Lynx a1fc6ec3c0 add text segment config for hash_reader (text_seg), the default is simple 11 years ago