18 Commits (master)

Author SHA1 Message Date
Kevin Lynx 6fbd0cb218 add a new force to string log func, add log to httpd, it can log unicode characters to logfiles 11 years ago
Kevin Lynx e5b35e58ed NOTE: rewrite hash_reader, config changed, dht_hash database changed, require to remove existed dht_hash database 11 years ago
Kevin Lynx 45ca7d584e config max download task per hash-reader, 11 years ago
Kevin Lynx 928fc86934 recompile 11 years ago
Kevin Lynx f5655ba0f3 fix hash_reader stop working bug 11 years ago
Kevin Lynx 810464330d NOTE: big change! Need to delete config files. The crawler will cache hashes and merge duplicated queries. 11 years ago
Kevin Lynx 1ed66b3863 fix memory leak for hash_reader (message queue keep increasing), set http search result to 50 11 years ago
Kevin Lynx ff85af0806 try to fix high cpu usage when no hash and no wait_download 11 years ago
Kevin Lynx 31a1bd04c0 to avoid there's no hash and no wait_download, the hash reader may stop working 11 years ago
Kevin Lynx d81d6a2fd2 integrate cache_index to hash_reader, default is disabled 11 years ago
Kevin Lynx 0f24428faa add cache_indexer progress displaying 11 years ago
Kevin Lynx 0579304407 change hash_reader read hash/wait_download using findAndModify, to avoid the read/delete two operations 11 years ago
Kevin Lynx 269584c708 add rmmseg, to segment chinese texts, add a tool to convert the existing torrent file names 11 years ago
Kevin Lynx 676d354515 disable numid for sphinx default 11 years ago
Kevin Lynx f5965304f7 add torrent download stats for hash reader 11 years ago
Kevin Lynx 5a0b21c7b0 chang http top query, add a new database to map date to hashes, to support query by date range 11 years ago
Kevin Lynx 42b32810c6 torbuilder(importer) fix badarith bug when there're invalid name torrent
files
11 years ago
Kevin Lynx 164c0f0f21 change inc_announce response fileds to empty (only _id) 11 years ago