13 Commits

Author	SHA1	Message	Date
Kevin Lynx	810464330d	NOTE: big change! Need to delete config files. The crawler will cache hashes and merge duplicated queries.	2013-07-17 22:55:35 +08:00
Kevin Lynx	1ed66b3863	fix memory leak for hash_reader (message queue keep increasing), set http search result to 50	2013-07-16 21:44:16 +08:00
Kevin Lynx	ff85af0806	try to fix high cpu usage when no hash and no wait_download	2013-07-15 23:01:26 +08:00
Kevin Lynx	31a1bd04c0	to avoid there's no hash and no wait_download, the hash reader may stop working	2013-07-15 22:04:41 +08:00
Kevin Lynx	d81d6a2fd2	integrate cache_index to hash_reader, default is disabled	2013-07-15 21:27:01 +08:00
Kevin Lynx	0f24428faa	add cache_indexer progress displaying	2013-07-15 13:39:41 +08:00
Kevin Lynx	0579304407	change hash_reader read hash/wait_download using findAndModify, to avoid the read/delete two operations	2013-07-14 15:33:46 +08:00
Kevin Lynx	269584c708	add rmmseg, to segment chinese texts, add a tool to convert the existing torrent file names	2013-07-13 11:45:55 +08:00
Kevin Lynx	676d354515	disable numid for sphinx default	2013-07-12 10:27:23 +08:00
Kevin Lynx	f5965304f7	add torrent download stats for hash reader	2013-07-11 22:38:39 +08:00
Kevin Lynx	5a0b21c7b0	chang http top query, add a new database to map date to hashes, to support query by date range	2013-07-11 20:35:16 +08:00
Kevin Lynx	42b32810c6	torbuilder(importer) fix badarith bug when there're invalid name torrent ... files	2013-07-11 09:06:58 +08:00
Kevin Lynx	164c0f0f21	change inc_announce response fileds to empty (only _id)	2013-07-09 21:43:26 +08:00