Kevin Lynx
|
44464b40b3
|
add a new config search_method', if set to sphinx', hash reader will not create name_array, also add config for httpd, to config the search method
|
2013-08-03 15:48:03 +08:00 |
|
Kevin Lynx
|
e816757fef
|
add a new config to head_reader use_sphinx', when this flag is true, the reader will not create name_array' for torrent document; now http use sphinx search
|
2013-08-03 14:57:46 +08:00 |
|
Kevin Lynx
|
e5b35e58ed
|
NOTE: rewrite hash_reader, config changed, dht_hash database changed, require to remove existed dht_hash database
|
2013-07-21 21:13:05 +08:00 |
|
Kevin Lynx
|
72c35be437
|
change default config
|
2013-07-21 09:24:33 +08:00 |
|
Kevin Lynx
|
45ca7d584e
|
config max download task per hash-reader,
|
2013-07-18 22:03:47 +08:00 |
|
Kevin Lynx
|
f5655ba0f3
|
fix hash_reader stop working bug
|
2013-07-18 12:38:31 +08:00 |
|
Kevin Lynx
|
810464330d
|
NOTE: big change! Need to delete config files. The crawler will cache hashes and merge duplicated queries.
|
2013-07-17 22:55:35 +08:00 |
|
Kevin Lynx
|
d81d6a2fd2
|
integrate cache_index to hash_reader, default is disabled
|
2013-07-15 21:27:01 +08:00 |
|
Kevin Lynx
|
0f24428faa
|
add cache_indexer progress displaying
|
2013-07-15 13:39:41 +08:00 |
|
Kevin Lynx
|
a1fc6ec3c0
|
add text segment config for hash_reader (text_seg), the default is simple
|
2013-07-13 22:27:17 +08:00 |
|
Kevin Lynx
|
269584c708
|
add rmmseg, to segment chinese texts, add a tool to convert the existing torrent file names
|
2013-07-13 11:45:55 +08:00 |
|
Kevin Lynx
|
676d354515
|
disable numid for sphinx default
|
2013-07-12 10:27:23 +08:00 |
|
Kevin Lynx
|
5a0b21c7b0
|
chang http top query, add a new database to map date to hashes, to support query by date range
|
2013-07-11 20:35:16 +08:00 |
|
Kevin Lynx
|
42b32810c6
|
torbuilder(importer) fix badarith bug when there're invalid name torrent
files
|
2013-07-11 09:06:58 +08:00 |
|
Kevin Lynx
|
164c0f0f21
|
change inc_announce response fileds to empty (only _id)
|
2013-07-09 21:43:26 +08:00 |
|