dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword
Go to file
2013-08-03 21:39:14 +08:00
include add a new force to string log func, add log to httpd, it can log unicode characters to logfiles 2013-07-22 22:59:10 +08:00
priv add rmmseg, with a pre-compiled win32 version 2013-07-13 21:53:03 +08:00
src adjust crawler log directory 2013-08-03 21:39:14 +08:00
tools http ui adjust 2013-08-03 17:10:42 +08:00
www modify `giza' library so that i can get sphinx search stats, and because of this, i can add a more detailed page navigation 2013-08-03 16:58:04 +08:00
.gitignore first commit 2013-07-01 23:06:18 +08:00
Emakefile add sphinx support, in expirment status right now 2013-07-29 23:03:39 +08:00
LICENSE.txt add LICENSE.txt, lincensed by MIT 2013-07-24 20:13:12 +08:00
README.md add LICENSE.txt, lincensed by MIT 2013-07-24 20:13:12 +08:00
rebar disable numid default, update rebar to support user macro 2013-07-12 10:30:39 +08:00
rebar.cmd disable numid default, update rebar to support user macro 2013-07-12 10:30:39 +08:00
rebar.config fix some sphinx related bugs, now it can be used to build sphinx index, still in experiment stage, add `giza' library to query sphinx in http_fontend 2013-07-30 22:14:28 +08:00

dhtcrawler

dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword.

screenshot

Compile

  • get all deps

      rebar get-deps
    
  • compile

      rebar compile
    

LICENSE

See LICENSE.txt