Mirror/dhtcrawler2
1
0
Fork 0
mirror of https://github.com/btdig/dhtcrawler2.git synced 2025-01-18 12:11:39 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword
4 Commits 2 Branches 0 Tags 3.4 MiB
Batchfile 47.8%
Erlang 26.2%
HTML 23.3%
JavaScript 2.7%
c482202fb0
Go to file
Kevin Lynx c482202fb0 change hash reader wait time to 1 min
2013-07-02 12:27:19 +08:00
deps add kdht ebin 2013-07-02 11:14:42 +08:00
ebin change hash reader wait time to 1 min 2013-07-02 12:27:19 +08:00
www change http interface 2013-07-02 11:05:07 +08:00
create_bin.bat first commit 2013-07-01 22:42:14 +08:00
README.md first commit 2013-07-01 22:42:14 +08:00
win_start_crawler.bat first commit 2013-07-01 22:42:14 +08:00
win_start_hash.bat change http interface 2013-07-02 11:05:07 +08:00
win_start_http.bat first commit 2013-07-01 22:42:14 +08:00

README.md

dhtcrawler2

This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly.

Usage

  • install Erlang R16B or newer

  • download mongodb and start mongodb first

      mongod --dbpath your-database-path --setParameter textSearchEnabled=true

  • start crawler, on Windows, just click win_start_crawler.bat

  • start hash_reader, on Windows, just click win_start_hash.bat

  • start httpd, on Windows, just click win_start_http.bat

  • wait several minutes and checkout localhost:8000