Mirror/dhtcrawler2
1
0
Fork 0
mirror of https://github.com/btdig/dhtcrawler2.git synced 2025-01-19 12:41:36 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
950a12169d
dhtcrawler2/tools
History
Kevin Lynx 950a12169d add repl-set scripts
2013-07-02 17:43:12 +08:00
..
db-replset add repl-set scripts 2013-07-02 17:43:12 +08:00
create_bin.bat add repl-set scripts 2013-07-02 17:43:12 +08:00
README.md first commit 2013-07-01 23:06:18 +08:00
win_start_crawler.bat first commit 2013-07-01 23:06:18 +08:00
win_start_hash.bat change http interfaces (modify the database query), add some config 2013-07-02 11:03:01 +08:00
win_start_http.bat change http to read data from mongodb slave db in repla set, can still 2013-07-02 13:56:44 +08:00

README.md

dhtcrawler2

This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly.

Usage

  • install Erlang R16B or newer

  • download mongodb and start mongodb first

      mongod --dbpath your-database-path --setParameter textSearchEnabled=true

  • start crawler, on Windows, just click win_start_crawler.bat

  • start hash_reader, on Windows, just click win_start_hash.bat

  • start httpd, on Windows, just click win_start_http.bat

  • wait several minutes and checkout localhost:8000