mirror of
https://github.com/btdig/dhtcrawler2.git
synced 2024-12-13 20:16:21 +00:00
update readme
This commit is contained in:
parent
ea6df3b2df
commit
603336cfd7
24
README.md
24
README.md
@ -1,6 +1,14 @@
|
|||||||
## dhtcrawler2
|
## dhtcrawler2
|
||||||
|
|
||||||
This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly.
|
dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword.
|
||||||
|
|
||||||
|
![screenshot](https://raw.github.com/kevinlynx/dhtcrawler/master/screenshot.png)
|
||||||
|
|
||||||
|
dhtcrawler2 is an extended version to [dhtcrawler](https://github.com/kevinlynx/dhtcrawler). It has improved a lot on crawling speed, and much more stable.
|
||||||
|
|
||||||
|
This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly. So you don't need to compile it yourself, just download it and run it to collect torrents and search a torrent by a keyword.
|
||||||
|
|
||||||
|
Enjoy it!
|
||||||
|
|
||||||
## Usage
|
## Usage
|
||||||
|
|
||||||
@ -14,5 +22,19 @@ This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly
|
|||||||
* start **httpd**, on Windows, just click `win_start_http.bat`
|
* start **httpd**, on Windows, just click `win_start_http.bat`
|
||||||
* wait several minutes and checkout `localhost:8000`
|
* wait several minutes and checkout `localhost:8000`
|
||||||
|
|
||||||
|
You can also compile the source code and run it manually. The source code is in `src` branch of this repo.
|
||||||
|
|
||||||
|
Also you can check more technique information at my blog site (Chinese) [codemacro.com](http://codemacro.com)
|
||||||
|
|
||||||
|
## Config
|
||||||
|
|
||||||
|
Most config value is in `priv/dhtcrawler.config`, when you first run dhtcrawler, this file will be generated automatically. And the other config values are passed by arguments to erlang functions. In most case you don't need to change these config values, except these network addresses.
|
||||||
|
|
||||||
|
## Mongodb Repla set
|
||||||
|
|
||||||
|
It's not related about dhtcrawler, but only Mongodb, try figure it yourself.
|
||||||
|
|
||||||
|
## Another http front-end
|
||||||
|
|
||||||
|
Yes of course you can write another http front-end UI based on the torrent database, if you're interested in it I can help you about the database format.
|
||||||
|
|
||||||
|
BIN
deps/bson/ebin/bson.beam
vendored
BIN
deps/bson/ebin/bson.beam
vendored
Binary file not shown.
BIN
deps/bson/ebin/bson_binary.beam
vendored
BIN
deps/bson/ebin/bson_binary.beam
vendored
Binary file not shown.
BIN
deps/bson/ebin/bson_tests.beam
vendored
BIN
deps/bson/ebin/bson_tests.beam
vendored
Binary file not shown.
BIN
deps/ibrowse/ebin/ibrowse.beam
vendored
BIN
deps/ibrowse/ebin/ibrowse.beam
vendored
Binary file not shown.
BIN
deps/ibrowse/ebin/ibrowse_app.beam
vendored
BIN
deps/ibrowse/ebin/ibrowse_app.beam
vendored
Binary file not shown.
BIN
deps/ibrowse/ebin/ibrowse_http_client.beam
vendored
BIN
deps/ibrowse/ebin/ibrowse_http_client.beam
vendored
Binary file not shown.
BIN
deps/ibrowse/ebin/ibrowse_lb.beam
vendored
BIN
deps/ibrowse/ebin/ibrowse_lb.beam
vendored
Binary file not shown.
BIN
deps/ibrowse/ebin/ibrowse_lib.beam
vendored
BIN
deps/ibrowse/ebin/ibrowse_lib.beam
vendored
Binary file not shown.
BIN
deps/ibrowse/ebin/ibrowse_sup.beam
vendored
BIN
deps/ibrowse/ebin/ibrowse_sup.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/bencode.beam
vendored
BIN
deps/kdht/ebin/bencode.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/bucket.beam
vendored
BIN
deps/kdht/ebin/bucket.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/dht_id.beam
vendored
BIN
deps/kdht/ebin/dht_id.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/dht_net.beam
vendored
BIN
deps/kdht/ebin/dht_net.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/dht_state.beam
vendored
BIN
deps/kdht/ebin/dht_state.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/kdht_sup.beam
vendored
BIN
deps/kdht/ebin/kdht_sup.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/msg.beam
vendored
BIN
deps/kdht/ebin/msg.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/search.beam
vendored
BIN
deps/kdht/ebin/search.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/storage.beam
vendored
BIN
deps/kdht/ebin/storage.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/timer_monitor.beam
vendored
BIN
deps/kdht/ebin/timer_monitor.beam
vendored
Binary file not shown.
BIN
deps/kdht/ebin/vlog.beam
vendored
BIN
deps/kdht/ebin/vlog.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo.beam
vendored
BIN
deps/mongodb/ebin/mongo.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_app.beam
vendored
BIN
deps/mongodb/ebin/mongo_app.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_connection.beam
vendored
BIN
deps/mongodb/ebin/mongo_connection.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_cursor.beam
vendored
BIN
deps/mongodb/ebin/mongo_cursor.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_id_server.beam
vendored
BIN
deps/mongodb/ebin/mongo_id_server.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_pool.beam
vendored
BIN
deps/mongodb/ebin/mongo_pool.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_protocol.beam
vendored
BIN
deps/mongodb/ebin/mongo_protocol.beam
vendored
Binary file not shown.
BIN
deps/mongodb/ebin/mongo_sup.beam
vendored
BIN
deps/mongodb/ebin/mongo_sup.beam
vendored
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
@ -1,6 +1,6 @@
|
|||||||
{application,dhtcrawler,
|
{application,dhtcrawler,
|
||||||
[{description,"A DHT crawler to index magnet hash to torrent"},
|
[{description,"A DHT crawler to index magnet hash to torrent"},
|
||||||
{vsn,"3505116"},
|
{vsn,"c82f006"},
|
||||||
{registered,[dht_crawler_sup]},
|
{registered,[dht_crawler_sup]},
|
||||||
{applications,[kernel,stdlib,crypto,public_key,ssl,inets,bson,
|
{applications,[kernel,stdlib,crypto,public_key,ssl,inets,bson,
|
||||||
mongodb]},
|
mongodb]},
|
||||||
|
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
BIN
ebin/vlog.beam
BIN
ebin/vlog.beam
Binary file not shown.
Loading…
Reference in New Issue
Block a user