Archives
/
dhtcrawler2
mirror of https://github.com/btdigg-org/dhtcrawler2
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
6 Commits
2 Branches
0 Tags
3.3 MiB
Batchfile 64.7%
HTML 31.6%
JavaScript 3.7%
 
 
 
master
src
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'ea6df3b2df'
${ noResults }
Go to file
Kevin Lynx ea6df3b2df add database repl-set scripts 11 years ago
deps add kdht ebin 11 years ago
ebin change http to read data from mongodb slave 11 years ago
tools/db-replset add database repl-set scripts 11 years ago
www change http interface 11 years ago
README.md first commit 11 years ago
create_bin.bat add database repl-set scripts 11 years ago
win_start_crawler.bat first commit 11 years ago
win_start_hash.bat change http interface 11 years ago
win_start_http.bat change http to read data from mongodb slave 11 years ago

README.md

dhtcrawler2

This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly.

Usage

  • install Erlang R16B or newer

  • download mongodb and start mongodb first

      mongod --dbpath your-database-path --setParameter textSearchEnabled=true

  • start crawler, on Windows, just click win_start_crawler.bat

  • start hash_reader, on Windows, just click win_start_hash.bat

  • start httpd, on Windows, just click win_start_http.bat

  • wait several minutes and checkout localhost:8000