linkdepth

WARNING: this project is unmaintained.

scrapy spider to check link depth over time.

License is MIT.

Usage

linkdepth.py urls.txt items.jl

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
.github		.github
.bish-index		.bish-index
.bish.sqlite		.bish.sqlite
.gitignore		.gitignore
README.rst		README.rst
deploy.sh		deploy.sh
fetch.sh		fetch.sh
frontier-size.py		frontier-size.py
linkdepth.py		linkdepth.py
middleware.py		middleware.py
queues.py		queues.py
rules.json		rules.json
scheduler.py		scheduler.py