Data created during crawl

Zip file of data/, links/, output/

You could extract this into the source tree and re-run my scripts to generate urls.txt without having to scrape the site again.