Robots.txt

Any reason respecting it?

The only reliable way to protect a page from crawl is to bury it inside of infinitely large set of randomly generated data.

If you don't want your web page to be downloaded, don't put it on the internet.