erwanlr 8d3907ff65 Fixes the location of the robots.txt check

2014-05-22 17:45:10 +02:00

..

interesting_headers.rb

Header names are case insensitive

2013-08-10 11:49:30 +02:00

robots_txt.rb

Fixes the location of the robots.txt check

2014-05-22 17:45:10 +02:00