garfield/wpscan
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

parse robots.txt

Browse Source
This commit is contained in:
Christian Mehlmauer
2013-08-10 11:35:17 +02:00
parent 6c8e76060a
commit 6c008015e9
10 changed files with 171 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files

0
spec/samples/wpscan/web_site/robots_txt/empty_robots.txt Normal file
View File

6
spec/samples/wpscan/web_site/robots_txt/invalid_robots.txt Normal file
View File

@@ -0,0 +1,6 @@
ölhkdfys
opihufgcasfa
dsds
fsdf
s
dtf

10
spec/samples/wpscan/web_site/robots_txt/robots.txt Normal file
View File

@@ -0,0 +1,10 @@
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wordpress/admin/
Disallow: /wordpress/wp-admin/
Disallow: /wordpress/secret/
Disallow: /Wordpress/wp-admin/
Allow: /asdf/
Sitemap: http://10.0.0.0/sitemap.xml.gz