# HOW TO EDIT THIS FILE: # The handy ruler below makes it easier to edit a package description. Line # up the first '|' above the ':' following the base package name, and the '|' on # the right side marks the last column you can put a character in. You must make # exactly 11 lines for the formatting to be correct. It's also customary to # leave one space after the ':'. # |----------------------------------------------------------| perl-www-robotrules: perl-www-robotrules (DB of robots.txt-derived perms) perl-www-robotrules: perl-www-robotrules: This perl module parses /robots.txt files as specified perl-www-robotrules: in "A Standard for Robot Exclusion". Webmasters can use perl-www-robotrules: the /robots.txt file to forbid conforming robots from perl-www-robotrules: accessing parts of their web site perl-www-robotrules: perl-www-robotrules: http://search.cpan.org/dist/WWW-RobotRules/ perl-www-robotrules: perl-www-robotrules: perl-www-robotrules: