blob: 5b901b095b9257e157888218bc9ff0399c9fae08 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
# HOW TO EDIT THIS FILE:
# The "handy ruler" below makes it easier to edit a package description.
# Line up the first '|' above the ':' following the base package name, and
# the '|' on the right side marks the last column you can put a character in.
# You must make exactly 11 lines for the formatting to be correct. It's also
# customary to leave one space after the ':' except on otherwise blank lines.
|-----handy-ruler------------------------------------------------------|
perl-www-robotrules: perl-www-robotrules (DB of robots.txt-derived perms)
perl-www-robotrules:
perl-www-robotrules: This perl module parses /robots.txt files as specified in "A
perl-www-robotrules: Standard for Robot Exclusion". Webmasters can use the /robots.txt
perl-www-robotrules: file to forbid conforming robots from accessing parts of their
perl-www-robotrules: web site
perl-www-robotrules:
perl-www-robotrules: http://search.cpan.org/dist/WWW-RobotRules/
perl-www-robotrules:
perl-www-robotrules:
perl-www-robotrules:
|
