agentP | Network.HTTP.Robots |
Allow | Network.HTTP.Robots |
CrawlDelay | Network.HTTP.Robots |
Directive | Network.HTTP.Robots |
directiveP | Network.HTTP.Robots |
Disallow | Network.HTTP.Robots |
Hole | |
1 (Type/Class) | Network.HTTP.Robots |
2 (Data Constructor) | Network.HTTP.Robots |
Literal | Network.HTTP.Robots |
parseRobots | Network.HTTP.Robots |
Path | Network.HTTP.Robots |
Robot | Network.HTTP.Robots |
robotP | Network.HTTP.Robots |
tokenP | Network.HTTP.Robots |
UserAgent | Network.HTTP.Robots |
Wildcard | Network.HTTP.Robots |