robotstxt

Robots.txt parser / rule evaluator

Uploader

sparked435

License

MIT/X11

Homepage

zadzmo.org/code/robotstxt

Downloads

117

$ luarocks install robotstxt

Robotstxt provides a Lua/LPEG based robots.txt file parser and
rule evaluator. Basic workflow is to load via a file or IO
handle, then set a user agent, then check if given URLs are
allowed or denied.

Versions

1.8-12 days ago10 downloads

1.7-12 days ago17 downloads

1.6-12 days ago2 downloads

1.5-12 days ago3 downloads

1.4-12 days ago6 downloads

1.3-12 days ago11 downloads

1.2-12 days ago5 downloads

1.1-12 days ago12 downloads

1.0-22 days ago22 downloads

1.0-12 days ago3 downloads

Dependencies

LPeg

lua >= 5.4, < 5.5

Manifests

root