A specification compliant robots.txt parser with wildcard (*) matching support.
[email protected] is safe to use (health: 44/100)
Get this data programmatically — free, no authentication.
curl https://depscope.dev/api/check/npm/robots-parserFirst published · 2014-09-27T12:30:05.941Z
Last updated · 2023-02-21T18:54:51.012Z