cobweb

rubygemsv1.2.1

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

License MITpermissive20 versions9 deps3,467 weekly dl
http://github.com/stewartmckee/cobweb
42
/ 100
Health
safe to use

[email protected] is safe to use (health: 42/100)

Health breakdown0 – 100
0/25
maintenance
6/20
popularity
25/25
security
9/15
maturity
2/15
community
Vulnerabilities
0
none known

Health History

Dependency Tree

License Audit

API access

Get this data programmatically — free, no authentication.

curl https://depscope.dev/api/check/rubygems/cobweb

Last updated · 2021-01-09T01:32:54.885Z