RunKit +

Try any Node.js package right in your browser

This is a playground to test code. It runs a full Node.js environment and already has all of npm’s 1,000,000+ packages pre-installed, including spiderman-crawler with all npm packages installed. Try it out:

var spidermanCrawler = require("spiderman-crawler")

all documents on RunKit are public
require() any package directly from npm
use arrow functions, classes, template strings, and most of ES6
await any promise instead of using callbacks (example)
create your own embedded node.js snippets

This service is provided by RunKit and is not affiliated with npm, Inc or the package authors.

spiderman-crawler v0.2.3

Spiderman makes it trivial work to write a crawler. Just define some components, use segues to connet them, finally write some script to specify data that needs to be transfer from one component to the next, that's all!

Overview Browse Files