Sign Up for Free

RunKit +

Try any Node.js package right in your browser

This is a playground to test code. It runs a full Node.js environment and already has all of npm’s 1,000,000+ packages pre-installed, including crawlkit with all npm packages installed. Try it out:

'use strict'; // eslint-disable-line const CrawlKit = require('crawlkit'); const baseURL = 'https://www.google.com'; const crawler = new CrawlKit(baseURL); crawler.addRunner('title', { getCompanionFiles: () => [], getRunnable: () => function extractTitle() { window.callPhantom(null, document.title); }, }); /* eslint-disable no-console */ crawler.crawl() .then((results) => { console.log(JSON.stringify(results, true, 2)); }, (err) => console.error(err));

This service is provided by RunKit and is not affiliated with npm, Inc or the package authors.

crawlkit v2.0.2

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

RunKit is a free, in-browser JavaScript dev environment for prototyping Node.js code, with every npm package installed. Sign up to share your code.
Sign Up for Free