RunKit +

Try any Node.js package right in your browser

This is a playground to test code. It runs a full Node.js environment and already has all of npm’s 1,000,000+ packages pre-installed, including gpt-tokenizer with all npm packages installed. Try it out:

var gptTokenizer = require("gpt-tokenizer")

all documents on RunKit are public
require() any package directly from npm
use arrow functions, classes, template strings, and most of ES6
await any promise instead of using callbacks (example)
create your own embedded node.js snippets

This service is provided by RunKit and is not affiliated with npm, Inc or the package authors.

gpt-tokenizer v2.1.2

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

Overview Browse Files