mandeal303/tiktokenizer
App
Can I trust it?
Worth a closer look before you use it.
Warnings Check
Very new: it was created 11 days ago. Wait a little before installing it.
Stars from real accounts No data
We haven't checked its stars for fakes yet.
Active OK
Last change 10 days ago.
Licence OK
MIT: you can use it for free, also in a commercial product. Keep the licence notice.
Quick checks from public data. They help, but they are no guarantee.
What it is
A web-based playground for inspecting how tokenizers split a given text into tokens. Built with TypeScript, Next.js and React, it uses openai/tiktoken to count tokens for a prompt.
Who it's for
Developers and prompt engineers who want to check token counts for OpenAI-style models before sending a prompt
How to use it
Ready-made installers, when the project publishes them, are on its latest release.
Ask your AI to set it up
Paste this into Claude, ChatGPT or your coding assistant.
Help me install and set up mandeal303/tiktokenizer in my project. Follow its README: https://github.com/mandeal303/tiktokenizer. Explain each step and check it is safe before running anything.
Star curve
Alternatives
Similar projects named in its profile. Each link searches the directory.
Get alerts for repos like this
We'll email you when something in Web & UI starts rising. Free, once a week, only what matches.
What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy
For maintainers
Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.
[](https://repoalerts.com/repo/mandeal303/tiktokenizer?ref=badge)Similar repos
- thecoderrrer/ai_manus
A general-purpose AI agent system that runs various tools and operations inside a sandbox environment. The README describes an agent that executes code, controls a browser and carries out multi-step t
- h296025733-sys/tiktok-creator-intelligence
Python tool that analyzes public TikTok creator content for commercial signals, relative video performance and visual evidence, then builds a product-fit report through a two-stage Codex review workfl
- luiscarlosjayk/tiza
A terminal user interface for drawing boxes, arrows, highlights and notes on top of source code, stepping through them as a presentation. Annotations stay attached to the code when scrolling or resizi
- plingjs/pling
An open capability layer for web applications. Pages declare the actions, records and read-only state an agent may inspect and invoke, which run through the same handlers and validation as user intera
- anomalyco/textjs
A React framework that renders terminal-style user interfaces in the browser console. It lays out frames with Yoga and writes them with %c-styled console.log calls, offering an App Router, components
- DominikScholz/open-bot-avatar
A JSON spec and TypeScript renderer for interactive agent avatars. An avatar is defined by one SVG path and eye positions; the renderer draws it as a CSS 3D scene or a static SVG, with moods and point