Self-hosted browser tool for counting and inspecting text tokens, with a Chinese UI adapted from the OpenAI Tokenizer.
-
Updated
May 13, 2024 - Go
Self-hosted browser tool for counting and inspecting text tokens, with a Chinese UI adapted from the OpenAI Tokenizer.
Token calculator & cost — LLM token counter
Production-grade token counter for PDF, TXT, DOCX, MD, and PPTX files using real GPT tokenization via tiktoken. Features streaming extraction, constant-memory processing, OCR/scanned PDF detection, batch processing, and Hugging Face Spaces-ready Gradio UI.
To associate your repository with the token-calc topic, visit your repo's landing page and select "manage topics."