#
flores
Here are 10 public repositories matching this topic...
Yellow Flowers (Floricienta)
-
Updated
Jan 29, 2025 - JavaScript
How many tokens does Bangla cost across LLMs? Tokenizer measurement on FLORES-200.
-
Updated
Oct 10, 2026 - Jupyter Notebook
How many more tokens do Indic languages need than English? Tokenizer fertility across English, Hindi, Telugu, Kannada and Marathi on the full FLORES+ devtest split (1,012 aligned sentences).
multilingual nlp benchmark tokenizer india hindi kannada telugu marathi tokenization indic-languages indian-languages fertility flores llm llm-evaluation flores-plus
-
Updated
Oct 1, 2026 - Python
Todo lo que hacemos es con amor y con nuestro sello personal
-
Updated
Jul 7, 2018
Add this topic to your repo
To associate your repository with the flores topic, visit your repo's landing page and select "manage topics."