High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
rust cli arrow data-engineering parquet data-cleaning synthetic-data fine-tuning jsonl pyo3 pretraining polars llm dataset-curation reasoning-models eval-harness jev typesafe-ai system-one type-safe-ai
-
Updated
Sep 24, 2026 - Rust