Prebuilt binary for TensorFlowLite's standalone installer. For RaspberryPi. A very lightweight installer. I provide a FlexDelegate, MediaPipe Custom OP and XNNPACK enabled binary.
-
Updated
Mar 29, 2024 - Shell
Prebuilt binary for TensorFlowLite's standalone installer. For RaspberryPi. A very lightweight installer. I provide a FlexDelegate, MediaPipe Custom OP and XNNPACK enabled binary.
🚀Explore how PyTorch models can be exported and lowered to the ExecuTorch Runtime for more effective, lightweight, minimalist inference at the Edge. Covers deploying to CPUs, particularly via the XNNPACK backend, for transformer-based and CNN models, before covering deployment to the Ethos-U backend, the TOSA IR, FVPs, and Google Model Explorer.🚀
Android-first React Native ONNX Runtime bindings with Nitro Modules, backend selection, tensor inference, benchmarking, and experimental QNN diffusion pipeline helpers.
Embedded-first C++26/C23 neural inference: float32+int8 on MCU/MPU/CPU. CMSIS-NN · ESP-NN · NMSIS-NN · XNNPACK. Peer-benched vs TFLM, microTVM, TF Lite, ONNX Runtime (Arm · Espressif · RISC-V · Apple).
An agent-first harness and collection of model recipes for exporting, validating, and optimizing AI models for ExecuTorch
Course materials for deploying and optimizing PyTorch models on Arm edge devices with ExecuTorch
Matsuba vs benizuwai crab classifier from photos: pure-Go training, TFLite flatbuffer, XNNPACK inference
Serve ExecuTorch .pte language models from an Android phone: an OpenAI and Anthropic compatible HTTP server that runs in the background, with KV cache reuse, run history and metrics. Kotlin Multiplatform core, Compose console.
Universal AI Quantization Engine (UAQE) — an autonomous, capability-driven platform for AI model inspection, quantization, optimization, benchmarking, validation, and deployment on resource-constrained hardware.
Read くずし字 with a CNN: pure-Go training, hand-built CONV_2D/MAX_POOL_2D flatbuffer, XNNPACK inference
A drowsiness detection system using facial landmarks and hand detection to monitor user alertness. 😴📹🔔👁️
Guess which 文豪 wrote a sentence: Aozora Bunko scraper, pure-Go training, TFLite flatbuffer, XNNPACK inference
Iris species classifier: pure-Go training, TFLite flatbuffer, XNNPACK inference
Read handwritten digits with a CNN: pure-Go training, hand-built CONV_2D/MAX_POOL_2D flatbuffer, XNNPACK inference
Hardware-bound, deterministic AI runtime for edge devices (SM8750-AB) featuring thermal-aware manifold inference and Veritas Gate governance.
On-device visual memory for the things you leave behind — Arm64 Android, EdgeTAM and ExecuTorch.
Benchmarks for compiled ExecuTorch models on real phones in AWS Device Farm: speed, memory, heat and answer quality, single and multi turn, every number traceable to a raw device log
Sazae-san janken predictor: scraper, pure-Go training, TFLite flatbuffer, XNNPACK inference
Fast local Supertonic-3 TTS engine for Android with LiteRT/XNNPACK CPU optimization, Qualcomm QNN NPU acceleration, custom voice JSON import, regex rules, and system TTS integration.
To associate your repository with the xnnpack topic, visit your repo's landing page and select "manage topics."