Skip to content

feat: add Latin text recognition support using ML Kit - #4195

Open
ismaelsousa wants to merge 2 commits into
margelo:mainfrom
ismaelsousa:feat/react-native-vision-camera-mlkit-text-recognition-latin
Open

ismaelsousa wants to merge 2 commits into
margelo:mainfrom
ismaelsousa:feat/react-native-vision-camera-mlkit-text-recognition-latin

Conversation

@ismaelsousa

@ismaelsousa ismaelsousa commented Sep 22, 2026 •

Copy link
Copy Markdown
Contributor

This pull request introduces a new ML Kit Latin-script text recognition plugin to the monorepo and integrates it into the Simple Camera app, alongside improvements to navigation and UI for camera-based plugins. The most significant changes are the addition of the new package, updates to workspace and build scripts, and enhancements to the app's navigation and user interface to support barcode scanning and text recognition.

New ML Kit Latin Text Recognition Plugin:

  • Added the new package react-native-vision-camera-mlkit-text-recognition-latin with all necessary configuration files for Android and iOS, including Gradle, CMake, Podspec, and documentation. This package enables Latin-script text recognition using ML Kit within VisionCamera frame processors. [1] [2] [3] [4] [5] [6]

Monorepo and Build System Updates:

  • Updated root package.json to include the new text recognition package in workspaces, scripts (build, specs, etc.), and version management for consistency across the monorepo. [1] [2] [3]

Simple Camera App Integration:

  • Added dependencies for the new text recognition plugin to the app's package.json.
  • Created new screens: TextRecognitionLatinScreen and BarcodeScannerScreen, each implementing real-time frame processing and UI overlays for their respective features. [1] [2]
  • Updated app navigation to include new routes for text recognition and barcode scanning, and imported the new screens. [1] [2]

UI and Navigation Improvements:

  • Enhanced the main camera screen with buttons to navigate to the new plugin screens, and added corresponding styles for these buttons. [1] [2] [3]

These changes collectively expand the functionality of the Simple Camera app, making it easy to test and demonstrate both barcode scanning and ML Kit-based Latin text recognition features.

- Implemented HybridTextLineSpec, HybridTextRecognizerFactorySpec, HybridTextRecognizerSpec, and HybridTextSymbolSpec for text recognition functionality.
- Created corresponding .cpp and .hpp files for each spec to define their interfaces and methods.
- Added Point and Rect structs to represent coordinates and bounding boxes.
- Developed factory functions to create text recognizers and manage text recognition processes.
- Introduced TypeScript interfaces for recognized text, text blocks, text elements, and recognized languages.
- Configured package.json and TypeScript settings for the new module.
- Added react-native.config.js for proper integration with React Native.
- Implemented useTextRecognizer hook for easy access to text recognition functionality in React components.
@vercel

vercel Bot commented Sep 22, 2026

Copy link
Copy Markdown

@ismaelsousa is attempting to deploy a commit to the Margelo Team on Vercel.

A member of the Team first needs to authorize it.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant