react-native-executorch  by software-mansion

React Native library for on-device AI model execution

Created 1 year ago
1,063 stars

Top 35.6% on SourcePulse

GitHubView on GitHub
Project Summary

This library provides a declarative interface for running AI models directly within React Native applications, leveraging Meta's ExecuTorch framework. It targets React Native developers seeking to integrate on-device AI capabilities without deep native or ML expertise, enabling efficient, local inference for features like LLM-powered text generation and computer vision.

How It Works

The library acts as a bridge between React Native's JavaScript environment and the native ExecuTorch runtime. It abstracts the complexities of model loading, execution, and data handling, allowing developers to interact with AI models using familiar React patterns. This approach simplifies the integration of advanced AI features into mobile applications, offering state-of-the-art performance for on-device inference.

Quick Start & Requirements

Highlighted Details

  • Enables on-device AI model execution in React Native via ExecuTorch.
  • Provides declarative hooks (useLLM) for simplified model integration.
  • Includes examples for speech-to-text (Whisper), computer vision, and LLMs (Llama).
  • Requires the React Native New Architecture.

Maintenance & Community

Created by Software Mansion, a company with significant contributions to React Native. Further developments and plans can be found on their discussion page.

Licensing & Compatibility

Licensed under The MIT License, permitting commercial use and integration with closed-source applications.

Limitations & Caveats

Running LLMs requires substantial RAM, and users may need to increase emulator RAM allocation to prevent crashes. The library mandates the React Native New Architecture.

Health Check
Last Commit

1 day ago

Responsiveness

1 day

Pull Requests (30d)
37
Issues (30d)
16
Star History
79 stars in the last 30 days

Explore Similar Projects

Starred by Guillermo Rauch Guillermo Rauch(Founder of Vercel), Jared Palmer Jared Palmer(SVP at GitHub; Founder of Turborepo; Author of Formik, TSDX), and
18 more.

ai by vercel

0.8%
19k
AI SDK for building AI-powered applications and agents
Created 2 years ago
Updated 19 hours ago
Feedback? Help us improve.