google-ai-edge/litert-torch

Health v2 · maintenance only

Adoption not part of the score

1091 stars · 187 forks observed · 2026-09-03

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

LiteRT Torch is a Python library that converts PyTorch models into .tflite format for running with LiteRT on Android, iOS, and IoT devices. It builds on torch.export() with broad CPU coverage and initial GPU/NPU support, including a Generative API for LLMs and transformer models.

Use cases

• convert pytorch model to tflite
• run pytorch models on android on-device
• deploy llm on mobile device
• quantize transformer model for edge inference
• convert resnet to tflite flatbuffer
• run machine learning models on iot devices

When to choose

• you have PyTorch models and need to run them on-device with LiteRT
• you want to deploy LLMs or transformer models on mobile with quantization
• you need broad Core ATen operator coverage for model conversion

When to avoid

• you target TensorFlow/Keras models rather than PyTorch
• you need server-side or cloud inference rather than on-device
• you require stable production support for the Generative API, which is Alpha

Facets

library · maturity active

machine-learning llm-inference compiler serialization machine-learning deep-learning large-language-models mobile-development embedded-systems python iot pytorch tflite litert on-device-ai model-conversion quantization edge-ai android ios linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="google-ai-edge/litert-torch")