ExecuTorch
PyTorch's official mobile / edge inference runtime. Compiles PyTorch models to a mobile-optimized format for Android (NNAPI / GPU / NPU) and iOS (Metal / CoreML). The successor to the deprecated PyTorch Mobile path.
Overview
PyTorch's official mobile / edge inference runtime. Compiles PyTorch models to a mobile-optimized format for Android (NNAPI / GPU / NPU) and iOS (Metal / CoreML). The successor to the deprecated PyTorch Mobile path.
Featured in this stack
The L3 execution stacks that pick this tool as a recommended component, with the one-line note explaining the role it plays in each.
- Stack · L3·Homelab tier·Role: PyTorch-native alternative (NNAPI / Vulkan delegate)Android on-device AI stack — Phi-3.5 Mini / Llama 3.2 3B via MLC LLM or Qualcomm AI Hub
ExecuTorch is PyTorch-first-party. Backend-pluggable: NNAPI (Android), Vulkan (cross-vendor GPU), custom NPU delegates. Pick when your model authoring is PyTorch-native and you don't want a separate compile pipeline.
Pros
- First-party PyTorch lineage — model authoring → mobile deploy is one toolchain
- Backend-pluggable: NNAPI (Android), CoreML (iOS), Vulkan, custom NPU delegates
- Active development under Meta — production-grade roadmap
Cons
- Toolchain still maturing — kernel coverage gaps on some ops
- LLM-specific optimizations behind MLC LLM and Qualcomm AI Hub for Snapdragon
- Requires PyTorch model source — pre-quantized GGUF doesn't import
Compatibility
| Operating systems | iOS Android Linux macOS |
| GPU backends | n/a |
| License | Open source · free + open-source |
Runtime health
Operator-grade signals on how actively ExecuTorch is being maintained, how fresh its measurements are, and what failure classes operators have flagged. Every label below is anchored to a real date or count — we never infer maintainer activity we can't show.
Release cadence
Derived from the most recent editorial signal on this row.
6 days since last refresh · source: lastUpdated
Benchmark freshness
How recent the editorial measurements on this runtime are.
No editorial benchmarks for this runtime yet.
Community reproduction
Submissions that match an editorial measurement on similar hardware.
No community reproductions on file yet.
Get ExecuTorch
Frequently asked
Is ExecuTorch free?
What operating systems does ExecuTorch support?
Which GPUs work with ExecuTorch?
Reviewed by RunLocalAI Editorial. See our editorial policy for how we evaluate tools.
Related — keep moving
Verify ExecuTorch runs on your specific hardware before committing money.