-
Notifications
You must be signed in to change notification settings - Fork 3.1k
Description
OpenVINO Version
2026.0.0
Operating System
Debian Trixie (trixie-slim)
Hardware Architecture
ARM (64 bits)
Target Platform
Linux aarch64 (AWS Graviton, Ampere Altra, Raspberry Pi 5, Rockchip RK3588, etc.)
Build issue description
OpenVINO 2026.0.0 ships manylinux_2_35_aarch64 wheels for cp310 through cp313, but the cp314 and cp314t (free-threaded) variants are missing. Meanwhile, cp314/cp314t wheels are published for all other platforms (x86_64 Linux, macOS ARM, Windows).
Published wheels for 2026.0.0 (from PyPI):
| Python | Linux x86_64 | Linux aarch64 | macOS ARM | Windows |
|---|---|---|---|---|
| cp310 | manylinux_2_28 |
manylinux_2_35 |
macosx_11_0 |
win_amd64 |
| cp311 | manylinux_2_28 |
manylinux_2_35 |
macosx_11_0 |
win_amd64 |
| cp312 | manylinux_2_28 |
manylinux_2_35 |
macosx_11_0 |
win_amd64 |
| cp313 | manylinux_2_28 |
manylinux_2_35 |
macosx_11_0 |
win_amd64 |
| cp314 | manylinux_2_28 |
MISSING | macosx_11_0 |
win_amd64 |
| cp314t | manylinux_2_28 |
MISSING | macosx_11_0 |
win_amd64 |
This appears to be a CI matrix omission rather than a technical limitation:
- The
linux_arm64.ymlworkflow builds on native ARM runners (aks-linux-4-cores-8gb-arm-docker-build) but only tests Python 3.11 - The
manylinux_2_28.ymlworkflow builds cp310-cp314t (line 190:SUPPORTED_PYTHON_VERSIONS=("3.10" "3.11" "3.12" "3.13" "3.14" "3.14t")) but is hardcoded to x86_64 only (line 117:ARCH: 'x86_64') - The CPU plugin uses ACL (ARM Compute Library) on both macOS ARM and Linux aarch64 (
src/plugins/intel_cpu/CMakeLists.txt), and macOS ARM already has cp314t wheels - The cp310-cp313 aarch64 wheels exist, proving the build infrastructure works
Since the system requirements documentation lists ARM64 Linux support with Python 3.10-3.14 (docs/articles_en/about-openvino/release-notes-openvino/system-requirements.rst line 264), the missing wheels create a gap between documented and actual platform support.
Impact
Users on Linux aarch64 with Python 3.14 (including free-threaded builds) cannot pip install openvino. This affects:
- AWS Graviton (c7g, c8g instances) — major cloud deployment target
- Ampere Altra — common in cloud and edge servers
- Raspberry Pi 5 — popular edge AI platform
- Rockchip RK3568/3588 — embedded AI boards
We currently work around this by falling back to ONNX Runtime on Linux aarch64, but would prefer OpenVINO's superior batch throughput (3.8x on Xeon vs ONNX Runtime in our benchmarks).
Related issues — community has been asking for ARM support since 2019
This is part of a long history of community requests for better ARM support:
- [Feature Request]: Support aarch64 python wheel for Linux #19018 — [Feature Request]: Support aarch64 python wheel for Linux (Aug 2023). Intel acknowledged "internal infrastructure issues". Resolved starting in OpenVINO 2023.1.0 which shipped cp38/cp39/cp310/cp311 aarch64 wheels; later releases expanded to cp312-cp313
- [Build]: Cannot install on AWS ARM compute instance #25367 — [Build]: Cannot install on AWS ARM compute instance (Jul 2024). AWS Graviton c7g install failure
- Not able install openvino for arm64 architecture #10661 — Not able to install openvino for arm64 architecture (Feb 2022). ROCK Pi aarch64
- Support for Raspberry aarch64, Debian GNU/Linux 11 (bullseye) #11059 — Support for Raspberry aarch64, Debian GNU/Linux 11 (Mar 2022). Raspberry Pi 4
- [Build]: Support Debian packages on arm64 #24049 — [Build]: Support Debian packages on arm64 (Apr 2024). Cortex-A53 aarch64
- [Feature Request]: Please publish Python 3.13t (free-threaded) wheels #29950 — [Feature Request]: Please publish Python 3.13t (free-threaded) wheels (Apr 2025). Led to cp314t support via PR [PyOV] Enable free-threaded python build #30978 (
ENABLE_NO_GIL_PYTHON_API, merged Jun 2025), but only for x86_64 and macOS - [Bug]: free(): invalid next size (fast) #31633 — [Bug]: free(): invalid next size (fast) (Aug 2025). Active aarch64 user on RK3568
- [Bug]: Unbounded Memory increase on a RaspberryPi 5 #31064 — [Bug]: Unbounded Memory increase on a Raspberry Pi 5 (Jun 2025). Active aarch64 user
- [Feature Request]: Optimize PagedAttention operation on aarch64 HW #26422 — [Feature Request]: Optimize PagedAttention on aarch64 HW (Sep 2024). Shows aarch64 is an active inference target
Suggested fix
Extend the release wheel build pipeline to include cp314 and cp314t for manylinux_2_35_aarch64, mirroring what already exists for cp310-cp313. The public linux_arm64.yml workflow could be extended to build multiple Python versions (like manylinux_2_28.yml does for x86_64), or the internal release pipeline could add cp314/cp314t to its aarch64 matrix.
Issue submission checklist
- The feature request or improvement must be related to OpenVINO