Jump to content

NPU

From ArchWiki

This article or section is a candidate for moving to Neural Processing Unit.

Notes: Like with ALSA, follow Help:Style#Title. (Discuss in Talk:NPU)

NPU stands for Neural Processing Unit. NPUs are specialized processors designed to accelerate machine learning and AI-related tasks. They are commonly integrated into modern SoCs (System-on-Chip), including those found in mobile devices, single-board computers, and some newer laptops and desktops. NPUs help offload computation from the CPU and GPU, improving performance and reducing power consumption for AI workloads.

Installation

AMD XDNA

The AMD XDNA-based NPU is supported via the amdxdna kernel driver, which is included in recent versions of the Linux kernel and enabled automatically.

To verify if the NPU has been detected and initialized:

$ journalctl -kg xdna

You can also check with rocminfo:

$ /opt/rocm/bin/rocminfo

Look for agents indicating XDNA or NPU support in the output. If properly working, an agent should list ISAs under the ISA Info entry.

List of NPU-accelerated software

This article or section needs expansion.

Reason: More applications may support NPUs; contributions welcome. (Discuss in Talk:NPU)

See also