Bbabo NET

Science & Technology News

Will NPUs in Intel processors finally become useful? The company has open sourced its NPU Acceleration Library

Intel has open sourced its NPU Acceleration Library, enabling compact AI models to run directly on the NPUs in Meteor Lake processors.

The library is written in Python and is designed to help developers improve their products by running them on the NPUs of the latest Intel processors. The library allows you to run compact language models like Gemma-2b or TinyLlama directly on the NPU, without requiring any cloud server. Actually, this is exactly why NPU hardware units are needed in processors at all, and what is currently missing.

Let us remind you that NPU units are found in Intel Meteor Lake and AMD Ryzen 7040/8040 processors. For now, these blocks are completely useless for most users.

Will NPUs in Intel processors finally become useful? The company has open sourced its NPU Acceleration Library