# Ryzen AI with AMD IPU on Framework laptops? **URL:** \ **Category:** Framework Laptop 13\ **Created:** [September 7, 2023, 2:51pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356 "2023-09-07T14:51:38Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![Bernhard\_Gabler](https://avatars.discourse-cdn.com/v4/letter/b/838e76/32.png) [@Bernhard\_Gabler](https://community.frame.work/u/Bernhard_Gabler)\ **Post date:** [September 7, 2023, 2:51pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/1 "2023-09-07T14:51:38Z")
Do the AMD Ryzen APUs on the Laptop 13 support AMD’s “Ryzen AI”? This software [1] to speed up neural networks requires both 1. an AMD **Inference Processing Unit** (IPU), which is contained in some (but not all) Ryzen 7000 mobile processors (HS and U series) [2]. In some publications it is called “XDNA”. 2. **enablement by the OEM**. Apparently some PCs with Ryzen 7000 APUs are on the market that do _ **NOT** _ support the AMD IPU for sheer lack of manufacturer support. [3] [1] https :// ryzenai.docs.amd .com/en/latest/index.html [2] [https://www.amd.com/en/products/ryzen-ai](https://www.amd.com/en/products/ryzen-ai) (click to open the footnotes at bottom of page) [3] [AMD IPU Device not detected on 7940hs · Issue #5 · amd/RyzenAI-cloud-to-client-demo · GitHub](https://github.com/amd/RyzenAI-cloud-to-client-demo/issues/5) Is there a clear statement from Framework Computer Inc. if “Ryzen AI” and the AMD IPU are supported on their laptops? I am currently looking at Laptop 13, but same question applies to Laptop 16. Best regards, Bernhard (pls. excuse the distorted first URL - as a forum newbie I am limited to 2 URLs) ---
**Author:** ![Tech\_Kai](https://avatars.discourse-cdn.com/v4/letter/t/e274bd/32.png) [@Tech\_Kai](https://community.frame.work/u/Tech_Kai)\ **Post date:** [September 8, 2023, 6:31am UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/2 "2023-09-08T06:31:25Z")
Welcome to the forum! AFAIK, so far there hasn’t been any _official_ communication regarding whether or not AMD IPU is built into the specific SKU that is shipping with Framework laptops or if it is enabled. Your best bet to get an answer though would be through creating a ticket and reaching out to Framework Support. Physically Slaying, Mentally Decaying Kai ---
**Author:** ![Aurelien\_D](https://sea1.discourse-cdn.com/flex001/user_avatar/community.frame.work/aurelien_d/32/16071_2.png) [@Aurelien\_D](https://community.frame.work/u/Aurelien_D)\ **Post date:** [September 8, 2023, 7:14am UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/3 "2023-09-08T07:14:10Z")
Wow I ordered an AMD with the hope of working with this new Ryzen AI tech and I’m batch 1. This has to be my workstation for work, so, I would be really disappointed if the feature is not implemented… Is this enablement is hardware design or can this be addressed by a firmware update ? ---
**Author:** ![Tech\_Kai](https://avatars.discourse-cdn.com/v4/letter/t/e274bd/32.png) [@Tech\_Kai](https://community.frame.work/u/Tech_Kai)\ **Post date:** [September 8, 2023, 1:12pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/4 "2023-09-08T13:12:53Z")
According to the [official Ryzen AI Software documentation](https://ryzenai.docs.amd.com/en/latest/inst.html) it appears to be a matter of installing the software. > The Ryzen AI Software Platform supports AMD Ryzen 7040U, 7040HS series mobile processors with Windows 11 OS. As mentioned before though I would highly recommend making a support ticket and seeing if you can get confirmation through official channels as considering how no end user has the machine in hand anything said by us is simply speculation. ---
**Author:** ![Bernhard\_Gabler](https://avatars.discourse-cdn.com/v4/letter/b/838e76/32.png) [@Bernhard\_Gabler](https://community.frame.work/u/Bernhard_Gabler)\ **Post date:** [September 8, 2023, 1:27pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/5 "2023-09-08T13:27:05Z")
> [@Tech\_Kai](#): > > AFAIK, so far there hasn’t been any _official_ communication regarding whether or not AMD IPU is built into the specific SKU that is shipping with Framework laptops or if it is enabled. If the term “SKU” refers to AMD’s processors, this detail can be found in AMD’s documentation: (see link [2] in original post above) > Ryzen™ AI technology is compatible with all AMD Ryzen 7040 series processors except the Ryzen 5 7540U and Ryzen 3 7440U. **OEM enablement is required.** Please check with your system manufacturer for feature availability prior to purchase. GD-220. I would assume this list could possibly be extended with processor models released in future. What struck me was the relevance of OEM support, i.e. just having the right processor is not good enough. The OP’s link [3] mentions a few affected devices. > [@Tech\_Kai](#): > > Your best bet to get an answer though would be through creating a ticket and reaching out to Framework Support. OK, thanks. I opened a ticket this morning, referring to this thread. I’d be pleased if they respond right here in the forum. Otherwise I’ll let you know of any personal response to me. ---
**Author:** ![Bernhard\_Gabler](https://avatars.discourse-cdn.com/v4/letter/b/838e76/32.png) [@Bernhard\_Gabler](https://community.frame.work/u/Bernhard_Gabler)\ **Post date:** [September 10, 2023, 11:55am UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/6 "2023-09-10T11:55:40Z")
Quick update: Framework’s support kindly responded to my ticket, essentially saying: > We understand that you want to know if the AMD Ryzen APUs on the Laptop 13 support AMD’s IPU and “Ryzen AI". We will be sharing more information before we start shipping Framework 13 AMD Ryzen 7040 Series. We suggest you register in our [**blog post**](https://frame.work/blog/category/news)​ to get newsletters and product updates. So I will follow the blog posts from now on. To early reviewers of Ryzen machines: you are welcome to contribute your own findings. ---
**Author:** ![James\_Bloom](https://avatars.discourse-cdn.com/v4/letter/j/6de8d8/32.png) [@James\_Bloom](https://community.frame.work/u/James_Bloom)\ **Post date:** [October 14, 2023, 4:41am UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/7 "2023-10-14T04:41:12Z")
Two reports of the IPU showing in device manager here [[RESPONDED] AMD Batch 1 Guild - #784 by joeshmoo](http://community.frame.work/t/responded-amd-batch-1-guild/28693/784) ---
**Author:** ![egsavage](https://sea1.discourse-cdn.com/flex001/user_avatar/community.frame.work/egsavage/32/16306_2.png) [@egsavage](https://community.frame.work/u/egsavage)\ **Post date:** [October 21, 2023, 5:07am UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/8 "2023-10-21T05:07:16Z")
If you’re interested in Ryzen AI support, especially on Linux, this article may be of interest. Make your voice heard. > **[AMD Wants To Know If You'd Like Ryzen AI Support On Linux](https://www.phoronix.com/news/Ryzen-AI-For-Linux-Requests)** > > With the newest AMD Ryzen 7040 series laptops there is 'Ryzen AI' as a dedicated AI engine based on Xilinx IP to help accelerate machine learning with the likes of PyTorch and TensorFlow ---
**Author:** ![Leonard](https://sea1.discourse-cdn.com/flex001/user_avatar/community.frame.work/leonard/32/28363_2.png) [@Leonard](https://community.frame.work/u/Leonard)\ **Post date:** [January 27, 2024, 3:44pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/9 "2024-01-27T15:44:26Z")
There is some progress: > **[AMD Publishes XDNA Linux Driver: Support For Ryzen AI On Linux](https://www.phoronix.com/news/AMD-XDNA-Linux-Driver-Ryzen-AI)** > > With the AMD Ryzen 7040 series 'Ryzen AI' was introduced as leveraging Xilinx IP onboard the new Zen 4 mobile processors ---
**Author:** ![Andy\_Wilson](https://sea1.discourse-cdn.com/flex001/user_avatar/community.frame.work/andy_wilson/32/21841_2.png) [@Andy\_Wilson](https://community.frame.work/u/Andy_Wilson)\ **Post date:** [February 10, 2024, 9:22pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/10 "2024-02-10T21:22:21Z")
Here is a tutorial that should get it working: [GitHub - AMDResearch/Riallto: The Riallto Open Source Project from AMD](https://github.com/AMDResearch/Riallto) ---
**Author:** ![tom\_chiverton](https://avatars.discourse-cdn.com/v4/letter/t/ed655f/32.png) [@tom\_chiverton](https://community.frame.work/u/tom_chiverton)\ **Post date:** [April 24, 2024, 11:50am UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/11 "2024-04-24T11:50:29Z")
Riallto appears to be Windows only ☹ I’m trying via the Discord for [https://lmstudio.ai/](https://lmstudio.ai/) (which is supported by AMD) but not getting very far so far - it only works with GPU offload turned off. Feel free to install and chip in ? ---
**Author:** ![bud](https://avatars.discourse-cdn.com/v4/letter/b/bcef8e/32.png) [@bud](https://community.frame.work/u/bud)\ **Post date:** [April 24, 2024, 2:05pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/12 "2024-04-24T14:05:10Z")
lmstudio is a wrapper around llama.cpp, which supports AMD GPUs through ROCm. ROCm does not support NPUs, though, only GPUs, so neither does llama.cpp and thus not lmstudio. ---
**Author:** ![tom\_chiverton](https://avatars.discourse-cdn.com/v4/letter/t/ed655f/32.png) [@tom\_chiverton](https://community.frame.work/u/tom_chiverton)\ **Post date:** [April 24, 2024, 7:56pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/13 "2024-04-24T19:56:19Z")
Although : [GitHub - huggingface/optimum-amd: AMD related optimizations for transformer models](https://github.com/huggingface/optimum-amd) ---
**Author:** ![JeremyT](https://sea1.discourse-cdn.com/flex001/user_avatar/community.frame.work/jeremyt/32/29747_2.png) [@JeremyT](https://community.frame.work/u/JeremyT)\ **Post date:** [October 4, 2024, 4:19pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/14 "2024-10-04T16:19:13Z")
Is there any update on this? Considering a Framework 16 purchase but also want to play with the ai features. ---
**Author:** ![Leonard](https://sea1.discourse-cdn.com/flex001/user_avatar/community.frame.work/leonard/32/28363_2.png) [@Leonard](https://community.frame.work/u/Leonard)\ **Post date:** [October 4, 2024, 7:37pm UTC](https://community.frame.work/t/ryzen-ai-with-amd-ipu-on-framework-laptops/36356/15 "2024-10-04T19:37:49Z")
For Linux: > **[AMD XDNA Linux Driver v3 Published For Ryzen AI Upstreaming](https://www.phoronix.com/news/AMD-XDNA-Linux-Driver-v3)** > > AMD engineers continue work toward upstreaming their XDNA kernel driver for Linux in enabling the Ryzen AI NPU on open-source Looks like it will land in kernel 6.13 earliest