Framework Laptop 13 Ryzen 7040 - Ryzen AI NPU use cases

[Finn_Wynono_Schmolke]

Hi everyone,

how are you using your Ryzen AI NPU?
I haven’t found a real application for the NPU yet and wanted to ask if anyone is using it seriously.

If I’m not mistaken, the NPU should actually enable Microsoft Studio Effects. However, I don’t see any settings options for it in the settings, or even the tile in the taskbar… Has anyone managed to get it working?

Maybe it’s because I’m using Windows 11 LTSC 24h2 and it’s simply not implemented there…

I’m looking forward to your answers!

[GreyXor]

Same question, but for Linux: while the amdxdna NPU driver is already available and functional, there are currently no applications making use of it.

[Brian_Gregory]

@GreyXor

NPU driver is already available and functional, there are currently no applications making use of it.

It seems to be the same situation on Windows 24H2.

[James_Bloom]

Thanks for this list

Framework 13 + Ryzen AI + Linux Distro + LLM

AMD Ryzen NPU support · Issue #5186 · ollama/ollama · GitHub Linux XDNA NPU Support · Issue #1254 · EricLBuehler/mistral.rs · GitHub Linux support · Issue #9 · amd/gaia · GitHub Running Your Model on XDNA under Linux · Issue #1 · AMD-AIG-AIMA/Instella · GitHub [Feature request] Any plans for AMD XDNA AI Engine support on Ryzen 7x40 processors? · Issue #1499 · ggml-org/llama.cpp · GitHub Linux? · Issue #2 · amd/RyzenAI-SW · GitHub

[Finn_Wynono_Schmolke]

It looks like microsoft studio effects might work if the appropriate MEP enumerator drivers were available, which are unavailable.

Perhaps @Kieran_Levin can explain why and whether this feature will work at some point?

@sgilderd

I can confirm that the engine is active on Windows (at least after installing the Framework driver bundle and the AMD adrenaline drivers). You can see the AMD IPU device under System Devices in Device Manager)

That said, Windows Studio Effects (which is the only functionality in Windows which uses a local AI processor) is not present. From searching a bit, I think there needs to be some additional AMD drivers provided (perhaps MEP enumerator) which seem to not be there.

I haven’t tried the development demo from AMD yet. Perhaps that works.

[Kieran_Levin]

MEP requires 3 drivers:
AMD MEP Driver.
Camera driver.
Microsoft MEP (From Microsoft)

The camera driver can be grabbed from the RyzenAI 300 driver bundle by extracting it: Framework Laptop 13 BIOS and Driver Releases (AMD Ryzen™ AI 300 Series)

The other drivers might be found from other sources. Microsoft did not enable support MEP on the 7040 series for us when we shipped that product.

[Finn_Wynono_Schmolke]

Thanks Kieran!
I extracted the RyzenAI 300 drivers:

08_Camera_10.0.22000.20357 → This is the camera driver you mentioned
09_Realtek_MEP_Opt-in_10.0.22000.10003 → Can’t be installed
10_AMD_MEP_ext_32.2.0.0 → Can be installed
11_MEP_2.0.11 → Can be installed

Actually, it’s not working. I’m not sure whether drivers 09 – 11 are compatible with the 7040 Framework.

I think Microsofts MEP driver can be downloaded from here:
1. Windows Studio Effects Driver from Microsoft Update Catalog
2. Windows Camera Effects Driver from Microsoft Update Catalog

These .cap files from Microsoft can be easily installed with this tool:
CabInstaller (GitHub)

@Kieran_Levin Do you have any other tips or recommendations? I don’t really have any experience with this.

[Finn_Wynono_Schmolke]

I also tested various drivers for the HP Elitebook 845 14 G10, Acer Swift Edge 16 and Lenovo ThinkPad T14 Gen4, as these are based on the 7840u and have microsoft studio effects.

Well, somehow it worked and somehow it didn’t.
When I open the camera app, the tile with the studio effects appears in the taskbar, but when I try to click on it, the quick options menu opens instead…

Nevertheless, nothing has changed in the settings. No Studio Effects appear in the camera tab, and nothing has changed in the ai components tab either…