Is in the plan possiblities like 96GB VRAM alocate for AMD Ryzen 9 AI 37 HX?

Framework Laptop 13
1

Hi all,
I have a question is in the plan allow 96GB VRAM allocate for GPU? Technically it will be possible, there are no limitation, if RAM is for example 128GB there is no technical problem, or custom allocation?
It should be probably easy fix in BIOS setting.
The best purpose of this ““overkill” could be in using local LLM, for example GPT-OSS-120b looks great but need about 80GB of VRAM.
Thank you.
TheSysRat

2

This has been answered elsewhere, but you don’t need VRAM for LLM.

You use gtt / ttm allocations on AMD APUs.

e.g.

For 90GB:

#Otherwise it's capped to only half the RAM
options amdgpu gttsize=90000 #in MB
options ttm pages_limit=22500000 #4k per page, 90GB total
options ttm page_pool_size=22500000
1 Like