./build_ref/rocm/bin/llama-cli --list-devices
ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
Available devices:
ROCm0: Radeon 8060S Graphics (63282 MiB, 63280 MiB free)
did you configure gtt or is it the defaut “VRAM” reported? (in my case default gtt…)