What AI/ML Use Cases Should We Demo?

[Djip]

A small llama.cpp bench (it is the start we can get better… )

Request: verify dGPU support

OK, so -ctk bf16 -ctvbf16 w/o FA is actually a bit faster than the fastest run: (base) 130 lhl@cluster4:~/llama.cpp/llama.cpp-djip007-igpu-fp8 (feature/igpu_fq8)$ build/igpu/bin/llama-bench -mmp 0 -ctk bf16 -ctv bf16 -m llama-3.1-8b-instruct-bf16.gguf -p 1,2,4,8,16,32,48,64,128,192,256,384,512,768,999,1024 -n 16 ggml-igpu: backend[IGPU] create ggml-igpu: device[IGPU<0>::0] added: AMD Radeon Graphics (gfx1151) | model | size | params | backend | ngl | type_…