I paid the ROCm tax to train on this box. For inference I skipped it: Qwen3-30B on llama.cpp over Vulkan, about 80 tokens a second, nothing leaving the house.
The Driver I Didn't Install
I paid the ROCm tax to train on this box. For inference I skipped it: Qwen3-30B on llama.cpp over Vulkan, about 80 tokens a second, nothing leaving the house.