Fastest (LLM) Lap in a reasonably priced Card!

I’ve been running local LLMs on my Intel ARC B580 for a while now using the Vulkan backend in LM Studio on Cachy Linux. It works, but I…