Llama.cpp Vulkan AMD Radeon RX550 ARM Phytium D2000
#Llama.cpp #Vulkan #AMD #Radeon #RX550 #ARM #Phytium #D2000
“LivingLinux”
So far I wasn’t able to use OpenCL to work with LLMs. But I found that Llama CPP can work with Vulkan. That means that you can use a lot of older GPUs to work with LLMs.
sudo apt install git git-lfs cmake libvulkan-dev…
source
Concluzion: Llama.cpp Vulkan AMD Radeon RX550 ARM Phytium D2000 – Linux,LLM,ARM,Vulkan,Llama,CPP,GGML