I’ve been trying to install rocm on the deck following this guide
(https://old.reddit.com/r/SteamDeckTricks/comments/102xxww/guide_how_to_install_rocm_for_gpu_julia/)
with the only exception that i used a generic ubuntu container on podman instead of using distrobox; I reach to the point where i need to use amdgpu-install to run rocm, but when i do it tries to install 30gb of files; which unfortunately it’s not feasible on my metered connection and storage (╥﹏╥). From what i saw from this issue on github there should be a way to select only the needed binaries for the specific chipset;
The question is, what should i do to install only the stuff necessary for the deck?
Sorry for the long post.
Try Vulkan in Koboldcpp https://github.com/LostRuins/koboldcpp/releases/tag/v1.81.1
I haven’t heard of anyone trying it on deck but I don’t see why it wouldn’t work.