I don't think Apple will do anything about providing a one click option, and that's for many reasons.
AMD-ROCm are responsible for making the GPU support AI use on an operating system (either macOS or Linux).
Current 1-click solution (after ROCm installation) is provided by Ollama. It works on macOS, but due to lack of ROCm support on macOS, ollama only uses CPU+RAM on macOS.
Apple's focus is on Apple Silicon (& MLX models?)
Mac Pro 2019 is officially discontinued. We're lucky to get hardware repairs in the coming few years.
On another note, regarding the AMD Radeon PRO W6900X being supported on Linux or with ROCm, I can confirm that it works, with the single change of adding the kernal flag "iommu=pt" in grub. Keep in mind that ROCm's documentation does not mention the W6800X or W6800X Duo; but only mentions the W6800. However, the W6800X & Duo work right out of the box. (assumingly due to being an almost exact replica to the standard W6800 on the inside)
Ollama even goes so far as to explicitly mention the W6900X, W6800X, & W6800X Duo, on Linux.
Here: https://docs.ollama.com/gpu & here https://ollama.com/blog/amd-preview
Topic:
Machine Learning & AI
SubTopic:
General
Tags: