Adding a note here in case someone else runs into this issue. I was able to resolve this by setting let modelConfig = MLModelConfiguration() modelConfig.computeUnits = .cpuAndGPU when initializing my model. This is likely due to this being a slightly older model.