Thanks for the answer, I will continue to use extendedGamepad for now...

Thanks! This helped a lot! My main issue (or misunderstanding) was that I expected simd_make_float3() with a simd_float4 to do the division by the "w" value automatically, not just truncate it (that is why it never scaled). Works now...