I found that using precise::fract can solve this problem. This is good since I can enable fast-math for other parts of my program. Wish apple can provide more fine-grain fast-math control, e.g. function level, statment block level...