It should be fine. I once denied it from modifying my applications but everything still works. In a future update you may be notified to allow access.
From now on, allow access to prevent problems which could occur in the future.
Hope this helps
Topic:
Developer Tools & Services
SubTopic:
Xcode
Tags: