@Jackill, from your conclusive experiment it seems that something goes wrong on inactivity.
Thus it might be interesting to test:
System Preferences > Energy Saver > Power Adapter
and as a bug hunting method, try the different settings which might block any thing which is fired upon inactivity.
Topic:
App & System Services
SubTopic:
Core OS
Tags: