After days and days of research this simple line fixed it for me. sudo pmset schedule cancelall

Well as Roberto saw it coming, my issue is not gone. It randomly starts during a restart (restarts in 1:30 min), after a certain time in sleep or even while using it. So it doesn't seem that theres a pattern but fot it to want me run a terminal line once a day. Typing "...cancelall" gives me about 24-40 hours. btw I'm on Ventura 22A5321d and theres no longer a way to set wake up schedules manually in settings. So you should solve it before updating.