I have found the issue solution. I had an error in my code. My manual one-hot-encoding function had an issue, that's why I got really weird results. Sorry about that and all the post. I can finally study again :).