Thank you for the kind words!
For the first time I had issues with the authorized_keys file, I didn't know about that file, and when I disabled password authentication on the SSH conf (yeah dumb move it was my first ever VPS) without testing the key authentication, I locked myself out from that box :). I needed to reset it via the shell provided by the VPS provider.