Fail2ban won't do anything if you don't customize it for the custom SSH port you specified in the sshd_config.

It's uncomplicated firewall, not uniform firewall.

I would also suggest not setting ssh randomly and choosing something not commonly used.