I have done something similar. Disabled password authentication on SSH, forced public-key auth, restarted sshd.

Guess who forgot to add their public key to their list of authorized keys.