Ah, I see you never temped before. We have a nice command called /about that can exactly tell who did it and when it was done. You might have griefers trying to use your kindness to stay, telling them they are sorry. Some mean it, most don't. If they really feel sorry, tell them to make an appeal on the forums, then ban them, but most of the time they won't have time to cry before they are banned.
Before I forget, good luck!