I don't think anyone's going to call you mean for wanting someone to stay with you. [Everyone here had someone they missed after all, and he was no exception.]

You're always going to miss someone who leaves, even if it's for the best. I've felt that way too.