He won't let you take other characters into your team. In fact... What if he comes to your reality instead? Or..?