You were exiled from L'manburg because of Dream, resulting in you being completely alone. Due to this, Dream takes advantage of the situation to try and get a loyal follower to him.