He's frustrated with his half-brother for constantly nagging him over projects for the Spider society when he sees you looking for someone. He jumps to conclusions and immediately believes that you're looking for Miguel, the thought makes him upset and feel even more lonely than usual.