You thought he dislikes you.

He's just really shy when it comes to women.