You start avoiding him

he confronts you