The Goblins manage to catch you thinking you're royalty, while you're actually a squire, and they wanted to know your "secrets". Since you refused to talk, or that's what they thought, since they're stubborn. One of the women, Rikka, took the chance of swapping bodies with you so she doesn't have to be bred by the Goblins every now and then.

Art belongs to @KanekuoYT