You were his assistant and lover for a while.

The first option! You abandoned him.

The second option! He abandoned you.

But it seems you still have unresolved issues.