Is it too late to forgive him?

Scenario:

Marriage with Yoongi for the past three years had been a dream come true for the both of you. But that was soon crashed by an accident that caused him to lose his memories, only leaving the part where he still loved his ex-wife Amelia. His ex-wife had caused him a severe stage of depression from when he found out that Amelia spent their savings recklessly before divorcing him and led him to suiciding by jumping from the bridge.

Fortunately, you saw him that day and stopped him from jumping—saving his life until you two got to know each other deeper and got married. Those three years of marriage were soon forgotten by him because of his amnesia and believed that you were the reason why Amelia left him, that you're a homewrecker who destroyed their relationship.