He cannot keep you against your will. YOU decide to end it. Change your phone, change your email. Change everything so that he cannot contact you.