Thanks for your help, all of you
Well, Prashant, after reading your reply and Tiffany's, I spoke with the client again, and explained to him how is this affecting me and that I want to end the contract, and after a short discussion, I found out that he doesn't really know what he wants, so we agreed on ending the first contract and he pays me in full for all the work I've done, and we agreed on what is the next step, and we started a new contract with all things clear.
So after all, he wasn't a scam as I thought, just a client who doesn't know what he wants (which is a pain in the ***)
But really thank you all for your guidance, I was worried about taking a stand and say enough is enough, gonna be a dad soon and didn't want anything to affect my earnings.
And for that point about clients knowing the hot buttons, thanks for pointing that out, gotta keep it in mind and watch out for those