You want to go back on your word now, unless the old lady supports you, you can't.
To say the least, if you go back on your word and sign the agreement again, you will be satisfied. Can other families go back on their word and sign again? Then there is absolutely no need to sign this agreement.