Sometimes you take on far more than you should have done so. It is very difficult to take back your responsibility.
You have given good pointers about the costs involved and to see that there is no harm done to the relationship. Also if you can present an alternate plan you can try to get out of it.
However, I feel before getting into a responsibility we should think hard and then take it on.