As they say, no good deed goes unpunished. Also? No one takes advantage of you without your permission. Knowing what you know about them and their life-sucking ways, if I were you, I'd stick to my guns and make a clean break.