Throwing the baby out with the bathwater

[KBKMNN]

I chose to put this in the Apostasy forum because that's what I am referring to. I'm sure we've all heard of the above statement and it's always made me shake my head. I've come across it alot lately regarding certain Christian leaders teachings (more than one). It's like those defending them say, oh I know that they said such and such, but I pick out the good parts and leave the rest. And then they tell me I shouldn't throw the baby out with the bathwater. :ohno Then they shake their heads at me when I say what if I had some cake with arsenic in it? Do I just pick out the poison and consume the cake? I can't. :ohno That may not be the best example though.
How would you respond to such statements? Any verses that come to mind would be appreciated.

[Hootmon]

On the whole it is reported that there is fornication among you, and such fornication as is not even named among the nations, so as one to have his father's wife. And you are puffed up, and have not rather mourned, so that he who has done this deed may be taken from your midst. For as being absent in body but present in spirit, I indeed have judged already as though I were present concerning him who worked out this thing; in the name of our Lord Jesus Christ, when you are gathered together, with my spirit; also, with the power of our Lord Jesus Christ; to deliver such a one to Satan for the destruction of the flesh, so that the spirit may be saved in the day of the Lord Jesus.

Your boasting is not good. Do you not know that a little leaven leavens the whole lump? Therefore purge out the old leaven so that you may be a new lump, as you are unleavened. For also Christ our Passover is sacrificed for us. Therefore let us keep the feast; not with old leaven, nor with the leaven of malice and wickedness, but with the unleavened bread of sincerity and truth.
(1Co 5:1-8)

[zhan]

I like the sewage water metaphor myself.
Take a glass, fill it with poo water ...
Take another glass, fill it with fresh water
Take an eye dropper, grab a couple of drops of the poo water and put it in the good glass.
Ask them which one they'd like to drink ...
most likely it would be 'neither' ;)

[Cloud Watcher]

I've always used "arsenic in the sugar bowl". The poo water sound REALLY icky. :puke

[Debbie M.]

The first thought to come to mind is " a little leven spoils the whole loaf". Even the devil mixes it up. He throws in a little "truth" with a big dash of falsehood. We should totally steer clear of ALL apostacy, even when its mixed in with truth.