Evil must be dealt with in truth and with mercy. One who persists in evil must be stopped for the good of all. We are to govern ourselves to do good; yet we also appoint a government to govern our society, to insure that evil be removed. We're not doing a very good job, are we?
Some thoughts to ponder concerning how to respond to evil:
"Recompense to no man evil for evil." Romans 12:17
"Be not overcome of evil, but overcome evil with good." Romans 12:21
"By mercy and truth iniquity is purged: and by the fear of the Lord men depart from evil." Proverbs 16:6
"This, then, is the judgment: the light has come into the world, and people loved darkness rather than light because their deeds were evil. For everyone who practices wicked things hates the light and avoids it, so that his deeds may not be exposed. But anyone who lives by the truth comes to the light, so that his works may be shown to be accomplished by God."
"For government is God's servant to you for good. But if you do wrong, be afraid, because it does not carry the sword for no reason. For government is God's servant, an avenger that brings wrath on the one who does wrong." Romans 13:4
The world is a better place when people choose the good and not the evil.
The redemption of a fallen mankind, whose heart is darkened by evil, is that those who will believe the Creator and recieve the cleansing atonement through Jesus the Christ, will be given new hearts that will choose the good. The redeemed man is a "new creation", born by the Spirit of God into Righteousness.