This is EXACTLY what Pontius Pilate said when the Jews brought Jesus before him for death...

....he said that he personally found no fault with him and he asked the Jews to consider an alternative. They would not, and Pontius Pilate said, "Well, I am not a Jew and this is a jewish concern so who am I to stand in the way of it>? I wash my hands of the affair".

That is precisely the same argument that you make about women and abortion.