It is worth the negative retaliation hit. Just be sure you strike first so he cannot claim it was retaliatory.