...when people write "race baiter," they think "N word."

My guess is that applies to all uses of that phrase.