There are symbols I wouldn't display and language I wouldn't use, which of course includes the stars and bars, but I do value the freedom to display and speak as I choose.
The solution is a conversation. People who are offended should be having conversations with those who display these things. It's called being an adult in a free society.
That said, banning the flag I am okay with too, yet there is that slippery slope.