I’ll make two simple, general points.
In this country, we have a fine tradition of politeness and respect for others. Carefully choosing words and symbols so as not to cause offence is a case of simple politeness and respect for others.
Calling someone “racist” is pointless. It is almost impossible to prove and takes the debate down a blind alley. However, it is perfectly reasonable to call statements, actions and the use of symbols “racist”. It is no good claiming that words or symbols in your little bubble aren’t or weren’t considered racist. If they cause the members of another race or colour offence then they are racist. Full stop.