Yes and no. It all depends on what people are taught to care about.

Saying something like “I hate your dress”, yes, that’s bad and doesn’t matter because the only person who should care is the person wearing it.

Saying something, however, like “Don’t do or say that to me” yes, absolutely should be said and people should respect that.