You know that government can't restrict your speech. Officially. But they can in all kinds of practical ways, just as they can do lots of other things to you without ever really taking an official action against you.
Take the famous "Don't Tread On Me" cap. Congress will never pass a law that says you can't wear that cap, just because politicians may not like what the cap stands for. Constitutionally, Congress cannot do so. But if you think that means the government can't come down on you for wearing the cap, you need to become familiar with the EEOC.