I know any number of atheists and they are generally cheerful, law-abiding, moral people. The ones I know don’t go around demanding that symbols and acts of religious devotion by others be restricted.
I like the atheists I know even if they don’t believe in God or identify themselves as Baptists, Lutherans, Methodists, or any other faith group. It’s their choice. The more militant atheists, however, should let others make their choices, too. They should be able to get through a brief, public moment of prayer without being upset about it.