
Racism in and of itself doesn't have rituals and rites. The KKK is a specific group that does specific things. Similarly, despite how sweeping and institutionalized Jim Crow and apartheid were, they were specific manifestations of racism.
Christians are theists, but not all theists are Christian (or even religious). The KKK are racists, but not all racists are members of the KKK (even if they sympathize/agree with them). Nazis are fascists, but not all fascists are Nazis.
This isn't a difficult concept. Belief (or a lack thereof) in something doesn't equal a religion or institution. That requires behavior.