Barbarian was a Greek word, not Roman. The Romans made a point of inclusivity as their empire expanded around the Mediterranean. A Roman citizen could be any colour.
Tho' Nature, red in tooth and celt
With ravine, shriek'd against his creed
Red Celt's Blog