Yes and no. Green bell peppers are underripe. But the final color depends on the variety. A red bell pepper doesn't turn yellow or orange, just directly to red. Yes, it looks odd!

Purple peppers and white peppers also exist.

Source: my parents like to grow them.