This definitely is not it, saying that as someone who grew up Catholic.

Even if the colours were tied to Jesus, why would the symbolism represent his death when the season is about his birth?

Some basic critical thinking proves your theory wrong.