Yes. Absolutely.
When talking about colors of white specifically:
The lower the Chroma value the closer a color is to a true neutral white and the greater odds it will be perceived as clean, clear, fresh.
The higher the Chroma value the more colorful the white is. In other words it will be easier to discern an amount of hue, the hue parent will be more evident. Compared to a lower Chroma color, odds are greater it will be perceived as dirty, grayed, aged, dingy.
No color of white is inherently dirty, grayed, aged, dingy.
Same as no color of white is in inherently clean, clear, fresh.
It's the context #1 and the light #2.
The rule of thumb to follow in order to manage both context and light is there has to be at least a 0.20 ish (plus or minus) difference in Chroma when combining colors of white.
Whether it's paint or material colors - the rule of thumb can serve you well.
The dimension of Chroma is where our perception of clean/vivid and gray/dirty comes from.
We can measure a color's Chroma. And if you can measure it, you can manage it. Ergo the 0.20 ish difference guideline.
Q