A perfect mirror has specular reflection, meaning it reflects all light in a single direction equal to what it receives.

Absolutely correct, and it is therefore the colour white, since we perceive something to be 100% white when all the frequencies are reflected and no frequency is absorbed by the material a perfect white light is signing on. The sun is a source that creates perfect white light.