Hmmm. I thought "color" is the mix of the frequencies of the light being reflected and/or emitted. I wouldn't call other things that affect the appearance "color" at all.
For instance, you can have a flat blue and a glossy blue that are the exact same color.
While I think you're technically correct, my practical opinion is the two are essentially inseparable. Physical properties greatly affect how a color is perceived.
For instance, you can have a flat blue and a glossy blue that are the exact same color.