Unless there's also a way to accurately extract the specific hue, you will never get anything accurate.
Anyone that ever wore foundation can tell you that human skin has tones, undertones, different reflective qualities, etc.
Just look at https://www.temptalia.com/wp-content/uploads/2018/05/summer-... or https://cdn.shopify.com/s/files/1/0009/0000/5932/files/Shade... or this https://pbs.twimg.com/media/B_zp3U1XAAAk4Iz?format=jpg&name=...