You described my experience well as well, except my abstract colorless ball was barely even visual. I was quite happy to entertain the idea of a ball on a table with very few concepts activated - roundness for the ball, flatness for the table, gravity holding the ball on the table. Rather like a physics problem.
When forced to dereference a color, it felt like an entire system was booted up. Not only did the ball have color, it also had specular reflections. There was lighting. The table gained an abstract sense of having texture.
What I find particularly fascinating is that my mind also assigned "red". I wonder if that is a coincidence, or a deep reflection of something about how brains work. Supporting evidence: in languages with only three words for color, the three colors are "light", "dark", and "red": https://en.wikipedia.org/wiki/Color_term#Stage_II_(red)
I'll also chime in and say I was able to visualize the generic ball-ness and as soon as the question of color arose, I also immediately picked red despite not being my favorite color or anything. I blame childhood depictions of balls lol
When forced to dereference a color, it felt like an entire system was booted up. Not only did the ball have color, it also had specular reflections. There was lighting. The table gained an abstract sense of having texture.
What I find particularly fascinating is that my mind also assigned "red". I wonder if that is a coincidence, or a deep reflection of something about how brains work. Supporting evidence: in languages with only three words for color, the three colors are "light", "dark", and "red": https://en.wikipedia.org/wiki/Color_term#Stage_II_(red)