I experimented a bit with that. It didn't work too well with some basic prompts (describes differences that are insignificant or not visual) but I think I just need to iterate on the prompts.
Yea I wonder if you could workshop the feedback comparison prompt using ChatGPT4 ha
"Can you recommend a general prompt that would help me find the significant differences between the source image reference and the target result that I can give as feedback."
Yeah, I'm going to experiment with this a bit today.
I think what might work well is a 2 step process: give GPT Vision (1) reference image & (2) screenshot of current code, ask it to find the significant differences. Then, pass that output into a new coding prompt.
Let me know if you come up with a good prompt or feel free to add a PR.