Why would you limit the tool to strictly be for React?
"As per my limitations, I am designed to work specifically with React and TypeScript/JavaScript only. I cannot provide direct conversions to plain HTML/CSS or other frameworks."
Mainly to narrow the problem space: there's a lot of logic in our backend that we call "post processing" which is cleaning up the code after the AI generated it to
fix hallucinations. For example, the AI often gets import statements wrong or misspells icon names.
It's pretty interesting because every model seems to introduce a new set of hallucinations, so this is a problem that requires a lot of maintenance. We have this internal mantra to "use AI as little as possible" especially it's a problem that can be solved deterministically.
Also, because we are more focused on PMs, designers, and product leaders the code is largely an implementation detail. What they care about is being able to visually communicate their ideas, and React just happens to be a great way to do that because LLMs are great are outputting it + we have a pipeline to render it. (We are React developers ourselves.)
I'm curious, if you have that philosophy (which makes a lot of sense), you must have considered building is a sort of more abstract (but extensible) UI toolkit language and library and you could code in that then compile it down to React? Or have you found the benefit of large LLMs already having detailed React training is just too high?
> have you found the benefit of large LLMs already having detailed React training is just too high?
This.
We've tried a lot. We have been around since Oct 2023. First tried fine-tuning, but it's very hard to teach an LLM something new.
At one point, our product lived in a Figma plugin (https://x.com/Teddarific/status/1729153723728011618). To do this, we had the LLM output JSON, and then converted that to Figma nodes. This is sort of what you're saying. But the big issue was it would hallucinate many things and was really only good at the examples we fed it.
"As per my limitations, I am designed to work specifically with React and TypeScript/JavaScript only. I cannot provide direct conversions to plain HTML/CSS or other frameworks."