AI doomerism I've seen largely boils down to pretty standard critiques of capitalism -- who controls the means of production (the capital class), who will benefit most from increases in productivity (capital class), who is going to end up poorer (working class).
Unless you mean the folks who believe AI will become AGI and start hurting people directly. Those folks are pretty fringe.
Sva did say AGI doomerism, which I think is distinct from the more mundane and grounded concerns about how extant "AI" systems will effect the labor market, and related concerns. The LessWrong people talking about AIs exterminating humanity because we failed to worship it correctly, not the artists complaining about AI mimicking their style and turning art into a commodities available to anybody.
Unless you mean the folks who believe AI will become AGI and start hurting people directly. Those folks are pretty fringe.