That's what we've always tended to assume would happen, but now it looks like it may not go that way, thus my concern. If knowledge workers could be replaced first, I don't think anyone's going to wait around for robotics to catch up before doing anything.
> AI/Robots should replace physical labor before it replaces knowledge workers.
There's actually a kind of internet famous novel where the exact opposite happens. I don't remember the name of it or the site it's on, but initial premise has AI automating management (starting with pretty menial things like directing workers at fast food restaurant, and working its way up the value chain).
It was pretty interesting, but I only got as far as the protagonist getting interned in a kind of debtors prison once his savings ran out and he couldn't afford to live outside of it (due to all the automation). The prison was theoretically open, but if you wandered too far away, robots would tranq you (after very many "nice" exhortations to return) and you'd wake up back in your bed.