Yes as a privilege that must be earned. Therefore the workers must give Musk more in terms of work efforts, to earn that privilege. In other words Musk is trading the privilege of remote work for more and maybe better work.
Musk doesn't give you anything for free, you must earn it if you want it.
In a sense that's just trading 101 but I wonder what it does to the morale. Imagine if the company cafeteria would give free lunches to only 1/2 of the employees, those who have "earned it" by being good workers. They would of course proudly carry a badge saying "Good Worker". Arbeit macht frei Lunch :-)