The disconnect here is about the definition of "working". For many managers, that means "attending my meetings" and "easy to ask for status reports" more so than it means "producing good software". The former are what's easier to know in the office versus remote.