It depends on your employer. Here are two EXTREMELY broad types (so broad that they probably lose applicability to you):
Business employer: Even if you are able to convince your employer that working remotely would be better for your well-being, then once you leave, you will be treated like an outsourced employee. It will gradually grow on you, but you will be bc in their mind you won't have as good of a grasp on the business and you will be expendable.
Person who employ's you and it just happens to involve business: You're good.