Flip the scenario. If the company was planning on letting you go, they would not change that date around based on what events you had going in your personal life.
Leave, don't feel bad, and no manager worth their title will think it reflects poorly on you personally or professionally.
Leave, don't feel bad, and no manager worth their title will think it reflects poorly on you personally or professionally.