After a few comments mentioned I was probably wasting money using AWS Lightsail, I finally tried out Hetzner Cloud for hosting my Ghost Blogs.
Since ARM is new and interesting, I picked the 4$ ARM Ubuntu server for hosting. After experimenting with a few different alternatives, I installed Captain Rover again( it's still the easiest solution here).
The only thing I really had issues with was getting the A records to work right. I had some weird franken system where I had the domains on a different register, pointing to AWS name servers, pointing to Hetzner Cloud.
This was really confusing and didn't work right, so I migrated the domains over to AWS. I'm happy to say both of my blogs are working fine now.
Both of these are near no traffic blogs, so I have no idea how this would behave under load. 4$ is a great deal compared to the 30$ a month I was spending before.
Whenever I have time I can see myself using Hetzner for other projects.
Thanks HN.