I have a production SaaS product, used by 1,000's a day.
Server bills are $1,000/month. Heroku mostly and Digital Ocean.
I'm thinking of moving to a home server, setting up 2 servers (a Staging + Production), with 4 raspberry PI 5's as worker servers.
It seems I can get far better performance, with a < 3 Month payback period...
What am I missing??
Server spec:
Server ->https://pcbuilder.net/rigs/4sg24H/ - $988 /each x 2
+
Raspberry PI 5 ->https://www.raspberrypi.com/products/raspberry-pi-5/#:~:text=Buy%20now-,Specification,-Broadcom%20BCM2712%202.4GHz - $80 /each x 4
+
Hardware Firewall -> https://www.amazon.com/Fortinet-FortiGate-Firewall-Throughput-Protection/dp/B07ZZMFWJ7/ - $350 x 1
+
Switch -> https://www.amazon.com/NETGEAR-5-Port-Gigabit-Ethernet-Managed/dp/B07PJ7XZ7X - $25 x 1
Total = $2,671 (+ time and effort to config)
+ DataDog
Payback < 3 months
Power cuts - Not had one ever. But, could spin up a server if a ping of the home server goes down
Internet disruption - Not ever happened. But would have a 5G fall back router.
What am I missing?? Why is this not more common?
Many residential ISPs won't give you a static IPv4 address.
Most residential ISPs won't give you sufficiently symmetrical bandwidth.
VM hosting companies have spare hardware on hand, and can generally shift you either transparently or with minimal downtime to different hardware.
If none of these things are an issue for you, go ahead.
Personally, I wouldn't use RPi hardware, EVO 970s, 2TB spinners, or a Fortigate.
Four boxes, each with a 12 core CPU, 64 GB RAM, a 2TB NVMe with at least a 1200TBW lifetime, and a pair of 4-8 TB spinners in RAID1. One box runs staging including workers, one runs production including workers, one runs all your firewall, utility, administration and backups, and the fourth is configured and powered off -- once a month, power it up, bring it up to date, and shut it down. Someday you will need it as a spare or for capacity. Get extra NICs for all of them.
I would estimate $5K in hardware costs. Buy an online UPS and connect the production and utility boxes to it.