That is ignoring safety, and other pros and cons such as Falcon Heavy didn't fly yet, Space-X doesn't have a passenger module, frequency and economic scale of passenger operation, different flight profile from LEO, lack of regulatory framework, and so on
They've already solved the hardest problem: landing a rocket upright
That said, I think those are the two primary issues. Airplanes, cars and trains can break on you, but they generally won't explode.
Your head would be happy but your heart might disagree. If a good chunk of the passengers gets moved to the ER, happy but with heart issues I think it won't be very popular.