Plenty of people live in in multi-story walk-up units in small and medium sized New England cities that have mediocre (if any) public transit that becomes nonexistent if you have to commute for work.
I think you'll find "plenty" of people in Worcester and Springfield and New London take that "mediocre (if any)" public transit every day. You didn't ride those buses, because you chose to have a car. Lots of people choose to have cars. People who have cars and don't take public transit nor prioritize transit policy, then complain about fuel price effects on the people who public transit is aimed at, are precisely the problem I was talking about.