They were the first state in the US to grow them in quantity, although these days they are 3rd behind SC and Cali.
Peaches are just a niche fruit. Worldwide production is ~25M tons a year, mostly in China, with just under 1 million tons in the US. Oranges do about triple that, even more in the US.
How the heck did they come to be associated with peaches?