How about a source that isn't a magazine interview from someone trying to sell their book?
There are sibling comments elsewhere in this thread that go into much greater detail than I can about how the link between plastic and fertility is tenuous at best. But the most significant piece of evidence against it IMO is that plastics are more or less evenly distributed. You don't have a lot more exposure at various socio-economic levels. But higher socio-economic class has a distinct negative correlation with obesity.