Not just sugar and fat though; eat plain bread made without any salt or seasoning; you will eat less than bread made other ways. Same for unseasoned potatoes.
And there is a really interesting effect I've noticed which I think of 'sugar blindness' which is that when I stopped eating a lot of sweet things my taste buds became more attuned to the taste of sweet. So things that weren't sweet before, are now. Its really an odd thing to experience.
Anedoctically, it's a thing the other way around too. When I moved to the UK from Italy, lots of foods tasted too sweet to me. After a year here, I don't feel that any more.
