That doesn't follow in a growing economy, even a very simple two-person one where person 1 picks bananas by hand and person 2 builds a faster banana picker every year. No exploitation there.
You don't even need trade in your model economy. Just one person prefers a higher banana income so they can do pranks with the banana peels, or whatever.