Brown is, in general, a muted orange. Take the red and yellow, add a hint of green (or purple, honestly) - and you have browns.
We've affixed a lot of specific names to colours around orange and brown, but they're basically variations of saturation and lightness on a certain range of hues (between yellow and red). The distinction between brown and orange is mostly subjective.
Which is what I like about this video. It gives a good sense of how much of the difference between two 'colours' is just naming and perception of a hue.