Yeah, you're going to have trouble getting enough calories for hard work from eating broccoli for that matter. Wheat contains a lot of protein for a grain although it is terribly imbalanced and is best when complemented. Note protein requirements are higher when calorie input is low
They eat legumes. Chickpeas, lentils, beans, etc.
Meat is still superior, but not as extreme as your initial dichotomy.