Working around the house/village is still work. Male peasants for the most part don't work outside the house/village either. They usually work on fields that relatively close to where they live. And a large fraction of the women work alongside them. Older men and women - grandpas and grandmas, etc. - do a lot of the childrearing while the younger women work.