Is that what we're doing? If I remember correctly, the walls around the houses in my childhood neighborhood were only one brick in width. Also walls around cemeteries and such, I could swear they are not double-width walls.
Those are just veneers. My grandfather was a professional brick and stone mason. You can tell if a brick wall is load bearing if it has alternating directions: every so many bricks you’ll see one or more that’s been rotated 90° to connect the layers together