I think we may have a different conception of what is determined as a right: I tend to conceptualise rights as inherent, things required to allow a human to live to the best of their ability. When we think of rights in this way, they aren't things that can be given; they can only be taken away or protected. If I build a hut when I'm stranded on a desert island, that's my hut and I shouldn't be forced out of it and no one else stranded on the island has a "right" to the product of my labour. If I spend time and effort gathering food, the other people on the island who haven't put that effort in don't deserve some of that food just because they're hungry. Now if I give them some out of pity or for the benefits of keeping a group around me, that's a different story than if they take it by force. If they take it by force, they've committed a moral wrong and violated the right required to live for me.
My approach is unforgiving but its from the perspective of individuals and their property rights. It doesnt exclude empathy and willing charity, just excludes forced empathy and charity.