Over several decades, they definitely do have that obligation. With just signs, it'd be hard to make a case for adverse possession, but easy to make the case for an easement.
If you're a little more permissive and let someone live in a little hut on your lawn, then after several decades, they'll own the lawn, and you won't.
