The right way to think about surveillance, in the US anyway, is as follows: the right of the people to be secure in their persons, houses, papers, and effects, against unreasonable searches and seizures, shall not be violated, and no Warrants shall issue, but upon probable cause, supported by Oath or affirmation, and particularly describing the place to be searched, and the persons or things to be seized.
> does not include communications or other people's papers about you.
One could say that the type information I have is ill-relevant: it is still covered by the 4th amendment (it is my papers, houses, persons, effects). So, it doesn't make logical sense that information I hold about other people is in some way not covered under the 4th amendment.