If it's file-level deduplication, sure. But if it's chunk-level, I think you may... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

FroshKiller on May 22, 2017 | parent | context | favorite | on: Rclone banned from Amazon Drive for having the enc...

If it's file-level deduplication, sure. But if it's chunk-level, I think you may find that you actually have many chunks identical to many other users' chunks.

nimrody on May 22, 2017 [–]

Unlikely given any non-negligible chunk size and accounting for the randomization effect of compression (image and video).

I think deduplication buys them most when people upload common assets - videos downloaded from the net, ebooks, ISO images, etc.

FroshKiller on May 23, 2017 | [–]

Doesn't compression generally reduce entropy?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact