On: We could save petabytes of cache storage with Zstandard and Pingora

[a_t48]

I've done similar things for large container images. My format allows for using FastCDC to chunk files, but there's a tradeoff between number of shared chunks and between number of HTTP requests. I keep it turned off by default.