Content-defined chunking added to Bazel
35 points - last Wednesday at 8:57 PM
SourceThis is something I'm very interested in implementing for Docker builds. I've tested out CDC for the final image outputs, it results in smaller outputs but requires tuning between saved space versus request count when pulling. For build cache it might be even more advantageous.
londons_explore
yesterday at 11:09 PM
Doesn't this mean that malicious inputs can deliberately cause super tiny or super huge chunks?
ramchip
yesterday at 11:53 PM
The same is true without CDC, and you can configure a maximum size.