\

Content-defined chunking added to Bazel

35 points - last Wednesday at 8:57 PM

Source
  • a_t48

    today at 2:41 AM

    This is something I'm very interested in implementing for Docker builds. I've tested out CDC for the final image outputs, it results in smaller outputs but requires tuning between saved space versus request count when pulling. For build cache it might be even more advantageous.

    • londons_explore

      yesterday at 11:09 PM

      Doesn't this mean that malicious inputs can deliberately cause super tiny or super huge chunks?

        • ramchip

          yesterday at 11:53 PM

          The same is true without CDC, and you can configure a maximum size.