\

Show HN: I wrote a 1-bit WebGPU runtime to run a 1.7B LLM in the browser

3 points - today at 5:05 PM

Source
  • debdattabasu

    today at 5:56 PM

    Wow this is a cool prototype and looks amazing. I am surprised some level of baseline intelligence survives this kind of aggro quantization. Do you think 300mb initial download is ok for something like quick website where I want to ask quick support question? Are you planning to have hosted fallback to answer q while download is happening?

    • stfurkan

      today at 5:36 PM

      [flagged]

      • today at 5:29 PM

        • today at 5:27 PM

          • today at 5:14 PM