\

Show HN: TurboGPT: train 22KiB transformer in 13s

33 points - today at 7:20 PM


Inspired by minGPT for home experiments.

Requires CUDA 13.4; build script is Windows only.

Source
  • vjsrinivas

    today at 9:55 PM

    Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.

    • jey

      today at 8:30 PM

      At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little

      • pane_poker_11

        today at 10:08 PM

        [dead]

        • fleshmonad

          today at 9:53 PM

          Who cares. This will not get you hired. Why do these submissions get any points at all. The same people who upvote this are the ones seething AI cannot create anything new. I don't see it. Not to shit on the work that went into this.

            • kadoban

              today at 9:59 PM

              Jesus. Would hate to see the work you _do_ want to shit on.