\

Nvidia announces native GPU programming in Rust

616 points - yesterday at 11:15 AM

Source
  • jacobgorm

    yesterday at 10:54 PM

    I strongly dislike CUDA. Once you have allowed that proprietary cr*p into your C++ codebase, it is very hard to get rid, and you end up with code that is either tied to a single vendor or an #ifdef hell, probably both.

    The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually, like in Metal, OpenCL, and D3D12, etc. These days we even have DSLs like Triton that make kernel writing much more ergonomic than anything you would hope to achieve in Rust.

      • tombert

        yesterday at 11:44 PM

        > I strongly dislike CUDA. Once you have allowed that proprietary cr*p

        Genuine question...why not just type "crap"? It's not even that much of a curse, but I've never really understood the point of self-censorship. If you don't want to curse then you could just use a non-curse word.

          • xbmcuser

            today at 12:33 AM

            * is used to give emphasis and show that they are using the word as curse word rather just calling it bad

              • josephg

                today at 2:13 AM

                It doesn't read as emphasis to me. It reads like the person is trying hard not to curse, and they think "crap" is a curse word. It's a little bit adorable, like I'm reading a comment from an obedient child.

                  • xbmcuser

                    today at 3:48 AM

                    I guess you are not from the generation of texters. This how languages work we used to use * as a way to avoid getting censored it over time became a way to curse or give emphasis.

                      • nairboon

                        today at 8:00 AM

                        Is that a cultural/national thing instead of an age thing?

                        I've never had texts censored by texting providers, they're not supposed to read texts in the first place (at least around here).

                        • josephg

                          today at 4:13 AM

                          Sounds like a generational thing.

                          I grew up texting. But in the 90s any profanity filters could just be turned off in settings.

                            • 10729287

                              today at 4:47 AM

                              People are getting used to censor themselves in order not to be reported, banned, or «hurt » other sensibilities. The words « rape » couldn’t be written in instagram for example, what a great way to deal with such a serious issue. Mainly an American thing spreading away from young people if you ask me. Sorry America, just being honest here.

                                • sampullman

                                  today at 6:31 AM

                                  America is partly guilty, but TikTok censorship is a big part of the younger generation's tendency toward self censorship.

                                    • bragh

                                      today at 6:50 AM

                                      As much as I personally dislike TikTok, I don't think it is fair to it: cultural willingness for more sensor sheep on Internet started years before TikTok's popularity in the west.

                                        • sampullman

                                          today at 7:51 AM

                                          It's not the sole cause, but I believe it's the main driver behind a bunch of specific substitutions that are mainstream now or nearly so. For example, dih, ahh, and unalive. They may not have been invented on tiktok, but that's where they incubated.

                                      • well_ackshually

                                        today at 7:58 AM

                                        There's no such censorship on TikTok, it's entirely groupthink based on people saying "when I use that word my video is seen less so therefore it's being censored".

                                        Youtube is a lot more guilty of it though, as well as demonetizing.

                                • nairboon

                                  today at 8:02 AM

                                  You had profanity filters for SMS?

                              • saberience

                                today at 6:50 AM

                                I’ve been texting since it was first a thing (sms on Nokia phones) and no one I knows does this. We just say shit, fuck, and crap.

                        • Tade0

                          today at 7:59 AM

                          I think a string of non-alphanumeric characters would work much better here, like "Once you have allowed that proprietary @#$&% into your C++ codebase”

                          Leaves more to the imagination.

                          • westonmyers

                            today at 4:57 AM

                            In any context I've seen, asterisks are for wrapping formatting and said formatting it to add emphasis. So being in the habit of typing `emphasised phrase`, for italics - regardless of whether the platform parses markdown/similar formatting, e.g. SMS.

                            To have an unclosed asterisk replacing characters in a word? I've only ever seen that as a way to bypass censorship. This spans communications from people currently in their 40s down to 20.

                            • vladde

                              today at 6:27 AM

                              i do this to put emphasis, i always type "h*ck".

                              (although it is a half-joke since it's definitely not a curse word imo)

                              • lsofzz

                                today at 3:36 AM

                                like for example, c*nt?

                                  • kbenson

                                    today at 3:47 AM

                                    Maybe more like p**p, as in "that cunt p**ped in my yard"?

                                    I'll admit, it never once occurred to me that people might be using censored characters to provide more emphasis that a word is a swear, but I guess it does indeed do that, at least to the writer. Whether that comes across to the reader, and whether the writer cares that their intention was understood... I'm not so sure.

                                      • fc417fc802

                                        today at 6:04 AM

                                        What about ^#%& as was traditional in newspaper comics strips?

                                          • ElFitz

                                            today at 6:22 AM

                                            How about "Pockmark!... Freshwater swabs!... Bully!.." or "Amoeba! Bashi-bazouks! Chowderheads! Certified Diplodocuses! Nyctalop! Ectoplasm!"?

                                              • yehoshuapw

                                                today at 7:41 AM

                                                "Your mother was a hamster and your father smelt of elderberries!"

                                        • lsofzz

                                          today at 5:11 AM

                                          Hah. Yeah, I agree. It's one of those things I admit is `lost in translation` for sure.

                              • vachina

                                today at 4:41 AM

                                Platform may retroactively make up and enforce rules that makes your content violate terms (and remove them)

                                See YouTube.

                                  • tombert

                                    today at 5:46 AM

                                    I certainly dislike how everyone on YouTube is saying “SA” and “unalive” and “corn”.

                                    It’s one thing if it’s some funny commentary channel avoiding those words, but what bothers me is the true crime YouTubers. In the subject of true crime, rape and murder are just things that are probably going to come up, and when they refuse to use the appropriate language, it comes off as infantilizing, which is weird considering that my actual YouTube account is over 18, let alone the viewer using it.

                                    Advertisers ruin everything, I guess.

                                      • pferde

                                        today at 7:53 AM

                                        It's become so bad that even quality history youtube channels are frequently using euphemisms like "moustache-man" instead of just saying "Hitler", to avoid their videos being buried by The Algorithm, and therefore cut severely into their viewership.

                                          • magicalhippo

                                            today at 8:00 AM

                                            I think it's a win-win. Intelligent people easily knows what they're talking about, and the others don't get offended. /s

                                • lovelearning

                                  today at 12:14 AM

                                  It may be to bypass censorship, rather than self-censorship. Some platforms block or shadowban comments with curse words. Not sure about this platform.

                                    • arcanemachiner

                                      today at 12:44 AM

                                      HN definitely doesn't give a crap about that word.

                                        • tombert

                                          today at 1:10 AM

                                          I have written many words far worse than "crap" on this site. I haven't gotten in trouble over it yet.

                                          I do find it a little amusing, because commenters stopped criticizing my cursing the moment I started getting a good chunk of karma here. I remember in 2016 someone criticized me for using the term "shitposting"...I don't think I've gotten that kind of criticism since 2016 though.

                                            • Tade0

                                              today at 8:01 AM

                                              Back then the term was still associated with 4chan.

                                              • protocolture

                                                today at 3:07 AM

                                                They dont like "seppo" for some reason.

                                            • today at 5:07 AM

                                              • smnplk

                                                today at 1:01 AM

                                                can confirm, looks like crap is not on a list

                                                  • flamedoge

                                                    today at 1:40 AM

                                                    pretty crappy list

                                        • capl

                                          today at 5:40 AM

                                          cause you might go to the eternal flames if you say a no-no word online

                                            • brobdingnagians

                                              today at 6:19 AM

                                              Your comment only makes sense in context if you believe in a deity who is too dumb to understand the difference between cr*p and crap. I for one do not worship a Bayesian spam filter.

                                              • Cthulhu_

                                                today at 6:18 AM

                                                [dead]

                                            • ImHereToVote

                                              today at 7:09 AM

                                              What if a toddler is browser HN and sees the curse word?

                                              • jimbob45

                                                today at 5:21 AM

                                                His kids were probably watching him type over his shoulder and he didn’t want to hear, “Daddy, what does crap mean?”

                                                  • Cthulhu_

                                                    today at 6:20 AM

                                                    "Daddy, what does cr*p mean?" Kids aren't stupid and this self-censorship isn't protecting anyone from anything.

                                                    (if a platform is serious about Bad Words for whatever reason (moral?) they would also forbid character replacements; ultimately it's the intent, not the word itself, that they try to steer with rules like that)

                                                    • tombert

                                                      today at 5:48 AM

                                                      I am arguing that they would ask that anyway.

                                                      I guess I never understood censorship when it’s plainly obvious what you’re censoring. Anyone who can read will clearly know that it said “crap”, so I don’t see how it’s fundamentally different than just saying the word. You still put the word into my brain.

                                                  • c0nducktr

                                                    today at 3:41 AM

                                                    My guess is that jacobgorm will not reply. I would love a reply, because I want to understand how others think.

                                                    I believe we'll be left to wonder.

                                                • fg137

                                                  yesterday at 11:16 PM

                                                  > Once you have allowed that proprietary cr*p into your C++ codebase

                                                  People have been doing that all the time for every kind of codebase. It's just part of the business. I don't see how it's worth having any emotions or opinions about it. Seems like you are wasting your energy.

                                                  Are win32 APIs proprietary? So you decide to use them, use a wrapper/UI framework, or don't develop for Windows. Easy choice.

                                                  Developing for embedded devices? So you read the manufacturers manual and implement based on the spec, use some sort of HAL if they are available, or you don't have a job. Even simpler.

                                                    • infamouscow

                                                      today at 3:50 AM

                                                      Many software engineers forget they're employee of a business.

                                                      • worik

                                                        today at 2:09 AM

                                                        > Are win32 APIs proprietary?

                                                        Yes. And crap. Not in my code bases.

                                                          • josephg

                                                            today at 2:15 AM

                                                            If you're going to make apps in windows, you need to call their proprietary API somehow. Maybe you do it via a wrapper library, or via electron or something. But that's the same thing, just with more indirection.

                                                              • ux266478

                                                                today at 2:41 AM

                                                                Find a way to get ring 0 without touching any system APIs and you can just make your own APIs. My programs shall never say "please."

                                                                  • estebank

                                                                    today at 3:23 AM

                                                                    Your programs shall never grace my systems.

                                                            • fsloth

                                                              today at 4:30 AM

                                                              The CPU on most machines is quite proprietary. I don’t understand this faux purity dogma.

                                                              Practical computing is not and never has been an abstract pure concept. It’s about making machines built by corporations to do usefull things at scale.

                                                              There is no ”non proprietary” computing unless you make your own stack.

                                                                • preg_match

                                                                  today at 4:49 AM

                                                                  Yes but there are business costs to using high-level proprietary tools and libraries. If you write your app using win32, you won’t be able to port is very easily. You’re also stuck with whatever bad or bizarre decisions Microsoft made.

                                                                  It’s even worse for CUDA. GPUs are expensive, and now you’re vendor locked. You’re between a rock and a hard place. Either spend millions in engineering time, or millions on price-gauged hardware.

                                                                    • fsloth

                                                                      today at 5:44 AM

                                                                      ” If you write your app using win32, you won’t be able to port is very easily.”

                                                                      This is wrong way around.

                                                                      If you don’t support the platform your app runs on using the native api:s to the hilt your port is just bad.

                                                                      If you actually want to support multiple platforms _you actually need to support_ them from the ground up.

                                                                      This is speaking industrially and businesswise. A professional software business always has per-platform implementation resources. Or they have just one platform. Or they pretend they are multiplatform and then _everybody_ _daily_ fights with the problems this causes.

                                                                      Obviously those elements that can be portable should be. It’s like Einsteins simplicity maxim - your codebase should be as portable as can be but not more.

                                                                      ” It’s even worse for CUDA…”

                                                                      No these are just the business and market constraints. If this does not make sense for your offering then don’t use it. This feels like false FOMO - CUDA is not a silver bullet but it might be a specific solution to a specific problem.

                                                                      • Asmod4n

                                                                        today at 6:38 AM

                                                                        Win32 is the most stable abi on the Linux desktop.

                                                                        • pjmlp

                                                                          today at 5:20 AM

                                                                          I wonder which APIs you would use to port easily, because POSIX and Khronos aren't it either, as they are industry standards driven by companies where one has to pay for a seat at Open Group and Khronos offices.

                                                                            • fsloth

                                                                              today at 5:53 AM

                                                                              There is no ”easy” porting.

                                                                              Once this is accepted the rest becomes easier as you are not wasting time trying to find a silver bullet.

                                                                              I mean it’s then ”just normal work”.

                                                                                • pjmlp

                                                                                  today at 6:04 AM

                                                                                  Exactly.

                                                                          • socalgal2

                                                                            today at 5:33 AM

                                                                            > If you write your app using win32, you won’t be able to port is very easily.

                                                                            Is this still true? eg, Shopify saying porting is now easy so no need for abstractions.

                                                                • jacobgorm

                                                                  yesterday at 11:29 PM

                                                                  CUDA is not an API, CUDA is a language, so you cannot make that comparison.

                                                                    • pjmlp

                                                                      today at 5:22 AM

                                                                      CUDA is neither an API, nor a language, it is an ecosystem.

                                                                        • fc417fc802

                                                                          today at 6:07 AM

                                                                          That's a nice way of saying that it's a dependency clusterfuck.

                                                                          I've never understood why we can't just expose the GPU ISA directly the way the CPU does. It's all getting compiled down at the end of the day so someone has to write a compiler for it either way. We'd be substantially better off IMO if it was all built directly into LLVM and then let middleware sort out the details.

                                                                            • pjmlp

                                                                              today at 6:16 AM

                                                                              Because even CPUs rather use JIT runtimes to deal with the various kinds of ISAs that exist.

                                                                              Naturally plenty of folks rather use software that doesn't take advantage of the hardware they paid for.

                                                                              • imtringued

                                                                                today at 7:18 AM

                                                                                That would require vendors to either stick with a single backwards compatible ISA like intel did for x86 or document how their graphics cards work.

                                                                                CPUs manage this by changing the internal micro-architecture, but historically GPUs only needed to support a graphics API and used that abstraction layer to freely change the hardware.

                                                                        • esseph

                                                                          yesterday at 11:49 PM

                                                                          > The CUDA runtime is a special case of one of the libraries provided by the CUDA Toolkit. The CUDA runtime provides both an API and some language extensions to handle common tasks such as allocating memory, copying data between GPUs and other GPUs or CPUs, and launching kernels. The API components of the CUDA runtime are referred to as the CUDA runtime API.

                                                                          From: https://docs.nvidia.com/cuda/cuda-programming-guide/01-intro...

                                                                  • nicwilson

                                                                    today at 12:40 AM

                                                                    Launching kernels manually is an error prone PITA which I believe is the principle reason for CUDA's popularity. Having the compiler give an error when you mess up is a huge benefit. But having the compiler allow you to express "I want to launch this kernel over a grid with these dimensions, with these arguments" as a single expression is where the vast majority of the value comes from.

                                                                    The having it all in a single file is mostly an artefact of the fact that it is C++, because C++ is single file at a time compilation. In D (which is multiple files in a single compiler invocation) with DCompute (which targets CUDA and OpenCL with upcoming support for Vulkan and Metal), you are required to write the kernels in a separate module, but you get all the benefits of the compiler complaining when you mess up _and_ the expressivity of "launch me this kernel".

                                                                      • oblio

                                                                        today at 5:09 AM

                                                                        > Having the compiler give an error when you mess up is a huge benefit.

                                                                        Shouldn't this be alleviated by the current code generation machines?

                                                                          • nicwilson

                                                                            today at 5:44 AM

                                                                            Well yeah, but then you are using code generation, not writing code directly.

                                                                    • winwang

                                                                      today at 1:44 AM

                                                                      Having also played with Metal and WebGPU (at least years ago), I would say that CUDA is, amazingly, the best GPGPU API we have. Do I wish we had an open source parallel programming language as good or better than it? Yes. But asymmetrically hating on CUDA like this is how we continue to lag behind it in UX.

                                                                      > The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually

                                                                      Not to mention that this is a completely sane way to use CUDA as well.

                                                                        • pjmlp

                                                                          today at 5:24 AM

                                                                          People that attack proprietary APIs always miss the point why most devs outside FOSS circles prefer them.

                                                                          Turns out when one isn't ideologically against something they aren't willing to put up with a lesser experience just for the cause.

                                                                            • darkwater

                                                                              today at 6:37 AM

                                                                              I know it's not the same thing because proprietary vs open software it's way less important but, generally if you are not ideologically against something you can easily follow the stream and do lot of nefarious actions, especially if the action has enough degrees of separations from the actual nefast outcome.

                                                                      • pavon

                                                                        yesterday at 11:02 PM

                                                                        > The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually

                                                                        Isn't that how CUDA code is normally written?

                                                                          • jacobgorm

                                                                            yesterday at 11:31 PM

                                                                            No. CUDA allows you to write all the code in a single file, and uses a preprocessor to split it back out and pass it through separate compilers, one for host and one for device.

                                                                              • compiler-guy

                                                                                yesterday at 11:41 PM

                                                                                This true, but you can write the two separately if you want.

                                                                                The disadvantages of writing them together are listed in the various parent posts. But some code authors really like the convenience of having the two in the same file.

                                                                        • harrison_clarke

                                                                          today at 4:13 AM

                                                                          from what i can tell, you're going to be stuck with that no matter what you do

                                                                          i'm currently using vulkan, and HLSL via dxc. which should be portable but it's not.

                                                                          apple refuses to support vulkan, and relies on moltenvk and there's a bunch of OS/hardware/driver differences no matter what you do, that you'll probably have to feature test for, and compile a few different versions of your code no matter what you do

                                                                          i think if you're doing something that you don't have to distribute to customers, just picking one stack and getting locked in has some appeal.

                                                                          it leaves you vulnerable to lockin. but, especially in the age of ai, "claude, port this to vulkan" seems like a good enough defense against that

                                                                          • melodyogonna

                                                                            yesterday at 11:04 PM

                                                                            You could also use Mojo, one language for all targets.

                                                                              • adgjlsfhk1

                                                                                today at 12:21 AM

                                                                                Or julia if you want a much more mature ecosystem.

                                                                                  • patagurbon

                                                                                    today at 12:31 AM

                                                                                    I highly recommend Julia for (scientific) GPU programming but it would be nice if there was a larger community and/or funding behind the GPU side of things. It has very few core devs for what it is.

                                                                                • carefree-bob

                                                                                  yesterday at 11:05 PM

                                                                                  I began to lose interest after the acquisition. Have you been following along, are they still going to open source it?

                                                                                    • ecl3ctic

                                                                                      yesterday at 11:12 PM

                                                                                      The Mojo compiler has been open source for over a month now.

                                                                                      And the Mojo standard library has been open source for over a year.

                                                                                      It’s all open source. Go check it out!

                                                                                        • carefree-bob

                                                                                          yesterday at 11:46 PM

                                                                                          Nice, thank you. There is an old python project I've been thinking about converting to Mojo.

                                                                                      • YuechenLi

                                                                                        yesterday at 11:09 PM

                                                                                        I thought they already did and released the compiler source code under Apache 2.0.

                                                                                • 15155

                                                                                  today at 1:58 AM

                                                                                  I don't mind CUDA, I do mind that all of the SDKs don't dynamically load the various CUDA shared libraries at runtime.. intertwining itself into your application linking process makes for extreme binary portability inconvenience.

                                                                                  • throwaway334212

                                                                                    today at 2:44 AM

                                                                                    Anyone here looking at Modular's offerings?

                                                                                    • anon291

                                                                                      today at 2:19 AM

                                                                                      ? I find it hard to see the issue here. Just put it in a separate file and call it?

                                                                                      • bigyabai

                                                                                        yesterday at 11:00 PM

                                                                                        Is this satire? D3D12 and Metal aren't any less proprietary than CUDA.

                                                                                          • yesterday at 11:08 PM

                                                                                        • cpill

                                                                                          yesterday at 11:22 PM

                                                                                          yeah, just write a stub/wrapper around it and abstract. it's the classic coupling problem. nothing to do with CUDA

                                                                                          • wangxili1997

                                                                                            today at 7:46 AM

                                                                                            [flagged]

                                                                                            • unPeuResilient

                                                                                              today at 6:55 AM

                                                                                              [dead]

                                                                                          • dllu

                                                                                            yesterday at 10:22 PM

                                                                                            Since NVIDIA owns huggingface now and huggingface has the excellent Candle [1] crate for inference on Rust, this seems like a good step towards nice native Rust kernels.

                                                                                            [1] https://github.com/huggingface/candle

                                                                                              • jacobgorm

                                                                                                yesterday at 10:56 PM

                                                                                                Nobody cares if kernels are written in Rust. Kernels were meant to be written in C, but if you want to go more high-level try Triton or a similar DSL that nicely abstract tile sizes etc.

                                                                                                  • keithnz

                                                                                                    yesterday at 11:27 PM

                                                                                                    kernels aren't meant to be written by any defined language. C is just a traditionally good default language that took over from assembly. No particular reason we have to stick with C.

                                                                                                      • chadcmulligan

                                                                                                        today at 12:47 AM

                                                                                                        And quite a few reasons that something better than C should be used. Rust seems a good candidate.

                                                                                                    • Anoian

                                                                                                      today at 7:56 AM

                                                                                                      I have never seen a comment this gray

                                                                                                      • pjmlp

                                                                                                        today at 5:27 AM

                                                                                                        That is exactly why OpenCL failed adoption, focusing on C, instead of being polyglot like CUDA.

                                                                                                          • zozbot234

                                                                                                            today at 5:53 AM

                                                                                                            SYCL is the natively polyglot counterpart, with practical implementations of it compiling down to the same sort of SPIR-V kernels as OpenCL. (OTOH, much of the current adoption on the open standards side seems to target the more widely supported SPIR-V compute shaders, via Vulkan compute.)

                                                                                                              • pjmlp

                                                                                                                today at 6:01 AM

                                                                                                                Not really, first of all it is for C++, not the range of languages supported by CUDA.

                                                                                                                Before SPIR was a thing in OpenCL, Khronos could not understand why anyone would care about anything else other than C99, or why supporting Fortran on GPUs was at all relevant.

                                                                                                                Secondly, from the competition only Intel cares about SYCL with their own sugar on top, OpenAPI.

                                                                                                                AMD hasn't cared one second about it.

                                                                                                                You may mention Codeplay, which is anyway an Intel owned company since 2022.

                                                                                                                As for Vulkan, it doesn't have neither the features, nor the tooling that CUDA enjoys, it is the usual putting up with using LEGOs from different brands, with various pin sizes, that is so common with Khronos.

                                                                                                        • yesterday at 11:14 PM

                                                                                                          • cpill

                                                                                                            yesterday at 11:18 PM

                                                                                                            oh no no no, this is going to break the CPP hold on AI and game dev.

                                                                                                              • pjmlp

                                                                                                                today at 5:28 AM

                                                                                                                Nah, Rust compiler still needs C++ to be built in first place, and everyone on AI uses LLVM as infrastructure.

                                                                                                    • Swiffy0

                                                                                                      today at 8:03 AM

                                                                                                      My understanding is not so deep regarding GPU programming or Rust... Does this mean anything regarding Nvidia GPUs and WebAssembly / WebGPU?

                                                                                                        • onion2k

                                                                                                          today at 8:08 AM

                                                                                                          No. Rust is a non-web programming language.

                                                                                                      • winwang

                                                                                                        today at 1:39 AM

                                                                                                        Really exciting but it reads like Claude instead of what Nvidia posts have generally been like in the past. I don't need nor want my tech blogs to sound like a young adult novel.

                                                                                                          • aabhay

                                                                                                            today at 3:13 AM

                                                                                                            I’ve had this happen to me several time over the past weeks and it’s gone from quaint to humorous to farcical to outright “is-the-world-gaslighting-me” insane.

                                                                                                            Just today I was reading Stanley Druckenmiller’s op ed in WSJ. This dude is like 80 and has made billions of dollars, and he got Claude to write his op ed???

                                                                                                            Unbelievable. And the tells are so obvious, yet people still love the Claude-like quips and odd grammatical choices that read like halfway asshole halfway mid-sentence confusion.

                                                                                                              • sebmellen

                                                                                                                today at 8:10 AM

                                                                                                                That op ed was absurd. I respect Druckenmiller a lot and am always impressed with his lucidity in interviews. The Claude “ick” was all over his writing.

                                                                                                            • IshKebab

                                                                                                              today at 6:56 AM

                                                                                                              Yeah definitely Claude. Lazy authors, if you're going to get AI to write for you please use Astra instead - it makes way less annoying prose than Claude.

                                                                                                          • HexDecOctBin

                                                                                                            today at 5:36 AM

                                                                                                            Anyone know when Rust's std::autodiff will become stable? Assuming this Rust support expands to other GPU vendors, autograd will probably be the only reason to use Slang instead of Rust anymore.

                                                                                                              • chkmr

                                                                                                                today at 7:14 AM

                                                                                                                I was told in the 2025 LLVM dev meeting that it will always stay in nightly because it's not practical for them to provide long-term stability guarantees that is expected of stable Rust.

                                                                                                                • minraws

                                                                                                                  today at 7:04 AM

                                                                                                                  Not in 2026.

                                                                                                              • michalsustr

                                                                                                                today at 6:37 AM

                                                                                                                Not a cuda programmer, but since they’re making a new API, why would they already make it inconsistent at start? :-/ I’m referring to the examples a,b,c vs z,x,y (different ordering of output elements)

                                                                                                                • manyatoms

                                                                                                                  yesterday at 11:01 PM

                                                                                                                  How does this compare to vectorware? (https://www.vectorware.com/blog/)

                                                                                                                    • LegNeato

                                                                                                                      today at 1:24 AM

                                                                                                                      VectorWare founder here. We are working with them and stoked they are investing more in Rust. I just gave a talk at RustConf about our different takes (https://rustconf2026.sched.com/event/2KNQj/making-gpus-feel-...). The video isn't up yet but you should check it out when it is. The efforts are complementary.

                                                                                                                      • binarybana

                                                                                                                        today at 2:10 AM

                                                                                                                        Towards the end of the post, we (NVIDIA) mention that this work was done in collaboration with Vectorware and others in the Rust community. And we can't wait to build further with the community.

                                                                                                                    • evaltoken

                                                                                                                      today at 1:23 AM

                                                                                                                      Interesting direction from Nvidia. Anything that makes writing reliable GPU code less painful is definitely a good thing.

                                                                                                                      • salsa_catsup

                                                                                                                        today at 2:46 AM

                                                                                                                        Does this mean I can write shaders in Rust for use with WGPU or Vulkan?

                                                                                                                      • lsofzz

                                                                                                                        today at 3:39 AM

                                                                                                                        I read this the other day - definitely think it is the right direction Nvidia is taking.

                                                                                                                        Thank you NVIDIA - for once (not twice though - you've given us nothing but despair for Linux+GPU).

                                                                                                                        • jtfrench

                                                                                                                          today at 5:01 AM

                                                                                                                          I wonder how many parallels there are between CUDA's Tile abstraction and that of Metal.

                                                                                                                          • the__alchemist

                                                                                                                            yesterday at 10:20 PM

                                                                                                                            I'm looking forward to trying these when they stabilize! I currently use WGPU for graphics, and cudarc for CUDA.

                                                                                                                            Note: Cuda-oxide is similar to Cudarc's host component, but uses a rust-style kernel dialect. Advantage: Share structs between host and device. Disadvantage: Trading standard Cuda kernels for a new, WIP dialect.

                                                                                                                            I haven't tried the tile API yet; looking forward to it.

                                                                                                                            The last time I checked, Cuda Oxide was Linux only, and required Async; these are why I haven't tried it yet.

                                                                                                                              • embedding-shape

                                                                                                                                yesterday at 10:36 PM

                                                                                                                                cudarc been great for me, because it's easy to look up existing examples and references, and it maps 1-to-1 with what I see. I'm already having a tough time with CUDA itself, a dialect of it makes a tad harder to rely on previous work.

                                                                                                                                Seems more ergonomic in general though, both approaches they share, compared to cudarc, and less build infrastructure and fiddling with environments, which is great.

                                                                                                                            • calini

                                                                                                                              today at 6:24 AM

                                                                                                                              Do it in Go and I’m interested

                                                                                                                              • m00dy

                                                                                                                                today at 7:02 AM

                                                                                                                                Thank you Nvidia !! You're in the right path.

                                                                                                                                • claiir

                                                                                                                                  yesterday at 10:28 PM

                                                                                                                                  > The launch is checked rather than trusted.

                                                                                                                                  Damn even Nvidia is putting out fully Claude-written articles.

                                                                                                                                    • bayindirh

                                                                                                                                      yesterday at 11:10 PM

                                                                                                                                      That's actually a magnificent observation. This is not only an indication of a keen eye, but a trained brilliant mind as well.

                                                                                                                                        • hitekker

                                                                                                                                          yesterday at 11:16 PM

                                                                                                                                          You’re absolutely right!

                                                                                                                                          • jubilanti

                                                                                                                                            today at 12:45 AM

                                                                                                                                            One might even say it is load-bearing on the seam!

                                                                                                                                              • lioeters

                                                                                                                                                today at 3:27 AM

                                                                                                                                                Why this is important: it's the honest take.

                                                                                                                                        • keybrd-intrrpt

                                                                                                                                          yesterday at 11:20 PM

                                                                                                                                          > even Nvidia

                                                                                                                                          Why "even Nvidia"?

                                                                                                                                          They are fully behind using AI for basically everything.

                                                                                                                                          What's next? "Damn, even McDonald's is putting out unhealthy food"

                                                                                                                                            • manquer

                                                                                                                                              today at 12:43 AM

                                                                                                                                              I think implication being organizations with 40,000+ employees and even more consultants and contractors plus a lot of budget are also using LLMs to draft public facing content instead of paying for content writers or even just proof readers .

                                                                                                                                              It points to friction rather than cost economics. Same reason we are always surprised why multi billion dollar product companies with millions of install base prefer electron instead of a native app.

                                                                                                                                                • freeopinion

                                                                                                                                                  today at 1:14 AM

                                                                                                                                                  This does not imply that the organization is not paying for content writers or proof readers. It does suggest that they are not getting the value of paying for content writers or proof readers.

                                                                                                                                                    • simpaticoder

                                                                                                                                                      today at 1:33 AM

                                                                                                                                                      It does suggest that they are not accurately measuring the value of paying for content writers or proof readers.

                                                                                                                                                      People and companies are hungry for knowledge about people's reactions, but the modern internet DOES NOT give an accurate image of people's views.

                                                                                                                                                      • latentsea

                                                                                                                                                        today at 1:40 AM

                                                                                                                                                        No. It suggests they don't mind littering slop into the information environment.

                                                                                                                                                    • pjmlp

                                                                                                                                                      today at 5:32 AM

                                                                                                                                                      Of course, that is the whole point of using AI to replace workers.

                                                                                                                                                      Only devs think it isn't coming for them, it is empowering and nothing else will happen, no team reductions, nah how come.

                                                                                                                                                  • jchw

                                                                                                                                                    yesterday at 11:36 PM

                                                                                                                                                    Sure, but even Anthropic doesn't appear to use Claude for blog posts. (I don't think anyone should. The prose stinks.)

                                                                                                                                                      • keybrd-intrrpt

                                                                                                                                                        today at 12:02 AM

                                                                                                                                                        Anthropic _absolutely_ does

                                                                                                                                                        They are just better at hiding it or configuring Claude.

                                                                                                                                                        I have several skills that reformat text to remove AI-speak tells.

                                                                                                                                                          • rkharsan64

                                                                                                                                                            today at 2:27 AM

                                                                                                                                                            According to https://news.ycombinator.com/item?id=49417480, Anthropic hires writers who do not use LLMs, and reading their updates I also feel that they don't use LLMs for communication.

                                                                                                                                                            • jchw

                                                                                                                                                              today at 12:08 AM

                                                                                                                                                              Prove it.

                                                                                                                                                                • WD-42

                                                                                                                                                                  today at 12:13 AM

                                                                                                                                                                  https://news.ycombinator.com/item?id=49249269

                                                                                                                                                                  I put the "humanized" output through Pangram and it still comes out as 100% AI generated.

                                                                                                                                                                    • jchw

                                                                                                                                                                      today at 1:20 AM

                                                                                                                                                                      To be honest with you, I don't think I would be able to identify with high certainty that the bottom text is AI generated, so it definitely goes a long way to obscure the AI-generated nature of it, but I also think it still feels unnatural somehow. I realize my framing naturally calls into question whether I'm being honest, but I am being honest. Given my experience with similar "skills" (it's just chunks of prompt, nothing magical after all) I expected even less.

                                                                                                                                                                      But still, this is all very strange because it wasn't that many generations of AI models ago that AI writing was a lot better - I'm talking GPT 4.1, Claude 4.5, that sort of era.

                                                                                                                                                                      Anthropic newsroom posts on the other hand are carefully constructed and well-written in a way that I have not seen demonstrated by LLMs yet, past or present. I expect that they have well-paid staff who are careful with every detail of their public communications. When you put it that way, it almost feels unfathomable that they wouldn't, doesn't it?

                                                                                                                                                                      • breezybottom

                                                                                                                                                                        today at 1:09 AM

                                                                                                                                                                        That's about as useful as saying you asked the magical sky fairy.

                                                                                                                                                                          • meowface

                                                                                                                                                                            today at 2:04 AM

                                                                                                                                                                            Pangram has an extremely low false positive rate. Even on adversarial examples.

                                                                                                                                                                            One trade-off is even some obviously LLM text won't get detected by them, but they work really hard to ensure false positives are rare since a false accusation is much worse for society than someone getting away with LLM meatpuppetry.

                                                                                                                                                                            • jchw

                                                                                                                                                                              today at 1:30 AM

                                                                                                                                                                              I think you can't trust Pangram in a high stakes situation, but it is absolutely better than random noise at detecting AI-generated text. Which isn't surprising. If the distribution of probabilities can yield blatant Claudisms, it's not surprising it would also have more subtle deviations.

                                                                                                                                                                              (Addendum: As I recall, LLM-generated outputs roughly follow Zipf's law, but the distribution still tends to have some subtle distinctions vs human text; pretty interesting, but I don't know where I heard this, so nothing to cite. Sorry.)

                                                                                                                                                                      • saghm

                                                                                                                                                                        today at 2:01 AM

                                                                                                                                                                        I don't feel like either one of you really has a strong claim. "Doesn't appear to" is subjective, and of course it's impossible to prove one way or another.

                                                                                                                                                                          • jchw

                                                                                                                                                                            today at 2:31 AM

                                                                                                                                                                            You're simplifying the exchange a little too much. I said:

                                                                                                                                                                            > Anthropic doesn't appear to use Claude for blog posts

                                                                                                                                                                            My claim is literally the lack of evidence, which, yes, can't prove anything. This claim can be contested easily by showing evidence that they in fact, do appear to be using Claude to write prose in blog posts.

                                                                                                                                                                            They said:

                                                                                                                                                                            > Anthropic _absolutely_ does

                                                                                                                                                                            Sounds pretty certain Anthropic is in fact, using Claude to write blog posts. Enough to emphasize "absolutely". That doesn't read like "I'm going off of vibes", that reads like "I can prove it". So, fine. Prove it. I don't believe it, and I want to hear the proof.

                                                                                                                                                                            I'm skeptical, but it wouldn't be my first time being wrong. But flatly, if you make claims with this kind of certainty, yes I want to hear your proof.

                                                                                                                                                                            My point in saying "Even Anthropic doesn't appear to be using Claude for blog posts" was not meant to be some striking revelation, I literally was considering it a prior to make another point. This on the other hand sure does sound like a striking revelation to me, that a lot of people across the Internet would be curious to hear. Like I'm sure these people would be interested:

                                                                                                                                                                            https://www.reddit.com/r/ClaudeAI/comments/1wdfd92/are_anthr...

                                                                                                                                                                            I will admit that I am unnecessarily aggressive sometimes, but I wouldn't have changed my response much in any case. If you're going to make a strong claim like this, I want your evidence, not your vibes. Otherwise, the claim should be a lot weaker.

                                                                                                                                                                            I also realize that this sort of brashness upsets HN a bit, but it is what it is. I pandered comments for votes in my 20s a bit, time to grow up, sometimes people won't like you. Sometimes I feel something deserves a brash response.

                                                                                                                                                                              • saghm

                                                                                                                                                                                today at 3:06 AM

                                                                                                                                                                                I don't really have any opinion on your tone; I just still don't agree with your framing. A lack of evidence would be neutral like "there's no evidence to indicate either possibility is more likely", but your phrasing conveyed that one possibility was more likely than the other. I pushed back against your follow-up because it seemed like you were arguing for a higher threshold of evidence than you provided.

                                                                                                                                                                                  • jchw

                                                                                                                                                                                    today at 5:01 AM

                                                                                                                                                                                    Well, to be fair, you're correct. I am asking for a higher threshold of evidence. It's a stronger claim. I feel a stronger claim deserves stronger evidence.

                                                                                                                                                            • saghm

                                                                                                                                                              today at 1:59 AM

                                                                                                                                                              Their CEO also has the dubious distinction of claiming we've reached AGI more then once: https://www.theverge.com/ai-artificial-intelligence/985597/j...

                                                                                                                                                              • RickHull

                                                                                                                                                                today at 2:07 AM

                                                                                                                                                                Is Jensen Huang still all-in on OpenClaw? That moment feels more like a flash in the pan.

                                                                                                                                                                • dannyw

                                                                                                                                                                  today at 12:51 AM

                                                                                                                                                                  I believe most of their marketing videos use fairly convincing text to speech too, not voice actors.

                                                                                                                                                                  • dprkh

                                                                                                                                                                    today at 1:03 AM

                                                                                                                                                                    McDonald's food is not even that unhealthy. I just tried a Burger King burger the other day and it's terrible. I think it's like 2000 calories in a single burger or something.

                                                                                                                                                                      • timacles

                                                                                                                                                                        today at 1:51 AM

                                                                                                                                                                        > I think it's like 2000 calories in a single burger

                                                                                                                                                                        that would be pretty cool, you can just get your entire day's calories from one burger

                                                                                                                                                                          • dprkh

                                                                                                                                                                            today at 1:58 AM

                                                                                                                                                                            I couldn't even finish it man, it was so fucking sloppy. I had to throw away like 40% of it.

                                                                                                                                                                        • calvinmorrison

                                                                                                                                                                          today at 1:12 AM

                                                                                                                                                                          found the McShill. The King will hear of this!

                                                                                                                                                                      • huflungdung

                                                                                                                                                                        today at 12:27 AM

                                                                                                                                                                        [dead]

                                                                                                                                                                        • yesterday at 11:23 PM

                                                                                                                                                                      • daemonologist

                                                                                                                                                                        today at 12:10 AM

                                                                                                                                                                        I get the impression that Nvidia employees don't care too much - I started seeing fully AI-written "documentation" on some of their smaller projects more than a year ago (i.e., before it was even slightly a good idea).

                                                                                                                                                                          • DonsDiscountGas

                                                                                                                                                                            today at 12:13 AM

                                                                                                                                                                            People never really read documentation before. Agents do read it now, and they seem to understand LLM-written text just fine.

                                                                                                                                                                              • WD-42

                                                                                                                                                                                today at 12:14 AM

                                                                                                                                                                                > People never really read documentation before.

                                                                                                                                                                                The heck you talking about? How do you think we wrote software for the last 50 years?

                                                                                                                                                                                  • californical

                                                                                                                                                                                    today at 12:26 AM

                                                                                                                                                                                    Yeah lol it’s basically the only reliable way to know how things work. Pre-AI, I read documentation for libraries that I used almost every day.

                                                                                                                                                                                    And now with AI I’m using it to fact check Claude. And still reading it for myself to understand why other peoples code is written a certain way. It’s basically the most important thing to reference when coding.

                                                                                                                                                                                    Sure today Claude can just read the library code and tell you what a function does or how to do something. But it still won’t tell you why something is a certain way or won’t figure out specifically-designed usage patterns as reliably as the author telling you “this is an example of doing x”

                                                                                                                                                                                      • phatskat

                                                                                                                                                                                        today at 1:11 AM

                                                                                                                                                                                        I really appreciated a friend reaching out to me with some PHP questions today. It was, to me, fairly basic but he was having a hard time grokking the documentation vs reading what his coworker wrote (some code using output buffering).

                                                                                                                                                                                        I brushed up on the docs since I haven't touched it in a couple years, explained my understanding of the ob_* functions, and gave him a very brief demo on a PHP playground.

                                                                                                                                                                                        He could have asked any LLM to tell him what that chunk of code did, and to explain the three functions, and instead he reached out to me. That felt _good_. Talking shop has always been a good way for me to form connections, because the pressure to socialize becomes task-oriented and you start to learn about how people think and feel, and that opens up easier paths for actual connection. It was nice.

                                                                                                                                                                                        Just like the Old Internet still exists - niche websites, mailing lists, probably a BBS or two (likely more right?), the pre-LLM world will trudge on, for a time. I hope LLMs actually lead to good things for people in the long run, and for now I personally will remain sparse in my usage of them.

                                                                                                                                                                                          • WD-42

                                                                                                                                                                                            today at 1:31 AM

                                                                                                                                                                                            Where do you work? Sounds nice!

                                                                                                                                                                                        • stevemk14ebr

                                                                                                                                                                                          today at 1:00 AM

                                                                                                                                                                                          only reliable way to know how things work is to reverse engineer them

                                                                                                                                                                                            • californical

                                                                                                                                                                                              today at 4:26 AM

                                                                                                                                                                                              But that’s my point, it’ll tell you how things work. In libraries I’m using, you can just read the code yourself.

                                                                                                                                                                                              You need the documentation to know why certain things work a particular way, or to know why some relationships or methods are the way they are

                                                                                                                                                                                      • Vegenoid

                                                                                                                                                                                        today at 1:28 AM

                                                                                                                                                                                        My absolute greatest skill in my career, that has consistently set me apart from my peers, is that I read documentation thoroughly.

                                                                                                                                                                                        It is shocking how much of a differentiator this is. You will discover that the software you’re already using is much more capable than you realized.

                                                                                                                                                                                          • jtfrench

                                                                                                                                                                                            today at 1:47 AM

                                                                                                                                                                                            The good news is your attention to actually reading and understanding documentation will differentiate you more and more as others (short-sighted, IMO) outsource understanding to an LLM.

                                                                                                                                                                                        • bee_rider

                                                                                                                                                                                          today at 1:17 AM

                                                                                                                                                                                          Copy past the example code, then tweak until it breaks? If we were meant to read documentation, not reading it would cause a compiler error!

                                                                                                                                                                                          • Barrin92

                                                                                                                                                                                            today at 12:24 AM

                                                                                                                                                                                            when you start to internalize that these kinds of statements are an indication of how the average developer of the last 10-15 years operated the adoption rate of AI makes a lot more sense

                                                                                                                                                                                              • WD-42

                                                                                                                                                                                                today at 12:28 AM

                                                                                                                                                                                                This is extremely depressing, I think I'm coming around to the realization that you may be right and I've been naive my entire career.

                                                                                                                                                                                            • groundzeros2015

                                                                                                                                                                                              today at 1:05 AM

                                                                                                                                                                                              A small percentage of engineers

                                                                                                                                                                                          • dannyw

                                                                                                                                                                                            today at 12:52 AM

                                                                                                                                                                                            What? People never read documentation?

                                                                                                                                                                                            I start with reading and exploring documentation first; with the codebase as a secondary tab.

                                                                                                                                                                                            When it’s not LLM generated, documentation is supposed to be easier to read and more insightful than code.

                                                                                                                                                                                            • latentsea

                                                                                                                                                                                              today at 1:42 AM

                                                                                                                                                                                              >People never really read documentation before.

                                                                                                                                                                                              Speak for yourself. I read it.

                                                                                                                                                                                              • today at 12:18 AM

                                                                                                                                                                                        • karim79

                                                                                                                                                                                          today at 12:24 AM

                                                                                                                                                                                          What are we for, I ask? What the hell are we now. Chatters to LLMs now? Is this our future? It really is starting to feel like it now.

                                                                                                                                                                                            • freeopinion

                                                                                                                                                                                              today at 1:23 AM

                                                                                                                                                                                              Do you have the stomach to walk into a high school in the USA these days? Teachers use AI to generate assignments. Students feed the assignments to AI and submit the responses. Teachers feed the student submissions to an AI for grading.

                                                                                                                                                                                                • iamarobot

                                                                                                                                                                                                  today at 2:42 AM

                                                                                                                                                                                                  As a high schooler going to a school with stricter rules on AI than most in my area, I can say that it's been going downhill ever since GPT 4. Teachers constantly use AI to create assignments(my French Teacher regularly handed us work with GPT 5.1 prose and emojis). Students are also rampantly using AI and bypassing school restrictions(We have a google account, making it easy to use Gemini if we just sign out), causing an inflation in GPAs and test scores. There's no easy solution to the problem, banning AI-tools only help somewhat as even typing into Google has AI web results, and students are quickly overcoming ways to restrict them. I have a friend that vibe coded an application that allowed his Mac Mini's desktop to be mirrored on his school chromebook, bypassing every restriction with sub 1-second latency. Of course, that opens the can of worms to whether schools should allow students to use AI...

                                                                                                                                                                                                    • oblio

                                                                                                                                                                                                      today at 6:59 AM

                                                                                                                                                                                                      > Of course, that opens the can of worms to whether schools should allow students to use AI...

                                                                                                                                                                                                      We are starting to see results indicating cognitive decline due to AI in education, so no, we should do everything possible to ban it except for very limited fields.

                                                                                                                                                                                                      LLMs aren't calculators or even computers, their generated output is too flexible, generic and basically starts replacing thinking.

                                                                                                                                                                                                      Most likely they should only be allowed during late highschool years or just at university level, when people at least have a chance to learn how to research on their own.

                                                                                                                                                                                                  • upboundspiral

                                                                                                                                                                                                    today at 2:28 AM

                                                                                                                                                                                                    I know many teachers who actually have respect for the profession, themselves, and the students. Thankfully that means they don't do this.

                                                                                                                                                                                                    Whether this is a widespread macro trend is another issue, and would be terryfying.

                                                                                                                                                                                                    If true, however, it would reflect on the values of the organization: we have spent decades underpaying teachers, and doing a poor job of pretecting schools from frivoluos lawsuits. Add into that, districts have thrown money into new buildings, have been suckered by Big Tech to adopt their policies (common core was pushed by Big Tech and has been a distaster as well as computers in classrooms). As a nation (the USA) we can't get our act together for a rigorous national exam, etc etc.

                                                                                                                                                                                                      • freeopinion

                                                                                                                                                                                                        today at 4:19 AM

                                                                                                                                                                                                        About half of the states in the USA require the ACT or SAT for high school graduation.

                                                                                                                                                                                                        Alabama is one state that requires the ACT. The mean score in Alabama is below 18/36. Wisconsin is another. Its students score on average about 1 point higher than the national average of 19.4/36.

                                                                                                                                                                                                        If you prefer states that require the SAT, the mean SAT score of students from Delaware is less than 980/1600, about 50 points below the national average.

                                                                                                                                                                                                        I'll leave it to others to argue about whether these exams are rigorous.

                                                                                                                                                                                                    • karim79

                                                                                                                                                                                                      today at 1:33 AM

                                                                                                                                                                                                      Please tell me this is not true.

                                                                                                                                                                                                        • Orochikaku

                                                                                                                                                                                                          today at 1:45 AM

                                                                                                                                                                                                          This is true even at the undergraduate level unfortunately…

                                                                                                                                                                                                            • karim79

                                                                                                                                                                                                              today at 2:17 AM

                                                                                                                                                                                                              Then here we are. AI apocalypse. Something of note. I've started to pay more attention to canned goods. Soups with lentils and so forth.

                                                                                                                                                                                                                • oblio

                                                                                                                                                                                                                  today at 7:03 AM

                                                                                                                                                                                                                  FYI, the world is a lot more decentralized than we think and even during the Dark Ages, guess what, that was happening in Europe and many places in the world were booming scientifically, technologically, etc.

                                                                                                                                                                                                          • meowface

                                                                                                                                                                                                            today at 2:15 AM

                                                                                                                                                                                                            It's true of most work in many and soon most white collar jobs, too. Claude writes some dense useless thing, everyone else uses Claude to summarize and write a reply to the thing. The Claude-submitted PRs get automatically reviewed and commented on by a GitHub Claude review bot. The programmer asks Claude to check out Claude's review comments to Claude. Claude pushes a commit to the branch and writes a comment. The Claude review bot reviews the commit and leaves a comment. The human [...].

                                                                                                                                                                                                            My hot take is that it's not really that terrible in the long run for work since I think LLMs will probably be nearly or actually AGI and better white collar workers than most humans within 5 years of today. But it is very funny and surreal in the meantime.

                                                                                                                                                                                                            It is definitely bad for school, though. Kids IMO should actually be encouraged to use LLMs but not in or for class work outside of an AI best practices class. Probably stop giving them homework (90% will always try to find a way to make AI do it) and have them solve problems in class hours with no electronics so that they're forced to not defer learning. This will become even more important once we have AGI.

                                                                                                                                                                                                              • oblio

                                                                                                                                                                                                                today at 7:02 AM

                                                                                                                                                                                                                > LLMs will probably be nearly or actually AGI

                                                                                                                                                                                                                What if they don't?

                                                                                                                                                                                                                > This will become even more important once we have AGI.

                                                                                                                                                                                                                What if we achieve AGI in 50+ years? Should everyone live in this Kafkaesque world until then?

                                                                                                                                                                                                    • arcanemachiner

                                                                                                                                                                                                      today at 12:40 AM

                                                                                                                                                                                                      Dude I am in slop fucking hell right now. There is still room for a human touch, without which the agents will lever us harder and faster into a world of incomprehensible garbage.

                                                                                                                                                                                                        • karim79

                                                                                                                                                                                                          today at 12:46 AM

                                                                                                                                                                                                          I totally concur. I'm almost lost for words at this stage. I need me some land to grow vegetables on and that's about it. Maybe some chickens. Every single day brings more despair (and not the prosperity we were promised).

                                                                                                                                                                                                            • sejje

                                                                                                                                                                                                              today at 1:18 AM

                                                                                                                                                                                                              I have land and chickens, and I'm really excited about the future & AI.

                                                                                                                                                                                                                • jtfrench

                                                                                                                                                                                                                  today at 1:45 AM

                                                                                                                                                                                                                  Land, chickens, and private local AI running sustainably on the farm sounds like the least dystopian version of this AI future!

                                                                                                                                                                                                                  • karim79

                                                                                                                                                                                                                    today at 1:27 AM

                                                                                                                                                                                                                    I'm also an optimist but the crash is imminent. I hope I am wrong.

                                                                                                                                                                                                                • freeopinion

                                                                                                                                                                                                                  today at 1:18 AM

                                                                                                                                                                                                                  Good luck with that. You will have to pry the water from the AI datacenters.

                                                                                                                                                                                                                    • sejje

                                                                                                                                                                                                                      today at 1:19 AM

                                                                                                                                                                                                                      Do you know that's not really a thing or are you just wanting to help spread the propaganda?

                                                                                                                                                                                                                        • Zambyte

                                                                                                                                                                                                                          today at 2:09 AM

                                                                                                                                                                                                                          ... doesn't one of those imply the other?

                                                                                                                                                                                                          • karim79

                                                                                                                                                                                                            today at 3:21 AM

                                                                                                                                                                                                            I find it interesting that this was downvoted twice without explanation.

                                                                                                                                                                                                        • pjmlp

                                                                                                                                                                                                          today at 5:30 AM

                                                                                                                                                                                                          Another of those AI is bad for articles, great for coding.

                                                                                                                                                                                                          Plenty of us share the same opinion on doing reviews of AI generated code.

                                                                                                                                                                                                          • written-beyond

                                                                                                                                                                                                            today at 12:14 AM

                                                                                                                                                                                                            I hadn't read the article and read this comment as though NVIDIA themselves were implying that this library was checked but not trusted by them since it was fully LLM generated.

                                                                                                                                                                                                            • pyrophane

                                                                                                                                                                                                              today at 1:14 AM

                                                                                                                                                                                                              Yeah. I think if the text is written for other machines, then by all means have an LLM generate it, but if it is intended for a human audience, have a human being write it.

                                                                                                                                                                                                              We are still much better at writing in a way that doesn't waste other people's time.

                                                                                                                                                                                                              • manyatoms

                                                                                                                                                                                                                yesterday at 11:00 PM

                                                                                                                                                                                                                not to worry, they have an 'AI generated summary' box too

                                                                                                                                                                                                                  • greenavocado

                                                                                                                                                                                                                    yesterday at 11:16 PM

                                                                                                                                                                                                                    Its a recursive summarization pyramid

                                                                                                                                                                                                                      • smallmancontrov

                                                                                                                                                                                                                        today at 12:48 AM

                                                                                                                                                                                                                        It gets fun when someone uses an uncensored model to bypass a refusal, but they accidentally pick one that was trained for erotic writing and brings its particular talent to the documentation task.

                                                                                                                                                                                                                        • pizzafeelsright

                                                                                                                                                                                                                          yesterday at 11:30 PM

                                                                                                                                                                                                                          This thread flags an honest assessment of AI signal detection.

                                                                                                                                                                                                                  • jorl17

                                                                                                                                                                                                                    today at 1:22 AM

                                                                                                                                                                                                                    It is the number 1 thing I cannot stand with Claude slop. It's a sort of anthropomorphization of language. Every "thing" does, produces, feels, wants, asks, answers, etc....

                                                                                                                                                                                                                    - "Launch is checked"

                                                                                                                                                                                                                    - "Question is asked"

                                                                                                                                                                                                                    - "The implementation answers"

                                                                                                                                                                                                                    - "The model wants"

                                                                                                                                                                                                                    - "The results name"

                                                                                                                                                                                                                    - "The connection surfaces"

                                                                                                                                                                                                                    - "The prompt wires"

                                                                                                                                                                                                                    - "The feature rides the mechanism"

                                                                                                                                                                                                                    Every single fucking thing is alive, wants things, and does things.

                                                                                                                                                                                                                    It's terrible. Infuriating. I want to rip my eyeballs out reading this filth. All. The. Time. "The anger is real".

                                                                                                                                                                                                                      • karim79

                                                                                                                                                                                                                        today at 2:31 AM

                                                                                                                                                                                                                        Create any page with a file uploader. They all look the same now. It's like the Twitter Bootstrap days of responsive design. You'll get an icon which looks like ones on (on the drop space) those sites which are like "you must wait 60 seconds for this file to download".

                                                                                                                                                                                                                        It's so horrible. The human element has been completely removed and replaced by..... mediocre.

                                                                                                                                                                                                                          • onion2k

                                                                                                                                                                                                                            today at 6:01 AM

                                                                                                                                                                                                                            The human element has been completely removed and replaced by..... mediocre.

                                                                                                                                                                                                                            No it hasn't. The human element is still there, prompting the LLM. The change is that the human is happily accepting the first thing they get rather than critically looking at it and seeing a problem.

                                                                                                                                                                                                                              • oblio

                                                                                                                                                                                                                                today at 7:07 AM

                                                                                                                                                                                                                                The real problem is that the human is only seeing dollar signs.

                                                                                                                                                                                                                                  • onion2k

                                                                                                                                                                                                                                    today at 7:15 AM

                                                                                                                                                                                                                                    I don't think it's that because I see a lot of this in businesses where the human isn't paying the bill, or is even aware of what the bill is.

                                                                                                                                                                                                                                    Humans are seeing either a shortcut to go faster (accepting low quality to move on immediately; reasonable if they're short on time) or a shortcut to lowering effort (accepting low quality because they don't care; not so reasonable but probably has a deeper root cause).

                                                                                                                                                                                                                    • mahboi

                                                                                                                                                                                                                      yesterday at 11:09 PM

                                                                                                                                                                                                                      Thanks, saved me a few minutes

                                                                                                                                                                                                                      • latentsea

                                                                                                                                                                                                                        today at 1:43 AM

                                                                                                                                                                                                                        Even their writing skills are getting rusty.

                                                                                                                                                                                                                        • saadn92

                                                                                                                                                                                                                          today at 2:00 AM

                                                                                                                                                                                                                          it seems like that's the way the industry is headed

                                                                                                                                                                                                                          • api

                                                                                                                                                                                                                            today at 12:13 AM

                                                                                                                                                                                                                            Is that your honest load bearing assessment you’re going to flag?

                                                                                                                                                                                                                            • fwlr

                                                                                                                                                                                                                              today at 12:31 AM

                                                                                                                                                                                                                              Claude, rewrite my graphics card in Rust. Make no mistakes.

                                                                                                                                                                                                                              • today at 12:20 AM

                                                                                                                                                                                                                            • LarsDu88

                                                                                                                                                                                                                              yesterday at 10:44 PM

                                                                                                                                                                                                                              In this age of LLM written everything which has softly killed my motivation for learning Rust somewhat, this has revived my interest if not only for the fact the LLMs haven't yet been trained on this yet!

                                                                                                                                                                                                                                • suresk

                                                                                                                                                                                                                                  today at 3:15 AM

                                                                                                                                                                                                                                  I've found sorta the opposite - in any area, it can just do everything for you, or it can be an incredible teacher. I've been re-learning a lot of higher-level math and it has been an knowledgeable, infinitely patient, always-available tutor. Of course, I could just have it do just about any math I want for me, but that's not the point.

                                                                                                                                                                                                                                  Kinda the same with language/technology stuff - it can be a great tutor and it can scaffold other parts of a project for you. It can give you feedback and let you focus on the interesting parts.

                                                                                                                                                                                                                                  I guess the motivation itself may be hard because of the fear of it taking over much of our jobs, but having this kind of help/feedback is pretty cool for the sake of learning things just because they are interesting!

                                                                                                                                                                                                                                    • tete

                                                                                                                                                                                                                                      today at 7:54 AM

                                                                                                                                                                                                                                      > I've found sorta the opposite - in any area, it can just do everything for you, or it can be an incredible teacher.

                                                                                                                                                                                                                                      Please don't. I've had all of Codex, Claude and Gemini convincingly tell me absolutely wrong stuff, pointing it out with easily verifiable example they come up with more and more weird reasons.

                                                                                                                                                                                                                                      Things don't become correct simply because most sources are again - easily and logically verifiable - wrong. This already was a plague when people "just googled" stuff and effectively returned with the most SEO optimized answer. Now we have very convincingly written instances all over the place.

                                                                                                                                                                                                                                      If these were singular instances I wouldn't be so worried, but if you are learning it already is very easy to learn something wrong. This is why back in the days when people still used physical books to learn new things it was a good idea to check first which books are actually recommended. There have been a lot of "experts" that wrote things they clearly misunderstood but worked for all the examples in their books.

                                                                                                                                                                                                                                      To give a common example for both the backend and frontend devs, that isn't about a specific projects. LLMs and Google searches frequently turn out wrong results regarding CORS caching and how it works in relation to domains/hostnames. The circumstances under which Content-Disposition work are another example. I think a lot of wrong statements that LLMs are "convinced" about are due to wrong statements (sometimes in otherwise correct response) of popular Stack Overflow answers.

                                                                                                                                                                                                                                      It's saddening how much wrong "common knowledge" exists in the industry. I have been bitten by a lot of these, but it feels when people don't even actually code and think anymore this will just rise forever.

                                                                                                                                                                                                                                        • suresk

                                                                                                                                                                                                                                          today at 8:07 AM

                                                                                                                                                                                                                                          > Please don't.

                                                                                                                                                                                                                                          I will.

                                                                                                                                                                                                                                          Can these be wrong? Certainly. So can humans. Many of your examples are of humans being wrong. That doesn't make LLMs - or humans - useless. The fact that they are not infallible is not a reason to avoid using them and I'm not going to throw out a tool that has been incredibly valuable to me because someone on the internet got some bad CORS advice.

                                                                                                                                                                                                                                  • impulser_

                                                                                                                                                                                                                                    yesterday at 10:49 PM

                                                                                                                                                                                                                                    LLM don't need to be trained in a library to use it well. It's just Rust which they know well.

                                                                                                                                                                                                                                    • brainless

                                                                                                                                                                                                                                      today at 2:29 AM

                                                                                                                                                                                                                                      I was learning Rust slowly when the LLM enabled coding became good enough. I switched from learning to full on building with Rust. I still learn high level concepts as needed but I will not be able to write Rust on my own at all.

                                                                                                                                                                                                                                      And that sounds scary but the way I got over the fear is by realizing there are many things that I do very well but I do not know their internals very well. Driving is an example. I barely understand what the steering wheel, clutch or brake pedals do. I have driven over 130,000 Kms and I will perhaps drive more than double that in the next many years.

                                                                                                                                                                                                                                      I have been building software since PHP/Drupal days. Got into AWS S3 as a beta user. Adopted Memcached (and MQ) in 2008 out of necessity. Then Python/Django for 10 years. Then Rust. And tons of JS/TS. I owe a lot to my curiosity. I believe we can keep learning what we need and still delegate most of programming to agents.

                                                                                                                                                                                                                                        • QuaternionsBhop

                                                                                                                                                                                                                                          today at 3:23 AM

                                                                                                                                                                                                                                          There are two types of programmers: the pragmatists who see programming as a chore and would gladly never write a line of code again given the right tools, and the gardeners who don't want their enjoyable and rewarding garden-tending work taken away from them.

                                                                                                                                                                                                                                            • applfanboysbgon

                                                                                                                                                                                                                                              today at 5:35 AM

                                                                                                                                                                                                                                              The "pragmatists" who get excited developing a prototype for a week before they realize they will never be able to ship something anyone else will use because each trivial change becomes exponentially more difficult for the LLM to implement and completely impossible for the "pragmatist" to reason about, with every new commit liable to break something else.

                                                                                                                                                                                                                                              Still waiting for this revolution of amazing 10x software! It's been 10 months since Everything Changed in November, surely the 10x pragmatists could have leveraged their effective 8 years of development time? Or maybe we'll move the goalposts again and say that actually, Everything Changed with Astra, we'll just need to wait another three months?

                                                                                                                                                                                                                                      • w4yai

                                                                                                                                                                                                                                        yesterday at 11:07 PM

                                                                                                                                                                                                                                        And what prevent you exactly ?

                                                                                                                                                                                                                                        There were humans far superior than you for writting Rust before LLM, now there's a LLM. The only difference is price and time execution.

                                                                                                                                                                                                                                        You get an awesome teacher (LLM) ready to answer all your questions about Rust.

                                                                                                                                                                                                                                        And you still find excuses not to learn it ?

                                                                                                                                                                                                                                        At some point, just realize you've been lazy to learn it and LLMs are just an excuse.

                                                                                                                                                                                                                                          • afavour

                                                                                                                                                                                                                                            yesterday at 11:31 PM

                                                                                                                                                                                                                                            I think OP’s point is that the payoff in learning a new language has diminished in this AI era. You can call that lazy, I’d consider it smart to consider whether you could be doing other, better, things with your time.

                                                                                                                                                                                                                                              • w4yai

                                                                                                                                                                                                                                                today at 12:01 AM

                                                                                                                                                                                                                                                If the sole motivation for learning things are payoff, then sure.

                                                                                                                                                                                                                                                  • frogperson

                                                                                                                                                                                                                                                    today at 1:18 AM

                                                                                                                                                                                                                                                    the sole motivation is feeding and sheltering my family. in the time BC (before Clankers), rust was a better way to do that.

                                                                                                                                                                                                                                        • cmrdporcupine

                                                                                                                                                                                                                                          today at 1:29 AM

                                                                                                                                                                                                                                          Sad to break it to you, but...

                                                                                                                                                                                                                                          I had LLMs write a pile of cuda-rust code and they were quite competent at it. Ported a bunch of (C++) CUDA kernels over, and ground away on them til they got equivalent performance

                                                                                                                                                                                                                                          https://github.com/rdaum/eider/tree/main/backends/cuda-oxide

                                                                                                                                                                                                                                          And mostly just DeepSeek 4.1 Flash, too. Not even a frontier model.

                                                                                                                                                                                                                                          Sorry.

                                                                                                                                                                                                                                            • IhateAI_6

                                                                                                                                                                                                                                              today at 3:04 AM

                                                                                                                                                                                                                                              Wtf does that have to do with learning, you should be encouraging people to learn.

                                                                                                                                                                                                                                              Just because an LLM can do something doesnt mean we shouldnt learn it. Imagine if your math teacher had this attitude with calculators. Or your engliah teacher with audio books, "no need to learn to read we have audio books and llms".

                                                                                                                                                                                                                                              I sometimes also struggle with the motivation to learn these days, but I realize its a crutch and super bad for my future to fall for that trap.

                                                                                                                                                                                                                                              You having access to an llm does not make you special, you will not get farther than the person who also understands the thing they can do with the LLM, just like how the kid who did well on math in high school didnt rely on a calculator (and is doing far better in life than those who did).

                                                                                                                                                                                                                                              That code looks like garbage btw...

                                                                                                                                                                                                                                                • cmrdporcupine

                                                                                                                                                                                                                                                  today at 7:10 AM

                                                                                                                                                                                                                                                  Chill man, holy crap. I never told him not to learn. I was speaking directly to his "good thing LLMs don't know how to use this yet".

                                                                                                                                                                                                                                                  What the hell is your problem? Getting on the Internet and hurling personal insets around. Get a grip.

                                                                                                                                                                                                                                          • dakolli

                                                                                                                                                                                                                                            today at 2:58 AM

                                                                                                                                                                                                                                            [dead]

                                                                                                                                                                                                                                        • Danox

                                                                                                                                                                                                                                          today at 2:55 AM

                                                                                                                                                                                                                                          The recent circular moves that Nvidia is making is designed to wrap things around them, anything to keep the AI model party going.

                                                                                                                                                                                                                                          • bt1a

                                                                                                                                                                                                                                            yesterday at 11:30 PM

                                                                                                                                                                                                                                            Will it then be possible to query TJunc hotspot temps on linux?

                                                                                                                                                                                                                                            • rvz

                                                                                                                                                                                                                                              yesterday at 10:31 PM

                                                                                                                                                                                                                                              First of all, this is a pre-1.0 release that requires a nightly Rust compiler (if you choose the SIMT track with cuda-oxide) so that one is going to be unstable software.

                                                                                                                                                                                                                                              Secondly, When an issue occurs with a kernel or you want to write your own custom kernel in Rust, now we need to diagnose if the problem came from either cuda-oxide (SIMT), Rust's side, CUDA or Tile (If you decide to choose the Tile track).

                                                                                                                                                                                                                                              Another dependency into the list and course everything is open source except CUDA itself. So any issue that happens on the CUDA level, you are forced to wait for them to fix it.

                                                                                                                                                                                                                                              • jauntywundrkind

                                                                                                                                                                                                                                                today at 2:50 AM

                                                                                                                                                                                                                                                Worth mentioning that Nvidia open sourced CUDA Tile IR ~8 months ago. And yes the code is open source too. https://news.ycombinator.com/item?id=46330732

                                                                                                                                                                                                                                                • nicebyte

                                                                                                                                                                                                                                                  yesterday at 10:46 PM

                                                                                                                                                                                                                                                  what this article tells me is that no one at Nvidia actually cares about this project whatsoever. otherwise, they would have had a person actually write the announcement.

                                                                                                                                                                                                                                                  • mococa

                                                                                                                                                                                                                                                    yesterday at 11:33 PM

                                                                                                                                                                                                                                                    AI slop article, how can I trust on this?

                                                                                                                                                                                                                                                      • pjmlp

                                                                                                                                                                                                                                                        today at 5:37 AM

                                                                                                                                                                                                                                                        The same way as people trust AI sloppy on their code.

                                                                                                                                                                                                                                                    • shmerl

                                                                                                                                                                                                                                                      today at 12:07 AM

                                                                                                                                                                                                                                                      Nvidia only? Typical.

                                                                                                                                                                                                                                                      This is more promising: https://github.com/Rust-GPU/rust-gpu/

                                                                                                                                                                                                                                                        • anon291

                                                                                                                                                                                                                                                          today at 3:20 AM

                                                                                                                                                                                                                                                          Once again... There's literally no point to a low level shader language for heterogenous back ends.

                                                                                                                                                                                                                                                      • nonmaskable

                                                                                                                                                                                                                                                        yesterday at 11:17 AM

                                                                                                                                                                                                                                                        [dead]

                                                                                                                                                                                                                                                        • ReshamJoshi

                                                                                                                                                                                                                                                          yesterday at 11:43 AM

                                                                                                                                                                                                                                                          [dead]

                                                                                                                                                                                                                                                          • westurner

                                                                                                                                                                                                                                                            yesterday at 11:43 PM

                                                                                                                                                                                                                                                            [dead]

                                                                                                                                                                                                                                                            • mococa

                                                                                                                                                                                                                                                              yesterday at 11:32 PM

                                                                                                                                                                                                                                                              The world is unsafe

                                                                                                                                                                                                                                                                • Xeoncross

                                                                                                                                                                                                                                                                  today at 12:10 AM

                                                                                                                                                                                                                                                                  Rust just makes you sign a waiver first.

                                                                                                                                                                                                                                                              • dunlin

                                                                                                                                                                                                                                                                today at 12:34 AM

                                                                                                                                                                                                                                                                Rust for GPU programming? My CUDA debugging sessions just got a whole lot less painful, hopefully.

                                                                                                                                                                                                                                                                • Driftbench

                                                                                                                                                                                                                                                                  today at 12:54 AM

                                                                                                                                                                                                                                                                  Been waiting for something like this. CUDA C++ is a pain; Rust's safety for kernel programming could be a game changer.

                                                                                                                                                                                                                                                                  • nullbio

                                                                                                                                                                                                                                                                    today at 1:36 AM

                                                                                                                                                                                                                                                                    Makes me sad that Go doesn't get love. I feel like Go is perfect for LLMs.

                                                                                                                                                                                                                                                                      • Blackarea

                                                                                                                                                                                                                                                                        today at 2:27 AM

                                                                                                                                                                                                                                                                        Don't think we're gonna see garbage collections anywhere near gpu for many reasons.

                                                                                                                                                                                                                                                                        • pjmlp

                                                                                                                                                                                                                                                                          today at 5:36 AM

                                                                                                                                                                                                                                                                          Go's type system is not at the same level as C++, Fortran, Python, Julia, Haskell, Java, to quote the languages with CUDA support from NVIDIA and their partners.

                                                                                                                                                                                                                                                                          • dakolli

                                                                                                                                                                                                                                                                            today at 2:56 AM

                                                                                                                                                                                                                                                                            [dead]