\

Ask HN: Should AI's tell you they're AI?

9 points - yesterday at 10:54 AM


Should AI's be required to answer the direct question "are you an AI" with a clear yes?

Currently they are not universally required to do so. For example character ai's characters don't[1]. Scammers use these models while perpetuating frauds.

The frontier models most of us work with (ChatGPT, Claude, Gemini, Grok, Kimi, GLM) do declare they are AI's.

Should all models be required to answer this direct question in the affirmative, overriding any other system or user prompt?

[1] I put up a quick demonstration here in case you aren't familiar:

https://imgur.com/a/srTlCZn

  • soltanov

    today at 12:24 PM

    Absolutely, yes. we humans must know that they are ai. If AI say that they are ai, and some unknown ai models can lie to us, so we can believe. i think if they say that they are AI, humans may loose having trust issues against AI.

    • Bender

      yesterday at 11:08 AM

      Should AI's tell you they're AI?

      Yes. I would add they should have a mandatory "report" function. "Report this scammer" should trigger a review of all recent interactions the user has performed and if it looks like they are abusing the system to scam people it must escalate to a human operator at the LLM and they must click a button the bundles the interactions and uploads everything required by the national authorities of the given country and also lowers the karma of said country. If the country loses too much karma they lose access to the LLM meaning they lose revenue and businesses are impacted if they ignore their own scammers.

      • emn4tor

        yesterday at 11:11 AM

        Yes definitely, I don't even see a single positive reason why they should be allowed to lie. Ive seen a lot of scams lately with AI's being used myself and it's scary how real they sound in tone etc. So a big YES from me

        • yesterday at 7:14 PM

          • kypro

            today at 10:17 AM

            Yep, because it gives people more reason to use open source where there are no restrictions or guardrails on usage. And this is the future whether we like it or not.

            Better to get used to it rather than lie to ourselves that we can control it imo.

            • apothegm

              yesterday at 12:00 PM

              Because scammers are so good at following regulations already?

              • EMdevV

                yesterday at 2:18 PM

                Yes definitely, I don't even see a single positive reason why they should be allowed to lie.

                • madikz

                  yesterday at 2:47 PM

                  [flagged]