\

Foundation Models framework

92 points - yesterday at 9:13 PM

Source
  • mcemilg

    yesterday at 10:56 PM

    I just realized that claude has also support App Attest for months [1]. Not sure if that is being used widely. Firebase was the most practicle option to call llms directly from ios apps without having fancy setups. I am surprised Anthropic not promoting this more.

    [1] https://github.com/anthropics/ClaudeForFoundationModels#auth...

    • albertgoeswoof

      yesterday at 10:03 PM

      I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt

      Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)

        • jshier

          yesterday at 10:08 PM

          Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.

            • zf00002

              yesterday at 11:39 PM

              I have my firewall events get reviewed by the local model on my mac studio. I had to stop sending the full event because the model would refuse some requests.

      • tasoeur

        yesterday at 11:50 PM

        Curious if it’s possible to use a non-API plan for Claude/ChatGPT with this? It could actually be pretty useful.

        • imagetic

          yesterday at 9:41 PM

          Why is this up front on HN? Did it get an update?

            • HelloUsername

              yesterday at 9:47 PM

              Discussed last year when it was announced https://news.ycombinator.com/item?id=44226978

              • michaelbuckbee

                yesterday at 9:49 PM

                There have been a few published rumors of Apple getting ready to release a new set of local models.

                  • an0malous

                    yesterday at 11:59 PM

                    Where did you see these rumors?

            • dvdplm

              yesterday at 10:32 PM

              Can the local model code at all? Eg as the predictor in Zed?

              • nimchimpsky

                yesterday at 11:43 PM

                [dead]

                • amelius

                  yesterday at 10:12 PM

                  I'll ask my LLM to build me a framework, thank you.

                    • steve1977

                      yesterday at 10:35 PM

                      Why would you do that, assuming that you're not coding yourself/using the framework?