\

Flint: A Visualization Language for the AI Era

238 points - today at 2:45 AM

Source
  • akst

    today at 4:57 AM

    Even in the Era AI, GGPlot's API is still the best charting API. The name "Grammar of Graphics" isn't just marketing, they literally sought to write a god damn grammar to was capable of expressing all possible qualitative graphics.

    They even wrote a book about how they went about it (not that it speaks to the quality of the API) https://link.springer.com/book/10.1007/0-387-28695-0

    I actually stumbled upon this book when I was trying to look up how draftsmen (with pens and pencils on paper) did qualitative graphics as I found they had a lot of charm as opposed to modern charting libraries. It's something I noticed when looking through a bunch of historical RBA (Reserve bank of Australia) annual reports, the 1960-1980 charts had a lot of character, but then you go into the early 2000s and its a stale chart from excel.

    Anyways ggplot doesn't really recapture the magic of those older charts, but it seems use quite a few of those as a baseline for how to communicate information. Like in figure 20.1 they talk about efforts to replicate older inforgraphics that showed Napoleon’s March on Russia, this graphic here (I think the example in the book is a bit nicer than the one in this blogpost IMO)

    https://www.andrewheiss.com/blog/2017/08/10/exploring-minard...

    On top of the charts just look nicer than anything you could produce with pyplot (and any API built on top of it) as pyplot seems to be have some really limited raster based rendering or something and the text handling is incredibly limited, I've never had this issue in ggplot.

    I feel like most software engineers aren't exposed to because it exists in the R ecosystem which is more so data scientist, econometricians, statisticians and other quantitative data professions, but it definitely one of the nicer APIs and I wish more people in the node and python ecosystem copied their homework. I see vega's full name is something to do with grammars, but idk it's for the same reason.

      • williamcotton

        today at 6:50 AM

        > They even wrote a book about how they went about it (not that it speaks to the quality of the API)

        Wilkinson’s Grammar of Graphics inspired ggplot. The textbook doesn’t even mention ggplot.

        Shameless plug for my own GoG inspired DSL, Algraf:

        https://williamcotton.github.io/algraf/demos

        There’s a Minard plot in the demos!

          • akst

            today at 11:41 AM

            Oh… I assumed it was a further expansion of the ideas that with into ggplot as they all look like ggplot charts and ideas were identical

            I wish I could edit my original comment to add this correction.

            • __jochen__

              today at 11:39 AM

              nice, but did you expect it to not work on Safari (WASM fails)?

                • williamcotton

                  today at 12:04 PM

                  Safari is my default browser and it seems to be working just fine!

          • abirch

            today at 5:17 PM

            Have you checked out plotnine?

            https://raw.githubusercontent.com/rstudio/cheatsheets/main/p... it's made by the same people behind ggplot. Hadley Wickham worked for RStudio which also created plotnine.

            plotnine is currently sponsored by Posit where Hadley works.

            • jiehong

              today at 6:51 AM

              To be fair, the Vega-lite backend is json mostly based on GG ideas.

              In this vein, I think I prefer ggsql that made it to HN recently [0].

              [0]: https://ggsql.org/

              • nylonstrung

                today at 12:13 PM

                Yeah Grammar of Graphics semantics are already very ideal for both humans and agents alike. Ggsql is a recent project that implements it as SQL user defined functions which is even more agent friendly

                I dont see what this brings to the table

                • WillAdams

                  today at 11:03 AM

                  Well, for that hand-drawn charm if you're willing to use METAPOST there is:

                  https://github.com/jemmybutton/fiziko

                  • porker

                    today at 7:03 AM

                    How would you quantify the magic of these older charts? What is it that makes them have charm and character?

                      • akst

                        today at 11:33 AM

                        I made this a while back never finished it, but it’s a slide show of the different styles of graphics the RBA used over time

                        https://x.com/Angus_KST/status/2057757395196293262/video/1?s...

                        It’s incomplete but it show cases some of what I mean. There’s just a lot more charm in these earlier graphics. I’m fairly certain they had to consider how the different colours of ink bleed on one another.

                        Like take 1978 for example, this might be some kind of highlighter ink, and when the colours over lap the grid they interact in ways most overlapping geometry don’t in charting libraries (but in CSS you can get a similar effect with mix-blend-mode: multiply)

                        https://www.rba.gov.au/publications/annual-reports/rba/1978/...

                        If you go to page 159 of the most recent RBA report, you’ll see otherwise clean clear charts that do a good job of communicating the relevant information (perhaps that’s all there should do from such an institution), but it’s admittedly soulless compared to the charts from previous decades

                        https://www.rba.gov.au/publications/annual-reports/rba/2025/...

                        • zem

                          today at 9:06 AM

                          not the parent, but one thing i find charming is that a lot of them have a really good feel for line weight and inking style, and vary it interestingly in various parts of the plot. computer generated charts tend to have a much more uniform line weight.

                      • nialse

                        today at 6:09 AM

                        Note that if you are affiliated with a University you probably can download a pdf of the book in the link for free.

                          • akst

                            today at 6:27 AM

                            Yeah that's how I got a copy, found it on my unis digital library.

                    • data-ottawa

                      today at 8:56 AM

                      I have tried using Flint vs asking the AI to generate a Vega lite spec directly, and in my opinion Flint was not as nice of a solution.

                      Flint is fine for doing predetermined chat types, with very low customization. But I found using an agent or sub agent to create the Vega spec directly allowed for a lot more flexibility, and ultimately that means higher quality visualizations (stuff like adding points for min and max on a timeseries, or adding a callout marker for a date where some event happened).

                      That being said, with Vega lite you have to validate your chart specs, provide specific guidance, and play whack a mole with Vega bugs/idiosyncrasies. So Flint is more reliable if you don’t want to dedicate a whole skill to making charts and want to get running quickly.

                      • shepherdjerred

                        today at 5:31 AM

                        So this is one interface that can render to multiple charting backends?

                        If AI is writing the "Flint", why not just have it write the backend code instead? I'm not sure why I would want pluggable charting backends.

                        I can see an argument for providing simpler APIs for LLMs, though, so that it can be more token efficient for example.

                          • awestroke

                            today at 7:20 AM

                            Different charting backends support different kinds of charts. Being able to easily switch between "ECharts Sunburst" and "Vega-Lite faceted bar" - one of the examples on the project website - seems like a super useful ability.

                              • scary-size

                                today at 9:09 AM

                                Fair. How is this specific to the marketed AI integration? This could just be a unifying abstraction layer for a bunch of, in my opinion, verbose chart APIs. And then the LLM could just be the abstraction layer.

                                • HawtAds

                                  today at 7:52 AM

                                  Interesting, TanStack Charts was also released a couple days ago with a similar design.

                                  https://tanstack.com/charts/latest

                                    • chrisweekly

                                      today at 1:11 PM

                                      Yeah I was going to share it too. I watched a yt video yesterday where Tanner talks about how (in contrast to trad component-based libs) it takes a very different approach to composition, letting D3 do the heavy lifting and using its visual grammar, and staying grounded in putting the data (not the component tree) first.

                                        • HawtAds

                                          today at 3:44 PM

                                          I wish they would provide an ECharts backend, it's probably one of the most performant and featureful charting libraries you can find.

                          • 1vuio0pswjnm7

                            today at 3:18 PM

                            02 Jul 2026 04:28:21 UTC

                            Microsoft/Flint-Chart

                            https://github.com/microsoft/flint-chart

                            https://news.ycombinator.com/item?id=48756577

                            [ok]

                            08 Jul 2026 17:46:12 UTC

                            Show HN: Microsoft releases Flint, a visualization language for AI agents

                            https://microsoft.github.io/flint-chart/#/

                            https://news.ycombinator.com/item?id=48834924

                            [ok]

                            • siliconc0w

                              today at 4:43 PM

                              DSLs for AI doesn't really make sense- they were trained on existing graphics libraries and are pretty good at them.

                              Maybe a long term play would be putting this out and creating a "graphics bench" to entice the labs to overfit on your DSL but that seems like a lot of work

                              • Imanari

                                today at 7:46 AM

                                What is wrong with "please make plot XYZ in plotly?"

                                  • DespairTensor

                                    today at 4:31 PM

                                    If you're doing automated data visualization, "please make plot XYZ in plotly" needs a sandbox to execute the JS or Python code. With something like this you can avoid it, you just validate it and plot it. If the LLMs are better at generating Flint than Vega-Lite specs then I see how the project can be useful.

                                    • xigoi

                                      today at 9:55 AM

                                      A Microslop employee won’t get promoted for that.

                                  • thepoet

                                    today at 4:54 AM

                                    An earlier larger discussion 22 days ago on this https://news.ycombinator.com/item?id=48834924

                                    • today at 4:11 AM

                                      • refactor_master

                                        today at 4:03 AM

                                        When does it get too abstract? What’s wrong with plotly? Or plotly express? How is yet another JSON spec era-anything?

                                        • anigbrowl

                                          today at 4:28 AM

                                          It's cool...but is it needed? I'm thinking of Apache echarts and any of many other mature charting libraries. Kinda seems like reinventing the wheel; thing gets released, thing gets more and more new features bolted onto it, eventually someone offers another thing that's basically the original thing with some slightly different design and syntax opinions...

                                          Switch backends to use their native strengths: ECharts for hierarchical sunbursts, Plotly for statistical and analytical traces, or Excel for editable charts embedded in a workbook.

                                          Or just find a charting library that you like and actually get to know what it can do, vs mixing and matching presets from different libraries but never tweaking them.

                                          • woah

                                            today at 4:08 AM

                                            Why is this "for the AI era"? Isn't it kind of not for the AI era since an LLM can create a gnarly python or js chart of whatever you want in seconds?

                                              • orbital-decay

                                                today at 6:43 AM

                                                It can write anything, but that's not a guarantee it can easily read and comprehend it later

                                                • croes

                                                  today at 5:46 AM

                                                  Nowadays you either create something with or for AI.

                                                  Like you created you own framework for wen apps before.

                                                  "For the AI era" is the necessary buzzword

                                              • barryhennessy

                                                today at 6:54 AM

                                                Maybe they’re not selling this well. Maybe they’re so close to the AI research that this seems like an obviously good idea.

                                                But there’s not one word of why this is good for LLMs, or how they tested/measured that.

                                                My gut would tell me that a new solution put up against all the vega lite specs it’s already be trained on would be a hard thing to win.

                                                • boomskats

                                                  today at 9:48 AM

                                                  This needs a side-by-side config comparison with something like echarts config schema format. I really don't see the point.

                                                  I'm 99% sure the verbosity required in the system prompt to teach non-M$ models this new ever-so-slightly-different-but-not-obviously-necessary chart def abstraction format, and the iterations required to get it right, will outweigh any supposed efficiency gains resulting from using it.

                                                  Just stating the obvious.

                                                    • StilesCrisis

                                                      today at 11:09 AM

                                                      Feels to me like a preexisting project that pivoted their marketing pitch to AI.

                                                      • fr2029

                                                        today at 1:43 PM

                                                        [dead]

                                                    • infecto

                                                      today at 2:11 PM

                                                      What is the point of this. I already can get an llm to draw charts using plotly, matplotlib, echarts, etc all the time. There will be always a better way but what does this buy us?

                                                      • xyzsparetimexyz

                                                        today at 5:52 AM

                                                        This is just json right? One issue with llms right now it's that if you give them a json specification, they're not always amazing at following it. I think it makes sense to have an agent tool that takes llm json, a file name and a spec path and only writes out the file if it conforms.

                                                          • mirashii

                                                            today at 6:47 AM

                                                            > give them a json specification, they're not always amazing at following it

                                                            Used correctly, this hasn't been true for a quite a while. Most inference engines have a form of grammar constrained decoding. See, for example: https://vllm.ai/blog/2025-01-14-struct-decode-intro

                                                              • xyzsparetimexyz

                                                                today at 8:49 AM

                                                                I trust my setup a lot more than whatever this is.

                                                        • today at 7:07 AM

                                                          • zurfer

                                                            today at 7:26 AM

                                                            If it's made for LLMs, the spec should be yaml not json. Way more token efficient

                                                              • garethrowlands

                                                                today at 3:58 PM

                                                                It's really not that simple. Yaml can be more token efficient but not necessarily. And it's often not the biggest factor.

                                                            • yoz-y

                                                              today at 7:03 AM

                                                              Every time I needed to do charts at work I had a conundrum. Libraries are aplenty but basically only plotly does everything, but it’s not the prettiest. I’d much rather developers contributed new features into existing libraries.

                                                                • lenkite

                                                                  today at 12:10 PM

                                                                  What does plotly do that other libraries don't ?

                                                              • hncsiocp9x

                                                                today at 10:58 AM

                                                                I've seen this play out plenty of times

                                                                • Culonavirus

                                                                  today at 5:08 AM

                                                                  Yeah this is not needed and every single day it is needed even less.

                                                                  • stared

                                                                    today at 11:23 AM

                                                                    "A Visualization Language for the AI Era", as a tagline, sounds weird.

                                                                    I had the best success with popular and versatile packages like matplotlib and ggplot2 - even 1.5 ago (vide https://quesma.com/blog/which-chart-would-you-swipe-right/).

                                                                    Now, frankly, my go-to visualization package is React, sometimes with a pinch of D3.js (e.g. https://p.migdal.pl/tree-of-tree/).

                                                                    • cyanregiment

                                                                      today at 10:12 AM

                                                                      What a waste of time over at Microsoft Research

                                                                      • williamcotton

                                                                        today at 7:08 AM

                                                                        So a stringly typed JSON-based DSL without a linter or LSP?

                                                                        • block_dagger

                                                                          today at 6:01 AM

                                                                          Does it do flowcharts and arch diagrams? Doesn’t seem like it.

                                                                          • today at 7:55 AM

                                                                            • slicendice

                                                                              today at 6:03 AM

                                                                              Can it respond to my several open github tickets?

                                                                              • vaniskey

                                                                                today at 2:50 PM

                                                                                Why is this for the AI era"?

                                                                                • Hawzen

                                                                                  today at 1:40 PM

                                                                                  My conspiracy theory is that this was not related to AI in any capacity, but it was tacked on because ai

                                                                                  The linked website has only two mentions of AI, and one of them is the title, the approach isn't AI-centric in any meaningful sense either

                                                                                  • est

                                                                                    today at 5:57 AM

                                                                                    unfortunately JSON is doomed to fail in "the AI era"

                                                                                    LLMs are surprisingly bad at generating JSON.

                                                                                      • afro88

                                                                                        today at 6:00 AM

                                                                                        Are they in 2026? I haven't had an issue with json and LLMs in a long while

                                                                                          • cyanregiment

                                                                                            today at 10:24 AM

                                                                                            JSON, CSS, JS config files… for me it tends to omit fields and produce unwanted or duplicate ones.

                                                                                            But way less so in TS. Because the types/interfaces are there to guide it further.

                                                                                            So everyone’s adding types everywhere: “Agent friendly”

                                                                                            What would a CSS type system look like !

                                                                                              • lenkite

                                                                                                today at 12:11 PM

                                                                                                I would love a CSS type system for humans. The language never stays in my brain for more than 2 weeks and then I have to re-learn it from scratch.

                                                                                                  • cyanregiment

                                                                                                    today at 12:23 PM

                                                                                                    Same, and I guess it already is (pretty strongly) typed but yeah

                                                                                                    > for humans

                                                                                                    And dare I say “agents” - it’d be nice to have very nuanced types

                                                                                        • steve_adams_86

                                                                                          today at 6:26 AM

                                                                                          You can use skills or harnesses to have them validate their json (using plain old JSON validation or schemas) and they seem to have a very high success rate with that gate in place. It's slightly more tokens, but it's reliable

                                                                                          • kamikazeturtles

                                                                                            today at 5:59 AM

                                                                                            Why is that?

                                                                                        • Garlef

                                                                                          today at 9:00 AM

                                                                                          idk ~ it's either a bit thin or i'd expect something more substantial "for the AI era"

                                                                                          ... as the kids would say: "weak sauce"

                                                                                          ... and it's just a tool to create charts not a "visualization language"

                                                                                          you could probably vibeslop a pipeline from some ad-hoc DSL to excel or pandas or R and get a better integration with your business context

                                                                                          • Alien1Being

                                                                                            today at 10:11 AM

                                                                                            Give it a year and Microsoft will have abandoned it for some other shiny buzzword rich agentic slop ...

                                                                                            • today at 7:52 AM

                                                                                              • simianparrot

                                                                                                today at 10:03 AM

                                                                                                If "AI" was actually as capable as its salesmen claim, why can't it just use whatever existing library is out there already?

                                                                                                • dankobgd

                                                                                                  today at 10:54 AM

                                                                                                  "for the ai era" == slop era

                                                                                                  • kburman

                                                                                                    today at 3:24 AM

                                                                                                    [deleted]

                                                                                                      • teruakohatu

                                                                                                        today at 3:44 AM

                                                                                                        Literally the first backend they mention is Vega-Lite.

                                                                                                          • today at 3:47 AM

                                                                                                    • missmoss

                                                                                                      today at 7:32 PM

                                                                                                      [dead]

                                                                                                      • myshapeprotocol

                                                                                                        today at 2:05 PM

                                                                                                        [dead]

                                                                                                        • Adsnetworksucce

                                                                                                          today at 10:01 AM

                                                                                                          [flagged]

                                                                                                          • hansmayer

                                                                                                            today at 7:38 AM

                                                                                                            [dead]