\

The Linux Boot Process: From Power Button to Kernel

292 points - yesterday at 11:04 PM

Source
  • deivid

    today at 7:40 AM

    Really nice post, some months ago I also wrote about linux boot, but a bit more focused on the IO side (what's on disk, how is it loaded), here: https://blog.davidv.dev/posts/booting-x86-64/

    • nickelpro

      today at 12:30 AM

      UEFI is an interface implemented by firmware (literally, Unified Extensible Firmware Interface), it's not the firmware itself. Saying "it starts the machine" is a bit of a nomenclature faux pas. The firmware starts the machine, you talk to the firmware via UEFI.

      This post skips all the interesting things in the modern firmware dance. Not the least of which is when you call ExitBootServices() you're already in long mode. There's no need for the journey through real and protected.

        • 1oooqooq

          today at 12:39 PM

          firmwares are the real IoT nobody talks about that that actually happened. infinite little computers and code churning away from view. and not being updated.

          next 'snowden leaks' will have that word on every page.

          • MonaroVXR

            today at 3:42 AM

            Where do I read more about this?

          • 7bit

            today at 10:39 AM

            I'm currently trying to learn more about how the boot process works, specifically with UEFI. Yesterday I watched a video on how to program a UEFI bootloader so I was happy when I saw this article this morning.

            The article jumps over so many steps and leaves out so many mechanics that I had to stop reading, because it just opened more and more questions without closing any. For example, right at the beginning:

            > Right after reset the CPU jumps to a special address called the reset vector at 0xFFFFFFF0. Think of it as a permanent bookmark that says “start here.” There is room for almost nothing at that address, so manufacturers put a short jump there that passes control to the firmware on your motherboard.

            What does that even mean? It jumps there means that it executed whatever is at that address, but it failed to explain how the instruction at that location is even put there in the first place.

            Reading a little more I truly am confused for who this was even written. It seems you need a lot of prior knowledge to understand what the author talks about and then it also makes me wonder what additional information this article conveys if you already can fill in the gaps.

        • zahlman

          yesterday at 11:53 PM

          In the page source:

            <body>
                <!-- Femboy Mode Button - Hidden on Mobile -->
                <button class="rave-button" id="raveButton" onclick="toggleRaveMode()" title="Femboy Mode" style="display: none;">
                    <span class="button-text">uwu</span>
                </button>
          
          OwO what's this?

            • 0xkato

              today at 12:03 AM

              Its a working progress.

                • HansardExpert

                  today at 8:22 AM

                  The expression is "work in-progress"

                    • munchlax

                      today at 12:34 PM

                      The author of the work can call it whatever he wants

                  • today at 2:42 AM

                    • kgasser88

                      today at 3:05 AM

                      [flagged]

                        • today at 3:10 AM

                      • juggerl

                        today at 1:58 AM

                        [flagged]

                        • juggerl

                          today at 2:12 AM

                          [dead]

                  • dgrin91

                    today at 2:29 AM

                    It's a weird article for me. On one side it is an interesting topic. On the other hand why are we explaining what a hex number is? Who is interested in this level of detail but doesn't know hex? Maybe I'm overanalyzing.

                    At the same time this doesn't address my biggest open question on the topic - how do we get from the physical push to the reset vector? Somehow that magic works in HW, physics and electronics - how?

                      • vixen99

                        today at 7:44 AM

                        HN is not just read by IT professionals. And they might be a bit curious about Linux startup without necessarily recalling what they know or never knew about hexadecimals.

                          • 7bit

                            today at 10:42 AM

                            It's fine to explain things to people that are not into that topic. But I also wonder what the target audience is. On one hand, he explains what a hexadecimal ist, but then jumps over essential information needed to understand the boot process. It's like: "Learning to swim: This is water, it is wet, if you jump in you sink and in water you cannot breath. Then you start moving your body parts and then you swim."

                    • zaxioms

                      today at 3:29 AM

                      Does anyone have a similar article with more detail? I don't quite want to read the datasheet of your favorite microprocessor, but I would like a decent amount more detail than what's provided. Especially before UEFI/BIOS.

                      • a022311

                        today at 12:06 PM

                        Thanks for the detailed write-up! I'd love to see something like this for ARM too!

                        • gblargg

                          today at 9:10 AM

                          I wonder whether the power button really directly starts the CPU. I wouldn't be surprised if the Intel Management Engine (or AMD equivalent), a CPU that's running all the time, is what gets the power button signal and starts the CPU.

                        • nightshift1

                          yesterday at 11:46 PM

                          The topic is interesting but it seems to be targeted for my grandmother.

                            • zahlman

                              yesterday at 11:49 PM

                              > When power stabilizes, the CPU resets itself to a tiny, old‑fashioned mode called real mode. Real mode dates back to the original 8086 chip. The rules are simple on purpose. Memory addresses are built from two values the CPU keeps in special fast storage called registers. You combine a segment and an offset like this:

                                physical_address = (segment << 4) + offset
                              
                              Your grandmother sounds unusually proficient with this sort of thing.

                                • nightshift1

                                  today at 12:35 AM

                                  I dont know, i just don't like the tone. This is a complex subject where the target audience should probably already know what is an hexadecimal number or an interrupt and the explanation of a cpu register ought to be better than: "A register is a tiny slot inside the CPU. It holds a number the CPU is using right now." If the subject interest you, you deserve better.

                                    • charcircuit

                                      today at 5:03 AM

                                      >A register is a tiny slot inside the CPU. It holds a number the CPU is using right now

                                      What's your issue with this? Would you prefer it mentioned the x86 register doesn't always correspond to the same place in the register file?

                                        • renewiltord

                                          today at 5:30 AM

                                          There's nothing wrong with it but most people striving to do this would make each bit clickable to detail or something so that you can read at your level. I imagine this was a constraint of the site framework or the author's writing style.

                                          But hey what the heck, it's fine. An LLM can rewrite it to whatever level of knowledge you like so the deepest level is optimal.

                                      • typpilol

                                        today at 12:59 AM

                                        Agreed. A lot of these articles leave me with more questions than answers.

                                        These blog posts really annoy me because I feel like with 20% more effort you could have something worth reading.

                                          • munchlax

                                            today at 7:38 AM

                                            The problem is that your 20% isn't the same 20% as anyone elses 20%.

                                            If you want a more thorough explanation, go read a book. Many are available for free on sites such as archive.org and programming-motherfucker.com

                                • Neywiny

                                  today at 12:48 AM

                                  One of the things we were taught in uni was audience analysis. I think about it a lot. What's expected to already be known? What acronyms or phrases need defining? Etc. This is an art I'm far from perfect at and it seems a lot of tech writers are too

                                  • hamonrye

                                    today at 4:38 AM

                                    [dead]

                                • metabagel

                                  yesterday at 11:23 PM

                                  Hard to read on my phone due to faded text.

                                    • Brybry

                                      yesterday at 11:44 PM

                                      The styling is bad on a desktop browser too. If you use Firefox or Firefox Mobile then reader mode is good for cases like this.

                                      • DonHopkins

                                        yesterday at 11:54 PM

                                        The self deprecatingly downvoted look.

                                    • pixelbeat__

                                      yesterday at 11:22 PM

                                      GRUB is mentioned but not detailed.

                                      Here are some details: https://www.pixelbeat.org/docs/disk/

                                      • liqilin1567

                                        today at 2:29 AM

                                        Seems like there are many useful suggestions for the author. Here is mine: maybe an interactive style would work much better for educational content.

                                        There is a well praised post on HN: https://www.nan.fyi/database, built with the framework: https://github.com/nandanmen/NotANumber

                                        • gmueckl

                                          today at 1:29 AM

                                          This is old school BIOS boot. EFI bootloaders work very differently.

                                            • okanat

                                              today at 2:22 AM

                                              and with GRUB running under UEFI, it actually uses UEFI load procedures instead of fumbling with 16-bit CS, DS, SS registers

                                          • ramanvarma

                                            today at 6:21 AM

                                            Reading this just reinforces how much of the x86/Linux boot chain is fossilized ceremony glued together for backward compatibility.

                                            • phendrenad2

                                              today at 7:26 AM

                                              Kinda missing the point of UEFI if you don't mention that it skips the first 3 sections and allows your kernel to boot directly from 64-bit mode ("long mode") with paging, a framebuffer, and a function to read files from your boot drive, already set up for you. Removes the need for GRUB entirely.

                                                • rollcat

                                                  today at 12:42 PM

                                                  This. I haven't seen or touched GRUB or BIOS in about a decade.

                                              • gldrk

                                                today at 5:01 AM

                                                As should be clear from the reset vector, the 80286 and its successors actually boot in unreal mode. On the 80386, the base address of the code segment is 0xffff0000, which cannot be obtained by shifting the 16-bit CS register by 4. The descriptor cache simply gets loaded with the correct value at reset. Writing to CS in real mode overwrites the cached value with CS * 16.

                                                • aborsy

                                                  today at 3:30 AM

                                                  Related to this topic, what is the best way to replace the code involved in the entire boot process? This is useful when sanitizing a system received from a provider that may not be trustworthy, as malware could be hidden at low levels.

                                                  The disk could be wiped from the BIOS. One could also run “fwupdmgr update” from a live USB to update the motherboard firmware and then reinstall the operating system. However, I’m not sure if this would completely clear the system.

                                                  • darkwater

                                                    today at 9:30 AM

                                                    This post made me remember the technical interview by phone I had with Facebook circa 2010 for a Production Engineer role (but maybe it wasn't called yet that way back then) where they asked me exactly this. Well, they actually asked "explain me the boot process of a Linux server", with no more hints and "go into the details you feel are important" as the only help.

                                                    Anyway I should have moved to Dublin and something something surveillance capitalism so the grape wasn't ripe enough anyway.

                                                    • pwpwp

                                                      yesterday at 11:46 PM

                                                      Light gray text on white??

                                                      • e-dant

                                                        today at 3:01 AM

                                                        ARM and lots of non-x86 architectures often use a series of bootloaders to kick up ram, wake up parts of the hardware, blah blah, and read devicetree blobs to know what the hardware looks like

                                                        • neoattikos

                                                          today at 1:02 AM

                                                          Nice to see the good old hacker energy & independent blogs explaining things showing up on top of hacker news. Welcome change from insufferable agent this and vibe that

                                                          • jiveturkey

                                                            today at 1:27 AM

                                                            fascinating how it's all over the place wrt level of detail. and absolutely unreadable. luckily the layout is simple and reader mode works.

                                                            > Hex is base 16

                                                            i would argue that someone that understand bases (in the first place), understands what the << operator does (context where base 16 is explained), but doesn't understand what base 16 is, doesn't exist. this is the kind of haphazard approach of this article i'm talking about. even the author's name, 0xkato, is an example of this.

                                                            as to the content, i wish it had touched on TPM, PCRs, UEFI secure boot, and ME pre-boot.

                                                            i'm forgiving all the actual errors since it is a pretty broad overview.

                                                            i'm guessing first-year uni student.

                                                            rather amazed a post like this can make it to the #1 spot.

                                                            • zzzeek

                                                              today at 12:45 AM

                                                              I'm going to save this guys blog in one step

                                                              https://webaim.org/resources/contrastchecker/

                                                              (this is the site: https://webaim.org/resources/contrastchecker/?fcolor=D0D0D0&...)

                                                              • superkuh

                                                                yesterday at 11:39 PM

                                                                Video device initialization is intimately intertwined and a dependency for all this early boot stuff. I was hoping to learn more but it's not even mentioned. Still, neat.

                                                                  • phendrenad2

                                                                    today at 7:31 AM

                                                                    It's because on a brief period of old PC hardware (1994-1998), when Linux was starting off, high-resolution video initialization (SVGA+) was easier to do in 16-bit mode, before the bootloader switched the CPU over to 32-bit mode. Because GRUB handled this transition, GRUB became responsible for video initialization. After 1998 GPU manufacturers added 32-bit support for initialization, but the long tail of users with hardware with that limitation really entrenched this responsibility in GRUB.

                                                                    • qingcharles

                                                                      today at 2:23 AM

                                                                      If you can find a copy of this on the high seas, it's a great resource. I wrote my own OS by starting with this and the Linux source in the mid-90s:

                                                                      https://www.amazon.com/-/he/Developing-32-Bit-Operating-Syst...

                                                                      • megous

                                                                        yesterday at 11:57 PM

                                                                        It's not a dependency for Linux boot at all. You can do well with serial port alone, as anyone who brought up eg. an ARM SoC in Linux will attest to.

                                                                        Also it's not very interesting either. At simplest, Linux just needs to take a pointer to a beginning of a framebuffer and some metadata, and will write to the framebuffer whenever there's something to update.

                                                                          • okanat

                                                                            today at 2:29 AM

                                                                            If you would like to see an actually "interesting" boot, I recommend checking out how Raspberry Pi's boot.

                                                                            It is a unique monstrosity that boots from the video / GPU core instead of one of the ARM cores. It has an arcane undocumented architecture.

                                                                            • edoceo

                                                                              today at 1:29 AM

                                                                              Soekris (rip) had an x86 network device. Four 10/100s and the disk was a CF. Could only serial console that thing - or SSH once it's running. Best router I ever had.

                                                                              Also, in 2000 when Windows crashed you could get a serial debugger. Wonder if they still do that?

                                                                            • superkuh

                                                                              today at 12:07 AM

                                                                              Maybe not linux specifically, but POST requires a video device software (BIOS Option ROM or UEFI GOP Drivers) of some sort does it not? That's been my experience with all PCs for 30 years. But maybe there are cases where it doesn't?

                                                                              edit: Apparently it's a desktop motherboard firmware thing. Ubiquitous but not technically a requirement for POSTing a computer.

                                                                                • GreenVulpine

                                                                                  today at 12:48 AM

                                                                                  I've found AM4/AM5 boards will still boot Linux without a discrete or integrated GPU, running a GPUless CPU, not an APU.

                                                                      • panny

                                                                        today at 12:33 AM

                                                                        I'm probably going to read this, but who thought putting light grey text on a white background was a good idea?

                                                                        • hamasho

                                                                          today at 12:16 AM

                                                                          Funny how those three posts are in hacker news top 5 now. I guess today is the low level appreciation day.

                                                                            * The Linux Boot Process: From Power Button to Kernel
                                                                            * The Journey Before main()
                                                                            * How programs get run: ELF binaries (2015) (lwn.net)
                                                                          
                                                                          edit: format

                                                                            • kuekacang

                                                                              today at 12:20 AM

                                                                              Oh hey, a fellow noticing person!

                                                                                • nightshift1

                                                                                  today at 12:38 AM

                                                                                  yes, and the bar is not at all at the same level.

                                                                              • rramadass

                                                                                today at 6:35 AM

                                                                                Very much overdue, i would say! Lately HN was turning into just adware for AI news.

                                                                                Does anybody have pointers to similar low-level details specific to iOS/Android systems? Given that most of us by now have a few of these lying around the house gathering dust, they can make a nice DUT to hack/study/learn a few technical things. I would be quite interested in knowing more about how the RF subsystem works and maybe repurposed as an SDR for example.

                                                                                • adtac

                                                                                  today at 1:01 AM

                                                                                  weekend hackernews best hackernews