'Completely unprecedented' outage causes havoc with IT systems across globe — as it happened
www.abc.net.au
A massive IT systems outage caused by issues with CrowdStrike software affects banks, airports, supermarkets and media companies across Australia and around the world.

All our servers and company laptops went down at pretty much the same time. Laptops have been bootlooping to blue screen of death. It’s all very exciting, personally, as someone not responsible for fixing it.

Apparently caused by a bad CrowdStrike update.

Edit: now being told we (who almost all generally work from home) need to come into the office Monday as they can only apply the fix in-person. We’ll see if that changes over the weekend…

  • alphacyberranger@sh.itjust.worksEnglish
    34·
    4 months ago

    One possible fix is to delete a particular file while booting in safe mode. But then they’ll need to fix each system manually. My company encrypts the disks as well so it’s going to be a even bigger pain (for them). I’m just happy my weekend started early.

    • rozodru@lemmy.caEnglish
      102·
      4 months ago

      that would only work for like low level people’s laptops. apparently if your role requires a more secure machine you also have to deal with bitlocker whiiiiiiich is tied in with crowdstrike soooooo no dice.

        • rozodru@lemmy.caEnglish
          8·
          4 months ago

          I mean if your IT was smart, IF they were smart, they would have the bitlocker decryptions backed up on like a usb or something. IF you need to access the decryption via microsoft then you’re apparently borked for now.

          • catloaf@lemm.eeEnglish
            3·
            4 months ago

            Yeah, most large orgs have a key server, or back up to AD. If you don’t have that, and no recovery key, you’re fucked and that data is gone.

              • catloaf@lemm.eeEnglish
                5·
                4 months ago

                I’ll give you one guess.

                (That’s why when I was in charge of that stuff at one company, I had that recovery key printed out and kept separately in a lockbox.)

          • conciselyverbose@sh.itjust.worksEnglish
            1·
            4 months ago

            Even if they do, though, if your business isn’t 20 people at 1 location, it’s going to be a giant headache to get people everywhere to fix them all.

            • rozodru@lemmy.caEnglish
              1·
              4 months ago

              oh no doubt, I was telling an old manager of mine today that this “fix” will likely take weeks as he thought it’d just be something they could update. yeah…no. it’s a manual fix for each individul machine. I do not envy anyone working in IT right now.

    • Valmond@lemmy.worldEnglish
      6·
      4 months ago

      You have ta have access to boot in safe mode too, I guess I can’t on my work pc for example.

      What a shitty workaround & might crowd strike burn in hell lol