• nyan@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      10
      ·
      edit-2
      6 months ago

      And it’s a sad, sad day when the situation in xkcd 908 looks like an improvement over even one of the commercial offerings.

  • shalafi@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    2
    ·
    6 months ago

    Better article:

    https://www.theregister.com/2024/05/09/unisuper_google_cloud_outage_caused/

    They restored from another cloud service. Were I in charge, I’d still be leery of not having that data on my own drives. I have my Windows libraries mapped to my ghetto RAID 0, and those folders are in turn backed to Google. If all else fails, I have a local backup. And this story reminds me, I haven’t installed VEEAM on this new PC…

  • LeTak@lemm.ee
    link
    fedilink
    English
    arrow-up
    26
    ·
    6 months ago

    Waiting for the news “Google deleted users account, now they lost access to their passkeys and with that to all other services” It can only be a matter of days until it happens.

  • kat_angstrom@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    ·
    6 months ago

    Yeah, this has definitely happened before, we just don’t hear about it in the news. I am personally aware of a Canadian non-profit whose Google accounts were nuked with no notice or explanation last year, leading to massive disruptions for 150 staff and even more clients. They never found out why, and had to restore from backups onto a brand new Google business account

    • nyan@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      30
      ·
      6 months ago

      had to restore from backups onto a brand new Google business account

      Thus proving that they learned nothing from the experience.

  • 7rokhym@lemmy.ca
    link
    fedilink
    English
    arrow-up
    24
    ·
    6 months ago

    Backup was on Azure. I get the sentiment on the cloud, but there is no excuse for this incompetence at Google.

  • billwashere@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    6 months ago

    “This should not have happened.”

    Duh, ya think?

    Google Sales Engineer: oh I see you didn’t purchase the “Do not randomly nuke my cloud” option… well there’s the problem.

  • markon@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    ·
    6 months ago

    But you can’t trust regular people to have open source ASI, but don’t worry, we won’t fuck it up.

  • specialseaweed@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    12
    ·
    6 months ago

    I started out a field tech for an industrial firm. My industrial job killed my body. 110+ degrees in the factories, heavy chemicals back when safety was a joke, impossible hours and crawling thru hell on earth to trace a control problem.

    Decades later I ended up a CTO. The more I worked, the more I realized it was impossible. Everything was impossible. It could never be secure enough. I could never have enough faith in my vendors to sleep at night. Everything in every direction was terrifying, and we were good at it. You just couldn’t be good enough.

    I wished I had stayed a field rat. That CTO job broke my mind. Now I’m that nutjob that won’t let people use my WiFi, they go on the visitor walled off WiFi. My kids can’t install apps without permission. I check my home network logs and have alerts set up for everything imaginable.

    I read stories like this and it gives me PTSD.

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    1
    ·
    6 months ago

    This is the best summary I could come up with:


    The company accidentally erased the private Google Cloud account of a $125 billion Australian pension fund, UniSuper.

    “This is an isolated, ‘one-of-a-kind occurrence’ that has never before occurred with any of Google Cloud’s clients globally,” Google Cloud CEO Thomas Kurian and UniSuper CEO Peter Chun said in a joint statement obtained by The Guardian May 8.

    Google Cloud has identified the events that led to this disruption and taken measures to ensure this does not happen again.”

    And nearly half a million companies across the globe use Google Cloud as a “platform-as-a-service,” or client-facing tool, including Volkswagen and Royal Bank of Canada.

    The National Security Agency inked a $10 billion deal with Amazon to move its intelligence surveillance data onto the company’s cloud.

    And the Pentagon has a $9 billion contract with Microsoft, Google, Oracle, and Amazon for cloud computing services.


    The original article contains 272 words, the summary contains 141 words. Saved 48%. I’m a bot and I’m open source!

    • kbin_space_program@kbin.run
      link
      fedilink
      arrow-up
      28
      ·
      6 months ago

      It has happened before. They just swept it under the rug and blamed the client.

      A user was setting up a new laptop and synced an empty folder with google drive, intending to download accounts data to their machine. It bugged and treated the empty folder as the master and began erasing the drive contents.

      After two weeks of pestering google, they relented and pulled from their backups they swore they didn’t have and didn’t exist.

    • db2@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      5
      ·
      6 months ago

      19 billion dollars and they can’t do it themselves? They need Amazon and Microsoft?

  • BearOfaTime@lemm.ee
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    4
    ·
    6 months ago

    This is a “one of a kind” error.

    OK, that it can happen at all is a problem. And sorry, but the idiots who put their data in with Google should be fired.

    I get offloading risk, little good will that do when your company goes tits up.

    • slimarev92@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      6 months ago

      Where would you put their data then? Self hosting is not exactly safe either.

      At the end of the day, every approach has its tradeoffs. Using a reputable cloud provider is a very valid choice.

      • whats_all_this_then@programming.dev
        link
        fedilink
        English
        arrow-up
        9
        ·
        6 months ago

        Thank you! Every time a story like this comes up, people seem to wanna pretend managing your own hardware is all sunshine and rainbows. Especially if you want global scale or as little down-time as possible, cloud provider’s your best bet, albeit one where you have less control than you would with your own servers.

        Opinion: You should be building on top of open source platforms and tools (Docker, Kubernetes if you need it…granted I’m not an expert in this area) to mitigate some of the vendor-lockin, and take a multi-cloud approach. If you’re mainly hosting on GCP for example, host smaller deployments on AWS, Azure, Cloudflare, or something else as a contingency…eventuality you can also add or just move to your own servers relatively painlessly. Also AGGRESSIVELY backup up your database in multiple places.

  • Juice@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    6 months ago

    Suddenly, using what little 401k I had for a down payment on a house doesn’t seem so bad lol

    • cannache@slrpnk.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 months ago

      Yup. I try to keep my money in cash or in the bank. Crypto is alright but it’s become a huge issue when guys who have no life skills outside hacking feel the need to assert power over others lives