So it turns out that the cause was indeed a rogue change they couldn’t roll back as we had been speculating.

Weird that whatever this issue is didn’t occur in their test environment before they deployed into Production. I wonder why that is.

35 points

All companies have a test environment. Some companies are lucky enough to have a separate environment for production.

permalink
report
reply
11 points
*

Change Manager who approved this is gonna be sweating bullets lol

“Let’s take a look at the change request. Now, see here, this section for Contingencies and Rollback process? Why is it blank?”

permalink
report
reply
3 points

I’m sure there was a rollback process, it just didn’t work.

permalink
report
parent
reply
0 points

If you don’t test a restored backup, you don’t have a backup, same applies here.

permalink
report
parent
reply
10 points

It’s as if they were running Windows 10 Home on their servers and had an upgrade forced onto them

permalink
report
reply
4 points

how else do you explain to the layman “catastrophic failure in the configuration update of core network infrastructure and its preceding, meant-to-be-soundproof, processes”

permalink
report
parent
reply
4 points

This happens in my business all the time…the test FTP IP address is left in the code and shit falls apart costing us millions… They hold a PIR and then it happens again.

permalink
report
reply
4 points

SNAFU

permalink
report
parent
reply
3 points

This should be their new logo. https://imgur.com/a/bdIUayH

permalink
report
reply

Australia

!australia@aussie.zone

Create post

A place to discuss Australia and important Australian issues.

Before you post:

If you’re posting anything related to:

If you’re posting Australian News (not opinion or discussion pieces) post it to Australian News

Rules

This community is run under the rules of aussie.zone. In addition to those rules:

  • When posting news articles use the source headline and place your commentary in a separate comment
Banner Photo

Congratulations to @Tau@aussie.zone who had the most upvoted submission to our banner photo competition

Recommended and Related Communities

Be sure to check out and subscribe to our related communities on aussie.zone:

Plus other communities for sport and major cities.

https://aussie.zone/communities

Moderation

Since Kbin doesn’t show Lemmy Moderators, I’ll list them here. Also note that Kbin does not distinguish moderator comments.

Additionally, we have our instance admins: @lodion@aussie.zone and @Nath@aussie.zone

Community stats

  • 1.1K

    Monthly active users

  • 1.4K

    Posts

  • 14K

    Comments