1. OCAU Merchandise is available! Check out our 20th Anniversary Mugs, Classic Logo Shirts and much more! Discussion in this thread.
    Dismiss Notice

Consolidated Business & Enterprise Computing Rant Thread

Discussion in 'Business & Enterprise Computing' started by elvis, Jul 1, 2008.

  1. Ryansta

    Ryansta Member

    Joined:
    Jul 7, 2016
    Messages:
    91
    Location:
    Brisbane
    Sigh...
    Yesterday at 15:52 Exchange 2013 database1 dismounted and had a status of dirty shutdown. Ran repairs move mailboxes around in prep to get rid of that database.
    As i get home now, Database3 has done the exact same thing only at 16:53.
    What on earth could cause this?
     
  2. looktall

    looktall Working Class Doughnut

    Joined:
    Sep 17, 2001
    Messages:
    26,876
    Something running on a scheduled task?
     
  3. PabloEscobar

    PabloEscobar Member

    Joined:
    Jan 28, 2008
    Messages:
    14,677
    Dollars to Donuts, someone has installed .Net 4.6 on it.


    Something that caught a lot of people out, due to the scale of the outage, was the availability of fuel... Normally, if its a (relatively) localised power outage, you can drive a few towns over, and find somewhere with power, so you can fill your Jerry's and keep your generator running... But when the whole state is out, that isn't viable. The few servo's that had their own power were doing a roaring trade :).
     
    Last edited: Sep 30, 2016
  4. Hive

    Hive Member

    Joined:
    Jul 8, 2010
    Messages:
    6,394
    Location:
    AvE
    This. Try installing sharepoint 2013 with .net 4.6 present. Claims .net isn't installed and can't be reverted back to sans 4.6, you have to registry edit the current version and set it to 4.5. Microsoft and their fucking QA department..... (or lack thereof)
     
  5. Foliage

    Foliage Member

    Joined:
    Jan 22, 2002
    Messages:
    32,058
    Location:
    Sleepwithyourdadelaide
    Hospital had fuel pump failure on their diesel gensets for people on life support. Those gensets should be serviced and run tested monthly which they obviously aren't. Absolutely disgraceful.

    On an oil rig their pumps are stripped and rebuilt every few weeks as they cannot ever stop due to the financial consequences. They are often serviced and treated as more critical than something that supports human life.

    People who don't regularly test their UPS might as well not have one. Same goes for backups.
     
  6. Ryansta

    Ryansta Member

    Joined:
    Jul 7, 2016
    Messages:
    91
    Location:
    Brisbane
    Doesn't look like 4.6 is installed. There are windows updates for 4.5.2 to install.

    Before the database3 corruption there were mailbox moves happening. I was moving mailboxes off of database1 to get rid of it. Could that cause it?
    Also, moving 40GB's of mailboxes used up 80GB's in the database3. 5 mailboxes were moving, 2 successful, 3 failed(too many corruptions to move). 80GB's gone :O

    There is 32GB of white space in database3 now though...
     
  7. OP
    OP
    elvis

    elvis Old school old fool

    Joined:
    Jun 27, 2001
    Messages:
    46,311
    Location:
    Brisbane
    Wait, I had a quote somewhere for this...

    There we go.
     
  8. PabloEscobar

    PabloEscobar Member

    Joined:
    Jan 28, 2008
    Messages:
    14,677
    Dang, I was so sure that was it :)... It always is when people complain of 2013 databases randomly dismounting... I guess I'll go back to blaming DNS :).

    Underlying disks are OK?
     
  9. Foliage

    Foliage Member

    Joined:
    Jan 22, 2002
    Messages:
    32,058
    Location:
    Sleepwithyourdadelaide
    See the way I see it is isn't even an option to not pay for it. If you do a simple risk analysis matrix the risk of not having redundant monthly tested fuel pumps comes out as a catastrophic risk.

    Eg if it fails you could have multiple dead. The cost of implementing the above practice is very low compared to the cost of killing multiple people due to negligence. Even if you simply put a dollar figure on their life and take all emotion out of it it is a no brainer.

    If an engineer didn't conduct a risk analysis on the above and someone died that is a jailable offence. People get sacked for not doing a documented peer reviewed risk analysis on far less serious pieces of equipment.

    If management won't listen to you just do a simple coloured risk analysis chart. When they see the red box with CATASTROPHIC written in it circled they tend to see reason. Bright colours and emotive words really do help convince stupid people.

    [​IMG]
     
    Last edited: Sep 30, 2016
  10. Ryansta

    Ryansta Member

    Joined:
    Jul 7, 2016
    Messages:
    91
    Location:
    Brisbane
    Disks are showing no errors. Its probably something to do with the backups and logs. Just don't know why its happening now and hasn't before.
     
  11. Punk

    Punk Member

    Joined:
    Mar 15, 2002
    Messages:
    1,058
    Location:
    Walking on Sunshine
    You would think but I've seen it a few times where it "Hits the Red" and still nothing happens. For months or even years... if at all.


    On another note, why are racks and cage nuts sooo different. Urgh...
    Lucky I have a specialised tool on me to deal with it.
     
  12. PabloEscobar

    PabloEscobar Member

    Joined:
    Jan 28, 2008
    Messages:
    14,677
  13. mr626

    mr626 Member

    Joined:
    Jul 17, 2011
    Messages:
    2,762
    What is the rant? I apply for the distribution thing each year- rarely use it but it only takes a couple of minutes and it is basically auto approved.
     
  14. Gunna

    Gunna Member

    Joined:
    Dec 25, 2001
    Messages:
    7,945
    Location:
    Brisbane
  15. PabloEscobar

    PabloEscobar Member

    Joined:
    Jan 28, 2008
    Messages:
    14,677
    The Rant is the removal of the functionality, and making it more difficult to update what is possibly the most bug ridden software in existence. In the past it was a one-click thing, I wasn't forced into stub downloads (which are another rant in themselves).
     
  16. OP
    OP
    elvis

    elvis Old school old fool

    Joined:
    Jun 27, 2001
    Messages:
    46,311
    Location:
    Brisbane
    Imma stop you right there.

    You see, you're a rational, logical, intelligent kind of dude. This is obvious by your postings here, and the profession you chose.

    Now, compare and contrast to corporate bean counters, who only ever see the bottom line, and only ever care about a window of time of about 18 months tops (if you're really lucky).

    Risk, people's well being, and even human life are all just mushy details to them that can't be represented as a number on a spreadsheet, or a column in their accounting package. As such, that's all way too hard, and can just be put on someone else to justify (and then easily be denied when it is less profitable than doing nothing).

    Same goes in the other direction - "potential" is meaningless to a bean counter until they see the invoice paid. So it's pretty easy for them to just kill any sort of preventative maintenance or research and development with a limited 1:1 view of thing done to nobody paying for it right now.

    Easiest thing in the world to just say "no" to everything, grind a company to a halt, and then blame everything else (economy, staff, government, "once in a 50 year event", whatever) for the problem.

    I'm with you, Pablo. Adobe make mass deployment way more painful than it needs to be. No, it's not impossible. But few other companies make you jump through as many hoops, and my time is precious.
     
    Last edited: Sep 30, 2016
  17. looktall

    looktall Working Class Doughnut

    Joined:
    Sep 17, 2001
    Messages:
    26,876
    The only thing worse than trying to deploy flash is trying to deploy Java.
     
  18. PabloEscobar

    PabloEscobar Member

    Joined:
    Jan 28, 2008
    Messages:
    14,677
    Do the cost/benefit of genset testing...

    Costs - Lots
    Benefits - None (unless we need it, then people die)
    Impact of People dying - Reputation goes down, Insurance premiums go up...

    Given hospitals don't really have a reputation to lose (after recent Chemo malarky) it just comes down to insurance costs, which are huge anyway, a slight increase in them is far less than the cost (and impact) of regular Genset testing.

    This is a pretty simplified view of this incident, but for most of the things that fall in Unlikely or Rare, even though the consequences can be dire. Preventative maintenance is not cost effective.

    Even WITH regular testing and redundant systems, shit breaks, and can (and seemingly always does, due to confirmation bias) break at inopportune times. So if you need to carry the insurance anyway... :).
     
  19. EvilGenius

    EvilGenius Member

    Joined:
    Apr 26, 2005
    Messages:
    10,920
    Location:
    elsewhere
    We had some fun with our generator years back. Genny was serviced. Fuel was good. Everything was going well. Then the pump to get fuel out of the 44gallon drum into the genny tank broke. At the same time we hit the hottest part of the day, AC load increased markedly and fuel usage went through the roof. In a mad panic I went out to buy a jerry can and some diesel, but didn't make it back in time :(
     
  20. bcann

    bcann Member

    Joined:
    Feb 26, 2006
    Messages:
    6,165
    Location:
    NSW
    surely a UPS should've been sitting in front of that generator, or you had one hell've trip back to site?
     

Share This Page

Advertisement: