So... 1070 minutes.

Post #390,805 by folkert 6/15/14 11:13:10 PM Reply	So... 1070 minutes. So, I had a major outage Friday night through Saturday After noon. So, my entire network stack blew a seal... and no it wasn't ice cream. So, back in March 2012, I had a partial outage that we were able to reset and swap around on and didn't have a problem up until 10:28PM MT on Friday night. You know it is tough replacing the stuff... remotely. Anyway, I am glad our colo is in Denver. Denver is the only place I know of that would have a store open on Saturday that has Enterprise level networking gear in stock. I'm happy about that... but 1070 minutes is a long time to be awake, considering I was awake from 3:30AM MT Friday... Yeah I passed out and slept for 2:20 at about 5:10AM MT. I'm still recovering. A couple other people were on the calls and in the colo doing work. -- greg@gregfolkert.net "No snowflake in an avalanche ever feels responsible." --Stanislaw Jerzy Lec
Post #390,806 by Another Scott 6/15/14 11:47:50 PM Reply	Ouch. Rest well.
Post #390,807 by folkert 6/16/14 12:38:05 AM Reply	More info... The power supply in one of the units screwed up everything else. Apparently the Fan failed... which took the power supply out... which back feed through the chaining and downlinks/uplinks. Just friggin burned me up... about as much as the outage did. Enterprise equipment isn't SUPPOSED to burn up like that. Grrr. -- greg@gregfolkert.net "No snowflake in an avalanche ever feels responsible." --Stanislaw Jerzy Lec
Post #390,811 by Ashton 6/16/14 4:30:45 AM Reply	Re: More info... ..just needs a 'crowbar' device to blow an appropriate fuse (from stored energy in regular/or from an isolated) fucking-Capacitor. In each fancy-thin 'enterprise' shiny-black box-thing. (And I guess they never heard of thermistors, or just any old PN or NP junction for a sensor. Duh.) Jeez, do I gots to fix Everything from these design-on-screen [then: Ship it] folk who can't even solder?
Post #390,814 by boxley 6/16/14 9:02:10 AM Reply	no, real data centers have those things dual power supplies redundant links everywhere but even then humans go wrong. A miswired electrical had both redundant power supplies on a single leg, oops the collapse of that leg during a "test" blew the whole effing thing. Made the new york news Any opinions expressed by me are mine alone, posted from my home computer, on my own time as a free American and do not reflect the opinions of any person or company that I have had professional relations with in the past 59 years. meep
Post #390,836 by Ashton 6/16/14 6:08:24 PM Reply	Ah.. OK, just another human Oopps brings down the Corp. Hindenburg :-/
Post #390,847 by static 6/16/14 11:51:53 PM Reply	You'd think it was obvious... When I (briefly) ran a small data center installation, I made sure all the boxes with dual power-supplies were even on different UPSs. And then I discovered the UPS software wasn't aware of this possibility. Wade. Just Add Story http://justaddstory.wordpress.com/
Post #390,850 by boxley 6/16/14 11:59:54 PM Reply	well in the bigs you have 48 volt frames, you have dual power supplies tied to dual transformers that supply current. Each of the frames is served by DC from a humungous battery center supplied by 2 (power company transformers) each on a different AC leg. That is good until power dies, then large generators kick in to assist the downage of AC power. All of this assumes the blueprints are correct. Sometimes they are not. That gets you a mention in the national papers. Any opinions expressed by me are mine alone, posted from my home computer, on my own time as a free American and do not reflect the opinions of any person or company that I have had professional relations with in the past 59 years. meep
Post #390,851 by Steve Lowe 6/17/14 12:31:35 AM Reply	:( sorry man

Welcome to IWETHEY!