At a point in the past we were focused on root cause analysis, but it turns out that the root cause of the problem is frequently outside the system, here's an example...
It's a few minutes before midnight at a cable company. The plan is to test the battery backup by cutting off the power. Someone is standing by the big junction box and ready to cut off the power to the street. (Over the past few years the focus has been on adding devices to the network and not on maintaining the batteries that backed up the street power...you get the picture...)
The clock strikes twelve and the lever is thrown, the power doesn't even stutter and the entire head end switches over to battery backup....success!....then someone says, "what's that smell?" uh oh, it looks like the batteries are cooking off...no problem, back they go to street power with a flick of the switch....meanwhile,a couple blocks away, a transformer turns into a roman candle. turns out they'd crossed some electrical line with the load rating of the transformer that served their facility.
The power goes out
Thousands of subscribers marooned
It is now a couple minutes past midnight and the cable company has gone from a perfectly functioning head end serving thousands of customers to a cable tv black hole...all without having a single problem ( outside the ones they made for themselves.)
Regularly scheduled preventive maintenance makes such a nice difference, doesn't it? even with cable network assets...The work we are doing in Tivoli Industry Solutions is championing the convergence or IT and non IT asset management into industry focused solutions.[Read More]