There was construction in the building over the past several months and nobody bothered to seal off the drop ceiling or door to the data center. As you might imagine all that dust was sucked in thru the servers, thru the network gear, and thru the AC unit. The AC unit got so bad that at one point it failed and shut down due to back pressure from clogged filters. The temperature spike may have caused a number of servers to fail as well. When I saw it several weeks had passed since the AC unit had been restored and yet no effort had been made to clean the data center.
To prevent the coating of dust from overheating the systems, every piece of equipment must be powered down, un-racked, opened, vacuumed with a very soft bristle brush, and then put back. The AC filters have already been replaced and now every surface has to be cleaned. It will probably take a couple weeks work for two of their people to complete.
|More sheet rock dust|
Its funny how much the condition of a data center can tell you about the rest of an IT department, how its run, and what kind of detail has been paid to the little things. These details are what make an IT department run smoothly. Neglect the little things and everything falls apart.
Just to end on a good note, this last pic is of a data center belonging to a smaller customer but which is very well maintained. Just like their entire IT organization everything is in its place and working as it should be.