Black Friday Turns Servers Dark at Wal-Mart, Macys

Two key E-Commerce leaders? and themselves shut out of the holiday sales rush for much of Friday, as their sites slowed to a crawl starting at about 4 AM in the East.

Keynote Systems, which tracks Web traffic, saw the Wal-Mart site "effectively down" from 4:30 AM Friday (East Coast time) until 2:30 PM Friday, said Ben Rushlo, a Keynote senior manager of competitive research.

In the morning, Rushlo said, the site of the nation's largest retailer was eight times slower than normal, with many unable to even reach the homepage. "Every request was either completely down?with an error message?or unusually slow," he said.

Things changed at 1:15 PM when the site went down completely, apparently a deliberate move by Wal-Mart to try and fix the problem. Users were then greeted with a Wal-Mart maintenance page. About an hour later?at 2:30 PM?the site came up and functioned perfectly.

A Wal-Mart spokesperson--Amy Colella?was quoted by the Associated Press as blaming the problems on a "higher than anticipated traffic surge." But 4:30 AM seems an unusually early time for such a surge, especially given that Wal-Mart's site would presumably have been prepared for a huge traffic surge on Friday anyway.

That said, this year did see extremely early traffic surges at Wal-Mart's brick-and-mortars, which absolutely would have prompted an online traffic spike. Ironically, the E-Commerce player that had been having periodic outages this year?Amazon?had a very uneventful day on Black Friday. One possible reason is that, unlike brick and mortars like Wal-Mart and Macys, Amazon is obviously always open 24x7, so it is less exposed to huge traffic surges as would Wal-Mart when it opens early for special events. Reports of huge lines out of Wal-Marts at 4 AM were flooding the Web.

Some industry observers speculated that it might have been an outsourced data center that was cause of the problem. Completely overloaded routers could have triggered such a situation, but the time of the impact makes that less likely. Another scenario was a denial-of-service attack, but the pattern of when the servers were back up makes that a less likely scenario.

Another key retailer who had problems on Friday was The parade people suffered what could be called The Disaster On 34th Street starting at about 4 AM, when their site was returning almost 100 percent error rates, according to a source familiar with's Web operations but who requested anonymity. Their performance dropped to one-sixth is normal response time and it didn't get repaired until about 2:15 PM.

The similarity of the times of both Macy's and Wal-Mart's outages?starting at 4 AM and 4:30 AM and completely resolving at 2:15 PM and 2:30 PM respectively?raised some initial questions about whether it was an Internet-wide problem, but the strengths of many other retail sites tended to eliminate that possibility. But the possibility that both sites were using the same data center seemed more likely, although that could not be confirmed.

On the good news front, the E-Commerce giant that was most closely watched on Friday? quite well, after some well-publicized outages. Amazon had a small hiccup on its site on Thanksgiving, but fared well on Black Friday itself, Rushlo said on Friday night. "? has been virtually perfect over the last two days, with no performance slowdowns and only a small period of performance stress when the XBOX 360 promotion was occurring," he said. ? was clearly ready for the holiday rush.?