Wal-Mart’s Plans For Its 4-Petabyte Database

Written by Evan Schuman
August 3rd, 2007

When the world’s largest retailer struggles with a database issue, the numbers can be a bit daunting. It’s datawarehouse, for example, is larger than 4 Petabytes. That’s more than 4,096 TBytes, give or take a few million bits.

The chain has more than 6,000 stores, with some having almost a half-million SKUs each. You think your Excel spreadsheets are bad? Wal-Mart’s database tables have literally 100 billion rows. The retailer’s POS systems have to ring up some 276 million items?a day.

This peek into the IT operations of this $345 billion retail empire comes courtesy of a phone interview with Wal-Mart Chief Technology Officer Nancy Stewart. The occasion: Wal-Mart wanted to talk up a recent purchase of HP Neoview systems.

Although HP and Wal-Mart issued the statement on Aug. 1, the systems have been in place for months, having gone into full production in May, Stewart said. Wal-Mart rarely agrees to news releases for purchases, let alone interviews. Why this special treatment for HP?

“We delayed this announcement for several months. This announcement has not come on a whim,” she said. The HP system “has very strong high-availability characteristics. The thing that did it for me personally in terms of the relationship is that it is an extremely high availability system and it requites very little support.”

HP’s servers, which will take their place along with hardware from IBM, EMC and Teradata, were chosen because of how they performed within Wal-Mart’s very high-volume, high stress environment.”We wanted our relationship to see if we could max out high performance characteristics,” she said. “What a lot of the folks we have dealt with do is they will parse the queries. Here at Wal-Mart, we don’t batch the queries. We process those records in realtime.”

The Wal-Mart executive said she was surprised with HP’s performance. “We are very very pleased with where we are today. We have been very very surprised that they have been able to deliver within this timeframe,” she said, adding that she also applauded their attitude. “They would just take every challenge. They kind of delighted in the opportunity.”

Although Stewart wouldn’t get into details about exactly what HP’s servers will be doing for Wal-Mart, she did say that it would involved with RetailLink?the chain’s supply chain system for suppliers and customers?with the goal of improving product information access. “What we want is to be able to better present wherever those products are, in the right store in a community. We need to make decisions much more quickly.”


Comments are closed.


StorefrontBacktalk delivers the latest retail technology news & analysis. Join more than 60,000 retail IT leaders who subscribe to our free weekly email. Sign up today!

Most Recent Comments

Why Did Gonzales Hackers Like European Cards So Much Better?

I am still unclear about the core point here-- why higher value of European cards. Supply and demand, yes, makes sense. But the fact that the cards were chip and pin (EMV) should make them less valuable because that demonstrably reduces the ability to use them fraudulently. Did the author mean that the chip and pin cards could be used in a country where EMV is not implemented--the US--and this mis-match make it easier to us them since the issuing banks may not have as robust anti-fraud controls as non-EMV banks because they assumed EMV would do the fraud prevention for them Read more...
Two possible reasons that I can think of and have seen in the past - 1) Cards issued by European banks when used online cross border don't usually support AVS checks. So, when a European card is used with a billing address that's in the US, an ecom merchant wouldn't necessarily know that the shipping zip code doesn't match the billing code. 2) Also, in offline chip countries the card determines whether or not a transaction is approved, not the issuer. In my experience, European issuers haven't developed the same checks on authorization requests as US issuers. So, these cards might be more valuable because they are more likely to get approved. Read more...
A smart card slot in terminals doesn't mean there is a reader or that the reader is activated. Then, activated reader or not, the U.S. processors don't have apps certified or ready to load into those terminals to accept and process smart card transactions just yet. Don't get your card(t) before the terminal (horse). Read more...
The marketplace does speak. More fraud capacity translates to higher value for the stolen data. Because nearly 100% of all US transactions are authorized online in real time, we have less fraud regardless of whether the card is Magstripe only or chip and PIn. Hence, $10 prices for US cards vs $25 for the European counterparts. Read more...
@David True. The European cards have both an EMV chip AND a mag stripe. Europeans may generally use the chip for their transactions, but the insecure stripe remains vulnerable to skimming, whether it be from a false front on an ATM or a dishonest waiter with a handheld skimmer. If their stripe is skimmed, the track data can still be cloned and used fraudulently in the United States. If European banks only detect fraud from 9-5 GMT, that might explain why American criminals prefer them over American bank issued cards, who have fraud detection in place 24x7. Read more...

Our apologies. Due to legal and security copyright issues, we can't facilitate the printing of Premium Content. If you absolutely need a hard copy, please contact customer service.