Facial Recognition May Not Work For Security, But For CRM, …

Written by Evan Schuman
April 24th, 2013

With all of the in-store changes being pushed by mobile—including the long-overdue predicted disappearance of the cashwrap—retailers are going to be moving payments in-aisle and pretty much anywhere in-store. Does facial recognition make sense? One vendor on Tuesday (April 23) tried, with a system that allows facial recognition to unlock a refrigerator, which determines which products are removed based on weight.

Although the current version of the system has serious technical limitations, the potential is probably greater for facial recognition than any other technology. Unlike PIN, cardswipes or any other form of biometrics, facial recognition has the promise to do far more than verify identity, including guessing at emotional state, gender, age and other attributes.

Selling suntan lotion? How about the ability to identify shoppers with deep tans? Want to be able to tailor suggestions made to first-time shoppers based on gender or age? With a thermal scan comes the ability to pitch hot cocoa to shoppers whose skin is especially cold or ice-cold lemonade to those whose skin is especially hot. (It could factor in the outside temperature so that it doesn’t confuse someone who has been working in the sun with someone who is just running a fever. And if that shopper does have a fever, how about 50 cents off Tylenol?)

As a practical matter, facial biometrics has huge potential for CRM and marketing efforts, much more so than for payment authentication. ShelfX, the vendor behind Tuesday’s introduction, is pushing its facial recognition package as a way for shoppers to charge their account when removing items from a locked refrigerator, instead of using the NFC card that shoppers are issued.

A minor restriction is that each store—not each chain—has its own customer database. That means that if a nine-store convenience chain installed this system, a customer would have to re-train the system each time a new store was visited. The much greater concern is the system’s sensitivity. The system is not likely to recognize a shopper if there is even a slight change in appearance, said ShelfX CEO Ran Margalit. “Let’s say you have on sunglasses and you didn’t shave today,” he said, citing two situations that could fool the system into not recognizing a shopper. “That’s why we tell you to keep your card in your pocket.” (Here’s a rather low-cost demo of how it’s supposed to work.)

If the system is that particular—and if the shopper has to bring the NFC card along anyway—it seems simpler to just use the card. Unless, of course, the shopper was given a monetary incentive to use the facial recognition system. It’s no different than bribing shoppers to fill out surveys or to participate in other CRM programs.

The technology is rapidly approaching the point where these wacky ideas may become practical. In the same way that Google Voice is showing Siri a thing or two about getting voice recognition correct, experiments with facial recognition have shown sharp improvements in how usable data can be extracted. Unilever did a wonderful ice cream vending machine trial, where the machine only disposed ice cream to people who were smiling. (Frownie-puss? No ice cream for you.) Kraft ran a facial recognition supermarket trial, which used it to identify gender and issue different coupons based on that assumption. Pennsylvania tried using it for its state stores to determine whether a shopper was old enough to purchase wine. And a University of California study found shopping differences between sad and angry customers, giving a reason to have an automated means of differentiating between the two.

Wouldn’t want to replace card-swipes with facial recognition, but in a year or two, having this specific form of biometrics as a CRM and marketing tool has serious possibilities.


One Comment | Read Facial Recognition May Not Work For Security, But For CRM, …

  1. Jon Says:

    The facial recognition technology is definitely there for this, but it will take time for HD cameras to become cheap enough for widespread installations. Most of these facial recognition systems require decent resolution photos of a face, which a wide angle low res security camera cannot provide for far-away faces.


StorefrontBacktalk delivers the latest retail technology news & analysis. Join more than 60,000 retail IT leaders who subscribe to our free weekly email. Sign up today!

Most Recent Comments

Why Did Gonzales Hackers Like European Cards So Much Better?

I am still unclear about the core point here-- why higher value of European cards. Supply and demand, yes, makes sense. But the fact that the cards were chip and pin (EMV) should make them less valuable because that demonstrably reduces the ability to use them fraudulently. Did the author mean that the chip and pin cards could be used in a country where EMV is not implemented--the US--and this mis-match make it easier to us them since the issuing banks may not have as robust anti-fraud controls as non-EMV banks because they assumed EMV would do the fraud prevention for them Read more...
Two possible reasons that I can think of and have seen in the past - 1) Cards issued by European banks when used online cross border don't usually support AVS checks. So, when a European card is used with a billing address that's in the US, an ecom merchant wouldn't necessarily know that the shipping zip code doesn't match the billing code. 2) Also, in offline chip countries the card determines whether or not a transaction is approved, not the issuer. In my experience, European issuers haven't developed the same checks on authorization requests as US issuers. So, these cards might be more valuable because they are more likely to get approved. Read more...
A smart card slot in terminals doesn't mean there is a reader or that the reader is activated. Then, activated reader or not, the U.S. processors don't have apps certified or ready to load into those terminals to accept and process smart card transactions just yet. Don't get your card(t) before the terminal (horse). Read more...
The marketplace does speak. More fraud capacity translates to higher value for the stolen data. Because nearly 100% of all US transactions are authorized online in real time, we have less fraud regardless of whether the card is Magstripe only or chip and PIn. Hence, $10 prices for US cards vs $25 for the European counterparts. Read more...
@David True. The European cards have both an EMV chip AND a mag stripe. Europeans may generally use the chip for their transactions, but the insecure stripe remains vulnerable to skimming, whether it be from a false front on an ATM or a dishonest waiter with a handheld skimmer. If their stripe is skimmed, the track data can still be cloned and used fraudulently in the United States. If European banks only detect fraud from 9-5 GMT, that might explain why American criminals prefer them over American bank issued cards, who have fraud detection in place 24x7. Read more...

Our apologies. Due to legal and security copyright issues, we can't facilitate the printing of Premium Content. If you absolutely need a hard copy, please contact customer service.