Marketers Are Struggling to Keep Up With Customer Expectations: Here's Proof

How pitiful is this: My wife left me alone all last weekend and the most mischief I could get into was looking for research about cross-channel customer views. The only defense I can make is I did promise a client a paper on the topic, which I finished Sunday night. But then I decided it was way too wonky and wrote a new, data-free version that people might actually read.

But you, Dear Reader, get the benefit of my crazy little binge. Here’s a fact-filled blog post that uses some my carefully assembled information. (Yes, there was actually much more. I’m so ashamed.) 

Customer Expectations are Rising

Let's start with a truth universally acknowledged – that customers have rising expectations for personalized treatment. Unlike Jane Austen, I have facts for my assertion: e-tailing group's 7th Annual Consumer Personalization Survey found that 52% of consumers believe most online retailers can recognize them as the same person across devices and personalize their shopping experience accordingly. An even higher proportion (60%) want their past behaviors used to expedite the shopping experience, and one-third (37%) are frustrated when companies don’t take that data into account.

Switching to customer service, Microsoft’s 2015 Global State of Multichannel Customer Service Report  found that 68% of U.S. consumers had stopped doing business with a brand due to a poor customer service experience and 56% have higher expectations for customer service than a year ago. So, yes, customer expectations are rising and failing to meet them has a price.

Marketers Know They Need Data

Marketers certainly see this as well. In a Harris Poll conducted for Lithium Technologies, 82% of 300 executives agreed that customer expectations have gotten higher in the past three years.  Focusing more specifically on data, Experian's 2015 Data Quality Benchmark Report, which had 1200 respondents, found that 99% agreed some type of customer data is essential for marketing success. Marketers are backing those opinions with money: when Winterberry Group asked a select set of senior marketers what was driving their investments in data-driven marketing and advertising, the most commonly cited reason was the need to deliver more relevant communications and be more customer-centric. .

Few Have the Data They Need

But marketers also recognize that they have a long way to go. In Experian’s 2015 Digital Marketer study, 89% of marketers reported at least one challenge with creating a complete customer view.

Econsultancy’s 2015 The Multichannel Reality study for Adobe found that just 29% had succeeded in creating such a view, 15% could access the complete view in their campaign manager, 14% integrate all campaigns across all channels, and 8% were able to adapt the customer experience based on context in real time.  In other words, the complete view is just the beginning.  In other words, marketers are nowhere near as good at personalizing experiences as consumers think.

Real-Time Isn't a Luxury

Given the challenges in building any complete view, is real-time experience coordination too much to ask? Customers don’t think so; in fact, as we've already seen, they assume it’s already happening. Marketers, of course, are more aware of the challenges, but they too see it as the goal. In a survey of their own clients, marketing data analysis and campaign software vendor Apteco Ltd found that 12% of respondents were already using real-time data, 31% were sure they needed it and 37% felt it might be useful. Just 17% felt daily updates were adequate.

Real-Time Must Also Be Cross-Channel

It’s important to not to confuse real-time personalization with tracking customers across channels or even identifying customers at all.  In a survey by personalization vendor Evergage, respondents who were already doing real-time personalization were most often basing it on immediately observable, potentially anonymous data including type of content viewed, location, time on site, and navigation behavior.  Yet the marketers in that same study gave the highest importance ratings to identity-based information including customer value, buying/shopping patterns, and buyer persona. It’s clear that marketers recognize the need for a complete customer view even if they haven't built one.

Summary

What are we to make of all this, other than the fact that I need to get out more?  I'd summarize this in three points:

- customer expectations are truly rising and you'll be penalized if you don't meet them
- marketers know that meeting expectations requires a complete customer view but few have built one
- the complete view has to be part of a real-time integrated, real-time to deliver the necessary results

None of this should be news to anyone. But perhaps this data will help build your business case for investments to solve the problem.  If so, my lost weekend will not have been in vain.
.

StrongView Moves Beyond Email to Real-Time, Contextual Marketing

Today's email vendors face an interesting business challenge. On one hand, building a high-volume email engine is a lot harder than you’d think, so business is strong despite near-commodity status. But marketers want to integrate email with other messaging channels, so a stand-alone email platform is increasingly unattractive. The obvious solution is to add other channels and, even more important, features to control the decisions of when, how, and to whom messages are sent. This puts vendor at the center of the marketing operations, helping them to retain clients and charge higher fees.

Indeed, this strategy has succeeded for many vendors: ExactTarget, Responsys, Silverpop, and Neolane all grew from mostly-email to broader systems that were purchased by larger vendors as the foundation of an all-compassing marketing suite. Other email providers have remained independent but still expanded their scope to remain competitive and grow.

StrongView, which was original email specialist StrongMail, has followed this course. Rotating banners on the company Web site position StrongView as a “product platform” and “marketing cloud” as well as mentioning “cross-channel lifecycle marketing”, “present tense marketing”, “true one-to-one communication” and “the first customer insight solution supporting unlimited cross-channel interaction data”. This may set a world record for buzzword intensity, but that’s okay so long as the underlying product matches the implied promises. On the whole, I’d say it does.

The key to all this is the one unfamiliar phrase on the previous list: “present tense marketing”. This is StrongView’s own coinage, intended to describe their proprietary view of context-based marketing (which strikes me as plenty buzzy all by itself, but then I have a low tolerance for such things). The gist of contextual marketing, in StrongView's definition, is to tailor customer treatments to the current situation (location, device, environment, past behaviors, etc.), so those treatments lead the customer in a profitable direction. StrongView sees this as the future of marketing and has defined its strategy as helping marketers make the transition by providing the necessary technology and supporting services.

StrongView earns considerable credit in my book for articulating a proper strategy: one that defines not just a goal (helping marketers make the transition) but also the method for achieving that goal (by providing the necessary technology and services). Still, articulation is just a first step. The next is even more important: implementing the method effectively.

StrongView has identified several key implementation requirements. Necessary technologies include real-time analytics to select best treatments; dynamic message assembly to construct those treatments; and multi-channel routing to deliver the treatments via email, SMS, mobile apps, Web pages, social media, and display ads.

Of these technologies, content creation, dynamic assembly and delivery are extensions of the company’s original email functions. StrongView has supplemented them by building an impressive campaign flow designer that handles complex, multi-step programs.  Predictive analytics rely on external modeling tools, but the vendor will compensate with prebuilt models and with services to create custom models. There’s also a methodology to guide creation of campaigns and models.

All these functions require a much larger, more flexible data environment than a traditional email system.  StrongView has stepped up to the challenge by building a data store using Amazon RedShift.  This closes a critical gap faced by email vendors trying to reach the next level.  StrongView has also knitted together everything from content creation and campaign design to execution and reporting in a tightly integrated user interface, another requirement in providing the speed and efficiency needed for a “contextual” approach.

Finally, we come to services.  StrongView recognizes that many marketers will need help in making the transition towards more advanced marketing techniques, so it is offering marketing strategy, analytics, technical development, campaign design, creative, production and delivery.  These are sold on project or retainer basis as appropriate. StrongView is clear that these services are intended to help marketers supplement their own resources, not to convert the business into a service agency.

All told, this is a pretty complete package. Although StrongView’s vision is far from unique, they have carefully worked through the implications to define and deliver a complete solution.  This should be enough to get their customers started.  Results will determine what happens next.

I've Discovered a New Class of System: the Customer Data Platform. Causata Is An Example.

It has taken me a while to connect the dots, but I’m now pretty sure I see a new type of software emerging. These systems that gather customer data from multiple sources, combine information related to the same individuals, perform predictive analytics on the resulting database, and use the results to guide marketing treatments across multiple channels. This differs quite radically from standard marketing automation systems, which use databases built elsewhere, rarely include integrated predictive modeling, and are focused primarily on moving customers through multi-step campaigns. In fact, the new systems complement rather than compete with marketing automation, which they treat as just one of several execution platforms. The new systems can also feed sales, customer service, online advertising, point of sale, and any other customer-facing systems.

Given how much vendors and analysts love to create new categories, I’m genuinely perplexed that no one has yet named this one. I’ll step in myself, and hereby christen the concept as “Customer Data Platform”.  Aside from having a relatively available three letter abbreviation (see Acronym Finder for other uses of CDP), the merits of this name include:

- “Customer” shows the scope extends to all customer-related functions, not just marketing;
- “Data” shows the primary focus is on data, not execution; and
- “Platform” shows it does more than data management while supporting other systems

But, you may ask, is this really new? Certainly systems for Customer Data Integration (CDI) have been around for decades: these include specialized products like Harte-Hanks Trillium and SAS DataFlux, CDI features within general data management suites like Informatica and Pentaho, and integration within cloud-based business intelligence products like GoodData and Birst. Many of those products have limited capabilities for working with newer data sources like Web sites and social networks, but the real distinction between them and CDPs is that the older systems are mainly designed to assemble data.  Some also provide analytics, but they don't extend to real-time decisions based on predictive models.

Similarly, there have long been specialized systems for real-time interaction management (such as Infor Interaction Advisor and Oracle Real Time Decisions) and for predictive modeling (SAS, IBM SPSS, KXEN). Some interaction managers do create predictive models, and the really big vendors (IBM, SAS, Oracle) have all three key components (CDI, real-time decisions, and predictive models) somewhere in their stables. But systems that closely couple just those features with the goal of feeding data as well as recommendations to execution systems? Those are something new.

By now, you’re probably wondering if I’ll ever get around to actually naming the vendors I have in mind. I’ve recently written about some of them, including Reachforce/SetLogik and Lattice Engines.  I also include RedPoint in the mix, because it has all the key capabilities (database development, predictive models, and real time decisions) even though it also offers conventional campaign management. Others I haven’t yet written about include Mintigo and Gainsight. Of course, each has a different mix of features and its own market position.  Indeed, several have specifically told me they do not compete with the others. Fair enough, but I still see enough similarity to group them together.

All this is a very long-winded introduction to Causata, yet another member of this new class. By now, you can probably guess Causata’s main functions: assemble customer data from multiple sources, consolidate it by customer, place it in an analytics-friendly format, run predictive models against it, and respond in real time to recommendation requests from other systems including Web sites, email, banner ads, and call centers. And you’d be right.

But that’s not the end of the story. With any product, it’s the details that matter. Causata is particularly strong in the data management department, accepting both batch and real-time data feeds and storing data as different types of events (email sent, Web site visit, call center interaction, etc.), each having predefined attributes. The system also has a particularly sophisticated “identity association” service, which looks for simultaneous events involving different identifiers as a way to link them, and can chain identifiers that were linked at different times. When I spoke with Causata about two months ago, the association rules were pretty much the same for all clients, but they promised users would get more control in the future. Users could already choose which types of associations to use in specific queries.

Causata stores the assembled data in HBase, a Hadoop-based database management system that is particularly well suited to large data volumes, many different data types, and ad hoc queries. In addition to the raw data, the system can store derived values such as aggregations (e.g., number of Web page view in past 24 hours) and model scores. Users can run SQL queries to extract data for analysis and predictive modeling in third-party software including QlikView, Tableau, SAS, and R. Prebuilt QlikView reports show the predictive power of different variables for user-specified events. The lack of native analysis and modeling tools creates some friction for users, but also lets them stick with familiar products. So the pros and cons probably cancel each other out.

The system’s decision tools are straightforward. For each situation, users define a “decision engine” that can select among multiple options, such as campaigns, products, or marketing content. These options can have qualification rules. To make a decision, the system can test the options in sequence and pick the first one for which a customer is qualified, or pick the option with the highest predictive model score. Users can also specify a percentage of customers to receive a random option, to gather data for future decisions. An engine can return multiple decisions for situations that require more than one option, such as a Web page with several offers. Causata has some machine learning algorithms to help with the decision process. It plans to expand these to automatically select the best option in a given situation.

Decision engines are called by external systems through a Web services API that can respond in under 50 milliseconds. This is fast enough to manage Web banner ads – something not all interaction managers can achieve. Model scores and other data are updated in real time during an interaction.

Causata can be deployed on-premise by a client or as a cloud-based service. The vendor says a typical implementation starts with three or four data sources and is deployed in about 30 days – very fast for this type of system. In February, Causata introduced prebuilt applications for cross-sell, acquisition, and return programs in financial services, communications, and digital media. These will further speed deployment.

Pricing is based on the number of data sources and touchpoints, with additional charges based on data storage. Cost begins around $150,000 per year.