Thursday, June 25, 2015

Campaign Management Is Dead. Here's What Next-Generation Marketing Automation Looks Like.

Scientists tell us that the attention span of the average human is now shorter than the attention span of a goldfish.(1)  In such a world, the chances of anyone reading this 2,000 word blog post are pretty much nil. But I think the topic is extraordinarily important, so here is a summary in sushi-sized bites:

- the conventional flow-chart model of marketing campaigns can’t capture the complexity of today’s  disjointed customer journeys.

- a new approach is emerging that identifies stages in the customer journey and picks “plays” (small, highly targeted sets of treatments) to execute in specific situations within each stage

- this approach is easier for marketers to manage because it lets them think in smaller, more comprehensible units

- it will eventually lend itself to greater automation as machines take over more of the marketer's job in a “madtech” world

You can stop here if you need to watch an important cat video.  But if you want to understand my thinking in more detail, please read on.

The first modern campaign manager, Third Wave Network’s MIND, was released in 1991. What made it modern was a standard relational database(2) and multi-step campaigns that that sent users down different paths depending on their actions during the campaign. The system displayed each campaign as a set of boxes connected with lines to represent movement of customers from one step to the next. This flow chart interface has been fundamentally unchanged ever since and remains the gold standard of marketing automation(3).

The significance of the flow chart is what it replaced. The previous standard was a list of segments, each described on one row of a (paper) spreadsheet, with characteristics including selection criteria, description, key code, promotion materials, and quantity. Marketers filled out these sheets and handed them to programmers to execute. This was how direct mail marketers worked for decades, and often still do: it’s an efficient way to manage dozens or hundreds of cells within a large outbound campaign. It supports multiple contacts, such as mailing a second catalog to high-performing segments several weeks after the initial drop. But the list for the second mailing is pulled at the same time as the first, so it doesn’t allow changes in treatment based on subsequent customer behavior. This adjustment is what branching flow charts provide.

A quarter century after its introduction, the flow chart is now ripe for replacement. Flow charts assume that customers will follow a small number of predefined paths. This was realistic when interactions were limited to a few company-controlled touchpoints.  But it doesn’t describe today’s self-directed, random-walk journeys through an ever-shifting media landscape. In this environment, the best a company can do is react intelligently wherever a customer appears, taking into account both the current situation and whatever it knows about the customer’s past. Even company-initiated messages, while not wholly reactive, must be consistent with other treatments.

The basic features of a better approach have been obvious for years. I’ve long described it as “do the right thing, wait, and do the right thing again.” What’s changed is visibility: marketers now can see vastly more data about their customers and can interact with them through vastly more channels. In the “madtech” vision I’ve been articulating recently, this translates to assuming that all data about each customer’s demographics, interests, behaviors, locations, intentions, and other attributes is available to everyone. This includes both data a company gathers through direct interactions and data aggregated by third parties and offered for sale. Indeed, third party data is essential for building a complete picture of each customer’s experience.(4)

The vision similarly assumes that messages can be delivered through channels the company does not own directly. These extend beyond conventional advertising to private channels that other companies have opened to external messages. A concrete example would be third party offers delivered through a company’s Web site. My shorthand for this is “everything is biddable”: meaning that marketers can pay to embed a message within every interaction the customer has with anyone. Since all marketers have the same opportunity to bid on all impressions, a corollary is that buying the right messages at the right price is the key to success – or, in another catchphrase, “the smartest bidder wins”.

Sadly, neither you nor I can make a living by repeating clever phrases. Someone has to do the hard work of figuring out what treatments to deliver in each situation. A flow chart can’t come close because the situations are far too varied for any one chart to capture all the alternatives. What’s needed is a system that will assess each situation as it arises and come up with a custom-tailored solution.

If the only goal were maximizing immediate response, this would be pretty simple. Existing recommendation engines and predictive models can easily tell you which content a person is most likely to pick or which product they are most likely to buy. Today's products often do this with limited information about the individual being targeted, but that’s just a reflection of what data is currently available: at least some current systems could incorporate individual details and history without a major revision. There are practical details of speed, scope, and accuracy but the broad design of such a system is straightforward.  It connects with every touchpoint (including exchanges that deliver external opportunities up for bidding), receives information about each interaction, and returns an optimal message along with the value to bid for the right to deliver it.

But immediate response isn’t the only goal. Each interaction is embedded in the context of a customer’s relationship with the company. The best message is the one that maximizes the long-term value of that relationship. This won’t necessarily be the message with the highest response rate or greatest immediate financial value. Automated systems can incorporate long-term value in their recommendations but only if they are tracking long-term outcomes and analyzing what changes them. I believe – and this is the main point of this entire post – that automated analysis can only optimize for long-term outcomes if customer data is classified by stages in the customer journey. In other words, you can’t just randomly test all possible treatments in all situations and let the best approaches bubble to the top. There are simply too many variables for that to work. Rather, marketers must assign customers to journey stages and use those stages as inputs when selecting treatments and evaluating results. The stages themselves can be adjusted over time in the light of experience. But without a journey map as a starting point, marketers and their machines will flounder endlessly in a sea of big data.

Maybe you're unimpressed.  Maybe that cat video beckons.  Maybe you're thinking, "All you've done is change the labels.  A map of journey stages looks a lot like a campaign flow, and for that matter an old-style campaign funnel."  I understand your doubts. But there are significant differences:

- journey stages are not associated with specific messages, while campaign steps are.  In fact, the whole purpose of campaign steps is to define which messages are delivered when. So a journey stage is a significantly higher level of abstraction. Put another way, journey stages are just one factor in deciding how to treat a customer, while campaign steps are the only factor.

- journey stages are inherently random, while campaign flows and funnel stages are relentlessly linear. The goal of a campaign or funnel is push customers from one stage to the next as quickly as possible. Journey stages do track a funnel-type motion but they’re more intended to capture a set of customer needs and interests. In conformance with the general notion that customers will control their own movement, journey stages are more descriptive than directional. It’s no problem for a journey map if customers move back to an earlier stage or if they stay in one stage indefinitely.  For stages such as “satisfied customer”, that’s actually a good thing.

I do recognize that “journey stage” implies motion, which means it's probably not the best term for what I have in mind.  A more neutral term like "state" would be better.  But I’ll stick with journey for now because it will intuitively make more sense to most people.

So let’s assume, at least for sake of argument, that you’re convinced marketing systems should consider  journey stage when they’re picking the best message for a specific customer in a specific situation. Does that mean campaign flows can be replaced by any recommendation engine that adds journey stage to its list of customer attributes?

I think not. The system needs an intermediate level between broad journey stages such as “interested prospect”, “active buyer”, “satisfied customer”, and “advocate”, and actual treatments during single interactions. That level is needed because marketers have to create the content that the machines will choose from during those treatments. Marketers will decide what content to create by envisioning experiences that span multiple interactions and then creating content for a complete experience. The best analogy I’ve found is “plays” in a sport like football: tightly choreographed sets of actions that serve a narrow purpose. Teams prepare plays in advance and pick the right play for the moment but they don’t try to set the sequence of plays before the game begins. They know that games, like customers, follow their own unpredictable course and all the team can do is react appropriately in each situation. It’s true that each play is directed towards a long-term goal, but execution of the play is really a self-contained project. What’s critical is that the marketing play can incorporate multiple interactions over time; this allows a more coherent, richer customer experience than treating each interaction as wholly independent.

Good marketers and sales people already think this way, although they usually describe it in terms of tactics to handle different types of buyers, personas, or situations. I’ve also recently heard several innovative marketing system vendors describe approaches that I believe are fundamentally similar to this concept, again in different terminology. I’ll tentatively adopt the term “plays” precisely because it’s vendor-neutral and because I think most people are familiar enough with sports plays for the analogy to be helpful.

To clarify, then, I believe that marketers of the future will think in terms of broad customer journey stages (i.e., states), such as “active buyer” or “satisfied customer”. Each stage has strategic objectives, which might be to move an active buyer closer to purchase or to strengthen the relationship with a satisfied customer. Marketers will pursue those objectives through “plays” that are appropriate in specific situations, such as “active buyer requests a demonstration” or “satisfied customer has a service problem” and take into account other context such as location, device, and recent behaviors. They will create content and process flows to execute those plays.  These plays will resemble current multi-step campaigns but on a smaller scale and with narrower goals. This limited scale is exactly what makes plays so useful, because marketers can easily visualize each play as a whole. This lets them construct coherent sets of messages, rules and metrics to execute each play from start to finish, measure its impact, and make changes to optimize its effectiveness. Today’s massive nurture campaigns are too large and complicated to do the same.

Marketing systems of the future will also be designed to support this model. It may even happen that systems designed on this model come first and marketers adopt the model as they come to appreciate the systems. Or, because the stage/play model is especially well suited to automated campaign design and the general “madtech” world, perhaps it will be embedded in automated systems and grow as such systems are adopted.

Whatever the mechanism, the traditional campaign flow model has reached the end of its useful life.  I believe the stage/play model will be its successor.


(1) The study actually measured the attention span of average Canadians.  It didn’t specify the nationality of the goldfish.

(2) The preceding generation of campaign managers, called MCIF systems, used proprietary columnar databases to wring adequate performance from the PC hardware available at the time. The first of these, MPI Max$ell, was introduced in 1984; other major products included OKRA Marketing (1986), Customer Insight (1987), and Harte-Hanks P/CIS (1988). Interestingly, the height of sophistication among these products was a feature called “matrix marketing”, which identified the best offer to make each customer after each (monthly) update. Sound familiar?

(3) click here for my 1994 review of MIND and a couple significant contemporaries. If you add a reference to digital media, I could be describing any of today’s cutting-edge marketing automation products:

“At the core is a very powerful campaign management function that allows a marketer to define sequences of marketing events–each including a mix of direct mail, telephone contacts and personal sales efforts–to be followed in different circumstances, and then to automatically execute these sequences.

“The system uses an efficient graphical interface to lay out the alternate sequences that can be followed within each campaign, the tasks associated with each step in each sequence, and even the specific promotional materials used with each task. As a result, the marketer gains extremely precise control over the marketing approach used with each customer–including the ability to switch the customer to a different sequence depending on actions during the campaign.”

(4) I'm perfectly aware that reality will be messier than the vision implies.  Coverage will be incomplete, people won’t always be recognized across devices, and some predictions will be wrong. But perfection isn’t necessary for success: systems using this data only have to be more effective on average than systems that don’t.


John Steinert said...

David. I agree wholeheartedly with this. From a systems perspective, you describe a convergence of AdTech and MarTech capability (I'm pleased that you've picked up the MADTech coinage too ;-). From a methods perspective, you've pointed out where humans can still add value. In my work, I found quite early that the nuture stream approach really started to collapse in on its own complexity (Jenga-ish). I think the set-play concept can work and that the sooner marketing organizations incorporate this into both their preparations for Intent based Marketing and SALES, the better they will do. As you alluded to, set-plays are like little bits of code, objects or "services" that can be called on to fulfill a customer need. They can be aligned as a prescribed nurture or they can user-defined, where the user is the customer.

David Raab said...

Thanks John. There was a parallel discussion of this post on CustomerThink, which prompted a bit more thought on what the next-generation interface would look like. I might as well share it here are well:

My guess regarding interface is that there will be a map that shows the flow between states (represented as boxes). Inside each "state box" is a grid with different contexts (events, locations, need-states, etc.) across the top and different customer segments down the side. Each cell then represents a situation in which you'd execute a play. The big advantage here is you could easily see where no play was available or review whether the assigned play really makes sense. (Remember that the premise is marketers primarily think about one play at a time.) You could let the size of each cell represent the number of customers who move through that cell within a given period, and maybe let the color show the value of a successful play (i.e., the change in lifetime value if the play fails or succeeds). That would be a pretty effective heat map for prioritizing your play development. To some extent, you could add complexity by splitting rows or columns to represent more detailed distinctions between situations or segments. This might get ugly from the top view but, again, remember you're most likely to look at subsets while actually working.

A roughly equivalent alternative would be to use a tree with the first node branching on situations and the second level branching on segments. You could use size and color the same as in the grid to help with prioritization. The tree makes it easier to add splits that apply in only some circumstances: say, in some situations you want different plays for people of different genders, while in other situations you don't. It's also visually prettier. But I think it loses some of the visual connection of segments across situations, which intuitively seems useful.

Unknown said...

Hi David,

Great piece, enjoyed it a lot.

I truly believe that Optimove is the closest company to realizing this vision.

I have already blogged about this topic a few weeks back (, but still I want to emphasize that the true challenge is in the data science! Can one make the machine as smart as a talented human, or even more? We have made a significant breakthrough recently and are close to bringing this to life. Wish us luck and stay tuned...

Pini Yakuel
CEO, Optimove

David Raab said...

Thanks Pini. Your post covers the topic very well. I look forward to seeing what you come up with. But don't make that machine too smart...I still need a job.

Anonymous said...

Great article. I'll start using the "MADtech" term now too. I think the progress you describe from where we were/are toward "plays" is a fulfillment of the idea of 1:1 conversations ... and by that I mean more the "conversation" part than the targeting. If you line up marketing for a car, say, from broadest TV ad to series of a flow of targeted emails about a specific car someone's had digital interactions with to an actual human conversation w/ salesperson in a showroom, the movement is more toward this "what state is my prospect in *now* and what is the best 'content' - or thing to say - right now." It's what a salesperson naturally does, in real time, making massively complex calculations about the optimal thing to say ... based on his own accrued learning, changing in real time as data points (body language of the would be buyer, what he says ...) continue to flow in to his senses, or the machine in machine learning. More and more MADtech becomes something like a machine having a digital conversation w/ a prospect, understanding the best thing to "say" in a given moment.