Three Ways Data Has Changed the CMO: Two Things to Look Out for and One Glimpse of What’s Next

 

One thing most CMOs seem to agree on is that the availability of data and the ability to process it into information have dramatically shifted the role and effectiveness of marketing in an organization.  This data-centric approach to marketing has had several very positive effects on the function, including:

  • Increased accountability of marketing within an organization.
  • Increased effectiveness of programs with better targeting and knowledge of outcomes.
  • Better understanding of the contribution of marketing, resulting in more powerful CMOs.

The Impact of More and Better Data

Data cuts both ways.  It can help make decisions.  It can show you exactly what is happening in any given operation without introducing bias or opinion.  But it can also show you where you are achieving results and where you are not.  It can open a very clear window into the CMO’s performance, which allows for evaluation in ways that are far more objective than were previously possible.

Robert Carroll (@robcarroll), senior vice president of marketing for Gild, notes that just seven or eight years ago, “Marketing accountability didn’t exist.”  It’s not that there were not metrics, but it was much more difficult to establish hard-data success criteria.  With the rise of both CRM systems and marketing automation systems, the data has become available, and it can be turned into analyses that provide these criteria.

One notable way this has changed the marketing organization is in how results are measured.  With these systems and their underlying data in place, it is far easier to determine the exact outcomes of any given program, often from initial engagement all the way to closed sale.

While some organizations are still learning how to make this work for them, many marketing teams use a range of outcome measures such as engagement or conversion to determine everything from cost of sales to whether programs have targeted the right market.

This has also given rise to an opportunity to shift the way marketers operate.  The availability of hard data showing the effectiveness of specific activities and the speed with which that data becomes available allow marketers to try many different hypotheses about which specific items—such as target audiences, content pieces or messages—will be most effective in achieving any given objective.  It lets marketers do the kind of testing and retesting that makes success possible in experimental sciences (such as lab experiments) or in manufacturing design (such as rapid prototyping).

The data and systems are also helping marketers understand media in ways that our profession had only dreamed of.  We can tell exactly which media are most effective to carry our messages and reach our desired target.  Carroll notes, “Email is still the most effective media for outreach.”  But he also has seen a rise, especially with the increasing number of Millennials in both marketing organizations and as members of our target audiences, in the effectiveness of what we might call old-fashioned outreach methods.

“Most Millennials are not used to receiving a telephone call or a postal mailer,” Carroll says. “The sheer novelty of the outreach method is starting to show some unexpectedly positive results.”

While accountability and measurement, in and of themselves, are generally considered good things.  The result of this new level of accountability and the success that has accompanied means that CMOs are gaining more power in the organization.  Now that it is easier to quantify contribution, it’s also easier to show the exact effect the marketing organization has had on the overall business.

As a result, Carroll points out, “More and more, CMOs are becoming CEOs.”

In my own opinion, this also has the potential to result in organizations that are more focused on serving their markets and building better customer relationships.  It certainly will create a different kind of organization than those that followed the historical trend and were led by CFOs or operational executives.

Data Caution!

So far, it’s starting to sound like the rise of the data-based marketer has brought incredibly positive changes and garnered promotions for CMOs.  But the rise of data is also fraught with possibilities to go awry for CMOs:

  • Measurement measures failure just as effectively as it measure success.
  • Data can mislead as easily as it can reveal.

CMOs have jumped on the data bandwagon, and it is, without a doubt, changing their careers.  But where marketers were once able to explain away failure of programs with everything from rebranding to fancy footwork, the ability to look at the data can expose exactly where and why programs failed.  John Philpin, a serial CEO and author of Beyond Bridges, says “Marketers are being found out.”

Philpin also expresses an opinion common to many of us:  “Marketing is as much art as science.”  It’s hard to say that just because a program failed, and we can pinpoint the source of that failure, that the error did not lie in our approach, strategy, judgment, or other human-created idea that was an assumption of the program.

Data can also mislead.  There’s an old saying that the numbers (if you’re an accountant, or the analysis if you’re a statistician) can say whatever you want them to say.  We see this every day in social media where those with specific points of view create charts that appear to be authoritative but are clearly designed to lead the viewer to specific conclusions that benefit the creator.  This happens not just with political pundits, but with marketers as well. We would love to convince the entire world that it has the exact problem we can solve.  And then, of course, sell them the solution.

The data on which we rely for measuring our own success and for proving our success to our organization suffers from the same limitation.  It can be used to show the kind of outcomes we want to believe we have achieved and can be manipulated to hide the outcomes we know will not lead to proving our own effectiveness.

These two concerns—the exposure of failure and the inclusion of human judgment—along with the ability of data to mislead the reader show the limits of reliance on data as the sole measure of success and accountability for a CMO.  It is incumbent upon the CMO to know when data will be useful, how it is most useful, and when to rely on it as a measure of success.

What’s Next for CMOs and Data?

CMOs are seeing the opportunities brought by an increased ability to analyze data and are seeking ways to both expand data access and analysis and find more effective ways to understand and use data.

We’ve all heard about the rise of so-called big data, which Carroll calls “too buzzy” and Philpin calls “a misnomer.  Philpin goes on to add, “Big data is about the relationship among the data—not the data itself.”

Data gets “big” when there’s lots of it, notably more than traditional databases can handle. But it is just this ability to store and analyze unstructured and often unrelated data that can provide insights into our markets and our customers in ways we are only beginning to see.

Carroll sees how the mass of unrelated data Gild is pulling together has started to show them how best to reach their audience, such as where telephone and postal mail can be effective.  He also sees a bigger picture.  “Prepare to be disrupted,” he says, “and all of that data can point to a potential disruptor of your business.”  Since all businesses are potential targets of disruption, it seems like a valuable use of data.

I also agree with Philpin’s answer to my question, “Have you seen big data work in a marketing effort?”  He responded, “Squirrel!”  Staring at data for too long can distract you and lead you to conclusions that are mere mirages.  You start to see things that are just not really there.

More and better data and data analysis are critical to the future of marketing.  Even more critical, however, is the human ability to know how, when, and where to use that data.

Knowing how to turn data into useful information will become more and more important to the success of marketing organizations—and the CMO.

[alert color=”white”]

MENG is the indispensable community of executive level marketers who share their passion and expertise to ensure each member’s success.
Learn moreApply for Membership

[alert color=”white”]

Choosing the Right Way To Create Transparency

Creating TransparencyWe hear about transparency every day.  We are told that, in a world where everything is exposed in media (mostly social media), it’s far better to be transparent than to try to hide blemishes, problems, and defects in the hope that they’ll go away or, at least, not be discovered until we fix them.  Marketing blogs and publications are filled with disaster stories about companies that have chosen not to be transparent and success stories of companies that have chosen transparency.

But just like our personal lives, we have to choose the right level of transparency, and we have to choose the topics on which we will be transparent.

The following is a great example.

In November, I wrote about Buffer, a tech start-up that put transparency on top of their values list.  Not only do they talk about nearly everything internally (including personal goals, such as education and weight-loss), but they publish many of their results externally, such as their customer success metrics, for the world to see.

Since then, they have become even more transparent, releasing more and more information publicly.  Two of the ways they have done this have produced very different outcomes.  Let’s take a closer look.

A Transparency Tempest in a Teapot

In December, Buffer decided to make public all the salaries of all their employees, including the formulas they use to determine these salaries.

This produced a small tempest in social media:  some praised their transparency, and others chided them for releasing personal information about their employees or for creating potential envy and dissatisfaction in their ranks.

The question I asked was this:  how does this disclosure benefit the customer (or any other constituent)?  The answer is simple: it doesn’t.  Granted, it does no harm, but it adds no benefit either.

This is a case of transparency for transparency’s sake.  Some have made the argument that disclosing this information is consistent with Buffer’s culture, so it enhances their reputation and brand.  I disagree.  Disclosure is a choice, and we can always find something they are not telling us (they can’t possibly think of everything!), and this choice does not add value to the most important audience of all: their customers.

The Slippery Slope of Transparency

Buffer’s chief happiness officer, Carolyn Kopprasch, also publishes a monthly report on their customer success efforts.  One element of this report shows how quickly Buffer responds to customer inquiries, tech-support requests, and the like (they state 85% of requests are answered in less than six hours though they’re not quite there yet).

This does add some value to their customers (including me) in that it shows what I can expect in terms of response to my requests as well as how well they are doing with all the issues brought to them.

To be clear, I think this disclosure is useful and valuable.  But it also creates a potentially slippery slope.

Not long ago, I sent in a tech-support request and waited four days for a response.  This is not typical of Buffer support or of my experience.  It left me asking about the distribution of response times.  Specifically, Buffer publishes the percentage of responses in one and six hours, but how often does it take a day?  Two days?  Four days?  Was my response in the bottom 10%? 1%? 0.001%?

Which then led to the logical next question:  since we know not all requests are of equal importance or urgency, and Buffer’s resources are limited, how do they make the triage decisions as to which requests get one hour response times and which get four day response times?

You can keep going, asking more and more logical questions until their entire operational plan is public.

Let’s say that Buffer chose to disclose the entire response time distribution and the triage criteria.  Where would that lead?

In our interview, Carolyn noted that most customer service and support organizations train customers to get angry.  Customers learn that getting angry leads either to faster resolution or to a supervisor who has the power to resolve an issue.  This is a version of gaming the system.

Buffer’s disclosure of the triage criteria most likely would cause its customers to game the system.  If I knew the criteria, I would certainly try to adjust my request to get a higher position in the queue and get a faster response.

Clearly this doesn’t help Buffer or its customers; it only adds to animosity and frustration.

Let’s say they only disclosed the distribution of response times.  That would create frustration on the part of customers who were in the bottom 10%, or worse, the bottom 1%.  My assuming my request fell at the bottom is not nearly as bad for my relationship with Buffer as having them tell me exactly how unimportant they deemed me.  We are all better off if I don’t know.

This is, then, a choice Buffer has made about how much information to disclose and where to stop disclosure.  I think they have made a good choice in that what they disclose helps customers understand their efforts better without taking away from the relationship and adding to frustration.

Is this two-faced?  Yes.  But not in a detrimental way.

Buffer values transparency on one hand and says it will keep increasing transparency.  But it also makes choices about just how much disclosure meets their transparency value.  Being transparent is an aspiration.  We have yet to find out how far Buffer will go.

We expect transparency from companies.  But we also expect there are boundaries, just like there are in our personal lives.

How Do You Decide?

You make decisions every day on what to disclose to whom.  Do we tell our customers this fact?  Do we tell the world that policy?

How should you decide?

I propose there is one simple standard embodied in these two questions: Does the disclosure add value?  And if so, to whom?  If it adds value for your customer, disclose.

Tell us how you’ve made your difficult disclosure decisions in the comments.
[alert color=”white”]

MENG is the indispensable community of executive level marketers who share their passion and expertise to ensure each member’s success.

Learn moreApply for Membership

[/alert]