“Client, Measure Thyself,” or “BYO Metrics”

In the Hutong

Upgrading the Windows machine

1126 hrs.


The pitch seems to be going well. There is good chemistry between the prospective client and the agency. The ideas are great, the concept clear, the tactics doable, the team qualified.

And then comes that moment where everyone sits back, and someone on the client side folds their arms, looks the agency leader in the eye, and asks “so how are you going to measure the effectiveness of your campaign?”

Usually the agency will have some sort of answer, and occasionally it will be enough to satisfy even the  procurement person sitting in on the pitch. But as someone who has sat through countless pitches on both sides of the table and have made more than my share, I have yet to hear an agency give the correct answer:

“I am sorry, but isn’t that your problem?”

You Want Us To Do What?

The idea of holding an agency accountable is a great one. Far too much money has been hurled at marketing (not just television advertising) based on little more than the assumption that the only bad marketing is none at all, with the primary beneficiaries being media and agencies. But accountability goes bad when the agency is handed the task of measurement.

The first problem with asking an agency to be responsible for monitoring the efficacy of their own campaign should be self-evident: it is like asking the fox to guard the hen-house. The agency has an implicit conflict of interest.

When asked to provide measurement, most agencies will endeavor to use the metrics that best validate their own approach. What is more, by giving the agency (under pressure from both client and upper management to perform and retain the client) the responsibility to handle measurement, you give them  both the motive and opportunity to “game” the results. This is not a condemnation of agencies: it is merely an acknowledgment of human nature.

One Yardstick to Rule Them All?

The second problem is that measurement, particularly in this day and age, is not (or should not) be the same for every company and in every situation. The use of standardized metrics like gross impressions, page views, ratings, ad-value equivalencies and click-throughs is helpful when comparing one marketing program to another. Yet they all suffer the same shortcoming: they are weak measures of how close a company is getting to reaching its specific business goals.

In any market, but especially in a place like China, goals are constantly changing as a company evolves and targets shift, and I would argue that different markets (geographic or product based) need different metrics. The way you would measure the marketing campaign for a “hero” product in a developed country is different than the way you would measure a campaign for a very-low-margin product in a developing one.

For these reasons, agencies should not be in the business of designing marketing metrics for companies. That responsibility belongs with each company, deciding what its business goals are, understanding how a marketing campaign can get the company to that goal, and then devising the way the agency (and the marketing team as a whole) will be measured in its performance.

Chief Measurement Officer

This means that the first and most important challenge of a new Chief Marketing Officer (CMO) – is not to call an agency pitch. Rather, it is to create a measurement system that all of a company’s leaders agree is tightly aligned with the firm’s business goals. The second challenge, in that case, is update and evolve that system as goals change, as tools change, and as more accurate means of measurement become available.

When, and only when, that system is in place is it time to seek agency help. Yet even when that time comes, the only measurement responsibility an agency should be given is to perform against the metrics set by the client on the basis of the client’s own business goals. Those metrics should be made clear in the pitch, and should be the focus of regular update meetings. Ideally, the measurement system should be real-time, so both agency and client can respond to critical data quickly.

Revolution is No Cocktail Party

If you think all of this is designed to go easy on the agency, you miss the point. This approach would require an agency to perform against different metrics for each client, and for that reason I suspect many agencies would be dead-set against it. (Many in-house marketers will be as well, because it places a greater burden on them, too.)

But before we dismiss this approach out-of-hand, consider the future. The marketing craft is going through a time of profound crisis. A deep vein of skepticism, disbelief, and distrust of traditional marketing tools is coming to the surface, exposed by the erosion caused by the financial crisis, a general movement for greater fiscal accountability, and what can best be characterized as Advertising Budget Growth Fatigue.

If we want to have the credibility that entitles us to influence at the highest levels of our companies, it is incumbent on us to do everything possible to demonstrate the value of what we practice, and to guide our practices toward strategies and tactics that deliver greater value. That means a creating and building a toolkit of metrics unique to each company that ties every marketing dollar to sales, to repeat business, and to individual customer relationships.