"All interactions magazine articles are posted with the permission of ACM."
© 2000, Association
for Computing Machinery. Permission to make digital or hard copies of all or
part of this work for personal or classroom use is granted without fee provided
that copies are not made or distributed for profit or commercial advantage and
that copies bear this notice and the full citation on the first page. To copy
otherwise, to republish, to post on servers or to redistribute to lists, requires
prior specific permission and/or a fee.
interactions magazine
Volume 8, No. 2 (March/April, 2000) Pages 19 - 24.
New Kid on the Block: Marketing Organizations and Interaction Design
David A. Siegel, Ph.D. & Susan M. Dray, Ph.D.
Dray & Associates, Inc.
Minneapolis, MN USA
A tale of two disciplines
Sometimes the things that are frustrating about a project turn out to be the most valuable aspects. We recently worked with a company that recognized how essential usable design would be to the success of their e-commerce strategy. But, they were not sure how to make this happen. So, they turned to us for help with planning for usability.
The project team had many of the kinds of questions that just beg for an organizational study, but no one wanted yet another report, filled with recommendations, that would sit on the shelf. Instead, they agreed to have us guide them through a usability evaluation on a website as a demonstration project. We assured them that, in a real-life evaluation like the one we were about to undertake, the important organizational issues would emerge naturally. Rather than merely talking about them, we could begin to solve them. .
Marketing was seen as a key stakeholder. Not only did they buy into the importance of usability, but they also had a lot of input into the whole e-commerce strategy. Furthermore, they might use an eventual in-house usability the lab for focus groups, and might even be the ones to administer it. Plus, since they already had experience with screeners, knew about the market segmentation, and were the internal experts in interviewing and facilitating, they were designated as our main collaborators for setting up the study. It looked like Marketing had been put in the driver's seat for this project, and might be establishing itself as the eventual organizational owner of usability
As we rolled up our sleeves and got to work with the lead marketing representative, things got interesting right away. The time spent negotiating every aspect of the study seemed much greater than usual. Time was consumed in going over minutiae of the evaluation script, which the marketing person thought must be followed verbatim. The list of highly structured questions she wanted in the protocol kept growing. Her emphasis on construction of rating scales to measure user opinions of the site began to remind us of a graduate course in psychometrics. She also felt that the sample had to closely reflect their existing off-line customer base, including matching its complex segmentation. So many decision rules would have to be added to the screener that it would start to look like the instruction manual for 3-mile Island, and the sample would have to be impractically large to achieve proportional representation of all the different types of customers
There was no way the study could be done within budget this way. More important, this "input" from Marketing risked pushing the study away from being a usability study. If we went with her approach, more time would be spent interviewing users about what they liked and disliked about the site than in observing and analyzing their task behavior.
What we were running into was not a client being a control freak, but a clash of paradigms. There is really no surprise about this. After all, we had promised the client that we would turn up the issues that would have to be addressed for them to build usability into their organization and development process, and here was at least one big one.
Vive la différence!
This experience was just one of several indications we have seen of a growing hands-on involvement of Marketing in many activities related to interaction design, including usability and other aspects of User-Centered Design (UCD). Not only are internal marketing people becoming involved in the development process and in usability, but there are more presentations on usability at marketing conferences, design firms that have primarily worked with marketing departments are increasingly focusing on interaction design, and market research facilities are adding usability to their range of services. In reflecting on this trend, we see some interesting implications. These include potential impacts on how UCD is carried out, and how resources for UCD are positioned and managed within organizations. The traditional marketing perspective and the practices through which it influences the product development process have important areas of overlap with the perspective and practices of user-centered interaction design. But there are significant divergences as well. While Marketing is potentially a tremendous ally and collaborator in the promotion of UCD, the differences in paradigm will have to be acknowledged and addressed as it becomes increasingly involved.
Therefore, in this article, we offer some reflections on the relationship between UCD and Marketing that we think may help practitioners from both sides in working together. This includes not only those working together on multidisciplinary development teams, but also those coming into Usability from a background in Marketing, and Usability and UCD professionals being hired by marketing firms.
Roots of the trend
It is helpful to start by identifying some of the many factors working to make Marketing a more central player in design and usability. These will help to clarify the areas of overlap between the traditional Marketing focus and UCD.
Link to the customer
Marketing is traditionally responsible for keeping the company's finger on the
pulse of the customer. In a way that is different from Sales or Customer Service,
Marketing tends to have a special role in proactively capturing knowledge about
the customer as an input to the process of product planning. Since UCD is an
extension of the company's need to know its customers, the tie-in to Marketing
is obvious. While UCD practitioners preach the need to introduce knowledge about
the customer into the design process as early as possible, Marketing has been
doing this all along.
Social Science Methodologies
Marketing is usually the corporate repository of knowledge about and resources
to systematically study people. Much of the traditional methodology of marketing
research has some similarity to UCD methods. Examples include one-on-one interviews
on buying behaviors, which resemble those used by collaborative design teams
to create user profiles or scenarios. Marketing has also uses qualitative, ethnographic
methods, such as "Mystery shopping", which also are similar in process
to those used in UCD. In most cases, the focus is quite different, as we will
make clear below, but the process can be similar.
While from the perspective of UCD some ofsee these resemblances are merely superficial, to an outside observer the differences in method or emphasis (which we will discuss below) may seem pretty subtle. Certainly, some of the infrastructure (facilities, video, recruiting resources) that supports marketing research is shared with UCD. Given the common ambiguity and uncertainty about where to organizationally house formal UCD activities like usability evaluation, Marketing may look like a pretty good fit on the basis of shared methodology and infrastructure.
Usability as a Product Differentiator
The growing awareness of usability as an important product attribute is making
"User-Friendliness" a more common and important marketing claim. Marketing
is traditionally concerned with whatever will differentiate products in the
marketplace, and to the extent that usability is perceived as important in this
regard, Marketing may be the most logical champion for it.
Marketing and Product Development
Marketing plays a variety of roles in product development that can involve it
with usability and user-centered design. Marketing often provides the leaders
of product development teams, and sometimes supplies the product managers who
manage entire product lines. As such, marketing people can be structurally positioned
to oversee the design process, and may be the final arbiters of design decisions.
Usable design therefore is unlikely to happen unless they give high priority
to usability in design trade-off decisions.
Even when marketing is not running the product development process, it can play a major role in product development. This is particularly apparent in the requirements definition phase, which is often led or "owned" by Marketing. UCD has to begin with an understanding of customer needs, and Marketing specializes in this. Furthermore, specific usability objectives are showing up with other product requirements in the Product Definition Documents, which are typically generated by Marketing. Marketing can have an ongoing influential role in development as initial requirements are renegotiated in the course of product development. As the " owner" of the product requirements, Marketing usually has to sign off on these changes. Furthermore, it often happens in the design process that new questions arise about the user and Marketing may be the source of the answers.
E-commerce and design
The growth of e-commerce is also blurring the distinction between marketing
and interaction design. Since a great deal of web content is an extension of
the company's marketing strategy and advertising, so marketing tends to play
a leading role in overseeing the company's use of the web to project its image,
brand and identity. As the evolution of e-commerce makes web pages more and
more interactive, Marketing inevitably is pulled into more involvement with
interaction design. There are many examples of design firms that originally
focused on providing graphical design for client companies who are now in the
forefront of interactive web design (and fortunately some that are approaching
the design process in a user-centered way!)
Contrasting paradigms
Obviously, the involvement of marketing in design is not accidental. In fact, in many ways the mindset, role, and organizational placement of Marketing and its role in product definition may make it a powerful champion for usability and UCD. However, we should not gloss over the differences.
At a high level, it would be obvious to say that Marketing focuses on what to build for the market and how to attract buyers to it, and UCD focuses on how to implement the product. We want to go beyond this and elaborate the contrast, while at the same time acknowledging that the divergence is not complete. We hope this contrast is instructive and not too much of an oversimplification. We also hope that it is clear that both perspectives are not only needed, but that they are also interdependent.
Focus
Marketing tends to focus on the strategic level. It is concerned with social
and market trends, and perceived customer needs, and tries to draw out the strategic
implications of this information in terms of product opportunities, product
mix, and ways of shaping perception of the company and its products. Both the
information it is preoccupied with and the interventions it generates are aimed
at directly influencing purchasing and market share. This means that its focus
is on the aggregate level and on interventions that will influence purchasing
behavior at a population level, rather than the individual level.
In contrast, UCD tends to focus on the tactical level, in that it is concerned with the specific details of implementation of a product or line of products. Satisfaction after purchase, rather than purchase alone, is the aim. While Marketing may aim at incremental increases in market share, UCD has to aim at design that is successful for essentially all target users. This requires an intensive focus on the individual, as opposed to the aggregate, and naturally calls for a different style of investigation.
"Clients"
In order to be effective, the two disciplines have to be able to "put themselves
in the shoes" of their respective clients, who differ in their mindset,
concerns, and accountabilities. The consumer of marketing input is traditionally
the executive who has authority for deciding what product opportunities to pursue,
and how to position the company and its products in the market. The consumer
of UCD input during the design phase is the designer, engineer, or development
manager who needs help finding specific design solutions. This "consumer"
needs a very different type and level of input.
Methodology and data of interest
Marketing differs from UCD in terms the type of data it collects, as well as
what kinds of samples are of interest.
Marketing puts a great deal of emphasis
on subjective data, retrospective self-report, and opinion. This makes sense,
since these are clues to attitudes and motivations that affect buying. It is
also concerned with behavioral data that relates directly to buying. In contrast,
UCD tends to be very skeptical of self-report and opinion. The research tradition
in cognitive psychology holds that people's introspection about their cognitive
processes is not accurate, especially in retrospect. Therefore, users' cognitive
processes must be inferred through intensive, interactive behavioral testing.
The variables of interest to Marketing make it more likely to collect data from
large samples, which are amenable to meaningful statistical analysis. The emphasis
on statistics requires the kind of standardized data collection necessary in
survey research. Because the cost per person sampled is small and sample sizes
can be large, it is possible to do statistically meaningful comparisons, such
as between demographic groups. Even studies looking at combinations of variables
are feasible. Marketing has an ultimate variable of interest, one that sums
up multiple inputs in one global measure: that is, the actual purchase. This
also promotes an emphasis on large-scale statistical research, since any variable
that empirically correlates with this one measure is of interest.
In contrast, the intensive behavioral investigations of UCD tend to make the cost per person sampled relatively high, and samples in a single study are small. Thus, statistically meaningful analyses and quasi-experimental comparisons are generally not feasible. In addition, UCD does not really have a simple global outcome measure that would be the equivalent of purchasing. The closest we come in UCD is probably "successful task completion," but in any given usability test, we only approximate this with a sample of representative tasks, and we can usually only test a portion of the total functionality.
Sampling for marketing studies often attempts to approximate the actual or potential purchasers of products as closely as possible. Since the emphasis is on subjective opinion data, and since these vary widely with demographics, it is critical that different groups that might be purchasers be proportionally represented in a sample. In UCD, however, we are looking for usage information - information which is less likely to be usefully predicted by external demographics, and which can often be assessed directly through behavior. Since the sample is small, we are usually constrained in the number of sample characteristics we can allow to vary in any given study. Furthermore, the composition of the sample may be determined more by patterns of technology experience and usage, than by other factors more relevant to motivation and purchasing.
When you consider all of these differences in focus, variables of interest, and approach, it becomes clear that there is a coherent set of differences between marketing research and usability. This is the meaning of "paradigm." The difference in mindset tends to be persistent and persvasive. For example, even in areas of overlap, such as in early user studies to determine user needs, Marketing is more apt to focus on expressed user wishes and UCD is more likely to infer needs from behavioral observation of existing work flows and task behaviors. One way of summarizing the differences between these paradigms is by analogy. While marketing research can often resemble survey research, UCD research like usability testing is much more like a process of clinical diagnosis.
And they lived happily ever after?
Once you recognize that there are two paradigms in play, how do you make the synergies happen and avoid the pitfalls? In our experience, the best way to do this is to address the paradigm issues directly in a way that promotes interdisciplinary collaboration. This often means identifying the legitimate role of each paradigm in the larger process. Let us illustrate by returning to the case from the beginning of this article:
Recognizing that what we were experiencing was a paradigm clash and not a matter of personalities, we reconvened the team and laid the issue before them as information that should be considered in planning for usability organizationally. We acknowledged the roles of both Marketing and Design in assuring products that met customer needs effectively, but also clarified the differences. To aid in this, and to normalize the issues, we used the table below. This helped the team recognize the ways in which usability was truly different from what they had done before, but also clarified that both approaches had essential roles.
Where previously it seemed that the team had let Marketing pick up the ball on this project almost by default, the entire team now became more engaged. Tension actually dissipated as they began to wrestle in an informed way not only with how to conduct this particular study, but also with the larger issues of how to set up usability within the organization. The team decided that it made most sense for the new usability efforts to remain in the e-commerce division, because the users of the information to be gathered were there, and because the ultimate mandate had to come from the head of e-commerce to ensure that usability results were actually incorporated in development. As a result of this project, a position was created, reporting directly to the head of e-commerce, for a senior technical staff person to oversee usability efforts. This company has now built its own lab and carried out a number of usability evaluations. Marketing remains a key participant in what is essentially an interdisciplinary process. In practice, there has been a marketing person involved in the planning of usability evaluations, and participating in them from behind the mirror.
Other organizational solutions are
certainly possible in principle, including basing usability in the marketing
organization. However, this can only work if Marketing expands its focus to
include the approaches specific to usability, and keeps a focus on providing
design input that helps designers find specific design solutions. In any case,
since the process of UCD begins by taking a user-centered approach in the product
definition phase as well as in the design phase, Marketing has to be a collaborator
in the overall goal of achieving useful and usable products.
| Dimension | Marketing Research | UCD |
| Purpose: | Strategic; guide product mix, positioning. | Tactical: guide product realization via design input. |
| Goal | Build product attractiveness by deciding what products and product features to build to meet perceived needs; developconcise messages and clear global strategies that will quickly influence mass perceptions, at corporate level and product level, to differentiate products from competitors. | Ensure continuing usage satisfaction by determining how to build identified product to facilitate user's task goals. |
| Who acts on input: | Executives, Brand and Advertising professionals, product managers | Designers, Engineers, IT developers |
| Most interested in: | Broad patterns of purchasing behavior, and attitudinal variables that influence it. based on trends and significant attitudinal differences between groups. | Specific details of design that influence reactions to structure, in-depth analysis of individual differences in performance, cognitive processes, problem-solving approaches, confusions. More interest in idiosyncratic responses. |
| Phenomena measured: | Subjective: perceptions, opinions, expectations, , feelings, and preferences, attention, affective reactions as clues to product attractiveness and likelihood of buying. | Objective: Task flows and task performance, usage behavior, cognitive processes, affective reactions such as confusion or frustration as clues to cognitive processes and performance problems . |
| Type of data: | Survey and self-report, often retrospective; behavioral measures related to purchasing. preferences, attention, and purchasing | Real-time behavioral data re: usage and task performance. Self-report ("Thinking aloud") construed only as an indirect clue to inferred cognitive process. |
| Sampling: | Large samples selected to reflect the demographics of purchasers. | Small samples selected to reflect people who are similar to targets in terms of technology usage. |
| Data analysis: | Statistics usually required, often quite sophisticated analyses. | Statistics rarely done, other than descriptive statistics on completion rate, error frequency. |