Complementary Methods: Combining Contextual Inquiry with Other Methods to Meet Specific Research Needs and Client Expectations, and to Maximize Insights Gained

The sessions included contextual inquiry along with other methods to meet specific informational needs. As Bjerén states regarding the use of a blended approach of qualitative and quantitative methods, the results are synergic. “Using them together nevertheless brings forth more nuanced and complicated knowledge about the object under study. The methods also reflect on each other and using them together…means that both qualitative and quantitative studies can be improved.” (Bjerén 2004:8)

As shown in Figure 1, the methods were drawn from traditional market research as well as ethnography and participatory design practices.

Figure 1: Methods Employed

Self-administered pre-visit survey: The intention of the self-administered pre-visit surveys was to “prime the pump” for the subsequent in-home sessions by encouraging participants to think about and describe the ring selection and purchase process, including steps they went through, how it made them feel, and where they currently are in the process. Gage and Kolari see the need for an introductory step in the research process before conducting applied ethnography or participatory design techniques. “The first step is to get research participants immersed in and aware of their daily experiences surrounding the area of focus. This brings latent daily experiences into their conscious memory…. After becoming aware of her experiences relative to a given subject, a person is ready to express associated emotions.” (Gage and Kolari 2002:4) Stappers, Sleeswijk Visser, and Keller agree that a pre-session exercise can be useful as a precursor to ethnographic and participatory sessions. “In the sensitizing phase, participants make ‘homework’ exercises…these exercises provide information to the researchers and designers, but also serve to draw the participant’s attention to the topic of the study: participants will then observe and reflect more about what they do in their personal life or during their work.” (Stappers, Sleeswijk Visser, and Keller 2003:2)

In this case study, the initial information was captured via a self-directed survey exercise, as early in the research process a self-administered survey may be received by participants as a safe, easy format in which to share such personal information. As Tourangeau and Smith have shown, self-administration of sensitive or highly personal survey questions results in a higher willingness to respond and to respond truthfully than interviewer-administered questions. “Self-administration can have marked effects on the responses obtained; by reducing fears of embarrassment or of disclosure to other household members, self-administration appears to increase respondent candor.” (Tourangeau and Smith 1996:277–282)

Here, the pre-visit survey was successful in having participants provide high-level information on the engagement decisions and steps they had taken, thus preparing participants for more lengthy and personal discussions of these topics with researchers during the subsequent sessions. Participants were willing to share strong feelings about the ring shopping process, particularly negative ones including: fear of selecting the wrong ring and disappointing the intended fiancée; distrust of sales people and disdain for the pressure they put on shoppers; feeling mislead or “cheated” by on-line merchandise that didn’t live up to promises; abhorrence for the diamond industry and its dubious practices; and feeling very overwhelmed with the entire ring shopping process. The revelation of these strong feelings gave the interviewers material to explore further during the subsequent visits.

Applied ethnography—contextual inquiry and observation: The use of applied ethnography in this study allowed for in-depth exploration of this shopping community while continuing to meet the client’s budget and timeline requirements. Applied ethnography has advantages in high-tech and other industry research as it is quicker, less expensive and can be less intrusive to participants than traditional ethnography which might take several months to years to complete (Sanders 2002:1–2). As Sanders describes, applied ethnography “draws simultaneously from a number of research methods. It listens to what people say, while at the same time watching what people do and what they use. Applied ethnography is the best way to discover the difference between what people say they do and what they really do in their daily lives.” (Sanders 2002:2)

Contextual inquiry via in-home interviews:These interviews focused on the entire engagement journey that had occurred. Interviewers engaged the participants in discussions about their expectations, experiences, successes and setbacks, and emotions resulting from these experiences. We conducted the interviews in the participants’ home environments, where the on-line-related research and shopping experiences had actually taken place and thus feelings about these experiences could be conjured up more readily. Participants discussed the decision to become engaged and purchase a ring, initial research and shopping, ring selection and purchase (for those who had journeyed this far), and ring presentation to the intended fiancée.

Observation of participants: During the contextual interviews, participants were observed as they navigated through various on-line ring sites. The intention of this exercise was to have participants relive browsing, shopping, and ring selection experiences. This technique allowed participants to show researchers what they did, and also allowed them easy access to the feelings that accompanied the original behaviors. Interviewers acted as apprentices, and participants were the experts—teaching interviewers about the processes they went through and the accompanying feelings. Note that the focus of this study was on on-line shopping experiences, with a secondary focus on understanding the relationship to in-store shopping. Had the focus been on in-store shopping, actual in-store observation would have been merited.

Utilizing inquiry and participant observation, we were able to delve deeply into each participant’s emotional journey through the engagement process. Participants shared their feelings surrounding the decision to become engaged—a heady mix of excitement and anticipation around the ring presentation itself, confusion surrounding how to go about information gathering and shopping for rings, and an overwhelming fear of getting something wrong with the ring selection or the ring presentation.

It became clear how important a role the ring shopping resources play in the process, and how a ring merchant—whether traditional brick-and-mortar or online—may provide services and tools to assist customers through this emotional whirlwind.

Experience mapping: Taking a page from the participatory design practice, we asked participants to create time-sequence maps of their individual diamond ring journeys showing all the steps they had gone through and the relative positivity or negativity of each step. Participants were encouraged to include the engagement decision, ring research, ring shopping, ring selection, and ring presentation in their maps as well as any other experiences that figured prominently in their journey. Participants then discussed the maps with interviewers so that each step and the accompanying emotions were shared.

Gage and Kolari state that participatory design techniques such as experience mapping allow people to express what they want in a product or experience—something that may not be expressed readily through interviews or surveys. “Participatory design assumes that users should play an active role in the creative process: users envision the future by identifying the defining moments from their perspective. These moments can highlight critical touch points and the desired feelings associated with them, which serve as a foundation for emotional connections.” (Gage and Kolari 2002:2)

During a participatory design exercise such as experience mapping or collage creation, discussion of the map or collage is even more important than creation of the artifact itself, as the meaning behind the artifact is discussed and shared with the research team. “The main emphasis is on the discussion after the collages are completed, not the collages themselves, which remain quite ambiguous…the sessions are very intensive and stimulating, and bring forward a list of considerations, anecdotes, opinions, observations, examples, motivations, practicalities.” (Stappers, Sleeswijk Visser, and Keller 2003:5) In this study, each participant became engaged in creating a map that depicted his journey, and even more engaged in sharing the story of the journey with researchers. Some participants actually seemed to find the process cathartic—they were able to share the low points of their journey with sympathetic listeners, with the knowledge that our clients would hear the stories and might someday be able to make things better for future shoppers. Creation of such a map allowed participants to really think through their engagement-related experiences from start to finish and brought to light accompanying emotional low points and high points that may not have been accessible given a more straightforward interview approach, including an extreme aversion to sales pressure from in-store sales people, and bewilderment at the online ring research and shopping resources.

During analysis for this study, composite maps were created for on-line and in-store shoppers to compare experiences and identify pain points and areas of opportunity for the client. These resulting composite maps clearly brought to life the unique experiences of the different communities and highlighted areas of differentiation where the client may focus attention if trying to support one community or the other.

Researcher-administered survey:At the end of each in-home session, interviewers administered a brief survey including scaled questions rating the importance of various on-line shopping tools and site features. Drawing from traditional market research, this approach allowed relative importance ratings for these features to be captured in a consistent fashion so that results could be compared across participants. Such analysis would not have been possible through contextual interviews, given the more fluid format and information gained. Though not the focus of the research, this component provided consistency in feedback related to the various on-line shopping features—an expressed desire from some of the client stakeholders who typically rely on traditional market research and wished to map results to established research metrics.