Dhanabir Sharma

When Customer Insights Meet Business Constraints: Building a Go-to-Market Strategy for a Smart Home Offering in a Regulated Space

ELIZABETH A. KELLEY ILLUME Advising, LLC AMANDA E. DWELLEY ILLUME Advising, LLC [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] Case Study—This case draws on work in the energy efficiency industry where many utilities rely on data-driven insights and decision-making to encourage consumers to adopt energy-saving products and behaviors. In this highly regulated industry, utility staff must show value through big data, and studies often rely exclusively on quantitative data analytics to create behavioral models to explain or predict behavior. However, purely data-driven research often fails to answer questions about why customers behave a certain way, and what product or program managers and marketers can do about it. In this case study, the team from ILLUME Advising LLC (ILLUME), a research consultancy in the clean energy industry, illustrates how their cross-functional team paired qualitative and quantitative research on residential home energy use. The case study...

ReHumanizing Hospital Satisfaction Data: Text Analysis, the Lifeworld, and Contesting Stakeholders’ Beliefs in Evidence

JULIA WIGNALL Seattle Children's Hospital DWIGHT BARRY Seattle Children's Hospital [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] Case Study—Declining clinician engagement, increasing rates of burnout, and stagnant patient and family experience scores have led hospital leadership at Seattle Children's Hospital to submit requests to a data scientist and an anthropologist to identify key themes of survey comments and provide recommendations to improve experience and satisfaction. This study explored ways of understanding satisfaction as well as analytic approaches to textual data, and found that various modes of evidence, while seemingly ideal to leaders, are hard pressed to meet their expectations. Examining satisfaction survey comments via text mining, content analysis, and ethnographic investigation uncovered several specific challenges to stakeholder requests for actionable insights. Despite its hype, text mining struggled to identify actionable themes, accurate sentiment,...

Humanizing Quant and Scaling Qual to Drive Decision-Making

LAUREN MORRIS Amazon Prime Video REBECCA GATI Amazon Prime Video [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] Case Study—The Amazon Prime Video User Experience (UX) Research team endeavored to balance qualitative and quantitative insights and translate them into the currency that drives the business, specifically customer engagement, to improve decision-making. Researchers conducted foundational qualitative research to uncover what matters most to Prime Video customers, translated resulting insights into a set of durable, measurable customer outcomes, and developed a global, longitudinal online survey program that validated the importance and perception of these outcomes at scale. Researchers then systematically linked customers’ attitudinal survey results to their usage patterns and overall satisfaction with the service. The resulting data showed how investing in improving a customer outcome is likely to increase service engagement, thus closing the loop between...

International Business Ethnography: Are We Looking for Cultural Differences?

YUUKI HARA Hitachi, Ltd. Research & Development Group LYNN SHADE Independent UX Research & Design Consultant [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] In international business ethnography, clients and subjects don’t share the same background. Without an understanding of the underlying factors affecting the subject’s behaviors, data can lead to false home-market based assumptions about cause and effect. Where do we as researchers look to detect meaningful findings in international contexts? Drawing on our decades of international fieldwork, we describe how focusing on culture or cultural differences to interpret differences in workflows and attitudes can sometimes hamper accurate interpretation of observations. We describe through case studies how instead, identifying foundation factors shaping behaviors and mindsets such as market forces, government policy, labour markets, and financial schemas can be the key to insight in international contexts. Keywords:...

Towards an Archaeological-Ethnographic Approach to Big Data: Rethinking Data Veracity

SHAOZENG ZHANG Program of Applied Anthropology, Oregon State University BO ZHAO Program of Geography, Oregon State University JENNIFER VENTRELLA Program of Mechanical Engineering and Program of Applied Anthropology, Oregon State University [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] For its volume, velocity, and variety (the 3 Vs), big data has been ever more widely used for decision-making and knowledge discovery in various sectors of contemporary society. Since recently, a major challenge increasingly recognized in big data processing is the issue of data quality, or the veracity (4th V) of big data. Without addressing this critical issue, big data-driven knowledge discoveries and decision-making can be very questionable. In this paper, we propose an innovative methodological approach, an archaeological-ethnographic approach that aims to address the challenge of big data veracity and to enhance big data interpretation. We draw upon our three recent case studies...

Acting on Analytics: Accuracy, Precision, Interpretation, and Performativity

JEANETTE BLOMBERG IBM Research ALY MEGAHED IBM Research RAY STRONG IBM Research [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] Case Study—We report on a two-year project focused on the design and development of data analytics to support the cloud services division of a global IT company. While the business press proclaims the potential for enterprise analytics to transform organizations and make them ‘smarter’ and more efficient, little has been written about the actual practices involved in turning data into ‘actionable’ insights. We describe our experiences doing data analytics within a large global enterprise and reflect on the practices of acquiring and cleansing data, developing analytic tools and choosing appropriate algorithms, aligning analytics with the demands of the work and constraints on organizational actors, and embedding new analytic tools within the enterprise. The project we report on was initiated by three researchers; a mathematician,...

How Modes of Myth-Making Affect the Particulars of DS/ML Adoption in Industry

EMANUEL MOSS CUNY Graduate Center / Data & Society FRIEDERIKE SCHÜÜR Cloudera Fast Forward Labs [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] The successes of technology companies that rely on data to drive their business hints at the potential of data science and machine learning (DS/ML) to reshape the corporate world. However, despite the headway made by a few notable titans (e.g., Google, Amazon, Apple) and upstarts, the advances that are advertised around DS/ML have yet to be realized on a broader basis. The authors examine the tension between the spectacular image of DS/ML and the realities of applying the latest DS/ML techniques to solve industry problems. The authors discern two distinct ways, or modes, of thinking about DS/ML woven into current marketing and hype. One mode focuses on the spectacular capabilities of DS/ML. It expresses itself through one-off, easy-to-grasp marketable projects, such as DeepMind’s AlphaGo (Zero). The other mode focuses...

Regarding the Pain of Users: Towards a Genealogy of the Pain Point

DAVID PLATZER Berggruen Institute [s2If is_user_logged_in()] Download PDF [/s2If] This essay offers an analysis of the “pain point,” a commonplace figure of speech in UX design and contemporary business contexts more broadly. By situating this everday trope within a wider discourse of pain, and its politiciztion in the United States, I seek to problematize the modes of relationality and forms of care entailed in the practice of design research. Ultimately, I will argue, while the “pain point” can be an effective tool for communicating with stakeholders and fomenting alignment about research objectives, it also implicates the more troubling ethical dimensions of applied practice. Through a narrative account of an innovation focused ethnographic research project conducted within the design unit of a major tech company, I argue that questions of solidarity, and its contemporary aporias, can be obscured by the humanitarian rhetoric of contemporary design praxis; a rhetoric of which the “pain point” is a prime example. [s2If...

Designed for Care: Systems of Care and Accountability in the Work of Mobility

ERIK STAYTON Nissan Research Center – Silicon Valley; Massachusetts Institute of Technology MELISSA CEFKIN Nissan Research Center – Silicon Valley   In this paper we explore the idea of a system of care through a city transit system. We argue that a systematic orientation to care is central to what makes a transit system work for people. Further, we suggest that this care orientation is recognized as such, even though it is not apparent in typical modes of systems management. Care is what knowing in this system is for. We examine how participants in the system navigate different epistemic bases of their work, focusing on how care work and information work intertwine. How is this work practiced and known? And how could we, as design researchers, use these practices to design systems of care? In service of these goals, we expand the notion of care work toward care of non-human actors as well as that of people. We focus particularly on the roles of automation and the risks automation presents for care. In a moment of...

Confessions Across Digital Distances

JESS SHUTT Salesforce PechaKucha Presentation Digital environments can expand the distances between people. While this is often challenging, it can also be leveraged to do great things. This PechaKucha explores how we can take this negative divide between people and flip it on its head to discover more powerful insights. By looking at a range of studies focused on sensitive subjects, we explore how technology has the power to create a safer environment for vulnerable participants. While technology is an often underutilized research tool, these technology enabled environments can lead to richer data and insights. As a result, we, as researchers, can create the space needed to share some of our most intimate stories. Jess Shutt has dedicated her career to studying & creating technology to help democratize complex processes & systems from finance to consumer robotics. Her current work as the Lead User Researcher of Einstein at Salesforce focuses on applying these concepts to artificial intelligence. 2018 EPIC Proceedings,...

The Stakes of Uncertainty: Developing and Integrating Machine Learning in Clinical Care

MADELEINE CLARE ELISH Data & Society Research Institute [s2If is_user_logged_in()] Download PDF [/s2If] [s2If current_user_can(access_s2member_level1)] [/s2If] The wide-spread deployment of machine learning tools within healthcare is on the horizon. However, the hype around “AI” tends to divert attention toward the spectacular, and away from the more mundane and ground-level aspects of new technologies that shape technological adoption and integration. This paper examines the development of a machine learning-driven sepsis risk detection tool in a hospital Emergency Department in order to interrogate the contingent and deeply contextual ways in which AI technologies are likely be adopted in healthcare. In particular, the paper bring into focus the epistemological implications of introducing a machine learning-driven tool into a clinical setting by analyzing shifting categories of trust, evidence, and authority. The paper further explores the conditions of certainty in the disciplinary contexts of data science and ethnography,...

“Empathizing” with Machines

CHRIS BUTLER Philosophie [s2If current_user_can(access_s2member_level1)] [/s2If] [s2If !is_user_logged_in()] Please sign in or become an EPIC Member to access video. [/s2If] [s2If current_user_is(subscriber)] Become an EPIC Member to access video. Learn More. [/s2If] PechaKucha Presentation When we study human systems and organizations we have a job that requires to empathize or at the very least be compassionate towards the experiences others are having. This allows to understand their goals, problems, and how we can best make their lives better. When machines start to do things that we can't imagine how do we continue to work with them? What is necessary to create great combinations of humans and machines? What is a machine's purpose? Very simply: it is to serve human purposes. As technology continues to build facades that hide the human element we need to pull back the curtain (like the one in the Wizard of Oz) and see that the tools we build are really us reflected back. We have the choice to make tools that are...

The Story As Evidence: It’s Yours, It’s Mine, It’s Theirs

NIK JARVIE-WALDROM Empathy [s2If current_user_can(access_s2member_level1)] [/s2If] [s2If !is_user_logged_in()] Please sign in or become an EPIC Member to access video. [/s2If] [s2If current_user_is(subscriber)] Become an EPIC Member to access video. Learn More. [/s2If] [s2If is_user_logged_in()] [/s2If] PechaKucha Presentation I've been reflecting on my role in the use and abuse of evidence — in the past as a radio producer and more recently as a writer in a design research company. Storytelling is held aloft as something businesses need to do more of — and be better at — but often the narratives do not belong to businesses. We are re-tellers. The work of a writer presenting design research isolates evidence from its source. There are limits to what we can do to make sure evidence is considered alongside the intention it was gathered with. I started working on this because I wanted to share my indignation at evidence I gathered being misrepresented. My editors have turned stories of triumph into stories of...

Midway Atoll

SARAH BROOKS IBM [s2If current_user_can(access_s2member_level1)] [/s2If] [s2If !is_user_logged_in()] Please sign in or become an EPIC Member to access video. [/s2If] [s2If current_user_is(subscriber)] Become an EPIC Member to access video. Learn More. [/s2If] [s2If is_user_logged_in()] [/s2If] PechaKucha Presentation We live our lives in contexts of overlapping systems. Developing the skill to connect dots of evidence between social, ecological and economic evidence offers the potential for more effective interventions in complex challenges. Sarah Brooks, Sarah Brooks’ teaching and design practice sits at the intersection of design research, service design, and social innovation. She currently serves as a Design Executive and Distinguished Designer at IBM. 2018 Ethnographic Praxis in Industry Conference Proceedings, p. 696, ISSN 1559-8918...

Rejected!: Design Research, Publics and the Purging of New Technologies

LEE CESAFSKY Nissan Research Center, Silicon Valley [s2If current_user_can(access_s2member_level1)] [/s2If] [s2If !is_user_logged_in()] Please sign in or become an EPIC Member to access video. [/s2If] [s2If current_user_is(subscriber)] Become an EPIC Member to access video. Learn More. [/s2If] [s2If is_user_logged_in()] [/s2If] PechaKucha Presentation A challenge for design research today lies in naming, knowing and accounting for people who are not direct users of our technologies, but who are nonetheless affected and compelled to interact with them in daily life. This Pecha Kucha takes us to the streets of Bogotá, Colombia, where a new bus system that was roundly rejected becomes a cautionary tale on the perils of ignoring the painpoints of ‘non-direct users.’ Drawing from pragmatist political science, I propose we can usefully understand this latter group as a ‘technological public,’ and I touch on key difficulties of designing for publics. Lee Cesafsky is an urban geographer, transportation nerd,...