ELIZABETH A. KELLEY
ILLUME Advising, LLC
AMANDA E. DWELLEY
ILLUME Advising, LLC
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
Case Study—This case draws on work in the energy efficiency industry where many utilities rely on data-driven insights and decision-making to encourage consumers to adopt energy-saving products and behaviors. In this highly regulated industry, utility staff must show value through big data, and studies often rely exclusively on quantitative data analytics to create behavioral models to explain or predict behavior. However, purely data-driven research often fails to answer questions about why customers behave a certain way, and what product or program managers and marketers can do about it. In this case study, the team from ILLUME Advising LLC (ILLUME), a research consultancy in the clean energy industry, illustrates how their cross-functional team paired qualitative and quantitative research on residential home energy use. The case study...
Intelligences
ReHumanizing Hospital Satisfaction Data: Text Analysis, the Lifeworld, and Contesting Stakeholders’ Beliefs in Evidence
Dhanabir Sharma • 0 Comments
JULIA WIGNALL
Seattle Children's Hospital
DWIGHT BARRY
Seattle Children's Hospital
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
Case Study—Declining clinician engagement, increasing rates of burnout, and stagnant patient and family experience scores have led hospital leadership at Seattle Children's Hospital to submit requests to a data scientist and an anthropologist to identify key themes of survey comments and provide recommendations to improve experience and satisfaction. This study explored ways of understanding satisfaction as well as analytic approaches to textual data, and found that various modes of evidence, while seemingly ideal to leaders, are hard pressed to meet their expectations. Examining satisfaction survey comments via text mining, content analysis, and ethnographic investigation uncovered several specific challenges to stakeholder requests for actionable insights. Despite its hype, text mining struggled to identify actionable themes, accurate sentiment,...
Intelligences
Humanizing Quant and Scaling Qual to Drive Decision-Making
Dhanabir Sharma • 0 Comments
LAUREN MORRIS
Amazon Prime Video
REBECCA GATI
Amazon Prime Video
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
Case Study—The Amazon Prime Video User Experience (UX) Research team endeavored to balance qualitative and quantitative insights and translate them into the currency that drives the business, specifically customer engagement, to improve decision-making. Researchers conducted foundational qualitative research to uncover what matters most to Prime Video customers, translated resulting insights into a set of durable, measurable customer outcomes, and developed a global, longitudinal online survey program that validated the importance and perception of these outcomes at scale. Researchers then systematically linked customers’ attitudinal survey results to their usage patterns and overall satisfaction with the service. The resulting data showed how investing in improving a customer outcome is likely to increase service engagement, thus closing the loop between...
Intelligences
International Business Ethnography: Are We Looking for Cultural Differences?
Dhanabir Sharma • 0 Comments
YUUKI HARA
Hitachi, Ltd. Research & Development Group
LYNN SHADE
Independent UX Research & Design Consultant
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
In international business ethnography, clients and subjects don’t share the same background. Without an understanding of the underlying factors affecting the subject’s behaviors, data can lead to false home-market based assumptions about cause and effect. Where do we as researchers look to detect meaningful findings in international contexts? Drawing on our decades of international fieldwork, we describe how focusing on culture or cultural differences to interpret differences in workflows and attitudes can sometimes hamper accurate interpretation of observations. We describe through case studies how instead, identifying foundation factors shaping behaviors and mindsets such as market forces, government policy, labour markets, and financial schemas can be the key to insight in international contexts.
Keywords:...
Intelligences
Towards an Archaeological-Ethnographic Approach to Big Data: Rethinking Data Veracity
Dhanabir Sharma • 0 Comments
SHAOZENG ZHANG
Program of Applied Anthropology, Oregon State University
BO ZHAO
Program of Geography, Oregon State University
JENNIFER VENTRELLA
Program of Mechanical Engineering and Program of Applied Anthropology, Oregon State University
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
For its volume, velocity, and variety (the 3 Vs), big data has been ever more widely used for decision-making and knowledge discovery in various sectors of contemporary society. Since recently, a major challenge increasingly recognized in big data processing is the issue of data quality, or the veracity (4th V) of big data. Without addressing this critical issue, big data-driven knowledge discoveries and decision-making can be very questionable. In this paper, we propose an innovative methodological approach, an archaeological-ethnographic approach that aims to address the challenge of big data veracity and to enhance big data interpretation. We draw upon our three recent case studies...
Intelligences
Acting on Analytics: Accuracy, Precision, Interpretation, and Performativity
Dhanabir Sharma • 0 Comments
JEANETTE BLOMBERG
IBM Research
ALY MEGAHED
IBM Research
RAY STRONG
IBM Research
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
Case Study—We report on a two-year project focused on the design and development of data analytics to support the cloud services division of a global IT company. While the business press proclaims the potential for enterprise analytics to transform organizations and make them ‘smarter’ and more efficient, little has been written about the actual practices involved in turning data into ‘actionable’ insights. We describe our experiences doing data analytics within a large global enterprise and reflect on the practices of acquiring and cleansing data, developing analytic tools and choosing appropriate algorithms, aligning analytics with the demands of the work and constraints on organizational actors, and embedding new analytic tools within the enterprise. The project we report on was initiated by three researchers; a mathematician,...
Intelligences
How Modes of Myth-Making Affect the Particulars of DS/ML Adoption in Industry
Dhanabir Sharma • 0 Comments
EMANUEL MOSS
CUNY Graduate Center / Data & Society
FRIEDERIKE SCHÜÜR
Cloudera Fast Forward Labs
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
The successes of technology companies that rely on data to drive their business hints at the potential of data science and machine learning (DS/ML) to reshape the corporate world. However, despite the headway made by a few notable titans (e.g., Google, Amazon, Apple) and upstarts, the advances that are advertised around DS/ML have yet to be realized on a broader basis. The authors examine the tension between the spectacular image of DS/ML and the realities of applying the latest DS/ML techniques to solve industry problems. The authors discern two distinct ways, or modes, of thinking about DS/ML woven into current marketing and hype. One mode focuses on the spectacular capabilities of DS/ML. It expresses itself through one-off, easy-to-grasp marketable projects, such as DeepMind’s AlphaGo (Zero). The other mode focuses...
Intelligences
Regarding the Pain of Users: Towards a Genealogy of the Pain Point
Dhanabir Sharma • 0 Comments
DAVID PLATZER
Berggruen Institute
[s2If is_user_logged_in()]
Download PDF
[/s2If]
This essay offers an analysis of the “pain point,” a commonplace figure of speech in UX design and contemporary business contexts more broadly. By situating this everday trope within a wider discourse of pain, and its politiciztion in the United States, I seek to problematize the modes of relationality and forms of care entailed in the practice of design research. Ultimately, I will argue, while the “pain point” can be an effective tool for communicating with stakeholders and fomenting alignment about research objectives, it also implicates the more troubling ethical dimensions of applied practice. Through a narrative account of an innovation focused ethnographic research project conducted within the design unit of a major tech company, I argue that questions of solidarity, and its contemporary aporias, can be obscured by the humanitarian rhetoric of contemporary design praxis; a rhetoric of which the “pain point” is a prime example.
[s2If...
Intelligences
Designed for Care: Systems of Care and Accountability in the Work of Mobility
Dhanabir Sharma • 0 Comments
ERIK STAYTON
Nissan Research Center – Silicon Valley; Massachusetts Institute of Technology
MELISSA CEFKIN
Nissan Research Center – Silicon Valley
In this paper we explore the idea of a system of care through a city transit system. We argue that a systematic orientation to care is central to what makes a transit system work for people. Further, we suggest that this care orientation is recognized as such, even though it is not apparent in typical modes of systems management. Care is what knowing in this system is for. We examine how participants in the system navigate different epistemic bases of their work, focusing on how care work and information work intertwine. How is this work practiced and known? And how could we, as design researchers, use these practices to design systems of care? In service of these goals, we expand the notion of care work toward care of non-human actors as well as that of people. We focus particularly on the roles of automation and the risks automation presents for care. In a moment of...
Intelligences
Confessions Across Digital Distances
Dhanabir Sharma • 0 Comments
JESS SHUTT
Salesforce
PechaKucha Presentation
Digital environments can expand the distances between people. While this is often challenging, it can also be leveraged to do great things. This PechaKucha explores how we can take this negative divide between people and flip it on its head to discover more powerful insights. By looking at a range of studies focused on sensitive subjects, we explore how technology has the power to create a safer environment for vulnerable participants. While technology is an often underutilized research tool, these technology enabled environments can lead to richer data and insights. As a result, we, as researchers, can create the space needed to share some of our most intimate stories.
Jess Shutt has dedicated her career to studying & creating technology to help democratize complex processes & systems from finance to consumer robotics. Her current work as the Lead User Researcher of Einstein at Salesforce focuses on applying these concepts to artificial intelligence.
2018 EPIC Proceedings,...
Intelligences
The Stakes of Uncertainty: Developing and Integrating Machine Learning in Clinical Care
Dhanabir Sharma • 0 Comments
MADELEINE CLARE ELISH
Data & Society Research Institute
[s2If is_user_logged_in()]
Download PDF
[/s2If]
[s2If current_user_can(access_s2member_level1)]
[/s2If]
The wide-spread deployment of machine learning tools within healthcare is on the horizon. However, the hype around “AI” tends to divert attention toward the spectacular, and away from the more mundane and ground-level aspects of new technologies that shape technological adoption and integration. This paper examines the development of a machine learning-driven sepsis risk detection tool in a hospital Emergency Department in order to interrogate the contingent and deeply contextual ways in which AI technologies are likely be adopted in healthcare. In particular, the paper bring into focus the epistemological implications of introducing a machine learning-driven tool into a clinical setting by analyzing shifting categories of trust, evidence, and authority. The paper further explores the conditions of certainty in the disciplinary contexts of data science and ethnography,...
Intelligences
“Empathizing” with Machines
Dhanabir Sharma • 0 Comments
CHRIS BUTLER
Philosophie
[s2If current_user_can(access_s2member_level1)]
[/s2If]
[s2If !is_user_logged_in()]
Please sign in or become an EPIC Member to access video.
[/s2If]
[s2If current_user_is(subscriber)]
Become an EPIC Member to access video. Learn More.
[/s2If]
PechaKucha Presentation
When we study human systems and organizations we have a job that requires to empathize or at the very least be compassionate towards the experiences others are having. This allows to understand their goals, problems, and how we can best make their lives better. When machines start to do things that we can't imagine how do we continue to work with them? What is necessary to create great combinations of humans and machines? What is a machine's purpose? Very simply: it is to serve human purposes. As technology continues to build facades that hide the human element we need to pull back the curtain (like the one in the Wizard of Oz) and see that the tools we build are really us reflected back. We have the choice to make tools that are...
Intelligences
The Story As Evidence: It’s Yours, It’s Mine, It’s Theirs
Dhanabir Sharma • 0 Comments
NIK JARVIE-WALDROM
Empathy
[s2If current_user_can(access_s2member_level1)]
[/s2If]
[s2If !is_user_logged_in()]
Please sign in or become an EPIC Member to access video.
[/s2If]
[s2If current_user_is(subscriber)]
Become an EPIC Member to access video. Learn More.
[/s2If]
[s2If is_user_logged_in()]
[/s2If]
PechaKucha Presentation
I've been reflecting on my role in the use and abuse of evidence — in the past as a radio producer and more recently as a writer in a design research company. Storytelling is held aloft as something businesses need to do more of — and be better at — but often the narratives do not belong to businesses. We are re-tellers. The work of a writer presenting design research isolates evidence from its source. There are limits to what we can do to make sure evidence is considered alongside the intention it was gathered with. I started working on this because I wanted to share my indignation at evidence I gathered being misrepresented. My editors have turned stories of triumph into stories of...
Intelligences
Midway Atoll
Dhanabir Sharma • 0 Comments
SARAH BROOKS
IBM
[s2If current_user_can(access_s2member_level1)]
[/s2If]
[s2If !is_user_logged_in()]
Please sign in or become an EPIC Member to access video.
[/s2If]
[s2If current_user_is(subscriber)]
Become an EPIC Member to access video. Learn More.
[/s2If]
[s2If is_user_logged_in()]
[/s2If]
PechaKucha Presentation
We live our lives in contexts of overlapping systems. Developing the skill to connect dots of evidence between social, ecological and economic evidence offers the potential for more effective interventions in complex challenges.
Sarah Brooks, Sarah Brooks’ teaching and design practice sits at the intersection of design research, service design, and social innovation. She currently serves as a Design Executive and Distinguished Designer at IBM.
2018 Ethnographic Praxis in Industry Conference Proceedings, p. 696, ISSN 1559-8918...
Intelligences
Rejected!: Design Research, Publics and the Purging of New Technologies
Dhanabir Sharma • 0 Comments
LEE CESAFSKY
Nissan Research Center, Silicon Valley
[s2If current_user_can(access_s2member_level1)]
[/s2If]
[s2If !is_user_logged_in()]
Please sign in or become an EPIC Member to access video.
[/s2If]
[s2If current_user_is(subscriber)]
Become an EPIC Member to access video. Learn More.
[/s2If]
[s2If is_user_logged_in()]
[/s2If]
PechaKucha Presentation
A challenge for design research today lies in naming, knowing and accounting for people who are not direct users of our technologies, but who are nonetheless affected and compelled to interact with them in daily life. This Pecha Kucha takes us to the streets of Bogotá, Colombia, where a new bus system that was roundly rejected becomes a cautionary tale on the perils of ignoring the painpoints of ‘non-direct users.’ Drawing from pragmatist political science, I propose we can usefully understand this latter group as a ‘technological public,’ and I touch on key difficulties of designing for publics.
Lee Cesafsky is an urban geographer, transportation nerd,...