Exploring digital well-being through an interdisciplinary lens

I double-majored in media and journalism and in computer science as an undergraduate. That might seem like an unusual combination, but I was attracted to both because of their potential for social good. Journalism teaches me how to identify and communicate important ideas. And through computer science, engineering supported me in turning ideas into tangible solutions for positive impact. Now, I’m a fourth-year PhD student in computer science at Stanford, researching digital well-being through an interdisciplinary lens as a member of the department’s Human Computer Interaction Group. 

My current research is on audio-enhanced wearable devices. It is a cross-disciplinary project blending software and hardware engineering with psychology. We built a wearable system made up of two microphones attached to the wrist that connect to earbuds that amplify a given set of sounds to the wearer. We chose sounds produced by our hands because we use them for daily tasks like cooking, washing our hands, doing skincare, or picking up a coffee cup. These are moments when our mind could easily go on autopilot. They sound trivial, but there are so many sensory experiences that exist within those moments that can be leveraged to cultivate a mindful moment by redirecting our attention back to what we’re doing. The project has an engineering aspect and a mental health aspect, and I’m excited to work at this intersection.

Mindfulness is a really powerful concept to me. The type of mindfulness I’m looking at is called everyday mindfulness, or informal practice of mindfulness. This is distinct from traditional mindfulness like meditation, where you close your eyes and set aside time and space to practice. I’m interested in improving day-to-day experiences. Many devices we regularly use, like mobile phones or smart glasses, give us a high volume of virtual content to consume, which results in a lot of opportunities to be distracted throughout the day. My research is motivated by the goal of building systems that actually reconnect us to the present. I’m applying this idea to my daily life too, so the subject I’m researching is actively shaping my own life. I understand so much more about how I’m perceiving things. Like when I’m stressed and walking around campus, I sometimes forget to enjoy all these great sensory experiences around me, like birds chirping, or the wind blowing on my face. Our device guides your attention back to those kinds of overlooked cues and allows you to be more present. 

Mindfulness as a research focus is less prevalent in the engineering field, but the growing awareness of digital well-being and its strong relevance to mental health and therapy is driving growth in this area. I’ve become a stronger interdisciplinary scholar thanks to this project and my advisors. My main advisor, Sean Follmer, is housed in the Department of Mechanical Engineering, but he also holds a courtesy appointment in computer science. My co-mentor on the project, Jeremy Bailenson in the Department of Communication, works on media psychology and the psychological impact of virtual reality and augmented reality. You could say the device I made is a kind of augmented reality experience itself, but it’s not the standard form like AR glasses. It’s an auditory form that’s less about immersive virtual experiences and more about making our real-world experience more immersive. 

I see many applications for how wearable systems can benefit people. We just launched a collaboration that I’m really excited about with clinicians actively applying mindfulness in their therapeutic approach. We’ve started a take-home deployment of the device that will help us monitor its long-term effects. There’s also the possibility that paying attention to different cues can help with learning new physical skills. Research into digital well-being is growing, so when we’re thinking about how we can design more responsible devices in the future, this work is pivotal. 

The incredible academic collaboration I experienced working on this project is a big part of why I enjoy being at Stanford. I’m also really enjoying being a Knight-Hennessy scholar, because it feels like having another department and community outside of my lab work. The program provides resources for extracurricular activities that enrich our academic lives. I recently hosted Pulitzer Prize-winning author Ed Yong for a fireside chat at Denning House, the home base of the Knight-Hennessy Scholars program. He wrote a book about how animals perceive the world, which is drastically different from how humans do, and how understanding that perspective and their sensory experiences helps us cultivate more empathy and understanding. His book is truly inspiring in challenging our canonical views of nature and human biology, and I got to talk to him and introduce him to other Stanfordians. It was an amazing experience. I recently joined the admission committee for the computer science PhD program, because helping to welcome new cohorts to our community feels like a way to pay forward all the wonderful experiences I’ve had.

Yujie Tao (2023 cohort), from Shanghai, China, is pursuing a PhD in computer science at Stanford School of Engineering. Yujie aspires to bridge the understanding of human perception with the design of computer user interfaces. She explores multisensory pathways to support daily interactions and improve mental well-being. Yujie has published at premier conferences on human-computer interaction, receiving one Best Paper Award and one Honorable Mention Award.

This article first appeared on the Stanford School of Engineering website.

Knight-Hennessy scholars represent a vast array of cultures, perspectives, and experiences. While we as an organization are committed to elevating their voices, the views expressed are those of the scholars, and not necessarily those of KHS.