The Shannon-Weaver model of communication stipulates that face-to-face interaction is the most immersive and information-rich mode of communication. Currently, many emerging communications technologies seem to be fixated on approximating a verisimilitude of face-to-face communication. In my view, emulating face-to-face communication should not be the gold standard and benchmark for any new media technology.

Why attempt to recreate what already exists? It seems that with every new major technological invention, the technicians try to show off how potent the system is in emulating a natural process or phenomenon. Writing preserved spoken stories from our ancestors. The daguerreotype allowed artists to accurately “trace” reality, to preserve it.  Portraiture was a way to reproduce the face of a person. Once another technology replaced a function of a former, sufficiently fulfilling it, then the latter could now be free to go outside the bounds of being technically precise.

What I find most compelling about the art forms I admire is their ability to evoke experiences without requiring explicit references to objective reality. They resonate viscerally, capturing feelings and moods that are inherently familiar. For instance, Escher’s drawing of first-person perspective accurately captures an embodied viewpoint (even given its faults). Cinematography can artfully capture the mood, emotions, and attention of a person or group. Critics might argue that these artworks create their own symbols, but I contend that they emerge from a shared familiarity with human experience.

We all dream, imagine, and remember, and we know what a dream, mental image, or a memory is like to experience. These mental states are emblematic of a shared human experience that most people can readily identify. Art that illuminates the ways in which these mental spaces are shared opens up new possibilities to communicate these intangible aspects of our being.

In Eternal Sunshine of the Spotless Mind, Michel Gondry visually articulates the incompleteness of memory through a bookstore scene with blurred titles and sections, highlighting the selective nature of perception, attention, and hence information retrieval in memory. Memory is not a bit-by-bit translation of a lived experience; Perception does not even grasp all of the information of reality “accurately”, nor “completely.” If our perceptions of reality are not accurate or complete, then why should we hold technology to a standard that does not align with our lived experiences? Instead, art and technology could aim to reveal the nuances of our mental lives and how we perceive the world.

By fostering honesty in our shared experiences and developing tools that help us recognize both common and unique features of these experiences, we can enhance our communication and deepen our sense of connection. This process can lead to greater communal understanding, facilitating transcendence through shared yet nuanced human experiences.

My argument is straightforward: while skilled practitioners of meditation or experts may cultivate refined modes of awareness, technology has the potential to reveal these modes as experienced by others. Imagine using technology to awaken our senses and engage in meaningful dialogue with another person.

Consider a user describing their experience with such technology: “Today, while sitting in the woods, I was guided by auditory cues and a gaze cursor to everything you noticed. When I heard the bluebird, my haptic device vibrated, and I saw your hand point toward a tree. ‘Look for the blue!’ you said, directing my attention to the bird. I felt your excitement as if it were my own.”

While we could achieve similar understanding through direct conversation, aligning our perceptions to share experiences can be a daunting task. The proposed technology does not aim to replace face-to-face interaction but offers something distinctly different and innovative. Our challenge lies in effectively capturing and transmitting embodied perceptions from one person to another.

I propose that technology can foster new methods for sharing experiences, addressing a fundamental human desire for connection. Currently, social technologies often foster superficial engagement, leading to a unique form of modern isolation. Technology has the potential to serve as a communication tool that explores our shared humanity, illuminating the intricate diversity of our minds and imaginations. It can evoke awe and wonder for the myriad complexities of human experience, functioning as one of many valuable tools for connection, much like a skilled writer immerses readers in a character’s thoughts.

I refer to this vision as Augmented Social Cognition. It embodies the concept of sharing our worlds with one another. Imagine walking in nature and receiving an audio capture of a bird song from a friend’s walk in another part of the world. Or capturing a photogrammetry image of a landscape or object to share with someone who can then place it in their own environment. While some advancements in augmented reality touch on this concept, they often neglect the critical social connection component.

Now, let’s delve deeper. Beyond visualizing another person’s environment, I envision innovative sensor technologies capable of transmitting embodied experiences. Imagine sharing the sensation of an ocean breeze or a haptic representation of this feeling. This could revolutionize how we share and connect with one another.

In conclusion, the future of communication lies not in merely replicating what already exists but in expanding our understanding of shared experiences. By leveraging technology to enhance our connections, we can create richer, more meaningful interactions that resonate with the complexities of being human.