The Hippocratic Oath for Designers in the Age of AI: A Concept

Can we even imagine a day without artificial intelligence (AI) impacting our choices? Over the past decade, AI has seamlessly integrated into our daily routines. From curating our news feeds to driving our cars, diagnosing diseases, and personalizing our online shopping experiences, its influence is undeniable. This transition reflects not just an advancement in technology, but a profound shift in the very fabric of our society.

Against this backdrop, we recall the ancient Greeks, particularly the physician Hippocrates, who is often dubbed the "Father of Medicine." While the medical tools and techniques of his era were primitive by today's standards, Hippocrates recognized a profound truth: with great power and knowledge comes great responsibility. This ethos gave birth to the Hippocratic Oath, a commitment by physicians to uphold specific ethical standards. For centuries, this oath has acted as an ethical compass for medical professionals, guiding them in their pursuit to heal while maintaining a deep reverence for human life.

Now, as we stand at the crossroads of an AI-driven future, we face a new realm of ethical dilemmas. This exploration was inspired by a conversation I had recently with Gianni Giacomelli. Just as doctors influence life and death, designers and technologists influence societal dynamics, individual psychologies, and democratic processes with their creations. The very nature of AI, with its capacity for self-learning and its pervasive reach, makes these design decisions exponentially impactful. This raises an imperative question: In an era where design decisions can sway elections, deepen social divides, or even lead to mental health crises, isn't it time we had a Hippocratic Oath for designers? An ethical foundation to ensure that as we sculpt the future, humanity remains at the heart of every algorithm, every interface, and every AI-powered system.

The Imperative for a Designer's Oath

Today, designers have risen as architects of our online interactions, shaping swathes of our digital terrain. With AI being deeply intertwined in this environment, design decisions take on a significance that goes far beyond aesthetics or usability. They mold behaviors, alter perceptions, and even influence societal dynamics on a grand scale.

Drawing from the 2020 documentary "Coded Bias," we see the profound effects of design decisions in AI systems. The film uncovers the biases present in facial recognition technology, predominantly due to the design and training data. For example, MIT researcher Joy Buolamwini's discovery that facial recognition software had difficulty identifying darker-skinned and female faces speaks volumes about the inadvertent prejudices built into these systems. These oversights in design and development aren't just technical glitches; they lead to profound societal repercussions. Imagine the potential consequences when such biased systems are used in critical domains like law enforcement or job recruitment (both covered extensively in the documentary). The design reinforces racial and gender biases, leading to discriminatory outcomes that further perpetuate existing societal inequalities.

This evidence emphasizes the tremendous influence designers and developers have, especially as we delve deeper into the AI era. Crafting an oath isn't merely about drafting ethical guidelines. The very act of formulating a “Hippocratic Oath for Designers” is a significant design dilemma. It necessitates a balance between flexibility and strict adherence, evolution and stability, all while considering the ever-shifting technological and ethical landscape. Designing this oath, paradoxically, is a paramount design challenge in its own right.

The Foundations of the Oath

We can’t begin to think about an oath for designers without tackling the principle of universalism, which assumes that technologies will have uniform effects on all. This is overwhelmingly misleading. The question arises: when we design for human wellbeing, which humans are we considering? Historically, many technological advancements, especially in the realm of AI, have disproportionately affected marginalized groups. As discussed above, biases in facial recognition software and algorithmic decision-making have repeatedly shown that these negative impacts aren't just anomalies but are systemic. The essence of true universalism is not to design with a one-size-fits-all approach, but to ensure inclusivity by recognizing and addressing the unique needs and challenges faced by diverse user groups, particularly the marginalized.

The scope of design spans a wide range of domains, each with its distinct challenges. Whether it's developing user interfaces for healthcare systems, designing algorithms for banking applications, or shaping the next-generation social media platforms, every domain has its specific ethical considerations. While the overarching goal of ethical responsibility remains constant, its application varies depending on the context. A designer working on a casual mobile application will face different ethical challenges compared to one working on AI tools for law enforcement. Acknowledging this diversity is essential for the oath to be both relevant and actionable across various design scenarios.

Every design decision also carries a series of implications, both immediate and long-term. A decision might offer short-term user engagement, but at what cost in the long run? There could be repercussions related to societal impacts, user trust, or broader ethical concerns that manifest over time. Designers are not only shaping immediate experiences but are also influencing the trajectory of technology and its role in society for years to come. In his design ethics and activism book, "Ruined by Design," Mike Monteiro emphasizes, “As long as you are a designer, you have a responsibility to make the world better for the rest of humanity. If you are a designer, you are a human being first. It is your job to stop those that would denigrate humanity for their own selfish benefit.” The oath should emphasize the significance of this long-term vision, encouraging designers to consider not just the immediate outcomes but also the future ramifications of their work.

Addressing Design Concerns Through the Oath

Accessibility: At the forefront of ethical design lies the principle of accessibility, ensuring that every user, regardless of physical, cognitive, or socio-economic challenges, can engage with technology effectively and efficiently. Historically, design often catered to the "average" user, inadvertently excluding those who didn't fit this mold. But what does "average" truly encompass in a world as diverse as ours? An oath focused on ethical design must prioritize inclusivity, urging designers to think beyond traditional user profiles and incorporate features that cater to the differently-abled, the elderly, and others who might otherwise be marginalized.?

Environmental Sustainability: As stewards of the future, designers have a responsibility to consider the environmental implications of their work. From the materials used in physical products to the energy consumption of digital platforms, every design decision carries an environmental footprint. The oath should emphasize the significance of eco-conscious design. This could range from promoting designs that use sustainable materials, encouraging energy efficiency in digital platforms, to considering the full lifecycle of products, ensuring they don't end up as non-degradable waste.

Economic Implications: Design doesn't exist in a vacuum; it's closely intertwined with the economic realities of our world. Balancing the drive for innovation with economic feasibility is a delicate act. While pushing the boundaries of what's possible is commendable, the oath should also underscore the importance of creating solutions that are economically viable. This ensures that innovations don't remain confined to labs or limited demographics but reach broader audiences, maximizing societal impact.

Agency and Autonomy: As AI becomes more integrated into our digital experiences, there's a potential risk of diminishing user agency. Predictive algorithms, while making platforms more intuitive, can also lead users down predetermined paths, limiting their choices. The oath should champion the cause of user autonomy, ensuring that even as platforms become smarter, users always have the final say. This could mean providing clear opt-out options, transparent algorithmic decision-making, or tools that let users understand and control the AI's influence over their digital journey.

Mental Wellbeing: The psychological impacts of digital platforms are becoming increasingly evident. From the addictive nature of social media to the mental health implications of constant connectivity, the digital realm carries both opportunities and challenges. An ethical design oath should acknowledge these realities, guiding designers to create experiences that promote positive mental wellbeing. This could involve discouraging designs that promote addiction, fostering genuine social connections, or even ensuring platforms offer breaks or downtime to reduce digital fatigue. Yes, this takes time to think through, but it’s worth figuring out before we release even more products and services that have long-term societal implications.?

An oath for designers in the age of AI should be a compass, guiding them through the complex maze of ethical challenges, ensuring that every design decision, whether big or small, aligns with the broader goal of benefiting humanity in its entirety.

Navigating Challenges in Crafting the Oath

One of the most prominent challenges in formulating an oath for designers lies in the inherent subjectivity of terms like "harm" or "benefit." What might be considered beneficial in one cultural or societal context might be deemed harmful in another. Take, for example, Sasha Costanza-Chock’s experience at the Detroit Metro Airport, as outlined in her book, Design Justice. Sasha, who is a nonbinary trans femme, undergoes a TSA scan where the operator must choose a male or female scan setting. Because Sasha’s body does not align perfectly with the cis-normative standards embedded in the scanner's dataset, regardless of the setting chosen, she is flagged as "risky" for an anomaly. The TSA's protocol requires a subsequent physical search by an agent of the same gender the person presents as. This leads to an awkward public situation where agents debate and question Sasha’s gender preference for the pat-down. The experience highlights how deeply entrenched norms, assumptions, and binary gender values are encoded into sociotechnical systems, causing unnecessary distress for nonbinary individuals.

“Benefits” and “harms” require a deep understanding and acknowledgment of diverse perspectives. Crafting a universally applicable oath necessitates a nuanced approach that avoids overly prescriptive definitions, allowing flexibility for interpretation based on context, while still providing clear ethical guidelines.

Any such oath has to be adaptable at its core, because the pace at which technology is evolving is dizzying. What's relevant today might be obsolete tomorrow. Design principles that apply to current technology might not be suited for the innovations of the next decade. This poses a challenge in ensuring that the oath remains pertinent over time. A potential solution is to anchor the oath in broader ethical principles rather than specific technological contexts. By focusing on timeless values, such as inclusivity, transparency, and user autonomy, the oath can provide enduring guidance amidst the whirlwind of technological change.

Design also doesn't operate in isolation. It intersects with technology, sociology, psychology, economics, and various other disciplines. Different fields bring their own perspectives, methodologies, and values. These differences, while enriching, can also lead to discrepancies in understanding and approach. An effective oath should serve as a bridge, fostering interdisciplinary collaboration and dialogue. It should promote a shared ethical foundation while respecting the unique contributions of each field.

Finally, an oath, no matter how well-crafted, is of little value if it remains mere words on paper. The real challenge lies in its implementation and ensuring adherence. To be impactful, the oath should be accompanied by mechanisms for oversight, training, and continuous feedback. This could involve the establishment of ethics committees within design organizations, regular training sessions on ethical design principles, and platforms for stakeholders, including users, to provide feedback and raise concerns. By embedding the oath into the fabric of the design community, we can ensure it serves as a living guidepost, shaping ethical design decisions in practice.

Moving Forward: Actionable Steps

Much like the products that designers frequently engage with, the oath itself should be treated as a "product" – one that requires regular iterations and updates. As technology and societal needs evolve, so should our ethical guidelines. The oath should be seen not as a static document but as a dynamic framework that adapts to the changing technological landscape and the accompanying ethical challenges. Regular reviews, perhaps annually or biannually, could ensure that the oath remains pertinent and effective.

When navigating the murky waters of ethical dilemmas, abstract principles can sometimes fall short. A more tangible approach would be to integrate scenario-based guidelines, employing a design thinking approach. By simulating real-world challenges and dilemmas that designers might encounter, these guidelines can provide clearer direction on ethical decision making. These scenarios, drawn from actual case studies, can offer insights into potential pitfalls and best practices.

Also, an ethical guideline's true strength lies in its roots within the community it serves. Actively seeking feedback from a diverse range of stakeholders, from designers and developers to end-users from varied backgrounds, ensures that the oath is grounded in real-world perspectives. Such a bottom-up approach can highlight unforeseen challenges, biases, or oversights, refining the oath to be more comprehensive and inclusive.

But the journey towards a universally acknowledged Hippocratic Oath for Designers is not one that can be undertaken in isolation. It requires the collective wisdom and efforts of designers, technologists, policymakers, ethicists, and the public at large. Only through active participation, dialogue, and collaboration can we craft a guideline that stands the test of time, ensuring that the future of design remains firmly anchored in ethical principles. While the roadmap to an effective and impactful oath is fraught with challenges, with concerted efforts and a commitment to collaboration, it’s a journey that may be well worth undertaking.

Concluding Thoughts

Designers wield profound influence over the complex interplay between humans and technology. The designs of today don't just shape products; they shape perceptions, behaviors, and, ultimately, the very fabric of our society. With the surge of AI's capabilities, this influence is only growing exponentially, amplifying both the potential benefits and pitfalls.

This pivotal role underscores the imperative for ethical guidelines like a Hippocratic Oath tailored for designers. This compass doesn't just serve as a protective shield against potential pitfalls; it's a signal, guiding designers towards creating innovations that genuinely serve humanity's best interests.

In attempting to create this oath, challenges will undoubtedly arise. Yet, with challenges come opportunities – opportunities for collaboration, reflection, and growth. I fully acknowledge that there are blindspots to this concept that I might not have mentioned. I also acknowledge that attempting to check off every item on the list for a well-rounded Hippocratic Oath for Designers may seem impossible, maybe even utopian. But as we stand at this technological crossroads, there's a sense of hope. By intertwining AI and ethical design, we can envision a future not dominated by algorithms, but potentially enriched by them; a future where technology and design converge, not to overshadow humanity, but to uplift and celebrate it.