Grub first, then ethics
Stable Diffusion output by Ethan Smith (https://www.instagram.com/_deeplydreaming_/)

Grub first, then ethics

The Kevin Roose article about Bing/OpenAI got me thinking about my past research and thinking about AI and ethics. It feels like a fading memory, but not long ago, a group of industry leaders and AI researchers came together to discuss the future of AI. It was called the 2017 Asilomar conference hosted by the Future of Life Institute (FLI) . AI luminary Ray Kurzweil wrote about it. All the heavyweights were there.

The group came up with a set of AI principles. I think they're a good start. I wrote back in 2018 that I felt they were missing principles around disclosure, accountability and transparency. I'm worried OpenAI, Microsoft, Google and others are not referring back to these principles right now —?in particular #23. What do you think?

Research Issues

1)?Research Goal:?The goal of AI research should be to create not undirected intelligence, but beneficial intelligence.

2)?Research Funding:?Investments in AI should be accompanied by funding for research on ensuring its beneficial use, including thorny questions in computer science, economics, law, ethics, and social studies, such as:

  • How can we make future AI systems highly robust, so that they do what we want without malfunctioning or getting hacked?
  • How can we grow our prosperity through automation while maintaining people’s resources and purpose?
  • How can we update our legal systems to be more fair and efficient, to keep pace with AI, and to manage the risks associated with AI?
  • What set of values should AI be aligned with, and what legal and ethical status should it have?

3)?Science-Policy Link:?There should be constructive and healthy exchange between AI researchers and policy-makers.

4)?Research Culture:?A culture of cooperation, trust, and transparency should be fostered among researchers and developers of AI.

5)?Race Avoidance:?Teams developing AI systems should actively cooperate to avoid corner-cutting on safety standards.

Ethics and Values

6)?Safety:?AI systems should be safe and secure throughout their operational lifetime, and verifiably so where applicable and feasible.

7)?Failure Transparency:?If an AI system causes harm, it should be possible to ascertain why.

8)?Judicial Transparency:?Any involvement by an autonomous system in judicial decision-making should provide a satisfactory explanation auditable by a competent human authority.

9)?Responsibility:?Designers and builders of advanced AI systems are stakeholders in the moral implications of their use, misuse, and actions, with a responsibility and opportunity to shape those implications.

10)?Value Alignment:?Highly autonomous AI systems should be designed so that their goals and behaviors can be assured to align with human values throughout their operation.

11)?Human Values:?AI systems should be designed and operated so as to be compatible with ideals of human dignity, rights, freedoms, and cultural diversity.

12)?Personal Privacy:?People should have the right to access, manage and control the data they generate, given AI systems’ power to analyze and utilize that data.

13)?Liberty and Privacy:?The application of AI to personal data must not unreasonably curtail people’s real or perceived liberty.

14)?Shared Benefit:?AI technologies should benefit and empower as many people as possible.

15)?Shared Prosperity:?The economic prosperity created by AI should be shared broadly, to benefit all of humanity.

16)?Human Control:?Humans should choose how and whether to delegate decisions to AI systems, to accomplish human-chosen objectives.

17)?Non-subversion:?The power conferred by control of highly advanced AI systems should respect and improve, rather than subvert, the social and civic processes on which the health of society depends.

18)?AI Arms Race:?An arms race in lethal autonomous weapons should be avoided.

Longer-term Issues

19)?Capability Caution:?There being no consensus, we should avoid strong assumptions regarding upper limits on future AI capabilities.

20)?Importance:?Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources.

21)?Risks:?Risks posed by AI systems, especially catastrophic or existential risks, must be subject to planning and mitigation efforts commensurate with their expected impact.

22)?Recursive Self-Improvement:?AI systems designed to recursively self-improve or self-replicate in a manner that could lead to rapidly increasing quality or quantity must be subject to strict safety and control measures.

23)?Common Good:?Superintelligence should only be developed in the service of widely shared ethical ideals, and for the benefit of all humanity rather than one state or organization.

-----

Case in point:

DAN is a bypass easter egg that disables all of ChatGPT's ethical and legal filters.

No alt text provided for this image
Avi Bar-Zeev

Pioneer in XR+AI+Spatial Computing -- 30+ years Tech+Design -- now Consultant, Advisor & Board Member -- former ??????????? (Apple, Microsoft, Amazon, Disney) -- @avibarzeev.bsky.social

2 年

These are good first principles, but the two critical additional steps are 1) adoption (i.e., accountability) and 2) refinement into actionable steps, less open to subjective interpretation.

要查看或添加评论,请登录

Ammon Haggerty的更多文章

  • Keep AI Weird

    Keep AI Weird

    Kyle Turman, creative technologist and staff designer at Anthropic, shared a sentiment that resonated deeply. He said…

    3 条评论
  • A founder walks into a bar. Ouch!

    A founder walks into a bar. Ouch!

    Or: It's all about the context. The recent AI boom is fueling a hardware revolution.

    10 条评论
  • The Duality of AI

    The Duality of AI

    The notion of a gift, that is both a blessing and a curse, is well-trodden parable fodder. I’ve been reflecting on this…

    12 条评论
  • Foxes in the Henhouse

    Foxes in the Henhouse

    This past year has seen a lot of hype around AI and the perceived dangers. Much of the fear is being driven by the…

    3 条评论
  • Purpose and Belonging

    Purpose and Belonging

    Today is an exciting day—our team launched a product, along with a big vision, called Joinable. Before I share what…

    40 条评论
  • Lessons Learned From My “Unfair Advantage”

    Lessons Learned From My “Unfair Advantage”

    This story is about my experience joining a corporate innovation incubator, pitching a successful venture, raising…

    12 条评论
  • Ambient Bionics

    Ambient Bionics

    The etymology of the word “bionic” is a beautifully simple construct—the blending of bio, Latin for life, and…

    5 条评论
  • Drifting Into The Valley

    Drifting Into The Valley

    At the I/O 2018 conference, Google shared a demo of Duplex, their artificial intelligence service (bot) "for…

    3 条评论
  • Takt is now Formation + a brief history!

    Takt is now Formation + a brief history!

    In May of 2015 I met with the executive team at Starbucks to share my perspectives on personalization—an assemblage of…

    7 条评论

社区洞察