Trust Through Provenance

The recent advances in?generative AI?have led many people to fear all manner of?deepfakes?— particularly text, images, audio, and video. People like?Yuval Noah Hariri?feel that?AI threatens the future of humanity.

On one hand, I feel that these fears are well-grounded: even if AI-generated fakes are not good enough already, I believe that they soon will reach the point of being indistinguishable from reality. On the other hand, I do not think the content is the problem. What we need to focus on is?provenance.

We cannot determine what is real from just looking at it.

As a species, we have always been susceptible to forgery, whether in the form of fake signatures, photoshopped images, impersonated voices, or all manner of?social engineering. Our senses and intuitions are fallible, and there are a lot of highly motivated tricksters out there.

At this point, we should consider the possibility that content presented to us is fake, especially if the content is surprising and might lead us to unusual actions, such as a?report of an explosion near the Pentagon.

While such an attitude might have been considered paranoid in the past, today it is simply realistic. It is already fairly cheap and easy to create convincing fake content, and advances in technology will continue to lower the barrier to forgeries. It is not paranoia if they are really out to trick you.

Consider the source before you consider the content.

If we cannot trust what we perceive with our senses, then what can we trust? I believe that the better question is: who can we trust?

We learned to trust content in an age where it was difficult to create convincing forgeries. That difficulty allowed us to put less emphasis on ensuring that we trusted the source of the content.

That age is ending, if it has not ended already. Today and looking to the future, we need to consider the source before we consider the content.

For example, I trust that the?Apollo moon landing?happened because I trust the institutions that documented it, not because I do not believe the footage could not be convincingly faked. Conversely, I am skeptical of the authenticity of much of the content I see shared on social media, no matter how realistic the content is, if I cannot trace it back to a source I trust.

Lots of work to make this easy enough for mass adoption.

Shifting our focus from content to the source of the content will require a big change in how we consume and evaluate information. I suspect that most people have never even encountered the word “provenance”, let alone worried about the provenance of the content in their feeds.

The misinformation challenge facing us is serious and urgent. It is also one that we have the technology to solve. We have known how to create robust?digital signatures?for decades, as well as how to establish a?public key infrastructure. We have the technical tools to track provenance.

What we have not done is integrate these tools into browsers, apps, and devices in way that makes it simple for consumers to determine whether the provenance of a piece of content have earned their trust. Moreover, we are unlikely to cure human laziness. If we cannot make the process of evaluating content easy and frictionless, most people will not bother.

A successful integration will require a careful blend of engineering and design, as well as a management of tradeoffs. It will also require buy-in, or regulation, in order to interoperate with the many ways we consume content. Moreover, no system will be perfect, nor will one system or configuration necessarily meet everyone’s needs. After all, we do not always agree on whom to trust, which splinters our collective reality.

But we have to start somewhere. Focusing exclusively on the content is a dead end. The sooner we accept that, the sooner we can start building effective solutions that focus on provenance.

To update a phrase from the Cold War: we need to verify, then trust.

要查看或添加评论,请登录

Daniel Tunkelang的更多文章

  • ChatGPT, Are You Just Telling Me What I Want to Hear?

    ChatGPT, Are You Just Telling Me What I Want to Hear?

    These days, the Turing Test — which Turing originally called the “imitation game” — feels hopelessly outdated. With…

  • Not All Recall is Created Equal

    Not All Recall is Created Equal

    Search application developers constantly navigate tradeoffs, particularly between precision and recall. Precision…

    1 条评论
  • To Bot or Not to Bot: It Depends on the Question

    To Bot or Not to Bot: It Depends on the Question

    I was one of Quora’s earliest users. I earned Top Writer status for several years and even made some money through…

  • Ground Truth: A Useful Fiction

    Ground Truth: A Useful Fiction

    A key concern about AI is that models “hallucinate” — technical jargon for saying that they make up things that look…

    5 条评论
  • Conjunction, Disjunction, What’s Your Function?

    Conjunction, Disjunction, What’s Your Function?

    Like many folks of my generation, I grew up on Schoolhouse Rock, a series of animated educational shorts that aired…

  • Modeling Queries as Bags of Documents

    Modeling Queries as Bags of Documents

    Last week, I had the honor of presenting “Modeling Queries as Bags of Documents” at Search Solutions 2024 with Aritra…

  • Documents, Queries, and Categories

    Documents, Queries, and Categories

    I have published a number of posts and presentations about the bag-of-documents model, which essentially represents…

  • Where Do Categories Come From?

    Where Do Categories Come From?

    In my previous post, I argued that categories are fundamental for search applications. I characterized a robust set of…

    1 条评论
  • Categories are Fundamental for Search

    Categories are Fundamental for Search

    As a search consultant, I have learned to be flexible about structured data. However, I do insist on content being…

    5 条评论
  • Quo Vadis Nunc, Quora?

    Quo Vadis Nunc, Quora?

    I was one of Quora’s earliest users, earned Top Writer status for a few years, and topped the leaderboard as a 9-time…

    2 条评论

社区洞察

其他会员也浏览了