INBOX INSIGHTS: Fact-Checking AI, Social Media at Conferences
Trust Insights
We are a marketing analytics consulting firm. We help you solve marketing's data and analytics problems.
How Do I Know if My AI Information Is Correct?
Unless you’re living under a rock, you’ve probably heard a thing or two about all the advances in AI over recent months. ChatGPT is dominating the conversation but they aren’t the only game in town. For the purposes of this newsletter, thought, we’ll pick on ChatGPT - just a little.
Reminder, tools like ChatGPT have a lot of great potential and we’re already seeing the disruption of how we work. I’m a big fan of these tools and I think that they will help us refocus on really important work, while helping to automate more of the repetitive pieces. Keep in mind that this is not a post hating on ChatGPT. This is a remind to you, the end user, to use your noodle.
Since it has become available, the majority of users look at ChatGPT as a way to research and write content. Ever the skeptic, my first question is, “How do you know if the information is correct?”
The short answer is that you don’t. Just like looking up something on the internet, taking the results at face value can be dangerous. Unless you’re using GPT-4 through the Bing interface, it otherwise doesn’t cite its source of information.
Chris told me that he was using ChatGPT to help him write code. I asked him how he knew if the code the system was writing was correct. He said that he had to go back through it and make sure it was what he intended. I could ask ChatGPT to write code too. But because I’m not a developer I would have no idea if it was correct and if I take it at face value it could be a risk to my project and my business.
When you start extending that scenario into how quickly ChatGPT can create content, the risks of misinformation start to get even higher. Some companies are using these systems to churn out thousands of pieces of content without doing a thorough fact check of each piece.
Here’s a simple example. We asked ChatGPT: What do you know about Katie Robbert?
This is what it told us.
There is a person named Katie Robbert who is the CEO of Trust Insights, a marketing analytics and data consulting company. She is also a professor at Rutgers University and has been a keynote speaker at various conferences on topics related to marketing, analytics, and data science. Additionally, she co-hosts the podcast “Punch Out With Katie and Kerry” where she and her co-host discuss various topics related to marketing, business, and technology.
If you don’t know me that well, you’d think this was a reasonable response. Well, friend, the devil is in the details. This is about 90% correct. However, I do not at this time, have any affiliation with Rutgers University. (I am however open to the possibility).
The point is, if you don’t read carefully or aren’t a subject matter expert you could miss the incorrect information.
When we recorded our podcast, In-Ear Insights, the other day, we were walking through developing prompts. We decided to use “SEO in 2023” as the topic. We built the prompt, ran the query, and ChatGPT gave us a first draft of tactics that will be relevant for SEO in 2023. It said things like, video optimization and voice search.
To me, this was helpful advice. However, when Chris read it, he said that the advice was about five years out of date. The challenge is that I’m not a subject matter expert in SEO so I would have read this draft and thought it was good enough.
The examples I’m giving are pretty low risk. What happens when you start asking for content that involves medical advice or other high risk topics? There has to be a way to know if the information is correct, right?
Right.
Do your homework. Before you ask a tool like ChatGPT to write a post or develop code for you, make sure you know all the facts. In the example above where we ask the system to write a post on SEO in 2023, my first mistake was not being up to date on the latest SEO tactics. The way to get around the misinformation is to include the relevant facts in your prompt before asking the system to write for you. You can be as specific as you need to be. ChatGPT (on its own) isn’t a search engine, you shouldn’t be using it as one. Use it to rewrite your content, to summarize notes, to assist you, the expert.
This is the old, “Will AI take my job?” question. In this instance, if you’re a subject matter expert, the answer is no. If you know how to research a topic, the answer is no. If you know how to fact check, the answer is no. Humans need to, and continue to be, in charge. Not the other way around.
Are you using ChatGPT? Reply to this email or come tell me about your experience in?our free Slack Community, Analytics for Marketers.
- Katie Robbert, CEO
Share With A Colleague
Do you have a colleague or friend who needs this newsletter? Send them this link to help them get their own copy:
Binge Watch and Listen
In this week’s In-Ear Insights, Katie and Chris talk through how to improve your prompt engineering for large language models like ChatGPT, GPT-4, and other services through the use of the software development lifecycle. Learn how to apply the SDLC to your individual work with AI tools, and why it’s so important.
Last week on So What? The Marketing Analytics and Insights Livestream, we celebrated our fifth birthday.?Catch the episode replay here!
This Thursday at 1 PM Eastern on our weekly livestream, So What?, we’ll be discussing how to integrate AI into your organization.?Are you following our YouTube channel? If not, click/tap here to follow us!
In Case You Missed It
Here’s some of our content from recent days that you might have missed. If you read something and enjoy it, please share it with a friend or colleague!
Paid Training Classes
Take your skills to the next level with our premium courses.
Free Training Classes
Get skilled up with an assortment of our free, on-demand classes.
Data Diaries: Interesting Data We Found
In this week’s Data Diaries, we noticed something recently as we were doing our network maps for Social Media Marketing World. While we couldn’t put our finger on it exactly, it felt like there was less public social media activity than previously. However, a hunch does not make an analysis, so we did what we always do: pulled the data.
In this exploration, we extracted the public Twitter data using the appropriate hashtags for 6 major events since 2016:
领英推荐
What did we find?
What we see is clear evidence that across the board, all conferences and events took the expected hit during the peak years of the pandemic; however, content creation on Twitter for events has been steadily dropping well before the pandemic. Things are slowly building back; 2022 was a rebuilding year.
However, for many events, the overall trend is clear on Twitter: decreased public social media content creation.
Now, before we jump to conclusions, there are a variety of reasons this could be the case, none of which the data exposes:
So what? What are the key takeaways here? If you’re a conference organizer, recognize that social media engagement has taken a hit year after year for most events on Twitter. If you’re using social media as a proof point of your event’s popularity, that tactic may be past its prime. If you’re a conference attendee, chances are organizers are still trying to get social media attention to their event and with less content being created at events, the chance for you to stand out and be noticed is greater.
Trust Insights In Action
Job Openings
Here’s a roundup of who’s hiring, based on positions shared in the Analytics for Marketers Slack group and other communities.
Join the Slack Group
Are you a member of our free Slack group, Analytics for Marketers? Join 3000+ like-minded marketers who care about data and measuring their success.?Membership is free - join today. Members also receive sneak peeks of upcoming data, credible third-party studies we find and like, and much more.?Join today!
Blatant Advertisement
We heard you loud and clear. On Slack, in surveys, at events, you’ve said you want one thing more than anything else:?Google Analytics 4 training to get ready for the July 1 cutoff. The newly-updated?Trust Insights Google Analytics 4 For Marketers Course?is the comprehensive training solution that will get you up to speed thoroughly in Google Analytics 4.
What makes this different than other training courses?
With more than 5 hours of content across 17 lessons, plus templates, spreadsheets, transcripts, and certificates of completion, you’ll master Google Analytics 4 in ways no other course can teach you.
If you already signed up for this course in the past, Chapter 8 on Google Analytics 4 configuration was JUST refreshed, so be sure to sign back in and take Chapter 8 again!
Upcoming Events
Where can you find Trust Insights face-to-face?
Stay In Touch
First and most obvious - if you want to talk to us about something specific, especially something we can help with,?hit up our contact form.
Where do you spend your time online? Chances are, we’re there too, and would enjoy sharing with you. Here’s where we are - see you there?
Featured Partners and Affiliates
Our Featured Partners are companies we work with and promote because we love their stuff. If you’ve ever wondered how we do what we do behind the scenes, chances are we use the tools and skills of one of our partners to do it.
Read our?disclosures statement?for more details, but we’re also compensated by our partners if you buy something through us.
Legal Disclosures
Some events and partners have purchased sponsorships in this newsletter and as a result, Trust Insights receives financial compensation for promoting them.?Read our full disclosures statement on our website.
Conclusion: Thanks for Reading
Thanks for subscribing and supporting us.?Let us know if you want to see something different or have any feedback for us!