Exploring AI Evolution: A Faceoff Between ChatGPT and Google Bard in Analyzing Literature

Unveiling the Progress of AI in English Classes — A Comparative Analysis of ChatGPT and Google Bard’s Responses

Back in January, we did some early research with ChatGPT on new ways to embrace AI in English classes at our school. We let ChatGPT analyze The Absolutely True Diary of a Part-Time Indian by Sherman Alexie and reported on our findings on?Medium in this post.

How would ChatGPT respond today, six months later? In the meantime, in April 2023, a new model of ChatGPT showed up: GPT-3.5 with Browsing (ALPHA). So we wondered how the new capabilities of the chatbot would surface when using the same prompt and comparing the results.

The second experiment I would like to report today may even be more fascinating for those pursuing the progress of AI use: these days, another tool has become available, a competitor to ChatGPT: it is the long-awaited Google Bard. So, I wondered how the two would compete on exactly the same prompt.

Third, I asked ChatGPT and Google Bard to compare the responses. In a new chat, respectively. And I did not disclose to them that one of the texts was their own.

Finally, I revealed to each chatbot that they had just compared their own result with that of the respective competitor.

These experiments provided some interesting insights, both on the priorities when analyzing a person's personal traits, the circumstances of their life, and the tone of their responses.

One of the AI heroes was more superficial in tendency but, on the other hand, put more focus on the strengths and opportunities of the person. Who is it? What do you guess? The OpenAI hero or his Google counterpart?

Old Prompt ChatGPT, January 2023

Provide a summary of Junior's character traits and appearance in A Part-time Indian.

ChatGPT’s old answer, January 2023

Junior, also known as Arnold Spirit Jr., is the protagonist of the novel “The Absolutely True Diary of a Part-Time Indian” by Sherman Alexie. He is a 14-year-old boy who lives on the Spokane Indian Reservation in Wellpinit, Washington. Junior is a talented cartoonist and artist, and throughout the novel, he uses his drawings to express his thoughts and feelings. He is also a thoughtful and introspective character, who is very aware of the poverty and poverty-related issues that plague his community. He is often frustrated by the lack of opportunities and resources on the reservation, and decides to attend a mostly white high school off the reservation in order to get a better education. Junior is also physically described as having a “brain damage” from a hydrocephaly that he had as a baby. He is often bullied and has a hard time making friends due to his physical appearance.

Same Prompt ChatGPT, July 2023

Provide a summary of Junior's character traits and appearance in A Part-time Indian.

“Junior,” also known as Arnold Spirit Jr., is the protagonist of Sherman Alexie’s novel “The Absolutely True Diary of a Part-Time Indian.” Here is a summary of his character traits and appearance:

Character Traits:

Determined: Junior is resilient and determined to overcome the challenges in his life, despite facing numerous obstacles both on the Spokane Indian Reservation and at his new school outside the reservation.

Intelligent: He is highly intelligent and creative, possessing a keen observational skill that leads him to become an excellent cartoonist and artist.

Courageous: Junior exhibits bravery in pursuing his dreams, even when they seem impossible. He is not afraid to confront the unfairness of his circumstances and strives to change his life for the better.

Honest: Junior is honest, both with himself and others. He openly acknowledges his weaknesses and faults, which makes him a relatable and authentic character.

Compassionate: He cares deeply for his family and friends, demonstrating empathy and understanding for others’ struggles and pain.

Humorous: Junior has a sharp sense of humor, often using it as a coping mechanism to deal with the hardships he faces.

Appearance: Throughout the novel, Junior’s appearance is not described in great detail. However, it is mentioned that he was born with multiple physical challenges, such as having “water on the brain” (hydrocephalus) which results in having a larger head. Additionally, he has a lisp and wears thick eyeglasses due to poor eyesight. These physical characteristics, combined with his resilience and unique personality, make Junior a memorable and endearing character in the story.

How do they compare? ChatGPT January vs. ChatGPT July?

A few things are quite obvious at a glance: ChatGPT’s answer of today os way more extensive, elaborated and structured. Examples:

• Capabilities: “possessing a keen observational skill that leads him to become an excellent cartoonist and artist.” (July) vs. “Junior is a talented cartoonist and artist,” (January)
• Apperance: “it is mentioned that he was born with multiple physical challenges, such as having “water on the brain” (hydrocephalus) which results in having a larger head. Additionally, he has a lisp and wears thick eyeglasses due to poor eyesight.” (July) vs. “Junior is also physically described as having a “brain damage” from a hydrocephaly that he had as a baby.” (January)

How does Google Bard respond to the same prompt?

Same prompt:?Provide a summary of Junior's character traits and appearance in A Part-time Indian.

Sure, here is a summary of the character traits and appearance of Junior in A Part-time Indian:

Character traits:

Junior is a 14-year-old Spokane Native American boy who is often bullied because of his physical appearance. He has hydrocephalus, which has caused him to have a large head, huge hands and feet, and a misshapen body. He also has a stutter and a lisp, which makes him self-conscious and reluctant to speak up in class.

Despite his physical challenges, Junior is a bright and talented boy. He is a gifted artist and cartoonist, and he loves to play basketball. He is also a kind and compassionate person, and he is always willing to help others.

Junior is a complex and contradictory character. He is both strong and weak, confident and insecure, brave and afraid. He is still learning and growing, and he is not afraid to make mistakes.

Appearance:

Junior’s physical appearance is described as “weird” and “vegetable-like.” He has a large head, huge hands and feet, and a misshapen body. He also has a stutter and a lisp.

Junior’s appearance often makes him the target of bullying. He is called names like “retard” and “vegetable,” and he is often excluded from activities.

Despite the challenges of his appearance, Junior is proud of who he is. He does not let his physical differences define him, and he continues to pursue his dreams.

Overall, Junior is a complex and relatable character. He is a strong and compassionate boy who is still learning and growing. His story is one of hope, resilience, and triumph.

For further reference:

Link to ChatGPT’s answer of July?and?Link to Google Bard’s answer

Now, let's have them, ChatGPT and Google Bard, compare the answers without knowing that one of the texts has been created by themselves.

Big surprise! Read the full post on Medium. At the end we disclose our unfair trap to the two AI competitors and let them comment both views!