ChatGPT replicability
Going back to when I founded Foresight Science and Technology, and as a former academic, I have always insisted any data used in a report to me or a client (or now that I am at the Research and Innovation Foundation of Cypress) or a beneficiary be footnoted. Today my insistence was confirmed. In light of all the discussion about AI tools I though I would share the story.
On the way to work I found a crow feather. The crows in Cyprus have black and white bands on their wing feathers. When I turned the feather over, however, the other side was grey. I started thinking of reasons why ... evolutionary benefits in energy expended, food source, etc. Curious I though rather than search for literature, I will? ask ChatGPT. I did and got an answer. Then, wondering about the replicability of its answers given my understanding of the probabilistic? way the algorithm in the 3.5 neural net works, ?I asked 3.5 the same question twice and got two different answers. Related but different. I suspect this reflects the way the probability algorithm that drives the neural net's selection of the next word works in the context of looking at my last question and its answer to that and "learning" from it. But it is also a big red flag. Note the discussion of colors is different in the two and the absence of carotenoids in the second answer. The article Identification of pigment genes (melanin, carotenoid and pteridine) associated with skin color variant in red tilapia using transcriptome analysis - ScienceDirect suggests melanins and carotenoids are expressed by different genes, so without further research I don't know which one is right. Hummm....
Here is the example:
what determines the color of crow feathers
ChatGPT
ChatGPT
The color of crow feathers, as well as those of many other birds, is primarily determined by pigments in the feathers. There are two primary types of pigments that create color in feathers:
The specific coloration in crow feathers often results from the interaction between these pigments. For example, crows typically have glossy black feathers due to melanin, but in certain light conditions, these feathers might show shades of blue, green, or purple iridescence due to the microscopic structure of the feathers refracting light.
Environmental factors, diet, genetics, and overall health can influence the intensity and vibrancy of feather colors in crows and other birds. Additionally, some species might display variations in color based on gender or age, with juveniles having different feather colors than adults.
You
what determines the color of crow feathers
ChatGPT
ChatGPT
The color of crow feathers, like those of many other birds, is primarily determined by pigments and structural characteristics.
In summary, a combination of pigments, structural features of feathers, genetics, and environmental factors collectively determine the color of crow feathers. The interplay between these elements can lead to the observed variations in feather colors among crows and other bird species.
Today I asked 3.5 the same question twice and got two different answers. Related but different. I suspect this reflects the way the probability algorithm that drives the neural net's selection of the next word works in the context of looking at my last question and its answer to that and "learning" from it. But it is also a big red flag. Note the discussion of colors is different in the two and the absence of carotenoids in the second answer. The article Identification of pigment genes (melanin, carotenoid and pteridine) associated with skin color variant in red tilapia using transcriptome analysis - ScienceDirect suggests melanins and carotenoids are expressed by different genes, so without further research I don't know which one is right. Hummm....
领英推荐
Here is the example:
what determines the color of crow feathers
ChatGPT
ChatGPT
The color of crow feathers, as well as those of many other birds, is primarily determined by pigments in the feathers. There are two primary types of pigments that create color in feathers:
The specific coloration in crow feathers often results from the interaction between these pigments. For example, crows typically have glossy black feathers due to melanin, but in certain light conditions, these feathers might show shades of blue, green, or purple iridescence due to the microscopic structure of the feathers refracting light.
Environmental factors, diet, genetics, and overall health can influence the intensity and vibrancy of feather colors in crows and other birds. Additionally, some species might display variations in color based on gender or age, with juveniles having different feather colors than adults.
You
what determines the color of crow feathers
ChatGPT
ChatGPT
The color of crow feathers, like those of many other birds, is primarily determined by pigments and structural characteristics.
In summary, a combination of pigments, structural features of feathers, genetics, and environmental factors collectively determine the color of crow feathers. The interplay between these elements can lead to the observed variations in feather colors among crows and other bird species.
So footnoting data is still important and I am pleased this sensitivity to establishing accuracy of data and appreciation for the importance of ensuring, and documenting that you use reputable sources is alive and well at Foresight Science & Technology and RIF today.?