AI is like our dentist!

Experience with dentists

Have you ever been to a dentist? Has she or he ever told you that your teeth and gums are perfect and you should not clean anything? Come on, do not lie! There is not a single dentist in the world who does not find a fault, a cavity, a misalignment, or a stain.

The old English saying 'do not fix it if it is not broken' is completely forgotten. After all, a dentist has to feed their family and take a few exotic holidays each year!

Experiment with AI

The latest versions of the world's four leading AI programs - Microsoft Copilot, Claude, Gemini, and ChatGPT 4.0 - are all like dentists.

This weekend, I asked four of them to identify potential improvements in my software code. But this was a test. The code was perfect and nothing was broken. Yet, each AI program made suggestions for improvement.

Comparison of Performance of AI programs

Here is a further analysis of their recommendations and their rankings:

Rank #1: Microsoft Copilot: Everything it said was rather rudimentary. It ignored the specificity of the nginx software. It made one minor error; but did not break things.

Rank #2: ChatGPT stood second. It gave suggestions that would break the server. ChatGPT ignored the SSL certificate requirements.

Rank #3: Claude gave misguided answers.

Rank #4: Gemini's answers were the worst among the four. I think it is linked to obsolete information from Google searches, ignoring the new versions of the software currently in use.

So, what do we learn from this?

1) Do not go to the dentist unless you have a problem. Do not ask AI to fix something that is not broken.

2) Do not trust a dentist. Do not trust AI.

Please take care of your own teeth and IT infrastructure, so that you would not need a Dentist or AI.

Cheers,

Santosh Pandit

19 May 2024