[Exclusive] What Yan LeCun Thinks of ChatGPT?

"I don't think any company out there is significantly ahead of the others," said?Yan LeCun, VP and chief AI scientist at?Meta AI, in an exclusive interview with Analytics India Magazine, when asked about the growing popularity of?OpenAI's ChatGPT.?

LeCun said that a lot of people are, in fact, working on language models with slightly different approaches. He said there are three to four companies producing?GPT-X-like models. "But, they [OpenAI] have been able to deploy their systems in such a way that they have a data flywheel. So, the more feedback they have, the more the feedback they get from the system, and later adjust it to produce better outputs," he explained.?

"I do not think those systems in their current form can be fixed to be intelligent in ways that we expect them to be," said LeCun. He said that data systems are entertaining but not really useful. "To be useful, they have to make sense of real problems for people, help them in their daily lives as if they were traditional assistants completely out of reach," he added, painting the real picture.?

While?ChatGPT?makes you second-guess if you are talking to a human, it still has a long way to go to become an 'expert' and see some?real-world applications.

Of late, many people are calling?ChatGPT the 'New Google' or 'Google Killer,' which, to a certain extent, holds true – especially when the latter shows bizarre suggestions. For example, Google often suggests cancer for every symptom queried in.?ChatGPT?doesn't reflect such suggestions but curates?misinformation beautifully. We think, 'ChatGPT is a glorified version of Google Search’ – and better.?

Read:?Why Everyone is Bashing ChatGPT

OpenAI?chief Sam Altman recently?said?that ChatGPT is incredibly limited but good enough at certain things to create a misleading impression of greatness. He said it would be a mistake to rely on it for anything important as the team continues to work on enhancing the robustness and reliability of the model.

ChatGPT vs LaMDA?

"ChatGPT?is still a few years behind Google,"?said?Blake Lemoine, a former Google researcher who got fired for his claims on?LaMDA?(Language Model for Dialogue Applications) being?sentient, five months ago. "I love how people are talking about?ChatGPT?replacing Google, while Google just quietly uses a more advanced dialogue system behind the scenes," said Lemoine, replying to Gary Marcus'?post?about ChatGPT replacing Google Search.?

ChatGPT currently competes with a handful of models, including Google's LaMDA, Meta AI's BuilderBot 2, Galactica, and others. For instance, LaMDA is a transformer-based neural language model – similar to GPT-3, BERT, etc – consisting of up to 137 billion parameters and pre-trained on 1.56 trillion words from publicly available dialogue data and web documents. ChatGPT, on the other hand, is based on the latest GPT-3.5 architecture, having 175 billion parameters.?

The?GPT-3.5 architecture?consists of three models – namely code-davinci-002, the base model for code completion tasks, text-davinci-002, which is trained by supervised fine-tuning on human-written demo and samples rated 7/7 by human labellers on overall quality scores, and the most recently released text-davinci-003, the new and improved version that includes reinforcement learning with human feedback (RLHF), a reward-based model.?

Read more?here.?

TOP STORIES OF THE WEEK

Another Product Joins the Google Graveyard?

Google is no stranger to killing its most iconic products and putting to sleep some of the boring ones. Recently, the company added 'Google Duplex on the Web' to the?list. This service allowed Google Assistant to be used with various websites. However, it has been stopped from December 1, 2022, onwards.?

Read more?here.?

Forget Python and JS, Web3 Languages will Now Shape Developers' Future?

The demand for Web3 projects is only rising, and many developers today are pushing to fill the gap. This article introduces some of the latest Web3 languages and its use cases and applications. Last year, when Bitcoin and other cryptocurrencies rose to the limelight for their highest values, 18,500 developers participated in open-source Web3 projects.?

Read more?here.?

Is Data Science a Dying Field?

While data science has been touted as 'the most promising career’ by LinkedIn and the 'greatest job in America' by Glassdoor, many industry experts find it difficult to comprehend because of the ground realities and challenges faced by professionals in the industry.?

Click?here?to read more.

PEOPLE & TECHNOLOGY

Investment Philosophy of Speciale Invest

Founded in 2016, the young and energetic team at Speciale Invest believes in principles-first thinking and follows a bottom-up approach. In an exclusive interaction with AIM,?Arjun Rao?said that the firm does not always rely on domain experts to guide them about their investments but builds their convictions on technology trends and invests in disruptive technologies accordingly.

Portfolio companies:?Agnikul Cosmos,?QNu Labs,?Trainn,?CynLr,?TrueLark Materiall,?Wingman,?LoopPanel,?StreamAlive, and others.?

Read more?here.?

Inside Pocket FM’s Recommendation Engine?

Bengaluru-based Pocket FM claims to have built the first-audio-entertainment OTT company globally. As of last week, it's streaming on the platform doubled to 40 billion minutes, with the average daily listeners' time exceeding 100+ minutes. The company is also planning to build generative AI capabilities across NLP, text2speech, and image.

Check out the interview with Pocket FM CTO?Prateek Dixit?here.?

Inside Housing.com Recommendation Engine?

Founded in 2012, Housing.com is one of the largest property platforms in India. The company claims to be India's largest full-stack digital platform that supports customers in their home-buying journey. AIM recently got in touch with?Sangeet Aggarwal, head of product and design at Housing.com, to understand the data complexities, recommendation systems, and challenges the company faces and how they address them.?

Check out the interview?here.?

AIM VIDEOS

In our latest episode of Techie-la, we have created an explainer video that will help you understand ChatGPT within three minutes!?

What are you waiting for? Take a shot!

AIM SHOTS >>

• British engineering company Renishaw?recently?inaugurated?its state-of-the-art technology centre in Bengaluru.
• As ChatGPT continues to make waves globally,?OpenAI has?subtly launched the second version of Whisper, an open-sourced multilingual speech recognition model.?
• Amidst rising geopolitical tensions and?China's strict Zero-Covid policy,?Apple?plans to diversify its supply chain and?move its production to countries like Vietnam and India.?
• Google-backed DeepMind?recently?announced the launch?of its generator model,?AlphaCode, on GitHub, where it has made the dataset and code available.
• The Onion Router, or?TOR,?that allows?anonymous?communication gets a new upgrade—TOR Browser 12.0. Check out the details?here.?
• Google recently?revealed Simple ML,?a new tool that will let users create AI models in?Google Sheets.?
• Generate Biomedicines and?David Baker's?Group—relied on?generative AI, particularly?diffusion models, to develop new protein structures and eventually better drugs.?
• After Twitter, Meta, Google, and other tech companies, Adobe?has joined the list of companies that have?laid off close to 100 employees to cut costs.