2a. Which activation function to use?

• 举报此文章

Chandra P.

Chandra P.

Into the world of AI

发布日期: 2023年11月25日

+ 关注

We mainly have the following activation functions-

1. sigmoid
2. softmax
3. tanh
4. ReLU
5. Linear Activation

The above charts show which activation functions to use in different scenarios.

要查看或添加评论，请登录

Chandra P.的更多文章

• Part 1- Simple Introduction to AI Agents

  2025年3月3日

  Part 1- Simple Introduction to AI Agents

  One of the key limitations of LLMs is their inability to access real-time data; they generate responses based only on…

  4
• Part 2: The Power of Alignment in Language Models| RLHF and DPO

  2024年5月26日

  Part 2: The Power of Alignment in Language Models| RLHF and DPO

  Introduction: In our previous article, we explored the supervised finetuning stage of the canonical Large Language…

• Part 1: The Power of Alignment in Language Models: From Autocomplete to Human Preferences

  2024年5月25日

  Part 1: The Power of Alignment in Language Models: From Autocomplete to Human Preferences

  Introduction When training a language model, the first step is pre-training, where a large amount of data from the…

  4
• LoRA and QLoRA: A Simplified Approach to Fine-Tuning Large Language Models (LLMs)

  2024年5月12日

  LoRA and QLoRA: A Simplified Approach to Fine-Tuning Large Language Models (LLMs)

  Introduction As the world of natural language processing (NLP) continues to evolve, large language models (LLMs) have…

  4
• Unlock the Power of Large Language Models

  2024年5月11日

  Unlock the Power of Large Language Models

  3 Levels of Usage Large language models (LLMs) are rapidly transforming how we interact with and leverage AI…

• Why do we need GPUs for deep learning?

  2024年5月11日

  Why do we need GPUs for deep learning?

  Why do GPUs Outperform CPUs in Neural Networks? When it comes to neural networks, GPUs (Graphics Processing Units)…

  5
• Decoding X and y in Machine Learning

  2024年5月1日

  Decoding X and y in Machine Learning

  Ever wondered what X and y represent in machine learning? Capital X: A 2D matrix where each row is a sample and each…

  4
• Generative AI in a Nutshell

  2024年3月11日

  Generative AI in a Nutshell

  For those who want to have quick overview of GenAI, can refer to below video. I found the video very informative.

• What is Large Language Model (LLM)?

  2024年2月27日

  What is Large Language Model (LLM)?

  A language model is a machine learning model that aims to predict and generate plausible language. Autocomplete is a…

  3
• What is a tensor in deep learning?

  2024年2月15日

  What is a tensor in deep learning?

  Tensor is the data structure for Deep Learning. It is used to store the numerical data that we use in our neural…

  10

Show more

See all articles