The intuition and nuts & bolts of transformers explained visually

The intuition and nuts & bolts of transformers explained visually

Inder Singh Inder Singh

Inder Singh

CTO - Lead for Applied AI & Engineering

发布日期: 2024年2月13日
+ 关注

The whole memo in PDF form is available here - https://github.com/inders/AISenseiCommunity-Knowledge/blob/main/TheIntutionOfTransfomersExplainedVisually.pdf


Community

Our mission it get 26.3M developers participate in open-source AI. For this, we need to break two barriers standing the way of open-source -

  1. Knowledge - All research that works is engineering and should be understood by everyone. We want to explain working research in a simple and visual way with code.

References

  1. Transformer series by Aditya Nigam
  2. https://jalammar.github.io/illustrated-gpt2/?
  3. ?https://osanseviero.github.io/hackerllama/blog/posts/random_transformer/?
  4. ?https://txt.cohere.ai/what-are-transformer-models/ ?
  5. ?https://txt.cohere.ai/what-is-attention-in-language-models/?
  6. https://www.youtube.com/@deeplearningsystemscourse1116
  7. https://arxiv.org/abs/1706.03762

Simplifying Complexity Simplifying Complexity

Simplifying Complexity

1,923 位关注者

订阅
Abdul Rehman

?? From Food Science to Supply Chain Solutions to Online Sales Talks about #FoodTech, #SupplyChain, and #ProfDev

7 个月

You can count me in for chit chat ?? Please let me in your WhatsApp group

赞
回复
Nilesh Potdar

Tech Leader with expertise on Scale, Performance, COGS and compliance.

7 个月

You can count me in, for compute pool contributions.

赞
回复
1 次回应
Arjun Jain

Solving Tough Problems at FastCode.AI || IISc || IITB || NYU || MPII || Apple || Yahoo!

7 个月

Definitely on my reading list!

赞
回复
1 次回应
查看更多评论

要查看或添加评论，请登录

Inder Singh的更多文章

社区洞察

其他会员也浏览了