Artificial Intelligence #24

Hey. First of all, I would like to say that this week, the newsletter reached 100,000 subscribers! It's a big milestone, and I want to thank you for being here. I hope you enjoy the quality of the content I curate for you. If you know someone who would also like this content, please don't hesitate to share it. Once the newsletter reaches 200,000 subscribers, it will become feasible to hire a dedicated editor or even editors. This will bring the quality of the newsletter to the next level!

In this issue: how to know if artificial intelligence is about to destroy civilization, the GPT-2 model explained step by step, a guide for optimizing machine learning infrastructure cost, an overview of deep learning for text, and more.

This week's issue is sponsored by Weights & Biases.

• How to know if artificial intelligence is about to destroy civilization
• AI doesn't always take jobs, it just makes them suck
• A step by step explanation of the GPT-2, one of the most powerful pre-trained models for natural language processing
• A guide for optimizing machine learning infrastructure cost on AWS
• [Sponsored] Weights Biases – Developer tools for machine learning

Never lose your progress again. Save everything you need to compare, select, and reproduce models — architecture, hyperparameters, weights, model predictions, GPU usage, git commits, and optionally even datasets. Trusted by OpenAI, Github, Toyota research, LatentSpace, and more. Get started in 5 mins.

• The 2010s: our decade of deep learning and outlook on the 2020s
• Deep learning for text: an overview
• Language models are few-shot learners (paper, discussion)
• A collection of 545 datasets for natural language processing
• TextAttack: a Python framework for model training, adversarial attacks, and data augmentation in natural language processing
• Paper explained: Discovering Symbolic Models from Deep Learning with Inductive Biases (video, paper, code)

If you build an AI or data product or service, you are invited to sponsor one of the next issues. Feel free to contact True Positive Inc. for more details on sponsorships.

Enjoy the newsletter? Help us make it bigger and better by sharing with your colleagues and friends.

Have a nice weekend! See you next week. — Andriy