??AI scale slowdown,??AlphaFold3 open source, ??Reddit 100k reads per second
OpenAI’s full o1 model leaked briefly a few weeks ago and it was impressive.
Ever since then, talk from OpenAI insiders hints that LLM performance (based on GPTs) isn’t scaling like it used to. Unnamed AI researchers told The Information that OpenAI’s next model, codenamed Orion, is showing a smaller performance jump than the one seen between GPT-3 and GPT-4.
This means that improvements in AI will come from scaling the next right thing, not just throwing another 100k Nvidia GPUs and more data at traditional GPT models.?
OpenAI co-founder, Ilya Sutskever, told Reuters, “"Now we're back in the age of wonder and discovery once again. Everyone is looking for the next thing. Scaling the right thing matters more now than ever."
It’s also important to know that the slowdown isn’t as catastrophic for AI as headlines make it sound.
AlphaFold3 is now open source
Scientists can now download and use the model weights and code for AlphaFold3 – the Nobel-prize-winning tool for modeling protein structures.
Currently the AI tool is open for non-commercial applications and only scientists with an academic affiliation can access the training weights.
While it can’t be used for things like commercial drug discovery, it gives scientists a way to reproduce and understand their research. AlphaFold2 was open source and led to researchers finding proteins that could bind to cancer targets.
AlphaFold3 moving to open source is sure to lead to some world-changing research even if it's not a commercial model.
How Reddit handles 100k reads per second
This newsletter is AI-focused, but we’re busy solving big technical problems for our partners that have nothing to do with AI. So we got excited seeing this breakdown from Quastor on how Reddit’s Metadata Store handles 100k reads per second.
Reddit went from 430 million monthly active users in 2019 to 1.2 billion in 2024. They use AWS S3 to store every piece of media uploaded but their metadata storage was scattered across different storage systems.?
Their engineering team wanted to create a unified system for managing all their metadata to keep up with explosive growth – here’s how they did it.
领英推荐
There are a lot of interesting links this week??
Useful Links & News
AI Research Papers & Technical Links
PS
We hope these newsletters help you stay informed. We want to know what you think is useful or hear about news you're excited about. Tell us in comments below!