ChatGPT can do more than just talk

Hello, and welcome to WIRED Start: your weekly roundup of the most important stories, landing in your inbox every Monday. This week we’ve joined forces with Fast Forward — @Will Knight’s guide to the technological trends poised to shape our future. You can sign up to Fast Forward and more newsletters from WIRED here .?

This week, we watch ChatGPT play Minecraft by tapping the text generator to pick up new skills, suggesting that the tech behind the bot could automate many workplace tasks.

They Plugged GPT-4 Into Minecraft—and Unearthed New Potential for AI

The technology that underpins ChatGPT has the potential to do much more than just talk. Linxi “Jim” Fan, an AI researcher at the chipmaker Nvidia, worked with some colleagues to devise a way to set the powerful language model GPT-4—the “brains” behind ChatGPT and a growing number of other apps and services—loose inside the blocky video game Minecraft.

The Nvidia team, which included Anima Anandkumar, the company’s director of machine learning and a professor at Caltech, created a Minecraft bot called Voyager that uses GPT-4 to solve problems inside the game. The language model generates objectives that help the agent explore the game, and code that improves the bot’s skill at the game over time.?

Voyager doesn’t play the game like a person, but it can read the state of the game directly, via an API. It might see a fishing rod in its inventory and a river nearby, for instance, and use GPT-4 to suggest the goal of doing some fishing to gain experience. It will then use this goal to have GPT-4 generate the code needed to have the character achieve it.

The most novel part of the project is the code that GPT-4 generates to add behaviors to Voyager. If the code initially suggested doesn’t run perfectly, Voyager will try to refine it using error messages, feedback from the game, and a description of the code generated by GPT-4.?

Over time, Voyager builds a library of code in order to learn to make increasingly complex things and explore more of the game. A chart created by the researchers shows how capable it is compared to other Minecraft agents. Voyager obtains more than three times as many items; explores more than twice as far; and builds tools 15 times more quickly than other AI agents. Fan says the approach may be improved in the future with the addition of a way for the system to incorporate visual information from the game.

While chatbots like ChatGPT have wowed the world with their eloquence and apparent knowledge—even if they often make things up—Voyager shows the huge potential for language models to perform helpful actions on computers. Using language models in this way could perhaps automate many routine office tasks, potentially one of the technology’s biggest economic impacts.?

Read the full story here .

Get ahead with these recommended reads

Inside 4chan’s Top-Secret Moderation Machine

Internal company documents reveal how the imageboard’s chaotic moderation allowed racism and violence to take over, writes Justin Ling. Read the full story here.

Amazon Workers Walk Out Over Layoffs and Broken Climate Promises

Malaise swept through the company after massive job cuts, mandatory return to the office, and surging emissions despite the company's pledge to get greener, writes Caitlin Harrington . Read the full story here .

AI Is Being Used to ‘Turbocharge’ Scams

Lina Khan, the chair of the US Federal Trade Commission, warned this week that the agency is seeing criminals using artificial intelligence tools to “turbocharge” fraud and scams, writes Matt Burgess . Read the full story here.

How to Polish Your LinkedIn Profile

While other networks sputter, LinkedIn is growing. Here’s how to use the professional social network to highlight your accomplishments and skills, writes David Nield . Read the full story here.

Until next time

Thank you for reading! We'll be back next Monday with another WIRED Start.

If you enjoyed reading this week’s edition, you can receive a weekly dispatch from the future by Will Knight, exploring AI advances and other technology set to change our lives. Sign up for Fast Forward here .

Don’t forget, you can unlock unlimited access to WIRED’s content with a subscription .?