World Labs

We’ve been busy building an AI system to generate 3D worlds from a single image. Check out some early results on our site, where you can interact with our scenes directly in the browser! https://worldlabs.ai/blog World Labs aims to address the challenges many creators face with existing genAI models: a lack of control and consistency. Given an input image, our system estimates 3D geometry, fills in unseen parts of the scene, invents new content so you can turn around, and generalizes to a wide variety of scene types and artistic styles. Our output 3D scenes can be rendered in real-time in the browser with full camera control. This means you can explore them with a freely moving camera like in a videogame, or even simulate 3D camera effects like shallow depth of field or dolly zoom. Though most visual generative models predict pixels, predicting a 3D scene instead has many benefits: the scene won’t change if you look away and come back, and it obeys the basic physical rules of 3D geometry. Generating consistent 3D geometry allows us to interact with the scene in 3D-aware ways, like changing the scene’s lighting and appearance, modifying the geometry, or inserting other objects into the scene. 3D world generation naturally composes with other AI tools. This allows creators to work with tools they already know to enable new experiences. We've given a few creators an early sneak peek at our technology to begin experimenting with the possibilities enabled by a 3D-native generative AI workflow. This is just a glimpse into the future of 3D native generative AI – we’re working hard to put this tech into users’ hands as soon as possible! Stay tuned for future releases by signing up at worldlabs.ai/waitlist, or get in touch directly at [email protected].

Eric Solorio demonstrates how our models can fit into his creative workflow, making it easy to stage characters within scenes and direct precise camera movements!

A very special episode of Radical Talks just dropped. In honour of Geoffrey Hinton winning the Nobel Prize in Physics, we're excited to release our latest podcast featuring Geoffrey Hinton and Radical Scientific Partner and Co-Founder of World Labs, Fei-Fei Li. Moderated by Jordan Jacobs, Co-Founder of Radical Ventures, the conversation is part of the Radical AI Founders Masterclass, which kicks off its 2024 programming this week (more info here:?https://lnkd.in/esQ4QQVS) This entertaining and wide-ranging conversation took place before a live audience at the University of Toronto, marking the first time Hinton and Li have shared a stage. The two pioneers of AI discuss the vast potential of AI, its inherent risks and the critical importance of responsible development and stewardship of this critical technology. Geoffrey and Fei-Fei also share a dramatic recounting of the 2012 ImageNet competition, when their professional careers first intersected. It was a pivotal moment in the history of AI, when neural networks proved capable of ‘solving’ computer vision. Last but not least, we're excited to welcome a new host of Radical Talks, our very own, Aaron Rosenberg. Enjoy! https://lnkd.in/eayh862y

Thank you to Martin Casado and Andreessen Horowitz for having Fei-Fei Li and Justin Johnson on The a16z Podcast to talk about spatial intelligence and what's ahead for World Labs.

We are bringing together the most robust slate of pixel talent ever assembled, from AI research to systems engineering to product design. Check out our open positions at https://lnkd.in/eEV7y8vr

Radical is thrilled to announce our investment in World Labs, a spatial intelligence company building Large World Models (LWMs) to perceive, generate, and interact with the 3D world. World Labs was founded by visionary AI pioneer and Radical Scientific Partner Fei-Fei Li along with Justin Johnson, Christoph Lassner and Ben Mildenhall; each a world-renowned technologist in computer vision and graphics. Language has driven remarkable progress in generative AI in the last few years, and images and video have emerged as the latest modalities. But we’re only scratching the surface of what is possible. World Labs’ pursuit of AI capable of engaging with the world around us stands to create entirely new categories of opportunity. https://lnkd.in/eqy_9dMX

?? Congratulations, World Labs! We're thrilled to partner with Fei-Fei Li, @Justin Johnson, Christoph Lassner, and Ben Mildenhall as they propel their spatial intelligence AI company building Large World Models (LWMs) to perceive, generate, and interact with the 3D world. World Labs feature via WIRED: https://lnkd.in/gc8meRN9

We've known World Labs cofounder Fei-Fei Li for nearly two decades. She was joining Stanford as a new professor while a16z’s Martin Casado was just leaving to do his own startup. And she has advised the firm on AI many times in the past. Now, we are thrilled to partner with her and co-founders Justin Johnson, Christoph Lassner, Ben Mildenhall and the world-class team at World Labs, with our latest investment. Alongside language, there has been a “pixel” revolution in generative AI, allowing us to create images and videos from text descriptions of what we want to see. Unlike language models, these generated images are reflections of the physical world. But while these sorts of models are tremendously useful for creating images and videos, none are quite as general as LLMs are for language. For example, none can create a true 3D representation of a world you can walk through, interact with, and build upon — something that isn’t just confined to a screen, but an actual representation of the real world (or perhaps a generated virtual world), that sits within a computer, and allows for reasoning about physics and cause-and-effect. It is this problem that brings us to World Labs. At this point, the company is deep at work pushing the frontiers of the spatial intelligence problem. They’re building a foundation model that can generate 3D interactive worlds which are the basis for spatial reasoning. We are honored to be part of it. More from Martin Casado and Sarah Wang: https://lnkd.in/edFYq-Fp

Today we are announcing the formation of World Labs, a spatial intelligence company building Large World Models (LWMs) to perceive, generate, and interact with the 3D world. We aim to lift AI models from the 2D plane of pixels to full 3D worlds – both virtual and real – endowing them with spatial intelligence as rich as our own. Human spatial intelligence evolved over millennia; but in this time of extraordinary progress, we see the opportunity to imbue AI with this ability in the near term. World Labs was founded by visionary AI pioneer Fei-Fei Li along with Justin Johnson, Christoph Lassner, and Ben Mildenhall; each a world-renowned technologist in computer vision and graphics. We are bringing together the most formidable slate of pixel talent ever assembled – from AI research to systems engineering to product design – and we are hiring. Click to read a blog post about our vision for how spatial intelligence will propel forward individuals and humanity as a whole. Thank you to everyone who has supported us thus far, and we hope you'll follow along in our journey. https://lnkd.in/eqy_9dMX