Transforming 2D Images into 3D Environments

This week’s newsletter was written by AppAgent Motion Designer, Polina Anisimova.

Creating 3D scenes no longer requires complex 3D software; all you need are AI tools like ZoeDepth!

This method offers a quick and easy approach to simulating 3D scenes from still images, whether that be for creating game backgrounds, generating entire scenes with characters/objects, or animating packshots.

Previously, creating a 3D environment or integrating characters or greenscreen footage into a scene required extensive use of 3D software, a time-consuming process requiring significant expertise.

Now, anyone can achieve the same results in just 20 minutes, saving tons of time compared to the days it would take using traditional software.

Here’s a simple overview for artists and creative leads looking to simplify their creative production using this method:

1. Let’s start with this 2D image that I created using Leonardo AI.

2. Then, let’s head to ZoeDepth and select the 'Image to 3D' section.

3. Drag and drop your image into the 'Input Image' section. Remember to enable the "Keep occlusion edges" option and click the 'Submit' button.

4. Shortly after, on the right side, you'll see the 3D mesh reconstruction. Download the file by clicking the download arrow in the top right corner.

5. The downloaded file is a .glb file. It can be imported directly into the beta version of After Effects. If you don't have the beta version, download it from the 'beta apps' tab in your Creative Cloud.

6. Once you open After Effects (beta), import the .glb file from ZoeDepth.

7. Create a composition with this file. If you initially see nothing, it's likely because the file's default placement is incorrect. To fix this, select the file in the composition, press 'R' to open rotation parameters, and change the Y rotation to +180.

8. After adjusting the Y rotation, your image will appear correctly.

9. Next, create a camera and a null object. Make the null object 3D and parent the camera to it.

10. Experiment with the position keyframes of the null object to create your desired movement. Note that excessive movement can cause stretching in certain areas of the image, so it's important to be mindful of details and avoid too much distortion.?

Enhance the final look by adding a bit of the Sharpen effect and then render in your preferred format!

Here’s the result:

Final Thoughts

With this method, you can control camera movements and add objects or greenscreen footage, resulting in a convincing effect.?

While it's not suited for complex scenes requiring extensive camera movement, it works wonderfully for short scenes and can also be used for animatics to quickly visualize how a scene will look.

Today's Insights ??

Parcel delivery service DPD has deactivated its AI online chatbot following an incident where a customer prompted it to swear and compose a poem critical of the parcel delivery service.

And it’s pretty hilarious…

Mind-Blowing News ??

• Can you tell the difference between a real face and an AI-generated one?
• Introducing the first Spanish AI model, who gets hit on by celebrities and earns up to €10,000 monthly.
• Despite all of the claims about AI replacing jobs, a new MIT study indicates workforce automation may occur more gradually than we think.

Let’s see what next week will bring, stay tuned (and subscribe)!