The Future of Film is Sora - Behind The Scenes on How to Master It

Last year, I had the incredible opportunity to speak on a panel with OpenAI at Cannes Lions International Festival of Creativity where we had a fun conversation about the intersection of Art & AI. I sat alongside some of the most innovative AI and VFX artists today including Don Allen Stevenson III , Paul Trillo Souki Mansoor Nathan Shipley and Josephine Miller . A year later, I’m grateful to have continued this journey, experimenting with Sora to push the boundaries of art-driven storytelling.

Let me start by saying that Sora and AI video tools are the future because they lower the barriers to entry for filmmaking. These tools empower a new generation of creators to bring their visions to life, opening doors to paid opportunities and collaborations with renowned brands and artists. The ability to fast-track ideas into tangible proof-of-concepts allows for more authentic and impactful storytelling to emerge from diverse voices.

I firmly believe AI tools should never replace human filmmakers and creators.

Bringing my film concept Bloomchild to life took over 1,000 prompts and 74 days of dedication. This journey offers a behind-the-scenes look at both the power and the limitations of AI in filmmaking.

My Film Concept Trailer - "Bloomchild"

To give some context for why I created Bloomchild, I’m a first-generation kid from Jamaica, and I grew up in the suburbs of Connecticut. There weren’t many kids who looked like me. I was also a tomboy and an artsy, creative nerd, so I never really felt like I fit into any group. Growing up, I often felt isolated, but when I started embracing my artistic side and pursuing photography, I began to embrace what set me apart as my creative superpowers.

Bloomchild is a coming of age story about moving from feeling different, misunderstood, lonely, and isolated, to finding a sense of belonging.

Bloomchild also serves as a film concept pitch meant for production studios, film festivals, grant commissions, and creative partners who have the resources and resonate with this story. I want to make Bloomchild with real artists, real creators, and with the help of AI video tools.

How I Made Bloomchild with Sora

If you prefer watching the BTS, feel free to dive right in with the video above. But if you’re interested in a deeper dive into the process, follow along below.

World-building through Storyboards

Storyboarding with DALL-E 3 was the foundation of Bloomchild, and it took a full week just to get the prompts right before I could even start exploring the art direction. My initial focus was on perfecting Bloomchild's core design using DALL-E prompts, without being too concerned about style at that stage.

When I transitioned to Sora, the ability to quickly iterate and visualize different settings became essential. Some of my original storyboard concepts just weren’t working in Sora, no matter how much I refined them. However, other concepts were enhanced and evolved thanks to the outputs from Sora, which helped push the visual storytelling even further.

Art Direction: Consistency is Key

For Bloomchild, I envisioned a futuristic utopian society, characterized by light pastel colors and modern, advanced environments.

Once the storyboard scenes were finalized in Sora, I shifted my focus to giving those scenes a specific art direction. Consistency in my prompts became crucial. By refining and focusing on key phrases, I was able to establish a cohesive visual style:

• Set Design: "Organic and futuristic," "flowing shapes covered in greenery," "white, smooth, curved surfaces," and "splashes of pastel colors."
• Character Design: Bloomchild was envisioned as "a genderless adolescent figure made entirely out of vibrant flowers," while their classmates wore "pastel green, minimalistic blazers."

These consistent elements worked together to create a visually unified world that felt both advanced and inviting.

Cinematography

By approaching cinematography as a screenwriter might, I was able to guide Sora in adapting certain movements to achieve the desired look. Unlike a director, a screenwriter doesn’t specify camera movements but rather describes scenes from a neutral, observational perspective—almost like a fly on the wall. I found that focusing on Bloomchild’s or the classmates’ perspectives helped Sora better capture their emotions and mindsets.

• Focus and Clarity: Using prompts like "The camera focuses on..." and "Rendered with stunning clarity" helped emphasize key details.
• Shot Composition: Phrases such as "Medium shot" and "blurs the background, the foreground is sharp and clear" allowed me to guide the composition effectively.

While this method isn't perfect, it enabled me to achieve a level of cinematic storytelling that aligned closely with my vision.

Post-Production and VFX

While Sora provided a solid foundation, working with real human VFX artists was crucial to elevate the trailer to a true cinematic level. Human creativity and control in post-production are irreplaceable, which is why I collaborated with Simonas Mozūra and Karolus Labutis at Kopa Films to refine the visuals and ensure the trailer had the impact I envisioned. They used techniques like:

• Visual Emphasis: Enhancing key elements with VFX to highlight the mood of each scene.
• Color Adjustments: Masking and rotoscoping to ensure color consistency and narrative tone.
• Final Polish: Upscaling and color grading for a professional finish.

Additionally, integrating 3D titles I created in Blender added a cinematic trailer feel, making the final product something far beyond what Sora could achieve alone.

Embracing AI Video for Future Storytelling

I understand the fears and concerns around AI tools like Sora, especially when it comes to their potential impact on human creativity. However, I view Bloomchild as a use case that demonstrates how AI can be leveraged to pitch a proof of concept. This project is not about replacing human talent but about opening new doors and possibilities.

As a call to action, I invite studios and creators who believe in the message of Bloomchild to support bringing it to life. I envision this project using a combination of motion capture connected to a 3D model of Bloomchild in real-time software like Unreal Engine, paired with virtual production and green screen techniques with live-action. Together, we can create something truly magical that bridges the gap between AI innovation and human creativity.

If you're interested in collaborating or learning more about this project, feel free to reach out - https://qf8e39h93yl.typeform.com/to/AQf8jXRk

Let's explore the future of filmmaking together.