From Designer to Video Producer Using Gen-AI

Billy Boman is a designer turned video creator thanks to the help of AI. He has worked with world-famous brands and artists like Fred Durst and Intel and in this conversation he shares his process, unique tools, and how to pitch his services to clients. For the product spotlight I am going to share one of the most immersive video player you can try right now on your Quest.

You can subscribe to and support XR AI Spotlight right on Substack, with new issues appearing directly in your inbox, and the curated “Product Spotlight” section available only to subscribers.

If you’d like to sponsor this newsletter, and get your name in front of an engaged audience of 13K+ professionals and creatives, just contact me here on LinkedIn ?? Gabriele Romagnoli

Interview with Billy Boman

How do you balance creativity and control when co-creating with AI?

Billy Boman: Using AI feels like directing a fluid intelligence. You guide it with prompts, but it often surprises you with unexpected results. It’s like directing actors who occasionally improvise—those moments can bring magic. You have to let go of complete control and embrace the unpredictability while steering the process toward your vision. It’s about blending structure with spontaneity to create something truly unique.

How do you ensure a cohesive visual style across your projects?

Billy Boman: Cohesion comes from consistency in style, color, and lighting. I do a lot of post-production and color correction in tools like After Effects to help smooth over any inconsistencies. It’s about creating a seamless viewing experience where every element feels intentional, even when using a mix of AI tools and techniques.

What’s one AI tool you wish existed to make your work easier?

Billy Boman: I’d love a fully integrated pipeline combining image generation, video generation, and editing. Currently, I use seven to ten different tools to produce a single project, which is time-consuming. A unified platform would streamline the process, making it easier to focus on storytelling and creativity rather than technical workflows and tool juggling.

How do you find inspiration for your AI projects?

Billy Boman: Inspiration comes from everywhere—art, literature, music, and even classical works. For instance, the hurricane of souls from Dante’s Inferno inspired a key sequence in the Fred Durst video. I love blending timeless ideas with cutting-edge tools. AI allows me to reinterpret these inspirations in ways that feel fresh and visually captivating.

What makes music videos particularly suited for AI-generated content?

Billy Boman: Music videos are ideal for AI because they’re fast-paced, allowing for short, dynamic scenes. This format minimizes continuity issues AI can struggle with over longer shots. They’re also visually experimental, which plays to AI’s strengths in creating bold, imaginative imagery. Music videos are a perfect playground for exploring what AI can do while matching visuals to the energy and emotion of the music.

Why was working with Fred Durst a milestone for you?

Billy Boman: Growing up, Fred Durst was an icon in the music scene, so working with him felt surreal. It was my first project as a solo creator, where I handled everything—image generation, video, and editing. Reaching nearly 300K views on YouTube and seeing global reactions was incredible. For me, it marked a shift from being a designer to fully embracing my role as a visual storyteller, using AI to bring my creative visions to life.

Can you tell us about the challenges you faced when working on the music video with Fred Durst project using AI tools?

Billy Boman: This project was full of challenges. One standout was Fred Durst's backward red cap—a signature look. AI models simply couldn’t generate it correctly, even after over 100 iterations. Ultimately, I used Photoshop’s generative fill to fix it frame by frame. It’s a testament to the fact that AI tools still need human problem-solving to deliver a cohesive final product.

To keep reading the rest of the interview and access the product spotlight head over to Substack ??