Artistic Evolution: How AI is Shaping Our Creative Practice - A(I) Tapestry of Tools and Techniques
Creative Alchemy is an artistic practice working in real time visual effects 3d creative workflows in Live Events, Concert Touring, TV & Film, Immersive Spaces and Digital Art.? This article was prepared by Shannon Harvey and Serena Bliss with support from Owen Brierley, PhD and a well trained GPT.
The is part 4 of a multi-part article on AI in our creative practice.
Part 1: Introduction & Experimentation
Part 2: Impact on Creative Practice
Part 3: AI as a Collaborator
Part 6: AI Prompting Artistry
Part 7: Challenges & Discoveries
Part 8: Ethical AI Aesthetics
Part 9: The Future of Art and AI
Part 10: In Conclusion: a new beginning.
A(I) Tapestry of Tools and Techniques
As we ventured deeper into the realm of AI-assisted art, our workflow evolved into a complex tapestry, interwoven with a variety of AI tools and technologies. Each tool brought its unique strengths and capabilities, allowing me to push the boundaries of what was possible in our creative endeavours.
Image Diffusion + Manipulation
We experimented with Midjourney and Pikalabs, for generating novel visual concepts and immersive environments. We embarked on the creation of short film concepts, harnessing AI to visualise intricate and compelling storylines. A particularly fascinating project was the historical “reanimation” of vintage photographs, where these tools breathed new life into old imagery, creating a bridge between past and present. Runway and Leonardo offered advanced capabilities in image manipulation and creative reinterpretation, enriching our approach to visual storytelling.
The GPTs Among Us.
ChatGPT became a versatile tool in our arsenal, aiding in the creation of articles, artist statements, and helping us with the development of our web and portfolio presence. For immersive artworks and installations, ChatGPT's capabilities in generating narrative and descriptive content were invaluable.
Extending 3D Workflows
Our journey with AI extended into the realm of 3D modelling and animation. First we set out to use ChatGPT to generate Python scripts for Maya. Without any programming knowledge we developed an optimisation workflow for retopology and remeshing High Polygon assets to “Real-time Ready” completely automating this process for us going forward. In addition we have started using Johannes Andersson's ChatGPT for Maya plugin for some amazing modelling efficiency.?
A(i) Modular Approach
The development of a modular approach to AI integration in creative projects has opened new frontiers in production techniques, as exemplified in our recent project for a production of "Peter Pan." We successfully built a Notch block for the character Tinkerbell, utilising the NVIDIA Broadcast SDK's AI skeletal tracker. This innovative approach allowed us to process all the filmed footage, seamlessly adding dynamic elements like wings and pixie dust that followed Tinkerbell's movements. The AI's ability to track the performer's skeleton in real-time was crucial, as it enabled the added animations to remain consistent and realistic, regardless of the changing environments within each scene. This modular integration of AI not only enhanced the visual spectacle of the production but also demonstrated how AI can be effectively tailored and integrated into specific creative needs. The result was a captivating, technologically advanced portrayal of Tinkerbell, showcasing the possibilities when traditional theatre meets cutting-edge AI technology.
领英推荐
Capturing Reality
The use of AI in photogrammetry has significantly enhanced the accuracy and detail of 3D models, heralding a new era in digital reconstruction and preservation. Meshroom, available through AliceVision, has become an integral tool in our in-house toolkit. By generating 3D models from images, Meshroom offers us a powerful way to visually comprehend and interact with physical spaces in a digital format.?
This capability has been invaluable in our projection mapping projects, allowing us to accurately tailor our digital projections to the physical contours and features of a space. The precision with which Meshroom constructs these models ensures that our digital content aligns seamlessly with the real-world environment, enhancing the overall impact and immersive quality of our creative works.
Furthermore, in film production, we have used photogrammetry to get a detailed understanding of locations. By converting set images into 3D models, we gain a comprehensive view of the spatial relationships and dimensions within the set. This insight is crucial for integrating digital content into live-action footage, ensuring a cohesive blend of the virtual and real elements in our film projects.?
NeRF, SMERF and Splatting
As advancements in cutting-edge techniques like 3d Gaussian Splatting, NeRF (Neural Radiance Fields),and SMERF (Semantic Merging of Radiance) takeus further by constructing highly detailed 3D scenes from a collection of 2D images, offering unparalleled depth and realism in digital reconstructions. Additionally, the introduction of tools like Cuebric use sophisticated algorithms streamline the process of creating and refining 3D models, making it more efficient and accessible for virtual production.
The integration of AI into our workflow has been a journey of discovery and innovation. These tools are a vital resource for bridging the gap between real-world environments and digital creativity, thereby expanding our capabilities.?
Each tool and technique has contributed to a more enriched creative process, allowing us to explore new frontiers in visual effects, animation, and storytelling. This fusion of technology and artistry has not only enhanced our capabilities but also redefined our understanding of the creative potential inherent in the digital age.
Continue onto part 5 Revolutionising Artistic Conceptualization
This is a 10 part article on AI in our creative practice
Part 1: Introduction & Experimentation
Part 2: Impact on Creative Practice
Part 3: AI as a Collaborator
Part 6: AI Prompting Artistry
Part 7: Challenges & Discoveries
Part 8: Ethical AI Aesthetics
Part 9: The Future of Art and AI
Part 10: In Conclusion: a new beginning.