SunSiteVR

1st Grade through all of College all in an AI-Powered Watch

The old and the new ways of creating will merge to form something new that will allow us to tell stories and build worlds like never before. Here I'm creating 3d sketches in Gravity sketch and using Vizcom AI in-headset to transform those sketches to more detailed 3d models. Finally, I'm using those models as a base for an AI render pass done using Runways Gen 3. #art #3d

NASA’s Human Research Program has an open call for proposals. Help us reduce human health and performance risks for crewed missions to the Moon and Mars. More details and information for how to apply at the following link: https://lnkd.in/gxXvZM6K

Nvidia presents LLaMA-Mesh Unifying 3D Mesh Generation with Language Models paper: https://lnkd.in/ehyvx8Yu

???AutoVFX: One-Click VFX Creation? Here's an intriguing project by a group of students at the University of Illinois. Imagine a tool that could be described as a one-button Houdini or Maya—complete with a sprinkle of Nuke for good measure. The concept is as ambitious as it is bold: 1?? Upload a video. 2?? Speak into the mic and describe what effects you'd like to apply or how you'd like objects to explode in the scene. 3?? The system responds with a "Got it!" and delivers photorealistic, dynamic VFX with no manual effort. Here’s their vision in their own words: “We present AutoVFX, a framework that automatically generates realistic and dynamic VFX videos from a single video and natural language instructions. By leveraging neural 3D scene modeling, LLM-based code generation, and physics simulation, AutoVFX enables physically accurate, photorealistic effects that can be controlled directly through natural language commands.” Ambitious much? ???Check out their demo here: https://lnkd.in/gdGXheZX What’s fascinating is the ingenious stack of open-source tools and frameworks they’ve pulled together to make this work: - Gaussian Splatting submodules - diff-gaussian-rasterization - segmentation & tracking modules - Grounded-Segment-Anything and GroundingDINO - recognize-anything - lighting estimation modules - PyTorch3D? - Trimesh? - Tracking-Anything-with-DEVA - Blender for good measure (because why not?) - BakedSDF in SDFStudio?for surface reconstruction with custom tweaks. Sure, it feels like a proof-of-concept or a graduate thesis project, but their courage to tackle such a massive idea is awe-inspiring. ???For those interested in the nitty-gritty details, check out their GitHub: https://lnkd.in/g7g2QBbt This might not replace your favorite VFX tools just yet, but it’s certainly a glimpse into the future of accessible, automated content creation. What are your thoughts on projects like this? #VFX #GenAI #AI #Automation

?? AI can create cohesive 3D scenes based on a single image! ?? Meet DimensionX which allows you to create any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion! It's a game-changing tech that turns a single image into stunning, realistic 3D and 4D scenes using video diffusion. The ST-Director model, tackles the tricky parts of controlling space and time in scenes, making it possible to shape structures and movements precisely. By adding tools that keep details and identities intact, DimensionX brings these scenes closer to real life. Tests show it outperforms other methods on both real-world and synthetic data, setting a new bar for 3D and 4D scene creation. Source: https://lnkd.in/dzhVudEG

??? Text-to-3D movement ?? by Meshcapade me.meshcapade.com/editor Movement is liquid ??

DRONE RACE CONTROLLED BY THOUGHT Brain-controlled drone races are an emerging field that combines neuroscience and computer science to allow participants to pilot drones using only their thoughts. These races utilize brain-computer interfaces (BCIs) to translate electrical signals from the brain into commands for the drones. ?? The competition is a drag race in which drones go in a straight path towards the finish line. ?? Participants wear EEG headsets that record the electrical activity of their brains. ?? To give instructions to the drone, pilots concentrate on moving an object on a screen. ?? BCI technology has the power to revolutionize a variety of industries, including entertainment and disability assistance. These races serve multiple purposes: ??Advancing BCI technology: They help researchers refine and improve brain-computer interfaces. ??Educational outreach: The races introduce students and the public to cutting-edge neurotechnology and computer science. ??Exploring potential applications: Beyond racing, this technology has implications for medical applications, smart home control, and enhancing human-computer interaction Follow Bhavishek Malik for more Video Credit : Respective owner

Replace real background with Gaussian Splat in AFX This is a "quick & rough" test using iPad lidar for camera tracking and After Effects for quick rotoscoping. Then using the Irrealix plugin to replace the background with a gaussian splat of my kitchen. ?? Its a proof of concept for low budget virtual production with just an iPad/iPhone with lidar and a splat I created with Luma AI online. Greenscreen is propably better for a good key - but this way I managed to have very similar lighting conditions. PS: I'll definetly use a gimble next time ?? #gaussiansplattin #virtualproduction #lowbudgetfx

Game-changer alert! ?? Wonder Animation just dropped, and it demonstrates how creating animated films is truly transforming. This new AI tool converts any video into fully editable 3D scenes with multiple camera angles and full creative control. As part of the Autodesk family, this tool bridges the gap between traditional filming, mocap, and 3D animation. Can't wait to see what creators will make with this! ?? Already available, and currently in beta. More ???? https://lnkd.in/dW5bxYyP #Animation #AI #Filmmaking