SunSiteVR

Nvidia presents LLaMA-Mesh Unifying 3D Mesh Generation with Language Models paper: https://lnkd.in/ehyvx8Yu

???AutoVFX: One-Click VFX Creation? Here's an intriguing project by a group of students at the University of Illinois. Imagine a tool that could be described as a one-button Houdini or Maya—complete with a sprinkle of Nuke for good measure. The concept is as ambitious as it is bold: 1?? Upload a video. 2?? Speak into the mic and describe what effects you'd like to apply or how you'd like objects to explode in the scene. 3?? The system responds with a "Got it!" and delivers photorealistic, dynamic VFX with no manual effort. Here’s their vision in their own words: “We present AutoVFX, a framework that automatically generates realistic and dynamic VFX videos from a single video and natural language instructions. By leveraging neural 3D scene modeling, LLM-based code generation, and physics simulation, AutoVFX enables physically accurate, photorealistic effects that can be controlled directly through natural language commands.” Ambitious much? ???Check out their demo here: https://lnkd.in/gdGXheZX What’s fascinating is the ingenious stack of open-source tools and frameworks they’ve pulled together to make this work: - Gaussian Splatting submodules - diff-gaussian-rasterization - segmentation & tracking modules - Grounded-Segment-Anything and GroundingDINO - recognize-anything - lighting estimation modules - PyTorch3D? - Trimesh? - Tracking-Anything-with-DEVA - Blender for good measure (because why not?) - BakedSDF in SDFStudio?for surface reconstruction with custom tweaks. Sure, it feels like a proof-of-concept or a graduate thesis project, but their courage to tackle such a massive idea is awe-inspiring. ???For those interested in the nitty-gritty details, check out their GitHub: https://lnkd.in/g7g2QBbt This might not replace your favorite VFX tools just yet, but it’s certainly a glimpse into the future of accessible, automated content creation. What are your thoughts on projects like this? #VFX #GenAI #AI #Automation

?? AI can create cohesive 3D scenes based on a single image! ?? Meet DimensionX which allows you to create any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion! It's a game-changing tech that turns a single image into stunning, realistic 3D and 4D scenes using video diffusion. The ST-Director model, tackles the tricky parts of controlling space and time in scenes, making it possible to shape structures and movements precisely. By adding tools that keep details and identities intact, DimensionX brings these scenes closer to real life. Tests show it outperforms other methods on both real-world and synthetic data, setting a new bar for 3D and 4D scene creation. Source: https://lnkd.in/dzhVudEG

??? Text-to-3D movement ?? by Meshcapade me.meshcapade.com/editor Movement is liquid ??

DRONE RACE CONTROLLED BY THOUGHT Brain-controlled drone races are an emerging field that combines neuroscience and computer science to allow participants to pilot drones using only their thoughts. These races utilize brain-computer interfaces (BCIs) to translate electrical signals from the brain into commands for the drones. ?? The competition is a drag race in which drones go in a straight path towards the finish line. ?? Participants wear EEG headsets that record the electrical activity of their brains. ?? To give instructions to the drone, pilots concentrate on moving an object on a screen. ?? BCI technology has the power to revolutionize a variety of industries, including entertainment and disability assistance. These races serve multiple purposes: ??Advancing BCI technology: They help researchers refine and improve brain-computer interfaces. ??Educational outreach: The races introduce students and the public to cutting-edge neurotechnology and computer science. ??Exploring potential applications: Beyond racing, this technology has implications for medical applications, smart home control, and enhancing human-computer interaction Follow Bhavishek Malik for more Video Credit : Respective owner

Replace real background with Gaussian Splat in AFX This is a "quick & rough" test using iPad lidar for camera tracking and After Effects for quick rotoscoping. Then using the Irrealix plugin to replace the background with a gaussian splat of my kitchen. ?? Its a proof of concept for low budget virtual production with just an iPad/iPhone with lidar and a splat I created with Luma AI online. Greenscreen is propably better for a good key - but this way I managed to have very similar lighting conditions. PS: I'll definetly use a gimble next time ?? #gaussiansplattin #virtualproduction #lowbudgetfx

Game-changer alert! ?? Wonder Animation just dropped, and it demonstrates how creating animated films is truly transforming. This new AI tool converts any video into fully editable 3D scenes with multiple camera angles and full creative control. As part of the Autodesk family, this tool bridges the gap between traditional filming, mocap, and 3D animation. Can't wait to see what creators will make with this! ?? Already available, and currently in beta. More ???? https://lnkd.in/dW5bxYyP #Animation #AI #Filmmaking

This is why Gen AI is exciting. Sound on, and immerse yourself in the potential this technology has to change how we tell stories. It's flawed, and its early days.. and you, the creatives, storytellers and Dreamers can make this wonderful. Oh, and what did you all think of the Adobe Max announcements? Lot's to think about! (I've added some of my latest experiments to this mega-comp). #art #ai #storytelling

High performance computers cooling method ?? Who has encountered this technology, please put your experience in the comments ????♂? Viktor Nagy Filip Nagy Dr.-Ing. Eike Wolfram Sch?ffer Stay up to date with me ????????Milo? Ku?era ??? Activate Bell for all posts ??Join to 61.000+ followers on my?#LinkedIn #innovation #technology #computercooling

Future of Combat sports? Only in #VR! Immersive technology allows us to experience dangerous situations in a safe environment. You can train, experiment, and simulate combat sports without physical confrontation. This is especially helpful in combat sports focusing more on technique than physical strength. You can also challenge your opponent across the globe, or train with the distant master. Of course, that virtual environment cannot fully substitute physical training, but it can be a nice addition to the journey of mastering combat sport. Let's connect and explore the Immersive World together with YORD! Credit: Virtual Teakwondo This post is part of the Future of Immersive Tech series. Check out my profile & ?? for more! Always happy for ?? , ?? or ?? ! #combat #sports #futuretech