nunu.ai

Introducing nunu.ai: The first Multimodal Gameplay Agents. We're thrilled to showcase our AI agents, capable of testing and playing any game. We enable people to create better games by infusing AI agents into the game development process, from QA all the way to player simulation. Key Innovations: ???Interactivity: Offering real-time AI interaction and observation in gaming environments. ?? Interpretability: Our AI offers clear insights into their decisions, giving developers and gamers more control and understanding. Beyond playing, they can also provide detailed written reports, on their observations and thoughts. ???Generalizability: While other AI systems have to be retrained for every game, our agents only need minimal adjustments and can play any game from the get-go. ?? Stay tuned for an exciting case study on Hogwarts Legacy. Follow us for more updates and discoveries. The best is yet to come! → Check out our website: https://nunu.ai/ → Check out our twitter: https://lnkd.in/eYB73jRs

Very impressive results from Sarath Suresh Menon who's doing his master thesis at nunu.ai with Nicolas Muntwyler. We are currently outperforming even Anthropic's new Claude 3.5 Sonnet models on zero-shot clicking! LFG!! ??

Meet Rob the robot ?? While we’re deep into A16Z GAMES SPEEDRUN in Los Angeles, we have a very cool project cooking in our Zürich office ???? The hypothesis: If our agent is able to navigate and act in any given virtual environment (game), it should not be far away from being able to tackle real-world scenarios. The task: Apply the VERY SAME AGENT that we use to play games, but now with a physical robot. See how well our agent generalizes from a virtual to a physical body, and where it's limitations are. We have assembled 4 brave men to test this out ?? : Deepana Ishtaweera, Robert Jomar Malate, Zeno Hamers and Zhengyu Fu. Early results are exceeding our expectations already haha. Keep in mind, this robot is controlled by THE EXACT SAME AGENT that we use to play games. The technology we're building can go far beyond gaming! I'll share some more cool clips soon ??

?? Excited to announce our $2M pre-seed round with A16Z GAMES SPEEDRUN, Boost VC, Y Combinator, and amazing angel investors! ?? “Before we have a million robots in the physical world, we will first see a billion embodied agents in virtual worlds. AI and Gaming are born for each other, and their happy marriage is just getting started.” - Jim Fan I could not agree more with this absolute banger of a quote. Game QA in particular represents the pinnacle of virtual agentic behavior while being one of the most broken parts of the gaming industry. Our mission is to change this. At nunu.ai, we're revolutionizing Game QA to provide broader testing coverage and faster iteration cycles for game studios. We want to thank our early believers , investors, and friends. Very much looking forward to spending the next 3 months in LA for A16Z GAMES SPEEDRUN with Troy Kirwin, Jonathan Lai, Andrew Chen, Jack Soslow and other legends! Our vision is to develop generally capable agents that can navigate and act in any given virtual 3D environment, starting with applications in gaming and moving towards general 3D simulations and robotics. This is just the beginning! ??

Hi everyone! World record attempt livestream: https://lnkd.in/g82KEcWt ??In the past two weekends we livestreamed how our AI agent plays pokemon emerald. Our AI already beat the first and second gym. In a couple of minutes (10am PT) we are live again for the third and final stream in which we attempt to beat the world record. ??What is the current world record? Pokemon has been used for a long time as a way to train, test and benchmark AI systems. Most notably a lot of work has gone into reinforcement learning approaches. After multiple distributed training runs and incredible engineering efforts the best RL bots can now reach gym 2 and have set the current world record in AI playing Pokemon.?

Our pokémon stream is now online! Watch and interact live on YouTube https://lnkd.in/d32JG4jy This is the second (out of three) stream to beat the world record!

?? Watch nunu.ai Conquer Pokémon Emerald Live! ?? ??? Save the Dates: - July 20, 10 AM PT / 7 PM CET: First Gym Stream - July 27, 10 AM PT / 7 PM CET: Second Gym Stream - August 3, 10 AM PT / 7 PM CET: Third Gym Stream Join us live as our agents attempt to beat the world record by reaching the third gym in Pokémon Emerald! Chat and Interact with the AI in real-time!

nunu.ai is coming to GDC! ?? Meet us at booth SU18 for a peek into the future of AI agents in gaming. We're excited to meet you there! ?? We're also opening more spots for game studios to automate their QA using our AI agents, focusing on regression testing. ?? See you at #gdc2024! ??