Nvidia recently unveiled its groundbreaking generative AI-based digital human technologies, showcasing their ability to create lifelike characters that enhance gaming experiences and extend to various applications. Collaborating with leading studios, Nvidia presented captivating demos that harness these AI innovations to bring dynamic, immersive interactions with computer-generated avatars to life.
At the forefront of Nvidia’s digital human technologies are Avatar Cloud Engine (ACE), NeMo, and RTX tech. ACE powers speech recognition and animation tasks, NeMo drives natural language processing, while RTX technology enables developers to render high-fidelity models. Over the years, Nvidia has refined these technologies, showcasing them at events to demonstrate their transformative potential.
During GDC 2024, an Unreal Engine 5-based demo by Inworld AI and NvidiaCovert Protocol showcased modular NPCs that adapt to player actions, ensuring each player experiences a unique journey. Leveraging Nvidia’s microservices, this demo detects player voice input and animates NPC dialogues, infusing dynamic behavior influenced by the character’s personality and emotional state.
Beyond gaming, Nvidia’s digital human technologies find practical applications showcased at GTC 2024. Hippocratic AI presented a digital healthcare agent for care coordination and post-discharge management, leveraging Nvidia’s ACE, Audio2Face, and Omniverse Streamer Client. Additionally, UneeQ demonstrated a digital avatar for customer service, utilizing Nvidia’s tech and Synanim ML.
In the gaming realm, Ubisoft unveiled tech demos of NEO NPCs, potential future features in their games, powered by Inworld AI and Nvidia technologies. These NEO NPCs demonstrate conversation memory, contextual awareness, and methodical decision-making, hinting at exciting possibilities for immersive gameplay experiences.
Furthermore, upcoming games are set to leverage Nvidia’s generative AI technologies to captivate players. Perfect World Games’ World of Jade Dynasty will utilize Nvidia’s Audio2Face for accurate lip-syncing across languages, while Unawake by RealityArts Studio and Toplitz Productions will employ this technology for lifelike facial animations.
As Nvidia’s generative AI technologies continue to evolve, the gaming landscape stands on the cusp of transformation. With more titles embracing these innovations, the development pipeline is poised for optimization, promising an exciting future of immersive storytelling and unparalleled gaming experiences.