Nvidia is open-sourcing Audio2Face, its AI-powered tool that generates realistic facial animations for 3D avatars — all based on audio input. The change means developers can now use the tool and its underlying framework to create realistic 3D characters for their games and apps.
Nvidia’s Audio2Face works by analyzing the “acoustic features” of a voice, allowing it to generate animation data that it maps to the 3D avatar’s facial expressions and lip movement. The company notes that…
