A 3D audio-visual renderer has been developed to implement Momentum’s patented face animation technology for mobile and videophone applications. The renderer allows for high-quality, speech-synchronized lip and head animation with minimum latency.
Real-Time Avatar for Video Telephony
Momentum offers a novel technology to provide a real-time avatar-based video call solution for 3G mobile and videophone service providers. During an avatar video call, the user’s voice will be processed in real-time in order to drive Momentum’s facial animation rendering engine on the mobile or videophone service providers servers. The lip-synchronized and photo-realistic live avatar video stream will be transmitted over the network to the other user’s phone.
The System Diagram:
As the speech stream arrives at the telecom service provider’s system (1), the stream is transmitted to the Avatar generation subsystem (2) for subscribers of the avatar service. The real-time speech recognition module generates input for the real-time facial animation rendering engine (3). The output video is compressed to a suitable format for delivery (4). The original speech stream is combined with the avatar video and finally sent to the receiver (5).
Text-to-Speech for Avatar Rendering
Momentum also offers Text-to-Speech (TTS) technology for real-time avatar-based rendering solution for mobile and videophone service providers. Momentum’s TTS software automatically converts text input to speech, which can be used to drive Momentum’s facial animation rendering engine.
Momentum is cooperating with STERIS, a global leader in infection prevention, contamination control, surgical and critical care technologies, to use 3D Simulation in product marketing and training.
View Suleymaniye Mosque in 3D with this Augmented Reality(AR) Application.
View Janissary Model in 3D with this Augmented Reality(AR) Application.