audio-driven video generation

MultiTalk: The Ultra-Realistic Digital Human for Group Conversations is Here! Essential for Karaoke, Covering Realistic Cartoon Animals, Easily Generate 15-Second Long Videos

by
MultiTalk: The Ultra-Realistic Digital Human for Group Conversations is Here! Essential for Karaoke, Covering Realistic Cartoon Animals, Easily Generate 15-Second Long Videos

❝ 🌹Hello everyone! Welcome toPoLang‘s homepage. Thank you for your support and encouragement. On the road of AIGC exploration, I willwalk with you. If you like it, pleasestar and follow PoLang or scan the code at the end of the article to join the discussion group! 1: Introduction to MultiTalk In previous articles, we introduced … Read more

Impressive! MultiTalk Open Source with Lip Sync Accuracy Exceeding 8.53 Points

by
Impressive! MultiTalk Open Source with Lip Sync Accuracy Exceeding 8.53 Points

This Article Overview Recently, the MultiTalk project, open-sourced by Sun Yat-sen University, Meituan, and Hong Kong University of Science and Technology, is a novel framework for audio-driven multi-person dialogue video generation. Given a multi-stream audio input, a reference image, and a prompt, MultiTalk generates a video that features interactions following the prompt, with lip movements … Read more

MultiTalk: A Quick Look at Realistic Multi-Person Dialogue and Singing with Cartoon and Animal Digital Avatars

by
MultiTalk: A Quick Look at Realistic Multi-Person Dialogue and Singing with Cartoon and Animal Digital Avatars

❝ 🌹Hello everyone! Welcome to PoLang‘s homepage. Thank you for your support and encouragement. On the road of AIGC exploration, I will be with you all the way. If you like it, please star and follow PoLang or scan the code at the end of the article to join the discussion group! 1: Introduction to … Read more