This is a great use of AI aimed at film makers who usually end up dubbing their films into English, because their native tongue isn’t. What they do is have their actors record a second audio track, which is English. Then they use AI to make the actors mouths & faces move in sync with the English words, so it looks like it was originally shot in English. It can also translate things like in-film signs, written notes, and newspaper articles.
https://www.youtube.com/watch?v=PTngv5MmtXo
Derek Martin /
npub1we…mj7l9
2025-03-28 12:32:32
Author Public Key
npub1wew3vwcdpmm0v56p9drht7y7eqdnyw3s0l8hce7kpvnma2rflj3q8mj7l9Published at
2025-03-28 12:32:32Event JSON
{
"id": "7df6f870b7c4638825685100070d7b896657b5ebb9f79c0fba6017d8c9014703",
"pubkey": "765d163b0d0ef6f653412b4775f89ec81b323a307fcf7c67d60b27bea869fca2",
"created_at": 1743165152,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.cloud/users/lo_fye/statuses/114240071462637120",
"activitypub"
]
],
"content": "This is a great use of AI aimed at film makers who usually end up dubbing their films into English, because their native tongue isn’t. What they do is have their actors record a second audio track, which is English. Then they use AI to make the actors mouths \u0026 faces move in sync with the English words, so it looks like it was originally shot in English. It can also translate things like in-film signs, written notes, and newspaper articles. \nhttps://www.youtube.com/watch?v=PTngv5MmtXo",
"sig": "e42c8cb0cf3816426a73d8be55907e4b3177b4ae6a5789226a20c06fff76778143ecdca64e642832979999adf1599a8565fc14b8c8b7b24e865fe390abb9470c"
}