The British company Flowless helps synchronize images through a neural network. In this way, separate lip movements should be developed for each language.
Synchronization, i.e. translating into other languages, is a big challenge in films as well as games. If the spoken texts are translated as true as possible to the original, the lip movements of the visible characters often do not match the visible lip movements. The audience notices it negatively.
Better sync with Deepfax
Various approaches have been developed to avoid this problem. Often the translations are specifically modified so that the content does not change much, but the movements match roughly. In games, on the other hand, it is also possible to create your own facial animations for each language, thus allowing more freedom when translating. In the main example Cyberpunk 2077 Was for example A special AI is used.
The British company is moving in the same direction FlawlessIt wants to change lip movements in images using a neural network. The so-called “true synchronization” technology is comparable to this Well known deep onesFor example, faces are exchanged in video recordings. With real synchronization, special attention should be paid to small facial movements so that the instrument does not change.
More interesting: [PLUS] Knowledge of deep learning: How computers perceive the world
Flawless hat Has already released some videosShowing the application in different scenes and allowing the actors to speak multiple languages. The results are interesting, but the scenes do not always seem completely normal. However, over the next few years, the tool will have to be improved so that its use is no longer noticeable. Cutskins filmed later in movies, and of course games, may benefit from technology.
![[PLUS] Performance code compared to CPU and GPU, Ryzen 7 4700U and Core i7-1165G7](https://news.google.com/screenshots/1020x/2021/02/aufmacher_startseiten-pcgh.jpg)
[PLUS] Performance code compared to CPU and GPU, Ryzen 7 4700U and Core i7-1165G7
Links marked as * Link links. Link links are not advertisements as we are independent in researching and selecting the products provided. We receive a small commission for product sales, which is used to finance some of the website’s free content.
“Avid writer. Subtly charming alcohol fanatic. Total twitter junkie. Coffee enthusiast. Proud gamer. Web aficionado. Music advocate. Zombie lover. Reader.”
More Stories
Acrylic Nails for the Modern Professional: Balancing Style and Practicality
The Majestic Journey of the African Spurred Tortoise: A Guide to Care and Habitat
Choosing Between a Russian and a Greek Tortoise: What You Need to Know