The use of artificial intelligence it’s becoming a constant across many industries, including entertainment. One of the most obvious examples of how AI could change the course of cinema is the fake deep. This technique has already rejuvenated Luke Skywalker by The Mandalorian and viralized Tom Cruise on TikTok. Now this technology wants to do the same in the foreign film dubbing in order to reach more audiences.
Adapt Entertainment, a Tel Aviv-based company, has developed technology that performs voice acting using artificial intelligence. Known as PLATO, the neural AI rendering process convert series and movies into another language with the help of the original actors.
Unlike the fake deep As far as we know, Adapt’s proposal is to record the actor saying his lines in another language. This is done in the post-movie sessions where the actors sit in front of several cameras and record their dialogue. His performance is recorded from different angles and later is merged with the original footage using artificial intelligence.
The first film to use this technology is The champion, a Polish drama set during World War II. According to Maciej Barczewski, director of the film, PLATO is a paradigm shift in international films. The audience you won’t depend on subtitles or lose the original message of film.
Artificial intelligence would help get rid of bad dubbing of films and series
Adapt’s technology goes beyond conventional dubbing and records the actor’s mouth movements and expressions. Darryl Marks, founder of the company, said in an interview with packaging which plate is not a fake deep.
The difference is that this technology uses the actors and does not depend solely on the algorithm. In The championAdapt used the tracks from the film to record their dialogue in English.
The process required an additional week of studio work. Subsequently, PLATO’s artificial intelligence corresponds to face and mouth movements in another language.
Mike Seymour, special effects supervisor, mentions that it is possible to integrate the dialogues no matter the angle, lighting conditions or if the actor is wearing prosthetic makeup. Seymour says the post-production conversion process is cheap and quick.
This is not a conventional “deepfake”
Although the original cast is not required for additional recordings, their participation is important to respect the original format of the film.
Darryl Marks thinks that not worrying about poor quality subtitles or dubbing would help achieve greater reach in theaters or streaming services. Diffusion. As well would change the perception that actors have of artificial intelligence. Many do not see with good eyes that technology alters their performance.
Adapt’s proposal is very similar to another developed by the Flawless company, founded by filmmaker Scott Mann. The British company captures the voice actors’ facial expressions and merges the lips with the lead actor’s face and head using artificial intelligence.