Text-based Editing of Talking-head Video (SIGGRAPH 2019)


Ohad Fried

Published on Jun 4, 2019

Read below for important ethical considerations. Project page: https://www.ohadf.com/projects/text-b… My webpage (with this and other related projects): https://www.ohadf.com/ Abstract: Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis. Ethical Considerations: Our text-based editing approach lays the foundation for better editing tools for movie post production. Filmed dialogue scenes often require re-timing or editing based on small script changes, which currently requires tedious manual work. Our editing technique also enables easy adaptation of audio-visual video content to specific target audiences: e.g., instruction videos can be fine-tuned to audiences of different backgrounds, or a storyteller video can be adapted to children of different age groups purely based on textual script edits. In short, our work was developed for storytelling purposes. However, the availability of such technology — at a quality that some might find indistinguishable from source material — also raises important and valid concerns about the potential for misuse. Although methods for image and video manipulation are as old as the media themselves, the risks of abuse are heightened when applied to a mode of communication that is sometimes considered to be authoritative evidence of thoughts and intents. We acknowledge that bad actors might use such technologies to falsify personal statements and slander prominent individuals. We are concerned about such deception and misuse. Therefore, we believe it is critical that video synthesized using our tool clearly presents itself as synthetic. The fact that the video is synthesized may be obvious by context (e.g. if the audience understands they are watching a fictional movie), directly stated in the video or signaled via watermarking. We also believe that it is essential to obtain permission from the performers for any alteration before sharing a resulting video with a broad audience. Finally, it is important that we as a community continue to develop forensics, fingerprinting and verification techniques (digital and non-digital) to identify manipulated video. Such safeguarding measures would reduce the potential for misuse while allowing creative uses of video editing technologies like ours. We hope that publication of the technical details of such systems can spread awareness and knowledge regarding their inner workings, sparking and enabling associated research into the aforementioned forgery detection, watermarking and verification systems. Finally, we believe that a robust public conversation is necessary to create a set of appropriate regulations and laws that would balance the risks of misuse of these tools against the importance of creative, consensual use cases.

Judge Jeanine: We are at risk of losing our greatness


Fox News

Published on Jun 9, 2019

Jeanine Pirro says we reward illegals whose backgrounds we don’t know. FOX News operates the FOX News Channel (FNC), FOX Business Network (FBN), FOX News Radio, FOX News Headlines 24/7, FOXNews.com and the direct-to-consumer streaming service, FOX Nation. FOX News also produces FOX News Sunday on FOX Broadcasting Company and FOX News Edge. A top five-cable network, FNC has been the most watched news channel in the country for 17 consecutive years. According to a 2018 Research Intelligencer study by Brand Keys, FOX News ranks as the second most trusted television brand in the country. Additionally, a Suffolk University/USA Today survey states Fox News is the most trusted source for television news or commentary in the country, whilea a 2017 Gallup/Knight Foundation survey found that among Americans who could name an objective news source, FOX News is the top-cited outlet. FNC is available in nearly 90 million homes and dominates the cable news landscape while routinely notching the top ten programs in the genre.

Jews Refuse Vaccinations In New York – Jim Stone

Wednesday, June 12, 2019 15:30

New York just shut down the TENTH Jewish Orthodox school over vaccine refusal

Yes, not a rumor. A while ago DeBlasio ordered all New Yorkers, including Jews, to get the MMR shot. But the orthodox community has REFUSED, and has chosen to instead accept getting their schools shut down. This story developed a LOT under the radar. OK THEN:

QUESTION: WHY IS THE ORTHODOX COMMUNITY REFUSING “VACCINES” FOR THEIR KIDS? . . . . . . . ANSWER: Because they know what the shots really are, and what is really in them. How come they get to know, and CNN won’t tell the rest of us?

“Surprise surprise. While you are “vaccinating” your children giving them autism retard shots “they” are not “vaccinating”

John Rubino – $10,000 Gold will be a Bad World

Greg Hunter

Published on Jun 11, 2019

Financial writer and book author John Rubino warns, ““Pretty much the only way out for central banks is they will have to devalue their currency aggressively to keep the debts from blowing up on us and completely destroying the financial system. That is a great environment for gold. It will become more and more apparent to people going forward. . . . As you add to your position (in gold and silver), the big trend will be positive for you. . . . Debt is continuing to soar . . . and that is continuing and accelerating right now. So, if the big bad trend is accelerating, then the big bad result of that trend is getting closer and closer, but timing is impossible to predict. . . . When this thing really begins to spin out of control, it’s too late to protect yourself. . . .You really hope you don’t end up in a world where gold is $10,000 per ounce because that is a bad world in a lot of ways. If that is no longer just a possibility but a probability, you need to protect yourself in some way. That’s what precious metals do.” Join Greg Hunter as he goes One-on-One with John Rubino, founder of DollarCollapse.com.