TikTok maker Bytedance unveils OmniHuman-1, a new AI tool that can make videos from a photo

2 hours ago 2

A inactive from a video of Albert Einstein talking generated by ByteDance's OmniHuman-1. (Image Source: ByteDance)

TikTok’s genitor institution – ByteDance precocious unveiled a caller AI instrumentality that tin make lifelike videos of radical talking, playing instruments and much utilizing a azygous photo. Dubbed OmniHuman-1, ByteDance says the caller instrumentality “significantly outperforms existing methods, generating highly realistic quality videos based connected anemic awesome inputs, particularly audio.”

In a probe insubstantial published connected arXiv, the institution claimed that the caller instrumentality tin enactment with images with immoderate facet ratio, irrespective of whether they are portraits, half-body oregon full-body images and present “lifelike and high-quality results crossed assorted scenarios.”

This is simply a measurement up compared to different AI models, galore of which tin lone alteration facial expressions oregon marque humans speak. On the OmniHuman-1 leafage hosted connected Beehiiv, researchers shared respective illustration videos showing however the instrumentality performs with examples showing manus and assemblage movements from aggregate angles, and animals successful motion.

In a achromatic and achromatic video, OmniHuman-1 shows the known idiosyncratic Albert Einstein talking successful beforehand of a blackboard performing manus gestures and showing facial expressions. ByteDance says it trained the caller instrumentality connected much than 18,700 hours of quality videos, combining it with assorted types of inputs similar text, audio and carnal poses.

The researchers besides suggest that OmniHuman-1 presently outperforms akin systems crossed aggregate benchmarks. OmniHuman-1 isn’t the archetypal image-to-video generator, but ByteDance’s caller instrumentality whitethorn person immoderate vantage implicit its rival since it is apt trained connected videos from TikTok.

*** Disclaimer: This Article is auto-aggregated by a Rss Api Program and has not been created or edited by Nandigram Times

(Note: This is an unedited and auto-generated story from Syndicated News Rss Api. News.nandigramtimes.com Staff may not have modified or edited the content body.

Please visit the Source Website that deserves the credit and responsibility for creating this content.)

Watch Live | Source Article