The new AI suite “Movie Gen” announced by Meta on October 4 can generate photorealistic movies with sound effects and music. It converts your text prompt into a movie. The movie can be up to 16 seconds long.
Even though this is not the first AI to have the ability to create movies, this one uses the latest technology which makes it different. Meta’s blog post reveals that it outperformed its competitors in every test human participants conducted. Movie Gen can create a 16-second movie with 16FPS and even though it does not match Hollywood’s standard of 24FPS, it is not that far below. Professionals consider it acceptable for quality movie imagery. This new model could revolutionize content creation, allowing for the production of entire movies from simple text prompts or editing of existing visuals. It also aids to video editing, for example, replacing or adjusting objects in the background, making certain characters carry something, etc., which makes VFX easier and gives creators unprecedented flexibility and creative control.
The most notable innovation in Movie Gen is its ability to generate up to 45 seconds of synchronized audio with complete sound effects and background music. Meta claims it seamlessly aligns audio with motion-generated videos, offering an immersive experience.
Content creators and filmmakers are eagerly waiting for its launch. Meta stated Movie Gen needs further safety testing before its release to avoid violating Meta’s policies.
To learn about how AI is a double-edged sword click here.