OpenAI, the company behind ChatGPT, has upped its AI game by introducing ‘Sora,’ a generative AI that can transform a short-word description into a vividly realistic AI video clip.
According to OpenAI, Sora can create 1080p movie-like scenes with several people, various sorts of motion, and background features when given a brief or extensive description or a still image. Sora may also “extend” existing video footage, attempting to fill in any missing details, according to the business.
OpenAI’s Sora follows in the footsteps of heavyweights such as Google and Meta, which have already introduced video-generation tools.
While announcing the launch of the tool via a post on X, OpenAI’s CEO, Sam Altman, requested his followers to put Sora to the test by giving a command.
- “We’d like to show you what Sora can do. Please reply with captions for videos you’d like to see, and we’ll start making some,” he said.
This elicited responses from X users, providing different prompts from which several videos were created.
In a blog post, OpenAI said it is teaching AI to understand and simulate the physical world in motion, with the goal of training models that help people solve problems that require real-world interaction.
- “Sora can generate videos up to a minute long while maintaining visual quality and adherence to the user’s prompt. Sora is able to generate complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background. The model understands not only what the user has asked for in the prompt but also how those things exist in the physical world.
- “The model has a deep understanding of language, enabling it to accurately interpret prompts and generate compelling characters that express vibrant emotions. Sora can also create multiple shots within a single generated video that accurately portrays characters and visual style,” OpenAI said.
Sora’s Cons
OpenAI, however, admitted that Sora’s current model has its weaknesses. According to the company, Sora may struggle with accurately simulating the physics of a complex scene and may not understand specific instances of cause and effect. For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.
- “The model may also confuse spatial details of a prompt, for example, mixing up left and right, and may struggle with precise descriptions of events that take place over time, like following a specific camera trajectory,” it said.
Sora is not currently available generally. OpenAI said it is currently granting access to a number of visual artists, designers, and filmmakers to gain feedback on how to advance the model to be most helpful for creative professionals.
