September 11th, 2024

Adobe Firefly Video Model

Adobe will release the Firefly Video Model for Premiere Pro, enhancing video editing with AI tools for tasks like generating B-roll and smoothing transitions, entering beta later this year.

Read original articleLink Icon
Adobe Firefly Video Model

Adobe has announced the upcoming release of the Firefly Video Model, which will enhance video editing capabilities within its Premiere Pro software. This new generative AI model, set to enter beta later this year, aims to streamline workflows for editors by allowing them to ideate, fill gaps in timelines, and add new elements to existing footage. The Firefly Video Model is built with the feedback of the video editing community and is designed to be commercially safe, trained only on content that Adobe has permission to use. The model will assist in common editorial tasks such as removing unwanted objects, smoothing transitions, and generating B-roll footage based on text prompts and reference images. Additionally, it will support the creation of atmospheric elements and animations, facilitating better collaboration among creative teams. Adobe emphasizes that the integration of AI tools will enable editors to focus more on creative exploration while reducing the tedium of post-production tasks. The Firefly Video Model is part of Adobe's broader strategy to leverage AI in its Creative Cloud suite, which has already seen significant adoption with over 12 billion images and vectors generated by users since the launch of Firefly in March 2023.

- Adobe Firefly Video Model to enhance video editing in Premiere Pro.

- Set to enter beta later this year, focusing on streamlining workflows.

- Designed to be commercially safe, using only licensed content.

- Aims to assist in common tasks like filling gaps and generating B-roll.

- Part of Adobe's broader strategy to integrate AI into Creative Cloud tools.

Link Icon 2 comments
By @talldayo - 4 months
Will temporal stability ever be a solved problem? A lot of these shots are still pretty "goopy" and present more action than really exists or just shuffles around constantly. The dandelion and reindeer examples are jarringly inorganic and would probably get identified as AI by most people who see it, I'd imagine.
By @nom - 4 months
> our community has generated over 12B images

They say it came out March 2023, so 1M images per hour.

Very active, this community.