Adobe has released an updated public beta version of its Firefly application for generating images, which now is now available for producing videos with the Firefly Video Model.

Video Model is the industry’s first commercially safe AI video generation model. Users will be able to generate video clips from a text prompt or image, use camera angles to control shots, create professional-quality images from 3D sketches, craft atmospheric elements and develop custom motion design elements. Further refinements can be made with Photoshop on the web, Premiere Pro and Adobe Express, while they can also leverage Firefly-powered features such as Generative Fill in Photoshop and Generative Remove in Lightroom should additional editing be needed. Two new offerings, Firefly Standard and Firefly Pro, give customers access to premium Firefly video and audio features. All Firefly plans include unlimited access to Firefly imaging and vector features and tiered capacity for premium video and audio features so customers can choose the right capacity for their generative AI needs.

New tools available globally in the Firefly app today include:

  • Generate Video (beta) for industry-leading controls that enable creative professionals to generate videos, b-roll, animations and more, all powered by the Firefly Video Model. With Text to Video and Image to Video features, creative professionals can produce stunning high-quality 1080p video from simple text prompts, generate b-roll to fill gaps in timelines, add atmospheric elements to a shot and develop custom motion design elements. Intuitive controls provide new levels of precision to fine-tune any video with detailed camera settings, like sweeping aerial views, frame subjects exactly as envisioned, from dramatic close-ups to expansive long shots, and dynamic movement by selecting from multiple motion paths. Creative professionals can also lock in the first and last frames of a shot to preserve visual continuity, keep colours and character details consistent and more.
  • Multi-modal workflows that enable creators to seamlessly ideate and create, all within the Firefly application. Bringing together video, image and vector generation in a single app empowers creative professionals to generate an image and turn it into stunning video, quickly translate audio into several new languages and write a text prompt to create a video clip with exactly the desired style and camera angle all within Firefly. To take their ideas and creations further, Firefly integrates with Adobe Creative Cloud applications including Photoshop, Premiere Pro and Adobe Express.
  • Scene to Image (beta) for creating professional quality images from 3D sketches and reference shapes. Using a lightweight 3D sketching tool, creative professionals can transform artwork into beautiful high-resolution images, build structure references directly within Text to Image and create precise visual guides using intuitive 3D tools. Creative professionals can change 3D image angles and perspectives to get the perfect output. With Scene to Image, creators can seamlessly render production-ready assets from 3D shapes, all with the flexibility and precision required in professional graphic design workflows.
  • Translate Audio and Translate Video for the translation of spoken dialog into multiple languages while maintaining an authentic voice. Creators can quickly and easily translate videos and audio files to reach a large, global audience with personalised, natural-looking content. With voice, tone, cadence and acoustic match when translating video content into different languages, creators can also spend less time on dubbing performance and audio mixing, saving time and budget on translation and dubbing services. Translate Audio and Video supports translations in over 20 languages.

Available today with early access pricing the two new Adobe Firefly plan offerings are as follow: Firefly Standard plans enable access to 2,000 video/audio credits per month, up to 20 five-second 1080p video generations, starting at AU$16.49 (or /$19.32 NZD). Firefly Pro plans enable access to 7,000 video/audio credits per month, up to 70 five-second 1080p video generations, with prices starting at AU$49.49 (or $58.08 NZD). Click here for more information.