AI - Google Research Dremix

Advancing text-driven video editing through cutting-edge AI research's diffusion-based method enables high-fidelity motion and appearance editing for videos.

Logo of Google Research Dremix
Last Audited At

About Google Research Dremix

Google Research Dremix is a cutting-edge AI research initiative focused on advancing the field of text-driven video editing. They have developed a diffusion-based method that enables text-based motion and appearance editing for general videos. By combining low-resolution spatio-temporal information from the original video with high-resolution, synthesized data aligned to guiding text prompts, Dremix maintains high fidelity to the source material.

In their research, they have demonstrated remarkable editing capabilities and superior performance compared to baseline methods through numerical experiments. Their approach involves mixed video-image finetuning, where the video diffusion model is not only finetuned on the input video but also on an unordered set of frames using "masked temporal attention." This allows for adding motion to a static video while preventing excessive finetuning of temporal attention and convolution. Dremix's method supports various applications with application-dependent pre-processing, converting input content into a uniform video format.

Through their work on text-based video editing, Google Research Dremix is pushing the boundaries of what AI can achieve in media processing and generation. Their innovations have significant implications for fields like film production, visual effects, and interactive media.

Screenshot of Google Research Dremix Website

More companies

Amazon Polly

Transforming text into lifelike speech's high-quality, multilingual text-to-speech service by Amazon Web Services.

Read more

Meta AI BlenderBot

Empowering AI research and development in conversational settings through Meta AI BlenderBot's open-source platform and community.

Read more

Imagen

Revolutionizing primary care diagnostics with FDA-cleared AI technology, Imagen delivers instant and accurate results, virtual specialist consultations, and permanent infrastructure solutions.

Read more

Tell us about your project

Our Hubs

London, United Kingdom

A global AI hotspot, thrives on innovation, diverse talent, and a dynamic tech ecosystem, offering unparalleled opportunities for AI engineers.

Munich, Germany

A vibrant AI hub, merges cutting-edge technology with rich cultural experiences, creating an inspiring environment for AI engineers.