AI - Google Research Dremix

Advancing text-driven video editing through cutting-edge AI research's diffusion-based method enables high-fidelity motion and appearance editing for videos.

Logo of Google Research Dremix
Last Audited At

About Google Research Dremix

Google Research Dremix is a cutting-edge AI research initiative focused on advancing the field of text-driven video editing. They have developed a diffusion-based method that enables text-based motion and appearance editing for general videos. By combining low-resolution spatio-temporal information from the original video with high-resolution, synthesized data aligned to guiding text prompts, Dremix maintains high fidelity to the source material.

In their research, they have demonstrated remarkable editing capabilities and superior performance compared to baseline methods through numerical experiments. Their approach involves mixed video-image finetuning, where the video diffusion model is not only finetuned on the input video but also on an unordered set of frames using "masked temporal attention." This allows for adding motion to a static video while preventing excessive finetuning of temporal attention and convolution. Dremix's method supports various applications with application-dependent pre-processing, converting input content into a uniform video format.

Through their work on text-based video editing, Google Research Dremix is pushing the boundaries of what AI can achieve in media processing and generation. Their innovations have significant implications for fields like film production, visual effects, and interactive media.

Screenshot of Google Research Dremix Website

Was this page helpful?

More companies

Exscientia

Exscientia uses AI tech to revolutionize drug discovery, setting new industry standards with patient-focused systems for optimal target ID, design, exp., & medicine creation.

Read more

Motional

Leading autonomous mobility company, Motional, transforms global transportation with safe, reliable, and accessible driverless solutions via advanced engineering, robotics, ML, and AI.

Read more

Couchbase

Provides flexible, high-performance NoSQL databases for handling large data loads & seamless digital transformation with advanced AI integration.

Read more

Tell us about your project

Our Hubs

London, United Kingdom

A global AI hotspot, thrives on innovation, diverse talent, and a dynamic tech ecosystem, offering unparalleled opportunities for AI engineers.

Munich, Germany

A vibrant AI hub, merges cutting-edge technology with rich cultural experiences, creating an inspiring environment for AI engineers.