AI - Google Research Dremix

Advancing text-driven video editing through cutting-edge AI research's diffusion-based method enables high-fidelity motion and appearance editing for videos.

Logo of Google Research Dremix
Last Audited At

About Google Research Dremix

Google Research Dremix is a cutting-edge AI research initiative focused on advancing the field of text-driven video editing. They have developed a diffusion-based method that enables text-based motion and appearance editing for general videos. By combining low-resolution spatio-temporal information from the original video with high-resolution, synthesized data aligned to guiding text prompts, Dremix maintains high fidelity to the source material.

In their research, they have demonstrated remarkable editing capabilities and superior performance compared to baseline methods through numerical experiments. Their approach involves mixed video-image finetuning, where the video diffusion model is not only finetuned on the input video but also on an unordered set of frames using "masked temporal attention." This allows for adding motion to a static video while preventing excessive finetuning of temporal attention and convolution. Dremix's method supports various applications with application-dependent pre-processing, converting input content into a uniform video format.

Through their work on text-based video editing, Google Research Dremix is pushing the boundaries of what AI can achieve in media processing and generation. Their innovations have significant implications for fields like film production, visual effects, and interactive media.

Screenshot of Google Research Dremix Website

Was this page helpful?

More companies

Vertica, An OpenText Company

Vertica by OpenText: Rapid data warehouse w/ advanced analytics & AI tech for real-time business insights. FAST. FREEDOM.

Read more

Kili

Empowering businesses and researchers with accurate and high-quality labeled data for machine learning model development through Kili Technology's AI-driven data annotation and labeling solutions.

Read more

DataBento

Simplifying web experiences by enabling JavaScript functionality across browsers for seamless application usage.

Read more

Tell us about your project

Our Hubs

London, United Kingdom

A global AI hotspot, thrives on innovation, diverse talent, and a dynamic tech ecosystem, offering unparalleled opportunities for AI engineers.

Munich, Germany

A vibrant AI hub, merges cutting-edge technology with rich cultural experiences, creating an inspiring environment for AI engineers.