AI - Google Research Dremix

Advancing text-driven video editing through cutting-edge AI research's diffusion-based method enables high-fidelity motion and appearance editing for videos.

Logo of Google Research Dremix
Last Audited At

About Google Research Dremix

Google Research Dremix is a cutting-edge AI research initiative focused on advancing the field of text-driven video editing. They have developed a diffusion-based method that enables text-based motion and appearance editing for general videos. By combining low-resolution spatio-temporal information from the original video with high-resolution, synthesized data aligned to guiding text prompts, Dremix maintains high fidelity to the source material.

In their research, they have demonstrated remarkable editing capabilities and superior performance compared to baseline methods through numerical experiments. Their approach involves mixed video-image finetuning, where the video diffusion model is not only finetuned on the input video but also on an unordered set of frames using "masked temporal attention." This allows for adding motion to a static video while preventing excessive finetuning of temporal attention and convolution. Dremix's method supports various applications with application-dependent pre-processing, converting input content into a uniform video format.

Through their work on text-based video editing, Google Research Dremix is pushing the boundaries of what AI can achieve in media processing and generation. Their innovations have significant implications for fields like film production, visual effects, and interactive media.

Screenshot of Google Research Dremix Website

Was this page helpful?

More companies

Clarity AI

Empowering organizations with data-driven sustainability insights and regulatory compliance solutions through Clarity AI's advanced artificial intelligence platform.

Read more

Wellsaid

Empowering brands and enterprises with ethical, high-quality AI voices for engaging digital experiences through collaboration, innovation, and scalable solutions.

Read more

PathAI

Revolutionizing pathology and diagnostics through AI-powered solutions and human expertise, trusted by 90% of top BioPharma companies.

Read more

Tell us about your project

Our Hubs

London, United Kingdom

A global AI hotspot, thrives on innovation, diverse talent, and a dynamic tech ecosystem, offering unparalleled opportunities for AI engineers.

Munich, Germany

A vibrant AI hub, merges cutting-edge technology with rich cultural experiences, creating an inspiring environment for AI engineers.