AI - Horovod

Simplifying and accelerating distributed deep learning with Open-source framework for easy multi-GPU/machine training across TensorFlow, Keras, PyTorch, and Apache MXNet.

Logo of Horovod
Last Audited At

About Horovod

Horovod is a open-source distributed deep learning training framework, developed for TensorFlow, Keras, PyTorch, and Apache MXNet. The mission of Horovod is to simplify and accelerate the process of distributed deep learning. Horovod offers easy-to-use functionality that allows users to run deep learning models across multiple GPUs or machines with minimal configuration.

Horovod provides a DistributedOptimizer for TensorFlow, which enables training on large datasets using multiple GPUs or machines. By leveraging the power of horizontal data parallelism, Horovod can significantly reduce the time required to train deep learning models. The framework also includes utilities for broadcasting model parameters and synchronizing gradients across workers.

Some notable achievements of Horovod include its integration with popular cloud platforms such as Microsoft Azure and its support for a variety of deep learning frameworks including TensorFlow, Keras, PyTorch, and Apache MXNet. The project has a strong community presence with active Slack channels, mailing lists, and public discussion forums.

Horovod is licensed under the Apache 2.0 license and is open source, allowing anyone to contribute to its development and use it for their deep learning projects.

More companies

Synthesia

Leading video technology company, Empowering businesses with AI-driven solutions for easy video creation, personalized content delivery, and seamless integrations.

Read more

Alpaca

Empowering artists to seamlessly integrate generative AI tools into their workflow for imaginative and efficient creative expression with Alpaca.

Read more

Chainalysis

Leading provider of blockchain analysis and compliance solutions for industries, empowering clients to detect, disrupt, and deter crypto crime with trusted data and expertise.

Read more

Tell us about your project

Our Hubs

London, United Kingdom

A global AI hotspot, thrives on innovation, diverse talent, and a dynamic tech ecosystem, offering unparalleled opportunities for AI engineers.

Munich, Germany

A vibrant AI hub, merges cutting-edge technology with rich cultural experiences, creating an inspiring environment for AI engineers.