bagua

Bagua is a communication library developed by Kuaishou Technology and DS3 Lab for deep learning.

See tutorials for Bagua’s rationale and benchmark.

Subpackages

• bagua.torch_api
  • bagua.torch_api.algorithms
    • bagua.torch_api.algorithms.base
    • bagua.torch_api.algorithms.bytegrad
    • bagua.torch_api.algorithms.decentralized
    • bagua.torch_api.algorithms.gradient_allreduce
    • bagua.torch_api.algorithms.q_adam
  • bagua.torch_api.contrib
    • bagua.torch_api.contrib.fused_optimizer
    • bagua.torch_api.contrib.load_balancing_data_loader
  • bagua.torch_api.bucket
  • bagua.torch_api.communication
  • bagua.torch_api.distributed
  • bagua.torch_api.env
  • bagua.torch_api.tensor