Bagua

This website contains Bagua API documentation. See tutorials if you need step by step instructions on how to use Bagua.

API Documents

• bagua
  • bagua.torch_api
    • bagua.torch_api.algorithms
      • bagua.torch_api.algorithms.async_model_average
      • bagua.torch_api.algorithms.base
      • bagua.torch_api.algorithms.bytegrad
      • bagua.torch_api.algorithms.decentralized
      • bagua.torch_api.algorithms.gradient_allreduce
      • bagua.torch_api.algorithms.q_adam
    • bagua.torch_api.checkpoint
      • bagua.torch_api.checkpoint.checkpointing
    • bagua.torch_api.contrib
      • bagua.torch_api.contrib.fuse
        • bagua.torch_api.contrib.fuse.optimizer
      • bagua.torch_api.contrib.utils
        • bagua.torch_api.contrib.utils.redis_store
        • bagua.torch_api.contrib.utils.store
      • bagua.torch_api.contrib.cache_loader
      • bagua.torch_api.contrib.cached_dataset
      • bagua.torch_api.contrib.load_balancing_data_loader
      • bagua.torch_api.contrib.sync_batchnorm
    • bagua.torch_api.data_parallel
      • bagua.torch_api.data_parallel.bagua_distributed
      • bagua.torch_api.data_parallel.distributed
      • bagua.torch_api.data_parallel.functional
    • bagua.torch_api.model_parallel
      • bagua.torch_api.model_parallel.moe
        • bagua.torch_api.model_parallel.moe.experts
        • bagua.torch_api.model_parallel.moe.layer
        • bagua.torch_api.model_parallel.moe.sharded_moe
        • bagua.torch_api.model_parallel.moe.utils
    • bagua.torch_api.bucket
    • bagua.torch_api.communication
    • bagua.torch_api.distributed
    • bagua.torch_api.env
    • bagua.torch_api.tensor