Bagua API Documentation
stable

API Documents

  • bagua
    • bagua.torch_api
      • bagua.torch_api.algorithms
      • bagua.torch_api.checkpoint
      • bagua.torch_api.contrib
      • bagua.torch_api.data_parallel
      • bagua.torch_api.model_parallel
        • bagua.torch_api.model_parallel.moe
      • bagua.torch_api.bucket
      • bagua.torch_api.communication
      • bagua.torch_api.distributed
      • bagua.torch_api.env
      • bagua.torch_api.tensor
Bagua API Documentation
  • Bagua API Documentation »
  • bagua »
  • bagua.torch_api »
  • bagua.torch_api.model_parallel
  • Edit on GitHub

bagua.torch_api.model_parallel¶

Subpackages¶

  • bagua.torch_api.model_parallel.moe
    • bagua.torch_api.model_parallel.moe.experts
    • bagua.torch_api.model_parallel.moe.layer
    • bagua.torch_api.model_parallel.moe.sharded_moe
    • bagua.torch_api.model_parallel.moe.utils
Next Previous

© Copyright 2021, Kuaishou AI Platform and DS3 Lab Revision 6d79588b.