Bagua API Documentation
latest

API Documents

  • bagua
    • bagua.torch_api
      • bagua.torch_api.algorithms
      • bagua.torch_api.checkpoint
      • bagua.torch_api.contrib
      • bagua.torch_api.data_parallel
      • bagua.torch_api.model_parallel
        • bagua.torch_api.model_parallel.moe
      • bagua.torch_api.bucket
      • bagua.torch_api.communication
      • bagua.torch_api.distributed
      • bagua.torch_api.env
      • bagua.torch_api.tensor
Bagua API Documentation
  • Bagua API Documentation »
  • bagua »
  • bagua.torch_api »
  • bagua.torch_api.model_parallel
  • Edit on GitHub

bagua.torch_api.model_parallel¶

Subpackages¶

  • bagua.torch_api.model_parallel.moe
    • bagua.torch_api.model_parallel.moe.experts
    • bagua.torch_api.model_parallel.moe.layer
    • bagua.torch_api.model_parallel.moe.sharded_moe
    • bagua.torch_api.model_parallel.moe.utils
Next Previous

© Copyright 2021, Kuaishou AI Platform and DS3 Lab Revision 09d44eb0.

Read the Docs v: latest
Versions
latest
stable
v0.9.0
v0.8.2
v0.8.1.post1
v0.8.1
v0.8.0
v0.7.0
v0.6.3
v0.6.2
v0.6.1
v0.6.0
0.5.0
0.4.0
Downloads
html
On Read the Docs
Project Home
Builds
Free document hosting provided by Read the Docs.